May 20 21:45:48.657796 ip-10-0-129-137 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 20 21:45:48.657807 ip-10-0-129-137 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 20 21:45:48.657814 ip-10-0-129-137 systemd[1]: kubelet.service: Failed with result 'resources'. May 20 21:45:48.658052 ip-10-0-129-137 systemd[1]: Failed to start Kubernetes Kubelet. May 20 21:45:58.874812 ip-10-0-129-137 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 20 21:45:58.874835 ip-10-0-129-137 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 700c0b746c144288921730a42d7e0311 -- May 20 21:48:17.010507 ip-10-0-129-137 systemd[1]: Starting Kubernetes Kubelet... May 20 21:48:17.474206 ip-10-0-129-137 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 20 21:48:17.474206 ip-10-0-129-137 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 20 21:48:17.474206 ip-10-0-129-137 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 20 21:48:17.474206 ip-10-0-129-137 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 20 21:48:17.474206 ip-10-0-129-137 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 20 21:48:17.476118 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.476014 2581 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 20 21:48:17.482142 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482124 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 20 21:48:17.482142 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482142 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 20 21:48:17.482253 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482145 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 20 21:48:17.482253 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482149 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 20 21:48:17.482253 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482151 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 20 21:48:17.482253 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482154 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability May 20 21:48:17.482253 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482157 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 20 21:48:17.482253 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482159 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 20 21:48:17.482253 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482163 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 20 21:48:17.482253 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482166 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 20 21:48:17.482253 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482169 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 20 21:48:17.482253 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482173 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 20 21:48:17.482253 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482184 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 20 21:48:17.482253 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482188 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 20 21:48:17.482253 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482190 2581 feature_gate.go:328] unrecognized feature gate: Example May 20 21:48:17.482253 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482193 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 20 21:48:17.482253 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482196 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 20 21:48:17.482253 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482198 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 20 21:48:17.482253 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482201 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 20 21:48:17.482253 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482204 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 20 21:48:17.482253 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482206 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 20 21:48:17.482253 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482209 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 20 21:48:17.482736 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482212 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 20 21:48:17.482736 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482214 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores May 20 21:48:17.482736 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482217 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 20 21:48:17.482736 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482220 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 20 21:48:17.482736 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482222 2581 feature_gate.go:328] unrecognized feature gate: NewOLM May 20 21:48:17.482736 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482225 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 20 21:48:17.482736 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482227 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 20 21:48:17.482736 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482229 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 20 21:48:17.482736 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482232 2581 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 20 21:48:17.482736 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482234 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 20 21:48:17.482736 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482237 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 20 21:48:17.482736 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482240 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 20 21:48:17.482736 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482243 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 20 21:48:17.482736 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482246 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 20 21:48:17.482736 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482249 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 20 21:48:17.482736 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482252 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 20 21:48:17.482736 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482255 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 20 21:48:17.482736 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482257 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 20 21:48:17.482736 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482260 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 20 21:48:17.482736 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482262 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 20 21:48:17.483258 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482265 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 20 21:48:17.483258 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482268 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 20 21:48:17.483258 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482271 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 20 21:48:17.483258 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482273 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 20 21:48:17.483258 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482275 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 20 21:48:17.483258 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482278 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 20 21:48:17.483258 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482280 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 20 21:48:17.483258 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482283 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 20 21:48:17.483258 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482285 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 20 21:48:17.483258 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482288 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 20 21:48:17.483258 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482290 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 20 21:48:17.483258 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482293 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 20 21:48:17.483258 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482295 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 20 21:48:17.483258 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482298 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 20 21:48:17.483258 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482303 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 20 21:48:17.483258 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482307 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 20 21:48:17.483258 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482310 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 20 21:48:17.483258 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482313 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages May 20 21:48:17.483258 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482315 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 20 21:48:17.483258 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482318 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 20 21:48:17.483741 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482321 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 20 21:48:17.483741 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482323 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 20 21:48:17.483741 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482326 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 20 21:48:17.483741 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482330 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 20 21:48:17.483741 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482334 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 20 21:48:17.483741 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482337 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 20 21:48:17.483741 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482339 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 20 21:48:17.483741 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482343 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 20 21:48:17.483741 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482345 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 20 21:48:17.483741 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482348 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 20 21:48:17.483741 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482350 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 20 21:48:17.483741 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482353 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 20 21:48:17.483741 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482356 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 20 21:48:17.483741 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482358 2581 feature_gate.go:328] unrecognized feature gate: Example2 May 20 21:48:17.483741 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482361 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 20 21:48:17.483741 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482365 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 20 21:48:17.483741 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482369 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 20 21:48:17.483741 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482372 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 20 21:48:17.483741 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482374 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 20 21:48:17.484217 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482377 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 20 21:48:17.484217 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482380 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 20 21:48:17.484217 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482383 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 20 21:48:17.484217 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482386 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 20 21:48:17.484217 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482389 2581 feature_gate.go:328] unrecognized feature gate: DualReplica May 20 21:48:17.484217 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482782 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 20 21:48:17.484217 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482787 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 20 21:48:17.484217 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482790 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 20 21:48:17.484217 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482792 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 20 21:48:17.484217 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482795 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 20 21:48:17.484217 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482797 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 20 21:48:17.484217 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482800 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 20 21:48:17.484217 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482802 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 20 21:48:17.484217 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482805 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 20 21:48:17.484217 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482808 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 20 21:48:17.484217 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482810 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 20 21:48:17.484217 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482813 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 20 21:48:17.484217 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482816 2581 feature_gate.go:328] unrecognized feature gate: Example May 20 21:48:17.484217 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482820 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 20 21:48:17.484217 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482824 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 20 21:48:17.484698 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482827 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 20 21:48:17.484698 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482830 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 20 21:48:17.484698 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482832 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 20 21:48:17.484698 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482835 2581 feature_gate.go:328] unrecognized feature gate: Example2 May 20 21:48:17.484698 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482838 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 20 21:48:17.484698 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482840 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 20 21:48:17.484698 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482843 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 20 21:48:17.484698 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482846 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 20 21:48:17.484698 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482848 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 20 21:48:17.484698 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482851 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 20 21:48:17.484698 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482853 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 20 21:48:17.484698 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482856 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 20 21:48:17.484698 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482859 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 20 21:48:17.484698 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482861 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 20 21:48:17.484698 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482864 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 20 21:48:17.484698 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482867 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 20 21:48:17.484698 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482869 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 20 21:48:17.484698 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482872 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 20 21:48:17.484698 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482874 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 20 21:48:17.484698 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482877 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 20 21:48:17.485210 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482880 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 20 21:48:17.485210 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482882 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 20 21:48:17.485210 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482885 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 20 21:48:17.485210 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482888 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 20 21:48:17.485210 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482890 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 20 21:48:17.485210 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482893 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 20 21:48:17.485210 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482895 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 20 21:48:17.485210 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482898 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 20 21:48:17.485210 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482900 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 20 21:48:17.485210 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482903 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 20 21:48:17.485210 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482907 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores May 20 21:48:17.485210 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482909 2581 feature_gate.go:328] unrecognized feature gate: DualReplica May 20 21:48:17.485210 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482912 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 20 21:48:17.485210 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482915 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 20 21:48:17.485210 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482919 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 20 21:48:17.485210 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482923 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 20 21:48:17.485210 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482926 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 20 21:48:17.485210 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482929 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 20 21:48:17.485210 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482931 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 20 21:48:17.485683 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482934 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 20 21:48:17.485683 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482937 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 20 21:48:17.485683 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482939 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 20 21:48:17.485683 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482941 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 20 21:48:17.485683 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482944 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 20 21:48:17.485683 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482946 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 20 21:48:17.485683 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482949 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages May 20 21:48:17.485683 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482952 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 20 21:48:17.485683 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482954 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 20 21:48:17.485683 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482957 2581 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 20 21:48:17.485683 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482959 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 20 21:48:17.485683 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482962 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 20 21:48:17.485683 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482964 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 20 21:48:17.485683 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482967 2581 feature_gate.go:328] unrecognized feature gate: NewOLM May 20 21:48:17.485683 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482969 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 20 21:48:17.485683 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482972 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 20 21:48:17.485683 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482974 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 20 21:48:17.485683 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482977 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 20 21:48:17.485683 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482979 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 20 21:48:17.485683 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482982 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 20 21:48:17.486267 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482985 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 20 21:48:17.486267 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482987 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 20 21:48:17.486267 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482990 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 20 21:48:17.486267 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482993 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 20 21:48:17.486267 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482996 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 20 21:48:17.486267 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.482999 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 20 21:48:17.486267 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.483001 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability May 20 21:48:17.486267 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.483005 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 20 21:48:17.486267 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.483008 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 20 21:48:17.486267 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.483010 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 20 21:48:17.486267 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.483012 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 20 21:48:17.486267 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.483016 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 20 21:48:17.486267 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484342 2581 flags.go:64] FLAG: --address="0.0.0.0" May 20 21:48:17.486267 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484352 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 20 21:48:17.486267 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484360 2581 flags.go:64] FLAG: --anonymous-auth="true" May 20 21:48:17.486267 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484365 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" May 20 21:48:17.486267 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484369 2581 flags.go:64] FLAG: --authentication-token-webhook="false" May 20 21:48:17.486267 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484373 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 20 21:48:17.486267 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484377 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 20 21:48:17.486267 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484381 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 20 21:48:17.486267 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484384 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 20 21:48:17.486790 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484388 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 20 21:48:17.486790 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484391 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 20 21:48:17.486790 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484394 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 20 21:48:17.486790 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484397 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 20 21:48:17.486790 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484400 2581 flags.go:64] FLAG: --cgroup-root="" May 20 21:48:17.486790 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484404 2581 flags.go:64] FLAG: --cgroups-per-qos="true" May 20 21:48:17.486790 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484407 2581 flags.go:64] FLAG: --client-ca-file="" May 20 21:48:17.486790 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484411 2581 flags.go:64] FLAG: --cloud-config="" May 20 21:48:17.486790 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484414 2581 flags.go:64] FLAG: --cloud-provider="external" May 20 21:48:17.486790 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484417 2581 flags.go:64] FLAG: --cluster-dns="[]" May 20 21:48:17.486790 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484421 2581 flags.go:64] FLAG: --cluster-domain="" May 20 21:48:17.486790 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484424 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 20 21:48:17.486790 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484427 2581 flags.go:64] FLAG: --config-dir="" May 20 21:48:17.486790 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484430 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 20 21:48:17.486790 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484433 2581 flags.go:64] FLAG: --container-log-max-files="5" May 20 21:48:17.486790 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484437 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" May 20 21:48:17.486790 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484440 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 20 21:48:17.486790 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484443 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 20 21:48:17.486790 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484446 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 20 21:48:17.486790 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484450 2581 flags.go:64] FLAG: --contention-profiling="false" May 20 21:48:17.486790 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484453 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" May 20 21:48:17.486790 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484456 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 20 21:48:17.486790 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484459 2581 flags.go:64] FLAG: --cpu-manager-policy="none" May 20 21:48:17.486790 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484461 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" May 20 21:48:17.486790 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484466 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 20 21:48:17.487424 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484468 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 20 21:48:17.487424 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484472 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" May 20 21:48:17.487424 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484475 2581 flags.go:64] FLAG: --enable-load-reader="false" May 20 21:48:17.487424 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484478 2581 flags.go:64] FLAG: --enable-server="true" May 20 21:48:17.487424 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484481 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 20 21:48:17.487424 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484485 2581 flags.go:64] FLAG: --event-burst="100" May 20 21:48:17.487424 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484488 2581 flags.go:64] FLAG: --event-qps="50" May 20 21:48:17.487424 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484491 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 20 21:48:17.487424 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484495 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 20 21:48:17.487424 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484498 2581 flags.go:64] FLAG: --eviction-hard="" May 20 21:48:17.487424 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484502 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 20 21:48:17.487424 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484504 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 20 21:48:17.487424 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484507 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 20 21:48:17.487424 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484510 2581 flags.go:64] FLAG: --eviction-soft="" May 20 21:48:17.487424 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484514 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" May 20 21:48:17.487424 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484517 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" May 20 21:48:17.487424 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484520 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 20 21:48:17.487424 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484523 2581 flags.go:64] FLAG: --experimental-mounter-path="" May 20 21:48:17.487424 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484526 2581 flags.go:64] FLAG: --fail-cgroupv1="false" May 20 21:48:17.487424 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484529 2581 flags.go:64] FLAG: --fail-swap-on="true" May 20 21:48:17.487424 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484532 2581 flags.go:64] FLAG: --feature-gates="" May 20 21:48:17.487424 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484536 2581 flags.go:64] FLAG: --file-check-frequency="20s" May 20 21:48:17.487424 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484539 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 20 21:48:17.487424 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484542 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 20 21:48:17.487424 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484545 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 20 21:48:17.488023 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484549 2581 flags.go:64] FLAG: --healthz-port="10248" May 20 21:48:17.488023 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484551 2581 flags.go:64] FLAG: --help="false" May 20 21:48:17.488023 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484555 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-129-137.ec2.internal" May 20 21:48:17.488023 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484558 2581 flags.go:64] FLAG: --housekeeping-interval="10s" May 20 21:48:17.488023 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484561 2581 flags.go:64] FLAG: --http-check-frequency="20s" May 20 21:48:17.488023 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484564 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 20 21:48:17.488023 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484567 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 20 21:48:17.488023 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484570 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" May 20 21:48:17.488023 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484574 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" May 20 21:48:17.488023 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484577 2581 flags.go:64] FLAG: --image-service-endpoint="" May 20 21:48:17.488023 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484580 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" May 20 21:48:17.488023 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484583 2581 flags.go:64] FLAG: --kube-api-burst="100" May 20 21:48:17.488023 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484586 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 20 21:48:17.488023 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484589 2581 flags.go:64] FLAG: --kube-api-qps="50" May 20 21:48:17.488023 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484592 2581 flags.go:64] FLAG: --kube-reserved="" May 20 21:48:17.488023 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484595 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" May 20 21:48:17.488023 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484598 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 20 21:48:17.488023 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484601 2581 flags.go:64] FLAG: --kubelet-cgroups="" May 20 21:48:17.488023 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484604 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 20 21:48:17.488023 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484607 2581 flags.go:64] FLAG: --lock-file="" May 20 21:48:17.488023 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484610 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" May 20 21:48:17.488023 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484613 2581 flags.go:64] FLAG: --log-flush-frequency="5s" May 20 21:48:17.488023 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484617 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 20 21:48:17.488023 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484622 2581 flags.go:64] FLAG: --log-json-split-stream="false" May 20 21:48:17.488631 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484625 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 20 21:48:17.488631 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484628 2581 flags.go:64] FLAG: --log-text-split-stream="false" May 20 21:48:17.488631 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484631 2581 flags.go:64] FLAG: --logging-format="text" May 20 21:48:17.488631 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484634 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 20 21:48:17.488631 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484637 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" May 20 21:48:17.488631 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484640 2581 flags.go:64] FLAG: --manifest-url="" May 20 21:48:17.488631 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484643 2581 flags.go:64] FLAG: --manifest-url-header="" May 20 21:48:17.488631 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484647 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 20 21:48:17.488631 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484650 2581 flags.go:64] FLAG: --max-open-files="1000000" May 20 21:48:17.488631 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484655 2581 flags.go:64] FLAG: --max-pods="110" May 20 21:48:17.488631 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484658 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" May 20 21:48:17.488631 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484661 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 20 21:48:17.488631 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484664 2581 flags.go:64] FLAG: --memory-manager-policy="None" May 20 21:48:17.488631 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484667 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 20 21:48:17.488631 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484670 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 20 21:48:17.488631 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484673 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" May 20 21:48:17.488631 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484676 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 20 21:48:17.488631 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484684 2581 flags.go:64] FLAG: --node-status-max-images="50" May 20 21:48:17.488631 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484687 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" May 20 21:48:17.488631 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484690 2581 flags.go:64] FLAG: --oom-score-adj="-999" May 20 21:48:17.488631 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484693 2581 flags.go:64] FLAG: --pod-cidr="" May 20 21:48:17.488631 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484696 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 20 21:48:17.488631 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484702 2581 flags.go:64] FLAG: --pod-manifest-path="" May 20 21:48:17.489200 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484705 2581 flags.go:64] FLAG: --pod-max-pids="-1" May 20 21:48:17.489200 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484709 2581 flags.go:64] FLAG: --pods-per-core="0" May 20 21:48:17.489200 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484712 2581 flags.go:64] FLAG: --port="10250" May 20 21:48:17.489200 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484715 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" May 20 21:48:17.489200 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484718 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07f7928d2d05c56ba" May 20 21:48:17.489200 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484721 2581 flags.go:64] FLAG: --qos-reserved="" May 20 21:48:17.489200 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484724 2581 flags.go:64] FLAG: --read-only-port="10255" May 20 21:48:17.489200 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484727 2581 flags.go:64] FLAG: --register-node="true" May 20 21:48:17.489200 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484730 2581 flags.go:64] FLAG: --register-schedulable="true" May 20 21:48:17.489200 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484733 2581 flags.go:64] FLAG: --register-with-taints="" May 20 21:48:17.489200 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484736 2581 flags.go:64] FLAG: --registry-burst="10" May 20 21:48:17.489200 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484739 2581 flags.go:64] FLAG: --registry-qps="5" May 20 21:48:17.489200 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484742 2581 flags.go:64] FLAG: --reserved-cpus="" May 20 21:48:17.489200 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484745 2581 flags.go:64] FLAG: --reserved-memory="" May 20 21:48:17.489200 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484749 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 20 21:48:17.489200 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484752 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 20 21:48:17.489200 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484754 2581 flags.go:64] FLAG: --rotate-certificates="false" May 20 21:48:17.489200 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484757 2581 flags.go:64] FLAG: --rotate-server-certificates="false" May 20 21:48:17.489200 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484761 2581 flags.go:64] FLAG: --runonce="false" May 20 21:48:17.489200 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484763 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 20 21:48:17.489200 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484766 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 20 21:48:17.489200 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484770 2581 flags.go:64] FLAG: --seccomp-default="false" May 20 21:48:17.489200 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484773 2581 flags.go:64] FLAG: --serialize-image-pulls="true" May 20 21:48:17.489200 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484776 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 20 21:48:17.489200 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484779 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 20 21:48:17.489200 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484783 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 20 21:48:17.489857 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484786 2581 flags.go:64] FLAG: --storage-driver-password="root" May 20 21:48:17.489857 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484789 2581 flags.go:64] FLAG: --storage-driver-secure="false" May 20 21:48:17.489857 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484791 2581 flags.go:64] FLAG: --storage-driver-table="stats" May 20 21:48:17.489857 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484794 2581 flags.go:64] FLAG: --storage-driver-user="root" May 20 21:48:17.489857 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484797 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 20 21:48:17.489857 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484800 2581 flags.go:64] FLAG: --sync-frequency="1m0s" May 20 21:48:17.489857 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484803 2581 flags.go:64] FLAG: --system-cgroups="" May 20 21:48:17.489857 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484806 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 20 21:48:17.489857 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484811 2581 flags.go:64] FLAG: --system-reserved-cgroup="" May 20 21:48:17.489857 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484813 2581 flags.go:64] FLAG: --tls-cert-file="" May 20 21:48:17.489857 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484816 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" May 20 21:48:17.489857 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484823 2581 flags.go:64] FLAG: --tls-min-version="" May 20 21:48:17.489857 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484826 2581 flags.go:64] FLAG: --tls-private-key-file="" May 20 21:48:17.489857 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484829 2581 flags.go:64] FLAG: --topology-manager-policy="none" May 20 21:48:17.489857 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484832 2581 flags.go:64] FLAG: --topology-manager-policy-options="" May 20 21:48:17.489857 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484835 2581 flags.go:64] FLAG: --topology-manager-scope="container" May 20 21:48:17.489857 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484838 2581 flags.go:64] FLAG: --v="2" May 20 21:48:17.489857 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484847 2581 flags.go:64] FLAG: --version="false" May 20 21:48:17.489857 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484851 2581 flags.go:64] FLAG: --vmodule="" May 20 21:48:17.489857 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484856 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 20 21:48:17.489857 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.484860 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 20 21:48:17.489857 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.484959 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 20 21:48:17.489857 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.484963 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 20 21:48:17.489857 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.484966 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 20 21:48:17.490451 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.484969 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 20 21:48:17.490451 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.484972 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 20 21:48:17.490451 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.484975 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 20 21:48:17.490451 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.484977 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 20 21:48:17.490451 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.484980 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 20 21:48:17.490451 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.484983 2581 feature_gate.go:328] unrecognized feature gate: Example May 20 21:48:17.490451 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.484986 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores May 20 21:48:17.490451 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.484991 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 20 21:48:17.490451 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.484994 2581 feature_gate.go:328] unrecognized feature gate: NewOLM May 20 21:48:17.490451 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.484996 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 20 21:48:17.490451 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.484999 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 20 21:48:17.490451 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485001 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 20 21:48:17.490451 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485004 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 20 21:48:17.490451 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485007 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 20 21:48:17.490451 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485010 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 20 21:48:17.490451 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485012 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 20 21:48:17.490451 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485015 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 20 21:48:17.490451 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485017 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 20 21:48:17.490451 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485020 2581 feature_gate.go:328] unrecognized feature gate: DualReplica May 20 21:48:17.490451 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485024 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 20 21:48:17.490451 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485027 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 20 21:48:17.491036 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485030 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 20 21:48:17.491036 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485032 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 20 21:48:17.491036 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485035 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 20 21:48:17.491036 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485038 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 20 21:48:17.491036 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485040 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 20 21:48:17.491036 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485042 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 20 21:48:17.491036 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485045 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 20 21:48:17.491036 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485048 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 20 21:48:17.491036 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485050 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 20 21:48:17.491036 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485052 2581 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 20 21:48:17.491036 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485055 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 20 21:48:17.491036 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485057 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 20 21:48:17.491036 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485060 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 20 21:48:17.491036 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485063 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 20 21:48:17.491036 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485065 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 20 21:48:17.491036 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485068 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 20 21:48:17.491036 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485071 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 20 21:48:17.491036 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485084 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 20 21:48:17.491036 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485088 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 20 21:48:17.491036 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485091 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 20 21:48:17.491697 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485093 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 20 21:48:17.491697 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485096 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 20 21:48:17.491697 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485099 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 20 21:48:17.491697 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485102 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 20 21:48:17.491697 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485104 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 20 21:48:17.491697 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485107 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 20 21:48:17.491697 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485109 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability May 20 21:48:17.491697 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485112 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 20 21:48:17.491697 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485114 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 20 21:48:17.491697 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485117 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 20 21:48:17.491697 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485120 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 20 21:48:17.491697 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485123 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 20 21:48:17.491697 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485126 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 20 21:48:17.491697 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485128 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 20 21:48:17.491697 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485131 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 20 21:48:17.491697 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485133 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 20 21:48:17.491697 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485136 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 20 21:48:17.491697 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485138 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 20 21:48:17.491697 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485141 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages May 20 21:48:17.491697 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485144 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 20 21:48:17.492505 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485148 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 20 21:48:17.492505 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485151 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 20 21:48:17.492505 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485154 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 20 21:48:17.492505 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485156 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 20 21:48:17.492505 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485160 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 20 21:48:17.492505 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485164 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 20 21:48:17.492505 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485167 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 20 21:48:17.492505 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485170 2581 feature_gate.go:328] unrecognized feature gate: Example2 May 20 21:48:17.492505 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485173 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 20 21:48:17.492505 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485177 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 20 21:48:17.492505 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485181 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 20 21:48:17.492505 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485183 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 20 21:48:17.492505 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485186 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 20 21:48:17.492505 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485188 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 20 21:48:17.492505 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485191 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 20 21:48:17.492505 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485193 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 20 21:48:17.492505 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485196 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 20 21:48:17.492505 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485198 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 20 21:48:17.492505 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485201 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 20 21:48:17.493109 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485203 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 20 21:48:17.493109 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485206 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 20 21:48:17.493109 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.485208 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 20 21:48:17.493109 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.486107 2581 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 20 21:48:17.494271 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.494251 2581 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 20 21:48:17.494304 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.494273 2581 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 20 21:48:17.494336 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494322 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 20 21:48:17.494336 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494328 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 20 21:48:17.494336 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494332 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 20 21:48:17.494336 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494335 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 20 21:48:17.494336 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494338 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 20 21:48:17.494471 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494341 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 20 21:48:17.494471 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494345 2581 feature_gate.go:328] unrecognized feature gate: NewOLM May 20 21:48:17.494471 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494347 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 20 21:48:17.494471 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494350 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 20 21:48:17.494471 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494352 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 20 21:48:17.494471 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494355 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 20 21:48:17.494471 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494358 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 20 21:48:17.494471 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494361 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 20 21:48:17.494471 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494363 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 20 21:48:17.494471 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494366 2581 feature_gate.go:328] unrecognized feature gate: Example2 May 20 21:48:17.494471 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494368 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 20 21:48:17.494471 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494371 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 20 21:48:17.494471 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494374 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 20 21:48:17.494471 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494376 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 20 21:48:17.494471 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494380 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 20 21:48:17.494471 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494385 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 20 21:48:17.494471 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494388 2581 feature_gate.go:328] unrecognized feature gate: DualReplica May 20 21:48:17.494471 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494391 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 20 21:48:17.494471 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494394 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 20 21:48:17.494471 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494397 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 20 21:48:17.494964 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494400 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 20 21:48:17.494964 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494403 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability May 20 21:48:17.494964 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494405 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 20 21:48:17.494964 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494408 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 20 21:48:17.494964 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494410 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 20 21:48:17.494964 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494413 2581 feature_gate.go:328] unrecognized feature gate: Example May 20 21:48:17.494964 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494415 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 20 21:48:17.494964 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494418 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 20 21:48:17.494964 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494420 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 20 21:48:17.494964 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494423 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 20 21:48:17.494964 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494425 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 20 21:48:17.494964 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494428 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 20 21:48:17.494964 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494431 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 20 21:48:17.494964 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494434 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 20 21:48:17.494964 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494437 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 20 21:48:17.494964 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494440 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 20 21:48:17.494964 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494443 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 20 21:48:17.494964 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494445 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 20 21:48:17.494964 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494448 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 20 21:48:17.494964 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494451 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 20 21:48:17.495481 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494453 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 20 21:48:17.495481 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494456 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 20 21:48:17.495481 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494465 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 20 21:48:17.495481 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494468 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 20 21:48:17.495481 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494472 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 20 21:48:17.495481 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494474 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 20 21:48:17.495481 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494477 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 20 21:48:17.495481 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494481 2581 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 20 21:48:17.495481 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494484 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 20 21:48:17.495481 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494487 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 20 21:48:17.495481 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494489 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 20 21:48:17.495481 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494492 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 20 21:48:17.495481 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494495 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 20 21:48:17.495481 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494498 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 20 21:48:17.495481 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494502 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 20 21:48:17.495481 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494505 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 20 21:48:17.495481 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494508 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 20 21:48:17.495481 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494511 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 20 21:48:17.495481 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494513 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 20 21:48:17.495946 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494516 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 20 21:48:17.495946 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494518 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 20 21:48:17.495946 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494521 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 20 21:48:17.495946 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494523 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 20 21:48:17.495946 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494526 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 20 21:48:17.495946 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494528 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 20 21:48:17.495946 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494531 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 20 21:48:17.495946 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494534 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 20 21:48:17.495946 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494537 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages May 20 21:48:17.495946 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494540 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 20 21:48:17.495946 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494543 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 20 21:48:17.495946 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494545 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 20 21:48:17.495946 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494549 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 20 21:48:17.495946 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494551 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 20 21:48:17.495946 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494554 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 20 21:48:17.495946 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494556 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 20 21:48:17.495946 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494559 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 20 21:48:17.495946 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494561 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 20 21:48:17.495946 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494564 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores May 20 21:48:17.495946 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494567 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 20 21:48:17.496500 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494569 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 20 21:48:17.496500 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494572 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 20 21:48:17.496500 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.494577 2581 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 20 21:48:17.496500 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494675 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 20 21:48:17.496500 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494680 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 20 21:48:17.496500 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494683 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 20 21:48:17.496500 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494686 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 20 21:48:17.496500 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494688 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 20 21:48:17.496500 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494691 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 20 21:48:17.496500 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494693 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 20 21:48:17.496500 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494696 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 20 21:48:17.496500 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494699 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 20 21:48:17.496500 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494702 2581 feature_gate.go:328] unrecognized feature gate: Example2 May 20 21:48:17.496500 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494704 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 20 21:48:17.496500 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494706 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 20 21:48:17.496881 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494709 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 20 21:48:17.496881 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494712 2581 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 20 21:48:17.496881 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494714 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 20 21:48:17.496881 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494718 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 20 21:48:17.496881 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494721 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 20 21:48:17.496881 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494724 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 20 21:48:17.496881 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494727 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 20 21:48:17.496881 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494730 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 20 21:48:17.496881 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494733 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 20 21:48:17.496881 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494735 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 20 21:48:17.496881 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494738 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 20 21:48:17.496881 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494741 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 20 21:48:17.496881 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494744 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 20 21:48:17.496881 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494746 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages May 20 21:48:17.496881 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494748 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 20 21:48:17.496881 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494751 2581 feature_gate.go:328] unrecognized feature gate: NewOLM May 20 21:48:17.496881 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494753 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 20 21:48:17.496881 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494756 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 20 21:48:17.496881 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494758 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 20 21:48:17.496881 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494761 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 20 21:48:17.497386 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494764 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 20 21:48:17.497386 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494766 2581 feature_gate.go:328] unrecognized feature gate: Example May 20 21:48:17.497386 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494769 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 20 21:48:17.497386 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494772 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 20 21:48:17.497386 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494774 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 20 21:48:17.497386 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494777 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 20 21:48:17.497386 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494779 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 20 21:48:17.497386 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494782 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 20 21:48:17.497386 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494784 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 20 21:48:17.497386 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494787 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 20 21:48:17.497386 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494789 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 20 21:48:17.497386 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494791 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 20 21:48:17.497386 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494794 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 20 21:48:17.497386 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494797 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 20 21:48:17.497386 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494799 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 20 21:48:17.497386 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494802 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 20 21:48:17.497386 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494805 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 20 21:48:17.497386 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494808 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 20 21:48:17.497386 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494810 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 20 21:48:17.497386 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494813 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability May 20 21:48:17.497869 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494815 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 20 21:48:17.497869 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494818 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 20 21:48:17.497869 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494821 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 20 21:48:17.497869 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494824 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 20 21:48:17.497869 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494827 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 20 21:48:17.497869 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494829 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 20 21:48:17.497869 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494832 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 20 21:48:17.497869 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494834 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 20 21:48:17.497869 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494837 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 20 21:48:17.497869 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494839 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 20 21:48:17.497869 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494841 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 20 21:48:17.497869 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494844 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 20 21:48:17.497869 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494847 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 20 21:48:17.497869 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494851 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 20 21:48:17.497869 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494854 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 20 21:48:17.497869 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494856 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 20 21:48:17.497869 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494859 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 20 21:48:17.497869 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494861 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 20 21:48:17.497869 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494864 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores May 20 21:48:17.498358 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494866 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 20 21:48:17.498358 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494869 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 20 21:48:17.498358 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494871 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 20 21:48:17.498358 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494875 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 20 21:48:17.498358 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494878 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 20 21:48:17.498358 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494881 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 20 21:48:17.498358 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494884 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 20 21:48:17.498358 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494886 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 20 21:48:17.498358 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494889 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 20 21:48:17.498358 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494892 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 20 21:48:17.498358 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494895 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 20 21:48:17.498358 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494897 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 20 21:48:17.498358 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494900 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 20 21:48:17.498358 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494903 2581 feature_gate.go:328] unrecognized feature gate: DualReplica May 20 21:48:17.498358 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:17.494906 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 20 21:48:17.498734 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.494911 2581 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 20 21:48:17.498734 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.495464 2581 server.go:962] "Client rotation is on, will bootstrap in background" May 20 21:48:17.498734 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.498185 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 20 21:48:17.499464 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.499451 2581 server.go:1019] "Starting client certificate rotation" May 20 21:48:17.499565 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.499548 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 20 21:48:17.499594 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.499581 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 20 21:48:17.523605 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.523582 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 20 21:48:17.525722 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.525702 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 20 21:48:17.540063 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.540037 2581 log.go:25] "Validated CRI v1 runtime API" May 20 21:48:17.544765 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.544739 2581 log.go:25] "Validated CRI v1 image API" May 20 21:48:17.547391 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.547375 2581 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 20 21:48:17.554748 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.554717 2581 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 20 21:48:17.555724 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.555687 2581 fs.go:135] Filesystem UUIDs: map[7805f1b4-2304-4e87-b205-1caf74bbc5c2:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a957ea01-423d-4817-83d8-8a0a0da29aa9:/dev/nvme0n1p3] May 20 21:48:17.555839 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.555720 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 20 21:48:17.560585 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.560461 2581 manager.go:217] Machine: {Timestamp:2026-05-20 21:48:17.559914574 +0000 UTC m=+0.422335495 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096031 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2590f37084c092344a33cf60da177d SystemUUID:ec2590f3-7084-c092-344a-33cf60da177d BootID:700c0b74-6c14-4288-9217-30a42d7e0311 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e1:84:e7:c2:0f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e1:84:e7:c2:0f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fe:d0:bf:75:27:5a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 20 21:48:17.561223 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.561211 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 20 21:48:17.561324 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.561312 2581 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 20 21:48:17.563254 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.563229 2581 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 20 21:48:17.563395 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.563258 2581 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-137.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 20 21:48:17.563881 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.563871 2581 topology_manager.go:138] "Creating topology manager with none policy" May 20 21:48:17.563915 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.563884 2581 container_manager_linux.go:306] "Creating device plugin manager" May 20 21:48:17.563915 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.563891 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 20 21:48:17.563915 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.563901 2581 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 20 21:48:17.565393 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.565382 2581 state_mem.go:36] "Initialized new in-memory state store" May 20 21:48:17.565500 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.565491 2581 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 20 21:48:17.568594 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.568582 2581 kubelet.go:491] "Attempting to sync node with API server" May 20 21:48:17.568655 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.568599 2581 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 20 21:48:17.568655 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.568617 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 20 21:48:17.568655 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.568627 2581 kubelet.go:397] "Adding apiserver pod source" May 20 21:48:17.568655 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.568635 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 20 21:48:17.569705 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.569688 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 20 21:48:17.569787 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.569714 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 20 21:48:17.572621 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.572599 2581 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 20 21:48:17.574467 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.574435 2581 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 20 21:48:17.575577 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.575564 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 20 21:48:17.575644 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.575582 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 20 21:48:17.575644 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.575588 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 20 21:48:17.575644 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.575594 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 20 21:48:17.575644 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.575602 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 20 21:48:17.575644 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.575608 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 20 21:48:17.575644 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.575614 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 20 21:48:17.575644 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.575620 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 20 21:48:17.575644 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.575627 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 20 21:48:17.575644 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.575633 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 20 21:48:17.575644 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.575641 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 20 21:48:17.575644 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.575646 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 20 21:48:17.577517 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.577507 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 20 21:48:17.577557 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.577518 2581 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 20 21:48:17.580715 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.580700 2581 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 20 21:48:17.580771 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.580742 2581 server.go:1295] "Started kubelet" May 20 21:48:17.580831 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.580801 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 20 21:48:17.580901 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.580842 2581 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 20 21:48:17.580959 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.580935 2581 server_v1.go:47] "podresources" method="list" useActivePods=true May 20 21:48:17.581833 ip-10-0-129-137 systemd[1]: Started Kubernetes Kubelet. May 20 21:48:17.582706 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.582648 2581 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 20 21:48:17.583877 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.583860 2581 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-137.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 20 21:48:17.584303 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:17.584279 2581 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-137.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 20 21:48:17.584406 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.584393 2581 server.go:317] "Adding debug handlers to kubelet server" May 20 21:48:17.587428 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:17.587406 2581 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 20 21:48:17.587981 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.587963 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 20 21:48:17.587981 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.587980 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 20 21:48:17.588120 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.588028 2581 volume_manager.go:295] "The desired_state_of_world populator starts" May 20 21:48:17.588120 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.588042 2581 volume_manager.go:297] "Starting Kubelet Volume Manager" May 20 21:48:17.588242 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.588229 2581 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 20 21:48:17.588307 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.588285 2581 reconstruct.go:97] "Volume reconstruction finished" May 20 21:48:17.588307 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.588295 2581 reconciler.go:26] "Reconciler: start to sync state" May 20 21:48:17.589882 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:17.589843 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-137.ec2.internal\" not found" May 20 21:48:17.590557 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.590538 2581 factory.go:55] Registering systemd factory May 20 21:48:17.590646 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.590567 2581 factory.go:223] Registration of the systemd container factory successfully May 20 21:48:17.590817 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:17.590783 2581 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 20 21:48:17.590874 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.590865 2581 factory.go:153] Registering CRI-O factory May 20 21:48:17.590929 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.590875 2581 factory.go:223] Registration of the crio container factory successfully May 20 21:48:17.590975 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.590929 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 20 21:48:17.590975 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.590949 2581 factory.go:103] Registering Raw factory May 20 21:48:17.590975 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.590970 2581 manager.go:1196] Started watching for new ooms in manager May 20 21:48:17.591660 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.591642 2581 manager.go:319] Starting recovery of all containers May 20 21:48:17.594119 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.594095 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7fnd5" May 20 21:48:17.599995 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:17.599806 2581 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 20 21:48:17.600205 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:17.600152 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-137.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 20 21:48:17.600884 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:17.599992 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-137.ec2.internal.18b1646178490b64 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-137.ec2.internal,UID:ip-10-0-129-137.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-137.ec2.internal,},FirstTimestamp:2026-05-20 21:48:17.580714852 +0000 UTC m=+0.443135773,LastTimestamp:2026-05-20 21:48:17.580714852 +0000 UTC m=+0.443135773,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-137.ec2.internal,}" May 20 21:48:17.602624 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.602601 2581 manager.go:324] Recovery completed May 20 21:48:17.607783 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.607769 2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 21:48:17.609713 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.609695 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-137.ec2.internal" event="NodeHasSufficientMemory" May 20 21:48:17.609786 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.609723 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-137.ec2.internal" event="NodeHasNoDiskPressure" May 20 21:48:17.609786 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.609735 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-137.ec2.internal" event="NodeHasSufficientPID" May 20 21:48:17.610265 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.610250 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" May 20 21:48:17.610265 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.610263 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 20 21:48:17.610374 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.610277 2581 state_mem.go:36] "Initialized new in-memory state store" May 20 21:48:17.610523 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.610508 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7fnd5" May 20 21:48:17.611854 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:17.611785 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-137.ec2.internal.18b164617a037af3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-137.ec2.internal,UID:ip-10-0-129-137.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-137.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-137.ec2.internal,},FirstTimestamp:2026-05-20 21:48:17.609710323 +0000 UTC m=+0.472131244,LastTimestamp:2026-05-20 21:48:17.609710323 +0000 UTC m=+0.472131244,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-137.ec2.internal,}" May 20 21:48:17.612429 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.612417 2581 policy_none.go:49] "None policy: Start" May 20 21:48:17.612482 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.612434 2581 memory_manager.go:186] "Starting memorymanager" policy="None" May 20 21:48:17.612482 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.612444 2581 state_mem.go:35] "Initializing new in-memory state store" May 20 21:48:17.654580 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.651732 2581 manager.go:341] "Starting Device Plugin manager" May 20 21:48:17.654580 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:17.651769 2581 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 20 21:48:17.654580 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.651779 2581 server.go:85] "Starting device plugin registration server" May 20 21:48:17.654580 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.652058 2581 eviction_manager.go:189] "Eviction manager: starting control loop" May 20 21:48:17.654580 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.652069 2581 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 20 21:48:17.654580 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.652207 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 20 21:48:17.654580 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.652299 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 20 21:48:17.654580 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.652308 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 20 21:48:17.654580 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:17.652872 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 20 21:48:17.654580 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:17.652934 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-137.ec2.internal\" not found" May 20 21:48:17.752648 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.752551 2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 21:48:17.753796 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.753781 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-137.ec2.internal" event="NodeHasSufficientMemory" May 20 21:48:17.753863 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.753813 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-137.ec2.internal" event="NodeHasNoDiskPressure" May 20 21:48:17.753863 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.753825 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-137.ec2.internal" event="NodeHasSufficientPID" May 20 21:48:17.753863 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.753857 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-137.ec2.internal" May 20 21:48:17.765984 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.765952 2581 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 20 21:48:17.767558 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.767509 2581 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 20 21:48:17.767670 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.767563 2581 status_manager.go:230] "Starting to sync pod status with apiserver" May 20 21:48:17.767670 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.767588 2581 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 20 21:48:17.767670 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.767599 2581 kubelet.go:2451] "Starting kubelet main sync loop" May 20 21:48:17.767670 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:17.767646 2581 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 20 21:48:17.772858 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.772841 2581 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 20 21:48:17.773526 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.773506 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-137.ec2.internal" May 20 21:48:17.773639 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:17.773537 2581 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-137.ec2.internal\": node \"ip-10-0-129-137.ec2.internal\" not found" May 20 21:48:17.804862 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:17.804835 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-137.ec2.internal\" not found" May 20 21:48:17.868724 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.868680 2581 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-137.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-137.ec2.internal"] May 20 21:48:17.868829 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.868773 2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 21:48:17.870388 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.870365 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-137.ec2.internal" event="NodeHasSufficientMemory" May 20 21:48:17.870513 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.870402 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-137.ec2.internal" event="NodeHasNoDiskPressure" May 20 21:48:17.870513 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.870429 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-137.ec2.internal" event="NodeHasSufficientPID" May 20 21:48:17.871969 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.871952 2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 21:48:17.872136 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.872121 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-137.ec2.internal" May 20 21:48:17.872188 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.872153 2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 21:48:17.872619 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.872604 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-137.ec2.internal" event="NodeHasSufficientMemory" May 20 21:48:17.872691 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.872630 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-137.ec2.internal" event="NodeHasNoDiskPressure" May 20 21:48:17.872691 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.872645 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-137.ec2.internal" event="NodeHasSufficientPID" May 20 21:48:17.872755 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.872605 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-137.ec2.internal" event="NodeHasSufficientMemory" May 20 21:48:17.872755 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.872717 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-137.ec2.internal" event="NodeHasNoDiskPressure" May 20 21:48:17.872755 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.872727 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-137.ec2.internal" event="NodeHasSufficientPID" May 20 21:48:17.873775 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.873760 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-137.ec2.internal" May 20 21:48:17.873870 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.873790 2581 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 20 21:48:17.874474 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.874460 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-137.ec2.internal" event="NodeHasSufficientMemory" May 20 21:48:17.874546 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.874482 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-137.ec2.internal" event="NodeHasNoDiskPressure" May 20 21:48:17.874546 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.874492 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-137.ec2.internal" event="NodeHasSufficientPID" May 20 21:48:17.888653 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:17.888634 2581 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-137.ec2.internal\" not found" node="ip-10-0-129-137.ec2.internal" May 20 21:48:17.889722 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.889705 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8d590ec180b8c090f18a7ca8bc0c5fe9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-137.ec2.internal\" (UID: \"8d590ec180b8c090f18a7ca8bc0c5fe9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-137.ec2.internal" May 20 21:48:17.889802 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.889737 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d590ec180b8c090f18a7ca8bc0c5fe9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-137.ec2.internal\" (UID: \"8d590ec180b8c090f18a7ca8bc0c5fe9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-137.ec2.internal" May 20 21:48:17.889802 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.889765 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9bbe3a098905df03db04c6508916d305-config\") pod \"kube-apiserver-proxy-ip-10-0-129-137.ec2.internal\" (UID: \"9bbe3a098905df03db04c6508916d305\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-137.ec2.internal" May 20 21:48:17.892097 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:17.892066 2581 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-137.ec2.internal\" not found" node="ip-10-0-129-137.ec2.internal" May 20 21:48:17.905125 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:17.905105 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-137.ec2.internal\" not found" May 20 21:48:17.990435 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.990406 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d590ec180b8c090f18a7ca8bc0c5fe9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-137.ec2.internal\" (UID: \"8d590ec180b8c090f18a7ca8bc0c5fe9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-137.ec2.internal" May 20 21:48:17.990550 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.990438 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9bbe3a098905df03db04c6508916d305-config\") pod \"kube-apiserver-proxy-ip-10-0-129-137.ec2.internal\" (UID: \"9bbe3a098905df03db04c6508916d305\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-137.ec2.internal" May 20 21:48:17.990550 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.990463 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8d590ec180b8c090f18a7ca8bc0c5fe9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-137.ec2.internal\" (UID: \"8d590ec180b8c090f18a7ca8bc0c5fe9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-137.ec2.internal" May 20 21:48:17.990550 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.990495 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8d590ec180b8c090f18a7ca8bc0c5fe9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-137.ec2.internal\" (UID: \"8d590ec180b8c090f18a7ca8bc0c5fe9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-137.ec2.internal" May 20 21:48:17.990550 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.990497 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d590ec180b8c090f18a7ca8bc0c5fe9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-137.ec2.internal\" (UID: \"8d590ec180b8c090f18a7ca8bc0c5fe9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-137.ec2.internal" May 20 21:48:17.990550 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:17.990506 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9bbe3a098905df03db04c6508916d305-config\") pod \"kube-apiserver-proxy-ip-10-0-129-137.ec2.internal\" (UID: \"9bbe3a098905df03db04c6508916d305\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-137.ec2.internal" May 20 21:48:18.005267 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:18.005211 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-137.ec2.internal\" not found" May 20 21:48:18.105318 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:18.105281 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-137.ec2.internal\" not found" May 20 21:48:18.191681 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:18.191639 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-137.ec2.internal" May 20 21:48:18.194149 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:18.194136 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-137.ec2.internal" May 20 21:48:18.205783 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:18.205761 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-137.ec2.internal\" not found" May 20 21:48:18.306344 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:18.306260 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-137.ec2.internal\" not found" May 20 21:48:18.406745 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:18.406708 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-137.ec2.internal\" not found" May 20 21:48:18.499224 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:18.499196 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 20 21:48:18.499763 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:18.499356 2581 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 20 21:48:18.507369 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:18.507344 2581 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-137.ec2.internal\" not found" May 20 21:48:18.580951 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:18.580925 2581 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 20 21:48:18.588122 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:18.588091 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 20 21:48:18.588238 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:18.588101 2581 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-137.ec2.internal" May 20 21:48:18.598617 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:18.598597 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 20 21:48:18.600375 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:18.600356 2581 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-137.ec2.internal" May 20 21:48:18.600954 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:18.600939 2581 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 20 21:48:18.609966 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:18.609942 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 20 21:48:18.613155 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:18.613123 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-19 21:43:17 +0000 UTC" deadline="2027-12-16 14:27:03.89439465 +0000 UTC" May 20 21:48:18.613155 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:18.613155 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13792h38m45.281243826s" May 20 21:48:18.622534 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:18.622508 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d590ec180b8c090f18a7ca8bc0c5fe9.slice/crio-d5ce6ea686c3c4c8465c5ac4ad6cff1fc899ff4d57d172d7eb19b0063e58c090 WatchSource:0}: Error finding container d5ce6ea686c3c4c8465c5ac4ad6cff1fc899ff4d57d172d7eb19b0063e58c090: Status 404 returned error can't find the container with id d5ce6ea686c3c4c8465c5ac4ad6cff1fc899ff4d57d172d7eb19b0063e58c090 May 20 21:48:18.622742 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:18.622716 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bbe3a098905df03db04c6508916d305.slice/crio-979ea00b47d0b4dd7b9715ba4cbdf56e354b10183587c1a13ae28b0b328eb487 WatchSource:0}: Error finding container 979ea00b47d0b4dd7b9715ba4cbdf56e354b10183587c1a13ae28b0b328eb487: Status 404 returned error can't find the container with id 979ea00b47d0b4dd7b9715ba4cbdf56e354b10183587c1a13ae28b0b328eb487 May 20 21:48:18.623842 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:18.623824 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kqwfl" May 20 21:48:18.627369 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:18.627307 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 20 21:48:18.631908 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:18.631891 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kqwfl" May 20 21:48:18.754690 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:18.754656 2581 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 20 21:48:18.771984 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:18.771929 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-137.ec2.internal" event={"ID":"8d590ec180b8c090f18a7ca8bc0c5fe9","Type":"ContainerStarted","Data":"d5ce6ea686c3c4c8465c5ac4ad6cff1fc899ff4d57d172d7eb19b0063e58c090"} May 20 21:48:18.772901 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:18.772881 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-137.ec2.internal" event={"ID":"9bbe3a098905df03db04c6508916d305","Type":"ContainerStarted","Data":"979ea00b47d0b4dd7b9715ba4cbdf56e354b10183587c1a13ae28b0b328eb487"} May 20 21:48:18.897996 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:18.897930 2581 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 20 21:48:19.439418 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.439386 2581 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 20 21:48:19.570550 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.570503 2581 apiserver.go:52] "Watching apiserver" May 20 21:48:19.578407 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.578382 2581 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 20 21:48:19.581112 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.579833 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-q2tcg","kube-system/kube-apiserver-proxy-ip-10-0-129-137.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwn2w","openshift-cluster-node-tuning-operator/tuned-rg5q8","openshift-dns/node-resolver-x5q4l","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-137.ec2.internal","openshift-multus/multus-additional-cni-plugins-g76b4","openshift-multus/network-metrics-daemon-6wbvb","openshift-image-registry/node-ca-vhwkk","openshift-multus/multus-tjnqv","openshift-network-diagnostics/network-check-target-qlq8p","openshift-network-operator/iptables-alerter-z8k7q","openshift-ovn-kubernetes/ovnkube-node-jgks5"] May 20 21:48:19.582926 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.582901 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g76b4" May 20 21:48:19.583972 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.583946 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwn2w" May 20 21:48:19.584096 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.584031 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rg5q8" May 20 21:48:19.585173 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.585151 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x5q4l" May 20 21:48:19.585397 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.585331 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 20 21:48:19.585509 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.585487 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 20 21:48:19.585574 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.585517 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 20 21:48:19.585574 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.585564 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lgfpl\"" May 20 21:48:19.585737 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.585720 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 20 21:48:19.585874 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.585857 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 20 21:48:19.586488 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.586470 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-q2tcg" May 20 21:48:19.586783 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.586642 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 20 21:48:19.586783 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.586679 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 20 21:48:19.588014 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.587576 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 20 21:48:19.588014 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.587633 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jdz7z\"" May 20 21:48:19.588014 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.587640 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 20 21:48:19.588014 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.587708 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 20 21:48:19.588014 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.587915 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-68728\"" May 20 21:48:19.588014 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.587921 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 20 21:48:19.588014 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.587923 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 20 21:48:19.588014 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.588001 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-htdhq\"" May 20 21:48:19.588536 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.588503 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 20 21:48:19.588680 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.588660 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 20 21:48:19.588762 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.588745 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-grtw4\"" May 20 21:48:19.589048 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.589031 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wbvb" May 20 21:48:19.589293 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.589274 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vhwkk" May 20 21:48:19.589516 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:19.589261 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wbvb" podUID="872c529b-f04d-4f44-be10-283c11ff49e0" May 20 21:48:19.590600 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.590580 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tjnqv" May 20 21:48:19.592169 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.592152 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 20 21:48:19.592169 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.592163 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7btkm\"" May 20 21:48:19.592308 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.592173 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 20 21:48:19.592308 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.592167 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 20 21:48:19.592784 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.592762 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 20 21:48:19.592978 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.592960 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-75lfq\"" May 20 21:48:19.593088 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.592987 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlq8p" May 20 21:48:19.593088 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:19.593039 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlq8p" podUID="b65cd3c8-efd2-4553-99d9-2afbaa703796" May 20 21:48:19.595585 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.595566 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z8k7q" May 20 21:48:19.596848 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.596832 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.599125 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.599108 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 20 21:48:19.599228 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.599137 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 20 21:48:19.599228 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.599153 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-959fk\"" May 20 21:48:19.600301 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.600105 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 20 21:48:19.600301 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.600124 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 20 21:48:19.600301 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.600136 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 20 21:48:19.600611 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.600341 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/30a53acd-d1d9-480d-885b-ebccb4ef3734-serviceca\") pod \"node-ca-vhwkk\" (UID: \"30a53acd-d1d9-480d-885b-ebccb4ef3734\") " pod="openshift-image-registry/node-ca-vhwkk" May 20 21:48:19.600611 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.600373 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/585dc410-8720-4e83-926c-486addf85ada-os-release\") pod \"multus-additional-cni-plugins-g76b4\" (UID: \"585dc410-8720-4e83-926c-486addf85ada\") " pod="openshift-multus/multus-additional-cni-plugins-g76b4" May 20 21:48:19.600611 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.600398 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b5bc4f12-7530-4f15-9365-5c88a796caf6-lib-modules\") pod \"tuned-rg5q8\" (UID: \"b5bc4f12-7530-4f15-9365-5c88a796caf6\") " pod="openshift-cluster-node-tuning-operator/tuned-rg5q8" May 20 21:48:19.600611 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.600421 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/24350846-e9be-481f-9301-3ebb3f081f66-sys-fs\") pod \"aws-ebs-csi-driver-node-mwn2w\" (UID: \"24350846-e9be-481f-9301-3ebb3f081f66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwn2w" May 20 21:48:19.600611 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.600446 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5bc4f12-7530-4f15-9365-5c88a796caf6-etc-kubernetes\") pod \"tuned-rg5q8\" (UID: \"b5bc4f12-7530-4f15-9365-5c88a796caf6\") " pod="openshift-cluster-node-tuning-operator/tuned-rg5q8" May 20 21:48:19.600611 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.600468 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b5bc4f12-7530-4f15-9365-5c88a796caf6-etc-sysctl-conf\") pod \"tuned-rg5q8\" (UID: \"b5bc4f12-7530-4f15-9365-5c88a796caf6\") " pod="openshift-cluster-node-tuning-operator/tuned-rg5q8" May 20 21:48:19.600611 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.600512 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b5bc4f12-7530-4f15-9365-5c88a796caf6-run\") pod \"tuned-rg5q8\" (UID: \"b5bc4f12-7530-4f15-9365-5c88a796caf6\") " pod="openshift-cluster-node-tuning-operator/tuned-rg5q8" May 20 21:48:19.600611 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.600551 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5bc4f12-7530-4f15-9365-5c88a796caf6-var-lib-kubelet\") pod \"tuned-rg5q8\" (UID: \"b5bc4f12-7530-4f15-9365-5c88a796caf6\") " pod="openshift-cluster-node-tuning-operator/tuned-rg5q8" May 20 21:48:19.600611 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.600598 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b5bc4f12-7530-4f15-9365-5c88a796caf6-host\") pod \"tuned-rg5q8\" (UID: \"b5bc4f12-7530-4f15-9365-5c88a796caf6\") " pod="openshift-cluster-node-tuning-operator/tuned-rg5q8" May 20 21:48:19.601021 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.600625 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b5bc4f12-7530-4f15-9365-5c88a796caf6-etc-tuned\") pod \"tuned-rg5q8\" (UID: \"b5bc4f12-7530-4f15-9365-5c88a796caf6\") " pod="openshift-cluster-node-tuning-operator/tuned-rg5q8" May 20 21:48:19.601021 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.600647 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5bc4f12-7530-4f15-9365-5c88a796caf6-tmp\") pod \"tuned-rg5q8\" (UID: \"b5bc4f12-7530-4f15-9365-5c88a796caf6\") " pod="openshift-cluster-node-tuning-operator/tuned-rg5q8" May 20 21:48:19.601021 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.600669 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/24350846-e9be-481f-9301-3ebb3f081f66-socket-dir\") pod \"aws-ebs-csi-driver-node-mwn2w\" (UID: \"24350846-e9be-481f-9301-3ebb3f081f66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwn2w" May 20 21:48:19.601021 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.600684 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7fbcb26-e155-4cf8-89ba-17e5c52f3f8c-tmp-dir\") pod \"node-resolver-x5q4l\" (UID: \"b7fbcb26-e155-4cf8-89ba-17e5c52f3f8c\") " pod="openshift-dns/node-resolver-x5q4l" May 20 21:48:19.601021 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.600701 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/585dc410-8720-4e83-926c-486addf85ada-system-cni-dir\") pod \"multus-additional-cni-plugins-g76b4\" (UID: \"585dc410-8720-4e83-926c-486addf85ada\") " pod="openshift-multus/multus-additional-cni-plugins-g76b4" May 20 21:48:19.601021 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.600710 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 20 21:48:19.601021 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.600717 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/585dc410-8720-4e83-926c-486addf85ada-cni-binary-copy\") pod \"multus-additional-cni-plugins-g76b4\" (UID: \"585dc410-8720-4e83-926c-486addf85ada\") " pod="openshift-multus/multus-additional-cni-plugins-g76b4" May 20 21:48:19.601021 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.600735 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/585dc410-8720-4e83-926c-486addf85ada-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g76b4\" (UID: \"585dc410-8720-4e83-926c-486addf85ada\") " pod="openshift-multus/multus-additional-cni-plugins-g76b4" May 20 21:48:19.601021 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.600757 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b5bc4f12-7530-4f15-9365-5c88a796caf6-etc-sysconfig\") pod \"tuned-rg5q8\" (UID: \"b5bc4f12-7530-4f15-9365-5c88a796caf6\") " pod="openshift-cluster-node-tuning-operator/tuned-rg5q8" May 20 21:48:19.601021 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.600796 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b5bc4f12-7530-4f15-9365-5c88a796caf6-etc-sysctl-d\") pod \"tuned-rg5q8\" (UID: \"b5bc4f12-7530-4f15-9365-5c88a796caf6\") " pod="openshift-cluster-node-tuning-operator/tuned-rg5q8" May 20 21:48:19.601021 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.600829 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/34b2cd4e-11b6-4278-8c16-9241eebd6cef-konnectivity-ca\") pod \"konnectivity-agent-q2tcg\" (UID: \"34b2cd4e-11b6-4278-8c16-9241eebd6cef\") " pod="kube-system/konnectivity-agent-q2tcg" May 20 21:48:19.601523 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.601088 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/30a53acd-d1d9-480d-885b-ebccb4ef3734-host\") pod \"node-ca-vhwkk\" (UID: \"30a53acd-d1d9-480d-885b-ebccb4ef3734\") " pod="openshift-image-registry/node-ca-vhwkk" May 20 21:48:19.601523 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.601126 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/585dc410-8720-4e83-926c-486addf85ada-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g76b4\" (UID: \"585dc410-8720-4e83-926c-486addf85ada\") " pod="openshift-multus/multus-additional-cni-plugins-g76b4" May 20 21:48:19.601523 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.601149 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9r29\" (UniqueName: \"kubernetes.io/projected/585dc410-8720-4e83-926c-486addf85ada-kube-api-access-p9r29\") pod \"multus-additional-cni-plugins-g76b4\" (UID: \"585dc410-8720-4e83-926c-486addf85ada\") " pod="openshift-multus/multus-additional-cni-plugins-g76b4" May 20 21:48:19.601523 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.601170 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5hkf\" (UniqueName: \"kubernetes.io/projected/872c529b-f04d-4f44-be10-283c11ff49e0-kube-api-access-x5hkf\") pod \"network-metrics-daemon-6wbvb\" (UID: \"872c529b-f04d-4f44-be10-283c11ff49e0\") " pod="openshift-multus/network-metrics-daemon-6wbvb" May 20 21:48:19.601523 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.601191 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/24350846-e9be-481f-9301-3ebb3f081f66-registration-dir\") pod \"aws-ebs-csi-driver-node-mwn2w\" (UID: \"24350846-e9be-481f-9301-3ebb3f081f66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwn2w" May 20 21:48:19.601523 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.601209 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9252b\" (UniqueName: \"kubernetes.io/projected/24350846-e9be-481f-9301-3ebb3f081f66-kube-api-access-9252b\") pod \"aws-ebs-csi-driver-node-mwn2w\" (UID: \"24350846-e9be-481f-9301-3ebb3f081f66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwn2w" May 20 21:48:19.601523 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.601229 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stv7d\" (UniqueName: \"kubernetes.io/projected/30a53acd-d1d9-480d-885b-ebccb4ef3734-kube-api-access-stv7d\") pod \"node-ca-vhwkk\" (UID: \"30a53acd-d1d9-480d-885b-ebccb4ef3734\") " pod="openshift-image-registry/node-ca-vhwkk" May 20 21:48:19.601523 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.601249 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/585dc410-8720-4e83-926c-486addf85ada-cnibin\") pod \"multus-additional-cni-plugins-g76b4\" (UID: \"585dc410-8720-4e83-926c-486addf85ada\") " pod="openshift-multus/multus-additional-cni-plugins-g76b4" May 20 21:48:19.601523 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.601269 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/585dc410-8720-4e83-926c-486addf85ada-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g76b4\" (UID: \"585dc410-8720-4e83-926c-486addf85ada\") " pod="openshift-multus/multus-additional-cni-plugins-g76b4" May 20 21:48:19.601523 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.601298 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b5bc4f12-7530-4f15-9365-5c88a796caf6-etc-modprobe-d\") pod \"tuned-rg5q8\" (UID: \"b5bc4f12-7530-4f15-9365-5c88a796caf6\") " pod="openshift-cluster-node-tuning-operator/tuned-rg5q8" May 20 21:48:19.601523 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.601320 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b5bc4f12-7530-4f15-9365-5c88a796caf6-etc-systemd\") pod \"tuned-rg5q8\" (UID: \"b5bc4f12-7530-4f15-9365-5c88a796caf6\") " pod="openshift-cluster-node-tuning-operator/tuned-rg5q8" May 20 21:48:19.601523 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.601340 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nhgp\" (UniqueName: \"kubernetes.io/projected/b5bc4f12-7530-4f15-9365-5c88a796caf6-kube-api-access-9nhgp\") pod \"tuned-rg5q8\" (UID: \"b5bc4f12-7530-4f15-9365-5c88a796caf6\") " pod="openshift-cluster-node-tuning-operator/tuned-rg5q8" May 20 21:48:19.601523 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.601343 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 20 21:48:19.601523 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.601358 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/872c529b-f04d-4f44-be10-283c11ff49e0-metrics-certs\") pod \"network-metrics-daemon-6wbvb\" (UID: \"872c529b-f04d-4f44-be10-283c11ff49e0\") " pod="openshift-multus/network-metrics-daemon-6wbvb" May 20 21:48:19.601523 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.601383 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/24350846-e9be-481f-9301-3ebb3f081f66-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mwn2w\" (UID: \"24350846-e9be-481f-9301-3ebb3f081f66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwn2w" May 20 21:48:19.601523 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.601412 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/24350846-e9be-481f-9301-3ebb3f081f66-device-dir\") pod \"aws-ebs-csi-driver-node-mwn2w\" (UID: \"24350846-e9be-481f-9301-3ebb3f081f66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwn2w" May 20 21:48:19.602219 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.601571 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/24350846-e9be-481f-9301-3ebb3f081f66-etc-selinux\") pod \"aws-ebs-csi-driver-node-mwn2w\" (UID: \"24350846-e9be-481f-9301-3ebb3f081f66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwn2w" May 20 21:48:19.602219 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.601596 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b7fbcb26-e155-4cf8-89ba-17e5c52f3f8c-hosts-file\") pod \"node-resolver-x5q4l\" (UID: \"b7fbcb26-e155-4cf8-89ba-17e5c52f3f8c\") " pod="openshift-dns/node-resolver-x5q4l" May 20 21:48:19.602219 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.601635 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b5bc4f12-7530-4f15-9365-5c88a796caf6-sys\") pod \"tuned-rg5q8\" (UID: \"b5bc4f12-7530-4f15-9365-5c88a796caf6\") " pod="openshift-cluster-node-tuning-operator/tuned-rg5q8" May 20 21:48:19.602219 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.601665 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwmhx\" (UniqueName: \"kubernetes.io/projected/b7fbcb26-e155-4cf8-89ba-17e5c52f3f8c-kube-api-access-rwmhx\") pod \"node-resolver-x5q4l\" (UID: \"b7fbcb26-e155-4cf8-89ba-17e5c52f3f8c\") " pod="openshift-dns/node-resolver-x5q4l" May 20 21:48:19.602219 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.601717 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/34b2cd4e-11b6-4278-8c16-9241eebd6cef-agent-certs\") pod \"konnectivity-agent-q2tcg\" (UID: \"34b2cd4e-11b6-4278-8c16-9241eebd6cef\") " pod="kube-system/konnectivity-agent-q2tcg" May 20 21:48:19.602219 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.601719 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 20 21:48:19.602219 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.601976 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dhls5\"" May 20 21:48:19.602517 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.602317 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 20 21:48:19.632720 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.632689 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-19 21:43:18 +0000 UTC" deadline="2028-03-03 19:27:10.201728124 +0000 UTC" May 20 21:48:19.632720 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.632721 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15669h38m50.569010038s" May 20 21:48:19.689899 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.689827 2581 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 20 21:48:19.702885 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.702844 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-host-kubelet\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.702885 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.702888 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-node-log\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.703126 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.702918 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5bc4f12-7530-4f15-9365-5c88a796caf6-etc-kubernetes\") pod \"tuned-rg5q8\" (UID: \"b5bc4f12-7530-4f15-9365-5c88a796caf6\") " pod="openshift-cluster-node-tuning-operator/tuned-rg5q8" May 20 21:48:19.703126 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.702939 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b5bc4f12-7530-4f15-9365-5c88a796caf6-run\") pod \"tuned-rg5q8\" (UID: \"b5bc4f12-7530-4f15-9365-5c88a796caf6\") " pod="openshift-cluster-node-tuning-operator/tuned-rg5q8" May 20 21:48:19.703126 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.702960 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b5bc4f12-7530-4f15-9365-5c88a796caf6-host\") pod \"tuned-rg5q8\" (UID: \"b5bc4f12-7530-4f15-9365-5c88a796caf6\") " pod="openshift-cluster-node-tuning-operator/tuned-rg5q8" May 20 21:48:19.703126 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.703017 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b5bc4f12-7530-4f15-9365-5c88a796caf6-host\") pod \"tuned-rg5q8\" (UID: \"b5bc4f12-7530-4f15-9365-5c88a796caf6\") " pod="openshift-cluster-node-tuning-operator/tuned-rg5q8" May 20 21:48:19.703126 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.703025 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b5bc4f12-7530-4f15-9365-5c88a796caf6-run\") pod \"tuned-rg5q8\" (UID: \"b5bc4f12-7530-4f15-9365-5c88a796caf6\") " pod="openshift-cluster-node-tuning-operator/tuned-rg5q8" May 20 21:48:19.703126 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.703025 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5bc4f12-7530-4f15-9365-5c88a796caf6-etc-kubernetes\") pod \"tuned-rg5q8\" (UID: \"b5bc4f12-7530-4f15-9365-5c88a796caf6\") " pod="openshift-cluster-node-tuning-operator/tuned-rg5q8" May 20 21:48:19.703126 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.703049 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5bc4f12-7530-4f15-9365-5c88a796caf6-tmp\") pod \"tuned-rg5q8\" (UID: \"b5bc4f12-7530-4f15-9365-5c88a796caf6\") " pod="openshift-cluster-node-tuning-operator/tuned-rg5q8" May 20 21:48:19.703126 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.703091 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/adaf6994-2a90-4542-a2e5-2e415a29094b-multus-socket-dir-parent\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.703126 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.703123 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/adaf6994-2a90-4542-a2e5-2e415a29094b-host-run-netns\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.703515 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.703140 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/adaf6994-2a90-4542-a2e5-2e415a29094b-host-run-multus-certs\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.703515 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.703155 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/adaf6994-2a90-4542-a2e5-2e415a29094b-hostroot\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.703515 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.703206 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-host-run-netns\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.703515 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.703251 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/585dc410-8720-4e83-926c-486addf85ada-system-cni-dir\") pod \"multus-additional-cni-plugins-g76b4\" (UID: \"585dc410-8720-4e83-926c-486addf85ada\") " pod="openshift-multus/multus-additional-cni-plugins-g76b4" May 20 21:48:19.703515 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.703282 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/585dc410-8720-4e83-926c-486addf85ada-cni-binary-copy\") pod \"multus-additional-cni-plugins-g76b4\" (UID: \"585dc410-8720-4e83-926c-486addf85ada\") " pod="openshift-multus/multus-additional-cni-plugins-g76b4" May 20 21:48:19.703515 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.703308 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b5bc4f12-7530-4f15-9365-5c88a796caf6-etc-sysconfig\") pod \"tuned-rg5q8\" (UID: \"b5bc4f12-7530-4f15-9365-5c88a796caf6\") " pod="openshift-cluster-node-tuning-operator/tuned-rg5q8" May 20 21:48:19.703515 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.703329 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/585dc410-8720-4e83-926c-486addf85ada-system-cni-dir\") pod \"multus-additional-cni-plugins-g76b4\" (UID: \"585dc410-8720-4e83-926c-486addf85ada\") " pod="openshift-multus/multus-additional-cni-plugins-g76b4" May 20 21:48:19.703515 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.703335 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/34b2cd4e-11b6-4278-8c16-9241eebd6cef-konnectivity-ca\") pod \"konnectivity-agent-q2tcg\" (UID: \"34b2cd4e-11b6-4278-8c16-9241eebd6cef\") " pod="kube-system/konnectivity-agent-q2tcg" May 20 21:48:19.703515 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.703328 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 20 21:48:19.703515 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.703360 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/30a53acd-d1d9-480d-885b-ebccb4ef3734-host\") pod \"node-ca-vhwkk\" (UID: \"30a53acd-d1d9-480d-885b-ebccb4ef3734\") " pod="openshift-image-registry/node-ca-vhwkk" May 20 21:48:19.703515 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.703390 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.703515 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.703396 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b5bc4f12-7530-4f15-9365-5c88a796caf6-etc-sysconfig\") pod \"tuned-rg5q8\" (UID: \"b5bc4f12-7530-4f15-9365-5c88a796caf6\") " pod="openshift-cluster-node-tuning-operator/tuned-rg5q8" May 20 21:48:19.703515 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.703420 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/585dc410-8720-4e83-926c-486addf85ada-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g76b4\" (UID: \"585dc410-8720-4e83-926c-486addf85ada\") " pod="openshift-multus/multus-additional-cni-plugins-g76b4" May 20 21:48:19.703515 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.703461 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/30a53acd-d1d9-480d-885b-ebccb4ef3734-host\") pod \"node-ca-vhwkk\" (UID: \"30a53acd-d1d9-480d-885b-ebccb4ef3734\") " pod="openshift-image-registry/node-ca-vhwkk" May 20 21:48:19.703515 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.703449 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p9r29\" (UniqueName: \"kubernetes.io/projected/585dc410-8720-4e83-926c-486addf85ada-kube-api-access-p9r29\") pod \"multus-additional-cni-plugins-g76b4\" (UID: \"585dc410-8720-4e83-926c-486addf85ada\") " pod="openshift-multus/multus-additional-cni-plugins-g76b4" May 20 21:48:19.704313 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.703510 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x5hkf\" (UniqueName: \"kubernetes.io/projected/872c529b-f04d-4f44-be10-283c11ff49e0-kube-api-access-x5hkf\") pod \"network-metrics-daemon-6wbvb\" (UID: \"872c529b-f04d-4f44-be10-283c11ff49e0\") " pod="openshift-multus/network-metrics-daemon-6wbvb" May 20 21:48:19.704313 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.703555 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-stv7d\" (UniqueName: \"kubernetes.io/projected/30a53acd-d1d9-480d-885b-ebccb4ef3734-kube-api-access-stv7d\") pod \"node-ca-vhwkk\" (UID: \"30a53acd-d1d9-480d-885b-ebccb4ef3734\") " pod="openshift-image-registry/node-ca-vhwkk" May 20 21:48:19.704313 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.703597 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/adaf6994-2a90-4542-a2e5-2e415a29094b-host-var-lib-cni-bin\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.704313 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.703622 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-run-ovn\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.704313 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.703649 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-host-cni-bin\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.704313 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.703674 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b5bc4f12-7530-4f15-9365-5c88a796caf6-etc-modprobe-d\") pod \"tuned-rg5q8\" (UID: \"b5bc4f12-7530-4f15-9365-5c88a796caf6\") " pod="openshift-cluster-node-tuning-operator/tuned-rg5q8" May 20 21:48:19.704313 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.703700 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9nhgp\" (UniqueName: \"kubernetes.io/projected/b5bc4f12-7530-4f15-9365-5c88a796caf6-kube-api-access-9nhgp\") pod \"tuned-rg5q8\" (UID: \"b5bc4f12-7530-4f15-9365-5c88a796caf6\") " pod="openshift-cluster-node-tuning-operator/tuned-rg5q8" May 20 21:48:19.704313 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.703725 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/872c529b-f04d-4f44-be10-283c11ff49e0-metrics-certs\") pod \"network-metrics-daemon-6wbvb\" (UID: \"872c529b-f04d-4f44-be10-283c11ff49e0\") " pod="openshift-multus/network-metrics-daemon-6wbvb" May 20 21:48:19.704313 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.703751 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/adaf6994-2a90-4542-a2e5-2e415a29094b-cnibin\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.704313 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.703791 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/adaf6994-2a90-4542-a2e5-2e415a29094b-cni-binary-copy\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.704313 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.703878 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/585dc410-8720-4e83-926c-486addf85ada-cni-binary-copy\") pod \"multus-additional-cni-plugins-g76b4\" (UID: \"585dc410-8720-4e83-926c-486addf85ada\") " pod="openshift-multus/multus-additional-cni-plugins-g76b4" May 20 21:48:19.704313 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.703890 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/34b2cd4e-11b6-4278-8c16-9241eebd6cef-konnectivity-ca\") pod \"konnectivity-agent-q2tcg\" (UID: \"34b2cd4e-11b6-4278-8c16-9241eebd6cef\") " pod="kube-system/konnectivity-agent-q2tcg" May 20 21:48:19.704313 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.703996 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/585dc410-8720-4e83-926c-486addf85ada-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g76b4\" (UID: \"585dc410-8720-4e83-926c-486addf85ada\") " pod="openshift-multus/multus-additional-cni-plugins-g76b4" May 20 21:48:19.704313 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.704052 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-etc-openvswitch\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.704313 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:19.704063 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 21:48:19.704313 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.704123 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b7fbcb26-e155-4cf8-89ba-17e5c52f3f8c-hosts-file\") pod \"node-resolver-x5q4l\" (UID: \"b7fbcb26-e155-4cf8-89ba-17e5c52f3f8c\") " pod="openshift-dns/node-resolver-x5q4l" May 20 21:48:19.704313 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.704140 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b5bc4f12-7530-4f15-9365-5c88a796caf6-etc-modprobe-d\") pod \"tuned-rg5q8\" (UID: \"b5bc4f12-7530-4f15-9365-5c88a796caf6\") " pod="openshift-cluster-node-tuning-operator/tuned-rg5q8" May 20 21:48:19.704986 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.704215 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/adaf6994-2a90-4542-a2e5-2e415a29094b-multus-conf-dir\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.704986 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.704239 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b7fbcb26-e155-4cf8-89ba-17e5c52f3f8c-hosts-file\") pod \"node-resolver-x5q4l\" (UID: \"b7fbcb26-e155-4cf8-89ba-17e5c52f3f8c\") " pod="openshift-dns/node-resolver-x5q4l" May 20 21:48:19.704986 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:19.704250 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/872c529b-f04d-4f44-be10-283c11ff49e0-metrics-certs podName:872c529b-f04d-4f44-be10-283c11ff49e0 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:20.204217444 +0000 UTC m=+3.066638367 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/872c529b-f04d-4f44-be10-283c11ff49e0-metrics-certs") pod "network-metrics-daemon-6wbvb" (UID: "872c529b-f04d-4f44-be10-283c11ff49e0") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 21:48:19.704986 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.704344 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfs9f\" (UniqueName: \"kubernetes.io/projected/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-kube-api-access-bfs9f\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.704986 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.704385 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b5bc4f12-7530-4f15-9365-5c88a796caf6-sys\") pod \"tuned-rg5q8\" (UID: \"b5bc4f12-7530-4f15-9365-5c88a796caf6\") " pod="openshift-cluster-node-tuning-operator/tuned-rg5q8" May 20 21:48:19.704986 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.704412 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rwmhx\" (UniqueName: \"kubernetes.io/projected/b7fbcb26-e155-4cf8-89ba-17e5c52f3f8c-kube-api-access-rwmhx\") pod \"node-resolver-x5q4l\" (UID: \"b7fbcb26-e155-4cf8-89ba-17e5c52f3f8c\") " pod="openshift-dns/node-resolver-x5q4l" May 20 21:48:19.704986 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.704439 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/34b2cd4e-11b6-4278-8c16-9241eebd6cef-agent-certs\") pod \"konnectivity-agent-q2tcg\" (UID: \"34b2cd4e-11b6-4278-8c16-9241eebd6cef\") " pod="kube-system/konnectivity-agent-q2tcg" May 20 21:48:19.704986 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.704451 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b5bc4f12-7530-4f15-9365-5c88a796caf6-sys\") pod \"tuned-rg5q8\" (UID: \"b5bc4f12-7530-4f15-9365-5c88a796caf6\") " pod="openshift-cluster-node-tuning-operator/tuned-rg5q8" May 20 21:48:19.704986 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.704468 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/30a53acd-d1d9-480d-885b-ebccb4ef3734-serviceca\") pod \"node-ca-vhwkk\" (UID: \"30a53acd-d1d9-480d-885b-ebccb4ef3734\") " pod="openshift-image-registry/node-ca-vhwkk" May 20 21:48:19.704986 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.704494 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9db1d15c-abcc-4519-9725-abe198e92979-iptables-alerter-script\") pod \"iptables-alerter-z8k7q\" (UID: \"9db1d15c-abcc-4519-9725-abe198e92979\") " pod="openshift-network-operator/iptables-alerter-z8k7q" May 20 21:48:19.704986 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.704517 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-env-overrides\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.704986 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.704543 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/585dc410-8720-4e83-926c-486addf85ada-os-release\") pod \"multus-additional-cni-plugins-g76b4\" (UID: \"585dc410-8720-4e83-926c-486addf85ada\") " pod="openshift-multus/multus-additional-cni-plugins-g76b4" May 20 21:48:19.704986 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.704571 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdq2d\" (UniqueName: \"kubernetes.io/projected/b65cd3c8-efd2-4553-99d9-2afbaa703796-kube-api-access-fdq2d\") pod \"network-check-target-qlq8p\" (UID: \"b65cd3c8-efd2-4553-99d9-2afbaa703796\") " pod="openshift-network-diagnostics/network-check-target-qlq8p" May 20 21:48:19.704986 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.704594 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-host-slash\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.704986 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.704624 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-var-lib-openvswitch\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.704986 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.704654 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-ovnkube-script-lib\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.705909 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.704680 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b5bc4f12-7530-4f15-9365-5c88a796caf6-etc-sysctl-conf\") pod \"tuned-rg5q8\" (UID: \"b5bc4f12-7530-4f15-9365-5c88a796caf6\") " pod="openshift-cluster-node-tuning-operator/tuned-rg5q8" May 20 21:48:19.705909 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.704685 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/585dc410-8720-4e83-926c-486addf85ada-os-release\") pod \"multus-additional-cni-plugins-g76b4\" (UID: \"585dc410-8720-4e83-926c-486addf85ada\") " pod="openshift-multus/multus-additional-cni-plugins-g76b4" May 20 21:48:19.705909 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.704705 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5bc4f12-7530-4f15-9365-5c88a796caf6-var-lib-kubelet\") pod \"tuned-rg5q8\" (UID: \"b5bc4f12-7530-4f15-9365-5c88a796caf6\") " pod="openshift-cluster-node-tuning-operator/tuned-rg5q8" May 20 21:48:19.705909 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.704730 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b5bc4f12-7530-4f15-9365-5c88a796caf6-etc-tuned\") pod \"tuned-rg5q8\" (UID: \"b5bc4f12-7530-4f15-9365-5c88a796caf6\") " pod="openshift-cluster-node-tuning-operator/tuned-rg5q8" May 20 21:48:19.705909 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.704785 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5bc4f12-7530-4f15-9365-5c88a796caf6-var-lib-kubelet\") pod \"tuned-rg5q8\" (UID: \"b5bc4f12-7530-4f15-9365-5c88a796caf6\") " pod="openshift-cluster-node-tuning-operator/tuned-rg5q8" May 20 21:48:19.705909 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.704820 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/24350846-e9be-481f-9301-3ebb3f081f66-socket-dir\") pod \"aws-ebs-csi-driver-node-mwn2w\" (UID: \"24350846-e9be-481f-9301-3ebb3f081f66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwn2w" May 20 21:48:19.705909 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.704846 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9db1d15c-abcc-4519-9725-abe198e92979-host-slash\") pod \"iptables-alerter-z8k7q\" (UID: \"9db1d15c-abcc-4519-9725-abe198e92979\") " pod="openshift-network-operator/iptables-alerter-z8k7q" May 20 21:48:19.705909 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.704875 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-run-openvswitch\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.705909 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.704885 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/30a53acd-d1d9-480d-885b-ebccb4ef3734-serviceca\") pod \"node-ca-vhwkk\" (UID: \"30a53acd-d1d9-480d-885b-ebccb4ef3734\") " pod="openshift-image-registry/node-ca-vhwkk" May 20 21:48:19.705909 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.704900 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7fbcb26-e155-4cf8-89ba-17e5c52f3f8c-tmp-dir\") pod \"node-resolver-x5q4l\" (UID: \"b7fbcb26-e155-4cf8-89ba-17e5c52f3f8c\") " pod="openshift-dns/node-resolver-x5q4l" May 20 21:48:19.705909 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.704847 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b5bc4f12-7530-4f15-9365-5c88a796caf6-etc-sysctl-conf\") pod \"tuned-rg5q8\" (UID: \"b5bc4f12-7530-4f15-9365-5c88a796caf6\") " pod="openshift-cluster-node-tuning-operator/tuned-rg5q8" May 20 21:48:19.705909 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.704927 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/adaf6994-2a90-4542-a2e5-2e415a29094b-multus-daemon-config\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.705909 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.704954 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gphwq\" (UniqueName: \"kubernetes.io/projected/adaf6994-2a90-4542-a2e5-2e415a29094b-kube-api-access-gphwq\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.705909 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.704953 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/24350846-e9be-481f-9301-3ebb3f081f66-socket-dir\") pod \"aws-ebs-csi-driver-node-mwn2w\" (UID: \"24350846-e9be-481f-9301-3ebb3f081f66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwn2w" May 20 21:48:19.705909 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.704979 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-host-cni-netd\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.705909 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.705017 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/585dc410-8720-4e83-926c-486addf85ada-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g76b4\" (UID: \"585dc410-8720-4e83-926c-486addf85ada\") " pod="openshift-multus/multus-additional-cni-plugins-g76b4" May 20 21:48:19.705909 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.705104 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b5bc4f12-7530-4f15-9365-5c88a796caf6-etc-sysctl-d\") pod \"tuned-rg5q8\" (UID: \"b5bc4f12-7530-4f15-9365-5c88a796caf6\") " pod="openshift-cluster-node-tuning-operator/tuned-rg5q8" May 20 21:48:19.706786 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.705124 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/adaf6994-2a90-4542-a2e5-2e415a29094b-multus-cni-dir\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.706786 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.705147 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/adaf6994-2a90-4542-a2e5-2e415a29094b-host-run-k8s-cni-cncf-io\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.706786 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.705153 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/585dc410-8720-4e83-926c-486addf85ada-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g76b4\" (UID: \"585dc410-8720-4e83-926c-486addf85ada\") " pod="openshift-multus/multus-additional-cni-plugins-g76b4" May 20 21:48:19.706786 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.705179 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7fbcb26-e155-4cf8-89ba-17e5c52f3f8c-tmp-dir\") pod \"node-resolver-x5q4l\" (UID: \"b7fbcb26-e155-4cf8-89ba-17e5c52f3f8c\") " pod="openshift-dns/node-resolver-x5q4l" May 20 21:48:19.706786 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.705187 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/24350846-e9be-481f-9301-3ebb3f081f66-registration-dir\") pod \"aws-ebs-csi-driver-node-mwn2w\" (UID: \"24350846-e9be-481f-9301-3ebb3f081f66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwn2w" May 20 21:48:19.706786 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.705218 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9252b\" (UniqueName: \"kubernetes.io/projected/24350846-e9be-481f-9301-3ebb3f081f66-kube-api-access-9252b\") pod \"aws-ebs-csi-driver-node-mwn2w\" (UID: \"24350846-e9be-481f-9301-3ebb3f081f66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwn2w" May 20 21:48:19.706786 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.705257 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b5bc4f12-7530-4f15-9365-5c88a796caf6-etc-sysctl-d\") pod \"tuned-rg5q8\" (UID: \"b5bc4f12-7530-4f15-9365-5c88a796caf6\") " pod="openshift-cluster-node-tuning-operator/tuned-rg5q8" May 20 21:48:19.706786 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.705271 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/adaf6994-2a90-4542-a2e5-2e415a29094b-host-var-lib-cni-multus\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.706786 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.705275 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/24350846-e9be-481f-9301-3ebb3f081f66-registration-dir\") pod \"aws-ebs-csi-driver-node-mwn2w\" (UID: \"24350846-e9be-481f-9301-3ebb3f081f66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwn2w" May 20 21:48:19.706786 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.705302 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/585dc410-8720-4e83-926c-486addf85ada-cnibin\") pod \"multus-additional-cni-plugins-g76b4\" (UID: \"585dc410-8720-4e83-926c-486addf85ada\") " pod="openshift-multus/multus-additional-cni-plugins-g76b4" May 20 21:48:19.706786 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.705327 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/585dc410-8720-4e83-926c-486addf85ada-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g76b4\" (UID: \"585dc410-8720-4e83-926c-486addf85ada\") " pod="openshift-multus/multus-additional-cni-plugins-g76b4" May 20 21:48:19.706786 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.705350 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/585dc410-8720-4e83-926c-486addf85ada-cnibin\") pod \"multus-additional-cni-plugins-g76b4\" (UID: \"585dc410-8720-4e83-926c-486addf85ada\") " pod="openshift-multus/multus-additional-cni-plugins-g76b4" May 20 21:48:19.706786 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.705392 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b5bc4f12-7530-4f15-9365-5c88a796caf6-etc-systemd\") pod \"tuned-rg5q8\" (UID: \"b5bc4f12-7530-4f15-9365-5c88a796caf6\") " pod="openshift-cluster-node-tuning-operator/tuned-rg5q8" May 20 21:48:19.706786 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.705421 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/24350846-e9be-481f-9301-3ebb3f081f66-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mwn2w\" (UID: \"24350846-e9be-481f-9301-3ebb3f081f66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwn2w" May 20 21:48:19.706786 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.705453 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/adaf6994-2a90-4542-a2e5-2e415a29094b-os-release\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.706786 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.705479 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b5bc4f12-7530-4f15-9365-5c88a796caf6-etc-systemd\") pod \"tuned-rg5q8\" (UID: \"b5bc4f12-7530-4f15-9365-5c88a796caf6\") " pod="openshift-cluster-node-tuning-operator/tuned-rg5q8" May 20 21:48:19.706786 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.705503 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/24350846-e9be-481f-9301-3ebb3f081f66-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mwn2w\" (UID: \"24350846-e9be-481f-9301-3ebb3f081f66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwn2w" May 20 21:48:19.707535 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.705539 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/adaf6994-2a90-4542-a2e5-2e415a29094b-host-var-lib-kubelet\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.707535 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.705578 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vg6n8\" (UniqueName: \"kubernetes.io/projected/9db1d15c-abcc-4519-9725-abe198e92979-kube-api-access-vg6n8\") pod \"iptables-alerter-z8k7q\" (UID: \"9db1d15c-abcc-4519-9725-abe198e92979\") " pod="openshift-network-operator/iptables-alerter-z8k7q" May 20 21:48:19.707535 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.705605 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/24350846-e9be-481f-9301-3ebb3f081f66-device-dir\") pod \"aws-ebs-csi-driver-node-mwn2w\" (UID: \"24350846-e9be-481f-9301-3ebb3f081f66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwn2w" May 20 21:48:19.707535 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.705630 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/24350846-e9be-481f-9301-3ebb3f081f66-etc-selinux\") pod \"aws-ebs-csi-driver-node-mwn2w\" (UID: \"24350846-e9be-481f-9301-3ebb3f081f66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwn2w" May 20 21:48:19.707535 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.705658 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-run-systemd\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.707535 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.705672 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/24350846-e9be-481f-9301-3ebb3f081f66-device-dir\") pod \"aws-ebs-csi-driver-node-mwn2w\" (UID: \"24350846-e9be-481f-9301-3ebb3f081f66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwn2w" May 20 21:48:19.707535 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.705684 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-log-socket\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.707535 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.705713 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-host-run-ovn-kubernetes\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.707535 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.705738 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-ovn-node-metrics-cert\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.707535 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.705743 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/24350846-e9be-481f-9301-3ebb3f081f66-etc-selinux\") pod \"aws-ebs-csi-driver-node-mwn2w\" (UID: \"24350846-e9be-481f-9301-3ebb3f081f66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwn2w" May 20 21:48:19.707535 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.705770 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/adaf6994-2a90-4542-a2e5-2e415a29094b-system-cni-dir\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.707535 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.705794 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/adaf6994-2a90-4542-a2e5-2e415a29094b-etc-kubernetes\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.707535 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.705818 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-systemd-units\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.707535 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.705843 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-ovnkube-config\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.707535 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.705872 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b5bc4f12-7530-4f15-9365-5c88a796caf6-lib-modules\") pod \"tuned-rg5q8\" (UID: \"b5bc4f12-7530-4f15-9365-5c88a796caf6\") " pod="openshift-cluster-node-tuning-operator/tuned-rg5q8" May 20 21:48:19.707535 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.705880 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/585dc410-8720-4e83-926c-486addf85ada-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g76b4\" (UID: \"585dc410-8720-4e83-926c-486addf85ada\") " pod="openshift-multus/multus-additional-cni-plugins-g76b4" May 20 21:48:19.707535 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.705897 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/24350846-e9be-481f-9301-3ebb3f081f66-sys-fs\") pod \"aws-ebs-csi-driver-node-mwn2w\" (UID: \"24350846-e9be-481f-9301-3ebb3f081f66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwn2w" May 20 21:48:19.708131 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.705963 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b5bc4f12-7530-4f15-9365-5c88a796caf6-lib-modules\") pod \"tuned-rg5q8\" (UID: \"b5bc4f12-7530-4f15-9365-5c88a796caf6\") " pod="openshift-cluster-node-tuning-operator/tuned-rg5q8" May 20 21:48:19.708131 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.706024 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/24350846-e9be-481f-9301-3ebb3f081f66-sys-fs\") pod \"aws-ebs-csi-driver-node-mwn2w\" (UID: \"24350846-e9be-481f-9301-3ebb3f081f66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwn2w" May 20 21:48:19.708131 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.707735 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5bc4f12-7530-4f15-9365-5c88a796caf6-tmp\") pod \"tuned-rg5q8\" (UID: \"b5bc4f12-7530-4f15-9365-5c88a796caf6\") " pod="openshift-cluster-node-tuning-operator/tuned-rg5q8" May 20 21:48:19.708131 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.707822 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/34b2cd4e-11b6-4278-8c16-9241eebd6cef-agent-certs\") pod \"konnectivity-agent-q2tcg\" (UID: \"34b2cd4e-11b6-4278-8c16-9241eebd6cef\") " pod="kube-system/konnectivity-agent-q2tcg" May 20 21:48:19.708131 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.708095 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b5bc4f12-7530-4f15-9365-5c88a796caf6-etc-tuned\") pod \"tuned-rg5q8\" (UID: \"b5bc4f12-7530-4f15-9365-5c88a796caf6\") " pod="openshift-cluster-node-tuning-operator/tuned-rg5q8" May 20 21:48:19.714989 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.714895 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5hkf\" (UniqueName: \"kubernetes.io/projected/872c529b-f04d-4f44-be10-283c11ff49e0-kube-api-access-x5hkf\") pod \"network-metrics-daemon-6wbvb\" (UID: \"872c529b-f04d-4f44-be10-283c11ff49e0\") " pod="openshift-multus/network-metrics-daemon-6wbvb" May 20 21:48:19.715433 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.715405 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stv7d\" (UniqueName: \"kubernetes.io/projected/30a53acd-d1d9-480d-885b-ebccb4ef3734-kube-api-access-stv7d\") pod \"node-ca-vhwkk\" (UID: \"30a53acd-d1d9-480d-885b-ebccb4ef3734\") " pod="openshift-image-registry/node-ca-vhwkk" May 20 21:48:19.715538 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.714939 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nhgp\" (UniqueName: \"kubernetes.io/projected/b5bc4f12-7530-4f15-9365-5c88a796caf6-kube-api-access-9nhgp\") pod \"tuned-rg5q8\" (UID: \"b5bc4f12-7530-4f15-9365-5c88a796caf6\") " pod="openshift-cluster-node-tuning-operator/tuned-rg5q8" May 20 21:48:19.715817 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.715786 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwmhx\" (UniqueName: \"kubernetes.io/projected/b7fbcb26-e155-4cf8-89ba-17e5c52f3f8c-kube-api-access-rwmhx\") pod \"node-resolver-x5q4l\" (UID: \"b7fbcb26-e155-4cf8-89ba-17e5c52f3f8c\") " pod="openshift-dns/node-resolver-x5q4l" May 20 21:48:19.716070 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.716040 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9252b\" (UniqueName: \"kubernetes.io/projected/24350846-e9be-481f-9301-3ebb3f081f66-kube-api-access-9252b\") pod \"aws-ebs-csi-driver-node-mwn2w\" (UID: \"24350846-e9be-481f-9301-3ebb3f081f66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwn2w" May 20 21:48:19.716070 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.716114 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9r29\" (UniqueName: \"kubernetes.io/projected/585dc410-8720-4e83-926c-486addf85ada-kube-api-access-p9r29\") pod \"multus-additional-cni-plugins-g76b4\" (UID: \"585dc410-8720-4e83-926c-486addf85ada\") " pod="openshift-multus/multus-additional-cni-plugins-g76b4" May 20 21:48:19.807091 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807047 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/adaf6994-2a90-4542-a2e5-2e415a29094b-host-var-lib-cni-multus\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.807277 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807109 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/adaf6994-2a90-4542-a2e5-2e415a29094b-os-release\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.807277 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807133 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/adaf6994-2a90-4542-a2e5-2e415a29094b-host-var-lib-kubelet\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.807277 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807154 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vg6n8\" (UniqueName: \"kubernetes.io/projected/9db1d15c-abcc-4519-9725-abe198e92979-kube-api-access-vg6n8\") pod \"iptables-alerter-z8k7q\" (UID: \"9db1d15c-abcc-4519-9725-abe198e92979\") " pod="openshift-network-operator/iptables-alerter-z8k7q" May 20 21:48:19.807277 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807177 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-run-systemd\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.807277 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807182 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/adaf6994-2a90-4542-a2e5-2e415a29094b-host-var-lib-cni-multus\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.807277 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807201 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-log-socket\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.807277 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807226 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-host-run-ovn-kubernetes\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.807277 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807232 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/adaf6994-2a90-4542-a2e5-2e415a29094b-host-var-lib-kubelet\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.807277 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807250 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-ovn-node-metrics-cert\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.807277 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807269 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-run-systemd\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.807719 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807282 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-log-socket\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.807719 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807275 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/adaf6994-2a90-4542-a2e5-2e415a29094b-system-cni-dir\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.807719 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807323 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-host-run-ovn-kubernetes\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.807719 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807324 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/adaf6994-2a90-4542-a2e5-2e415a29094b-system-cni-dir\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.807719 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807337 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/adaf6994-2a90-4542-a2e5-2e415a29094b-etc-kubernetes\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.807719 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807368 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-systemd-units\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.807719 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807395 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-ovnkube-config\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.807719 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807426 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-host-kubelet\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.807719 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807446 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/adaf6994-2a90-4542-a2e5-2e415a29094b-os-release\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.807719 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807451 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-node-log\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.807719 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807482 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/adaf6994-2a90-4542-a2e5-2e415a29094b-multus-socket-dir-parent\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.807719 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807398 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-systemd-units\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.807719 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807371 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/adaf6994-2a90-4542-a2e5-2e415a29094b-etc-kubernetes\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.807719 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807540 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/adaf6994-2a90-4542-a2e5-2e415a29094b-host-run-netns\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.807719 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807550 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-host-kubelet\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.807719 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807551 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-node-log\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.807719 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807572 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/adaf6994-2a90-4542-a2e5-2e415a29094b-host-run-multus-certs\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.807719 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807602 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/adaf6994-2a90-4542-a2e5-2e415a29094b-hostroot\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.808519 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807616 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/adaf6994-2a90-4542-a2e5-2e415a29094b-multus-socket-dir-parent\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.808519 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807621 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/adaf6994-2a90-4542-a2e5-2e415a29094b-host-run-netns\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.808519 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807628 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-host-run-netns\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.808519 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807661 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/adaf6994-2a90-4542-a2e5-2e415a29094b-hostroot\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.808519 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807667 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-host-run-netns\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.808519 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807675 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/adaf6994-2a90-4542-a2e5-2e415a29094b-host-run-multus-certs\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.808519 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807678 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.808519 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807715 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.808519 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807730 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/adaf6994-2a90-4542-a2e5-2e415a29094b-host-var-lib-cni-bin\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.808519 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807759 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-run-ovn\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.808519 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807786 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-host-cni-bin\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.808519 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807794 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-run-ovn\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.808519 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807821 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-host-cni-bin\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.808519 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807835 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/adaf6994-2a90-4542-a2e5-2e415a29094b-cnibin\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.808519 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807762 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/adaf6994-2a90-4542-a2e5-2e415a29094b-host-var-lib-cni-bin\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.808519 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807859 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/adaf6994-2a90-4542-a2e5-2e415a29094b-cni-binary-copy\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.808519 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807881 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/adaf6994-2a90-4542-a2e5-2e415a29094b-cnibin\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.808519 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807903 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-etc-openvswitch\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.809236 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807931 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/adaf6994-2a90-4542-a2e5-2e415a29094b-multus-conf-dir\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.809236 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807956 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bfs9f\" (UniqueName: \"kubernetes.io/projected/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-kube-api-access-bfs9f\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.809236 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807986 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9db1d15c-abcc-4519-9725-abe198e92979-iptables-alerter-script\") pod \"iptables-alerter-z8k7q\" (UID: \"9db1d15c-abcc-4519-9725-abe198e92979\") " pod="openshift-network-operator/iptables-alerter-z8k7q" May 20 21:48:19.809236 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.808003 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-ovnkube-config\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.809236 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.808011 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-env-overrides\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.809236 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.808002 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/adaf6994-2a90-4542-a2e5-2e415a29094b-multus-conf-dir\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.809236 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.807987 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-etc-openvswitch\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.809236 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.808038 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fdq2d\" (UniqueName: \"kubernetes.io/projected/b65cd3c8-efd2-4553-99d9-2afbaa703796-kube-api-access-fdq2d\") pod \"network-check-target-qlq8p\" (UID: \"b65cd3c8-efd2-4553-99d9-2afbaa703796\") " pod="openshift-network-diagnostics/network-check-target-qlq8p" May 20 21:48:19.809236 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.808064 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-host-slash\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.809236 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.808102 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-var-lib-openvswitch\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.809236 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.808146 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-var-lib-openvswitch\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.809236 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.808187 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-host-slash\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.809236 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.808245 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-ovnkube-script-lib\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.809236 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.808284 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9db1d15c-abcc-4519-9725-abe198e92979-host-slash\") pod \"iptables-alerter-z8k7q\" (UID: \"9db1d15c-abcc-4519-9725-abe198e92979\") " pod="openshift-network-operator/iptables-alerter-z8k7q" May 20 21:48:19.809236 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.808310 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-run-openvswitch\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.809236 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.808335 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/adaf6994-2a90-4542-a2e5-2e415a29094b-multus-daemon-config\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.809236 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.808368 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gphwq\" (UniqueName: \"kubernetes.io/projected/adaf6994-2a90-4542-a2e5-2e415a29094b-kube-api-access-gphwq\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.809944 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.808377 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-run-openvswitch\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.809944 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.808393 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-host-cni-netd\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.809944 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.808419 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9db1d15c-abcc-4519-9725-abe198e92979-host-slash\") pod \"iptables-alerter-z8k7q\" (UID: \"9db1d15c-abcc-4519-9725-abe198e92979\") " pod="openshift-network-operator/iptables-alerter-z8k7q" May 20 21:48:19.809944 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.808423 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/adaf6994-2a90-4542-a2e5-2e415a29094b-multus-cni-dir\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.809944 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.808436 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-env-overrides\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.809944 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.808452 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/adaf6994-2a90-4542-a2e5-2e415a29094b-host-run-k8s-cni-cncf-io\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.809944 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.808477 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/adaf6994-2a90-4542-a2e5-2e415a29094b-multus-cni-dir\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.809944 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.808496 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/adaf6994-2a90-4542-a2e5-2e415a29094b-host-run-k8s-cni-cncf-io\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.809944 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.808516 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-host-cni-netd\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.809944 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.809034 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/adaf6994-2a90-4542-a2e5-2e415a29094b-multus-daemon-config\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.809944 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.809049 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/adaf6994-2a90-4542-a2e5-2e415a29094b-cni-binary-copy\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.809944 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.809055 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9db1d15c-abcc-4519-9725-abe198e92979-iptables-alerter-script\") pod \"iptables-alerter-z8k7q\" (UID: \"9db1d15c-abcc-4519-9725-abe198e92979\") " pod="openshift-network-operator/iptables-alerter-z8k7q" May 20 21:48:19.809944 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.809259 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-ovnkube-script-lib\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.809944 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.809947 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-ovn-node-metrics-cert\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.823498 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:19.823471 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 21:48:19.823498 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:19.823500 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 21:48:19.823689 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:19.823511 2581 projected.go:194] Error preparing data for projected volume kube-api-access-fdq2d for pod openshift-network-diagnostics/network-check-target-qlq8p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 21:48:19.823689 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:19.823579 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b65cd3c8-efd2-4553-99d9-2afbaa703796-kube-api-access-fdq2d podName:b65cd3c8-efd2-4553-99d9-2afbaa703796 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:20.323559312 +0000 UTC m=+3.185980239 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fdq2d" (UniqueName: "kubernetes.io/projected/b65cd3c8-efd2-4553-99d9-2afbaa703796-kube-api-access-fdq2d") pod "network-check-target-qlq8p" (UID: "b65cd3c8-efd2-4553-99d9-2afbaa703796") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 21:48:19.826133 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.826103 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfs9f\" (UniqueName: \"kubernetes.io/projected/8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a-kube-api-access-bfs9f\") pod \"ovnkube-node-jgks5\" (UID: \"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:19.826881 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.826432 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gphwq\" (UniqueName: \"kubernetes.io/projected/adaf6994-2a90-4542-a2e5-2e415a29094b-kube-api-access-gphwq\") pod \"multus-tjnqv\" (UID: \"adaf6994-2a90-4542-a2e5-2e415a29094b\") " pod="openshift-multus/multus-tjnqv" May 20 21:48:19.826881 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.826838 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vg6n8\" (UniqueName: \"kubernetes.io/projected/9db1d15c-abcc-4519-9725-abe198e92979-kube-api-access-vg6n8\") pod \"iptables-alerter-z8k7q\" (UID: \"9db1d15c-abcc-4519-9725-abe198e92979\") " pod="openshift-network-operator/iptables-alerter-z8k7q" May 20 21:48:19.895944 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.895900 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g76b4" May 20 21:48:19.904792 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.904764 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwn2w" May 20 21:48:19.912624 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.912596 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rg5q8" May 20 21:48:19.917175 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.917155 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x5q4l" May 20 21:48:19.923818 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.923797 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-q2tcg" May 20 21:48:19.931153 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.931133 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vhwkk" May 20 21:48:19.937735 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.937714 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tjnqv" May 20 21:48:19.945250 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.945195 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z8k7q" May 20 21:48:19.950455 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:19.950436 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:20.186915 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:20.186887 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34b2cd4e_11b6_4278_8c16_9241eebd6cef.slice/crio-55e271b95e864afac9bc0ff8a2794080cd2522fc2255b60e5b33559bd923f633 WatchSource:0}: Error finding container 55e271b95e864afac9bc0ff8a2794080cd2522fc2255b60e5b33559bd923f633: Status 404 returned error can't find the container with id 55e271b95e864afac9bc0ff8a2794080cd2522fc2255b60e5b33559bd923f633 May 20 21:48:20.187942 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:20.187915 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5bc4f12_7530_4f15_9365_5c88a796caf6.slice/crio-2b8c19d8d0d92914f88a7efe8991520573844638c461d98db656335378046fdf WatchSource:0}: Error finding container 2b8c19d8d0d92914f88a7efe8991520573844638c461d98db656335378046fdf: Status 404 returned error can't find the container with id 2b8c19d8d0d92914f88a7efe8991520573844638c461d98db656335378046fdf May 20 21:48:20.190310 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:20.190289 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bfe6a9d_ec12_4bb0_8b48_d409d2044e3a.slice/crio-f302bcd17897185976e30a0b47b65e75b9fdf8ddba377738175e0446189ff231 WatchSource:0}: Error finding container f302bcd17897185976e30a0b47b65e75b9fdf8ddba377738175e0446189ff231: Status 404 returned error can't find the container with id f302bcd17897185976e30a0b47b65e75b9fdf8ddba377738175e0446189ff231 May 20 21:48:20.192176 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:20.192160 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7fbcb26_e155_4cf8_89ba_17e5c52f3f8c.slice/crio-243f7dc23d97b228fe99d4fdb1388294a9a4cecd8336aa896a3ab2c90fbc046a WatchSource:0}: Error finding container 243f7dc23d97b228fe99d4fdb1388294a9a4cecd8336aa896a3ab2c90fbc046a: Status 404 returned error can't find the container with id 243f7dc23d97b228fe99d4fdb1388294a9a4cecd8336aa896a3ab2c90fbc046a May 20 21:48:20.193361 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:20.193321 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30a53acd_d1d9_480d_885b_ebccb4ef3734.slice/crio-e922f2e6266b7ece900db49734009f296a81031301a7d9592f28094c60d51b8d WatchSource:0}: Error finding container e922f2e6266b7ece900db49734009f296a81031301a7d9592f28094c60d51b8d: Status 404 returned error can't find the container with id e922f2e6266b7ece900db49734009f296a81031301a7d9592f28094c60d51b8d May 20 21:48:20.193901 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:20.193879 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod585dc410_8720_4e83_926c_486addf85ada.slice/crio-24a8f5404f0584a25e83a3e13e160441d83ede4c24d30b21071f5c8a9286ea37 WatchSource:0}: Error finding container 24a8f5404f0584a25e83a3e13e160441d83ede4c24d30b21071f5c8a9286ea37: Status 404 returned error can't find the container with id 24a8f5404f0584a25e83a3e13e160441d83ede4c24d30b21071f5c8a9286ea37 May 20 21:48:20.195471 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:20.195405 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadaf6994_2a90_4542_a2e5_2e415a29094b.slice/crio-e82739f71fe219ec079802c5e52241529cd357d75381d9b5455602586f2bad98 WatchSource:0}: Error finding container e82739f71fe219ec079802c5e52241529cd357d75381d9b5455602586f2bad98: Status 404 returned error can't find the container with id e82739f71fe219ec079802c5e52241529cd357d75381d9b5455602586f2bad98 May 20 21:48:20.198447 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:20.196528 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9db1d15c_abcc_4519_9725_abe198e92979.slice/crio-3a697ffb30095475c2ef3f09dd63a722fac2642df524bcec0a2d0d350fd633bb WatchSource:0}: Error finding container 3a697ffb30095475c2ef3f09dd63a722fac2642df524bcec0a2d0d350fd633bb: Status 404 returned error can't find the container with id 3a697ffb30095475c2ef3f09dd63a722fac2642df524bcec0a2d0d350fd633bb May 20 21:48:20.200401 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:48:20.200377 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24350846_e9be_481f_9301_3ebb3f081f66.slice/crio-de02f5fc941eab93adfd8c3f966dfd620392b84851f9aa1bfd3fac4dc68f29b6 WatchSource:0}: Error finding container de02f5fc941eab93adfd8c3f966dfd620392b84851f9aa1bfd3fac4dc68f29b6: Status 404 returned error can't find the container with id de02f5fc941eab93adfd8c3f966dfd620392b84851f9aa1bfd3fac4dc68f29b6 May 20 21:48:20.211891 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:20.211870 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/872c529b-f04d-4f44-be10-283c11ff49e0-metrics-certs\") pod \"network-metrics-daemon-6wbvb\" (UID: \"872c529b-f04d-4f44-be10-283c11ff49e0\") " pod="openshift-multus/network-metrics-daemon-6wbvb" May 20 21:48:20.211996 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:20.211983 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 21:48:20.212054 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:20.212032 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/872c529b-f04d-4f44-be10-283c11ff49e0-metrics-certs podName:872c529b-f04d-4f44-be10-283c11ff49e0 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:21.212018291 +0000 UTC m=+4.074439199 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/872c529b-f04d-4f44-be10-283c11ff49e0-metrics-certs") pod "network-metrics-daemon-6wbvb" (UID: "872c529b-f04d-4f44-be10-283c11ff49e0") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 21:48:20.413601 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:20.413394 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fdq2d\" (UniqueName: \"kubernetes.io/projected/b65cd3c8-efd2-4553-99d9-2afbaa703796-kube-api-access-fdq2d\") pod \"network-check-target-qlq8p\" (UID: \"b65cd3c8-efd2-4553-99d9-2afbaa703796\") " pod="openshift-network-diagnostics/network-check-target-qlq8p" May 20 21:48:20.413806 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:20.413532 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 21:48:20.413806 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:20.413658 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 21:48:20.413806 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:20.413673 2581 projected.go:194] Error preparing data for projected volume kube-api-access-fdq2d for pod openshift-network-diagnostics/network-check-target-qlq8p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 21:48:20.413806 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:20.413735 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b65cd3c8-efd2-4553-99d9-2afbaa703796-kube-api-access-fdq2d podName:b65cd3c8-efd2-4553-99d9-2afbaa703796 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:21.413716743 +0000 UTC m=+4.276137657 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fdq2d" (UniqueName: "kubernetes.io/projected/b65cd3c8-efd2-4553-99d9-2afbaa703796-kube-api-access-fdq2d") pod "network-check-target-qlq8p" (UID: "b65cd3c8-efd2-4553-99d9-2afbaa703796") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 21:48:20.633868 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:20.633817 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-19 21:43:18 +0000 UTC" deadline="2028-01-10 09:06:37.243106306 +0000 UTC" May 20 21:48:20.633868 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:20.633866 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14387h18m16.609243581s" May 20 21:48:20.768568 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:20.768493 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlq8p" May 20 21:48:20.768730 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:20.768610 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlq8p" podUID="b65cd3c8-efd2-4553-99d9-2afbaa703796" May 20 21:48:20.788259 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:20.788186 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z8k7q" event={"ID":"9db1d15c-abcc-4519-9725-abe198e92979","Type":"ContainerStarted","Data":"3a697ffb30095475c2ef3f09dd63a722fac2642df524bcec0a2d0d350fd633bb"} May 20 21:48:20.794070 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:20.793998 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g76b4" event={"ID":"585dc410-8720-4e83-926c-486addf85ada","Type":"ContainerStarted","Data":"24a8f5404f0584a25e83a3e13e160441d83ede4c24d30b21071f5c8a9286ea37"} May 20 21:48:20.798684 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:20.798643 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" event={"ID":"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a","Type":"ContainerStarted","Data":"f302bcd17897185976e30a0b47b65e75b9fdf8ddba377738175e0446189ff231"} May 20 21:48:20.803937 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:20.803876 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rg5q8" event={"ID":"b5bc4f12-7530-4f15-9365-5c88a796caf6","Type":"ContainerStarted","Data":"2b8c19d8d0d92914f88a7efe8991520573844638c461d98db656335378046fdf"} May 20 21:48:20.806758 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:20.806728 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-q2tcg" event={"ID":"34b2cd4e-11b6-4278-8c16-9241eebd6cef","Type":"ContainerStarted","Data":"55e271b95e864afac9bc0ff8a2794080cd2522fc2255b60e5b33559bd923f633"} May 20 21:48:20.809613 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:20.809586 2581 generic.go:358] "Generic (PLEG): container finished" podID="8d590ec180b8c090f18a7ca8bc0c5fe9" containerID="65f98b4d2c414a19b1f7b5ebfeaef62f68a4bb57405a8cf4cfd7563538844967" exitCode=0 May 20 21:48:20.809730 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:20.809656 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-137.ec2.internal" event={"ID":"8d590ec180b8c090f18a7ca8bc0c5fe9","Type":"ContainerDied","Data":"65f98b4d2c414a19b1f7b5ebfeaef62f68a4bb57405a8cf4cfd7563538844967"} May 20 21:48:20.813840 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:20.813812 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-137.ec2.internal" event={"ID":"9bbe3a098905df03db04c6508916d305","Type":"ContainerStarted","Data":"d70290add00c737bb8d97320eca15024df0fd1eb83b97bc951145fd4d7858f01"} May 20 21:48:20.829533 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:20.829501 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tjnqv" event={"ID":"adaf6994-2a90-4542-a2e5-2e415a29094b","Type":"ContainerStarted","Data":"e82739f71fe219ec079802c5e52241529cd357d75381d9b5455602586f2bad98"} May 20 21:48:20.835433 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:20.835375 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-137.ec2.internal" podStartSLOduration=2.835358593 podStartE2EDuration="2.835358593s" podCreationTimestamp="2026-05-20 21:48:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 21:48:20.835316608 +0000 UTC m=+3.697737539" watchObservedRunningTime="2026-05-20 21:48:20.835358593 +0000 UTC m=+3.697779525" May 20 21:48:20.846528 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:20.846497 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vhwkk" event={"ID":"30a53acd-d1d9-480d-885b-ebccb4ef3734","Type":"ContainerStarted","Data":"e922f2e6266b7ece900db49734009f296a81031301a7d9592f28094c60d51b8d"} May 20 21:48:20.860543 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:20.860510 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x5q4l" event={"ID":"b7fbcb26-e155-4cf8-89ba-17e5c52f3f8c","Type":"ContainerStarted","Data":"243f7dc23d97b228fe99d4fdb1388294a9a4cecd8336aa896a3ab2c90fbc046a"} May 20 21:48:20.874996 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:20.874914 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwn2w" event={"ID":"24350846-e9be-481f-9301-3ebb3f081f66","Type":"ContainerStarted","Data":"de02f5fc941eab93adfd8c3f966dfd620392b84851f9aa1bfd3fac4dc68f29b6"} May 20 21:48:21.221585 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:21.221538 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/872c529b-f04d-4f44-be10-283c11ff49e0-metrics-certs\") pod \"network-metrics-daemon-6wbvb\" (UID: \"872c529b-f04d-4f44-be10-283c11ff49e0\") " pod="openshift-multus/network-metrics-daemon-6wbvb" May 20 21:48:21.221747 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:21.221723 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 21:48:21.221819 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:21.221788 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/872c529b-f04d-4f44-be10-283c11ff49e0-metrics-certs podName:872c529b-f04d-4f44-be10-283c11ff49e0 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:23.221769195 +0000 UTC m=+6.084190122 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/872c529b-f04d-4f44-be10-283c11ff49e0-metrics-certs") pod "network-metrics-daemon-6wbvb" (UID: "872c529b-f04d-4f44-be10-283c11ff49e0") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 21:48:21.423021 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:21.422980 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fdq2d\" (UniqueName: \"kubernetes.io/projected/b65cd3c8-efd2-4553-99d9-2afbaa703796-kube-api-access-fdq2d\") pod \"network-check-target-qlq8p\" (UID: \"b65cd3c8-efd2-4553-99d9-2afbaa703796\") " pod="openshift-network-diagnostics/network-check-target-qlq8p" May 20 21:48:21.423225 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:21.423210 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 21:48:21.423291 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:21.423230 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 21:48:21.423291 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:21.423244 2581 projected.go:194] Error preparing data for projected volume kube-api-access-fdq2d for pod openshift-network-diagnostics/network-check-target-qlq8p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 21:48:21.423391 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:21.423301 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b65cd3c8-efd2-4553-99d9-2afbaa703796-kube-api-access-fdq2d podName:b65cd3c8-efd2-4553-99d9-2afbaa703796 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:23.423283621 +0000 UTC m=+6.285704543 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fdq2d" (UniqueName: "kubernetes.io/projected/b65cd3c8-efd2-4553-99d9-2afbaa703796-kube-api-access-fdq2d") pod "network-check-target-qlq8p" (UID: "b65cd3c8-efd2-4553-99d9-2afbaa703796") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 21:48:21.769861 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:21.769264 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wbvb" May 20 21:48:21.769861 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:21.769404 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wbvb" podUID="872c529b-f04d-4f44-be10-283c11ff49e0" May 20 21:48:21.891049 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:21.890990 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-137.ec2.internal" event={"ID":"8d590ec180b8c090f18a7ca8bc0c5fe9","Type":"ContainerStarted","Data":"275d6e6e1a0718f435bb5e0b8ef68fdffae4d7776199a122944a39758d76c2c9"} May 20 21:48:21.904828 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:21.904775 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-137.ec2.internal" podStartSLOduration=3.904757503 podStartE2EDuration="3.904757503s" podCreationTimestamp="2026-05-20 21:48:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 21:48:21.904650729 +0000 UTC m=+4.767071660" watchObservedRunningTime="2026-05-20 21:48:21.904757503 +0000 UTC m=+4.767178434" May 20 21:48:22.768717 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:22.768686 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlq8p" May 20 21:48:22.768913 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:22.768813 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlq8p" podUID="b65cd3c8-efd2-4553-99d9-2afbaa703796" May 20 21:48:23.241520 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:23.241447 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/872c529b-f04d-4f44-be10-283c11ff49e0-metrics-certs\") pod \"network-metrics-daemon-6wbvb\" (UID: \"872c529b-f04d-4f44-be10-283c11ff49e0\") " pod="openshift-multus/network-metrics-daemon-6wbvb" May 20 21:48:23.241964 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:23.241622 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 21:48:23.241964 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:23.241702 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/872c529b-f04d-4f44-be10-283c11ff49e0-metrics-certs podName:872c529b-f04d-4f44-be10-283c11ff49e0 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:27.241681126 +0000 UTC m=+10.104102055 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/872c529b-f04d-4f44-be10-283c11ff49e0-metrics-certs") pod "network-metrics-daemon-6wbvb" (UID: "872c529b-f04d-4f44-be10-283c11ff49e0") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 21:48:23.443874 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:23.443240 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fdq2d\" (UniqueName: \"kubernetes.io/projected/b65cd3c8-efd2-4553-99d9-2afbaa703796-kube-api-access-fdq2d\") pod \"network-check-target-qlq8p\" (UID: \"b65cd3c8-efd2-4553-99d9-2afbaa703796\") " pod="openshift-network-diagnostics/network-check-target-qlq8p" May 20 21:48:23.443874 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:23.443427 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 21:48:23.443874 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:23.443449 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 21:48:23.443874 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:23.443462 2581 projected.go:194] Error preparing data for projected volume kube-api-access-fdq2d for pod openshift-network-diagnostics/network-check-target-qlq8p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 21:48:23.443874 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:23.443522 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b65cd3c8-efd2-4553-99d9-2afbaa703796-kube-api-access-fdq2d podName:b65cd3c8-efd2-4553-99d9-2afbaa703796 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:27.443502825 +0000 UTC m=+10.305923775 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fdq2d" (UniqueName: "kubernetes.io/projected/b65cd3c8-efd2-4553-99d9-2afbaa703796-kube-api-access-fdq2d") pod "network-check-target-qlq8p" (UID: "b65cd3c8-efd2-4553-99d9-2afbaa703796") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 21:48:23.768594 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:23.767911 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wbvb" May 20 21:48:23.768594 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:23.768068 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wbvb" podUID="872c529b-f04d-4f44-be10-283c11ff49e0" May 20 21:48:24.769351 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:24.768804 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlq8p" May 20 21:48:24.769351 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:24.768944 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlq8p" podUID="b65cd3c8-efd2-4553-99d9-2afbaa703796" May 20 21:48:25.769719 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:25.769206 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wbvb" May 20 21:48:25.769719 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:25.769352 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wbvb" podUID="872c529b-f04d-4f44-be10-283c11ff49e0" May 20 21:48:26.768850 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:26.768693 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlq8p" May 20 21:48:26.768850 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:26.768831 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlq8p" podUID="b65cd3c8-efd2-4553-99d9-2afbaa703796" May 20 21:48:27.278036 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:27.277994 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/872c529b-f04d-4f44-be10-283c11ff49e0-metrics-certs\") pod \"network-metrics-daemon-6wbvb\" (UID: \"872c529b-f04d-4f44-be10-283c11ff49e0\") " pod="openshift-multus/network-metrics-daemon-6wbvb" May 20 21:48:27.278549 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:27.278187 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 21:48:27.278549 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:27.278277 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/872c529b-f04d-4f44-be10-283c11ff49e0-metrics-certs podName:872c529b-f04d-4f44-be10-283c11ff49e0 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:35.278255268 +0000 UTC m=+18.140676186 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/872c529b-f04d-4f44-be10-283c11ff49e0-metrics-certs") pod "network-metrics-daemon-6wbvb" (UID: "872c529b-f04d-4f44-be10-283c11ff49e0") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 21:48:27.479868 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:27.479699 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fdq2d\" (UniqueName: \"kubernetes.io/projected/b65cd3c8-efd2-4553-99d9-2afbaa703796-kube-api-access-fdq2d\") pod \"network-check-target-qlq8p\" (UID: \"b65cd3c8-efd2-4553-99d9-2afbaa703796\") " pod="openshift-network-diagnostics/network-check-target-qlq8p" May 20 21:48:27.480059 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:27.479875 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 21:48:27.480059 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:27.479900 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 21:48:27.480059 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:27.479913 2581 projected.go:194] Error preparing data for projected volume kube-api-access-fdq2d for pod openshift-network-diagnostics/network-check-target-qlq8p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 21:48:27.480059 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:27.479974 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b65cd3c8-efd2-4553-99d9-2afbaa703796-kube-api-access-fdq2d podName:b65cd3c8-efd2-4553-99d9-2afbaa703796 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:35.479954296 +0000 UTC m=+18.342375219 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fdq2d" (UniqueName: "kubernetes.io/projected/b65cd3c8-efd2-4553-99d9-2afbaa703796-kube-api-access-fdq2d") pod "network-check-target-qlq8p" (UID: "b65cd3c8-efd2-4553-99d9-2afbaa703796") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 21:48:27.771228 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:27.771194 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wbvb" May 20 21:48:27.771807 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:27.771429 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wbvb" podUID="872c529b-f04d-4f44-be10-283c11ff49e0" May 20 21:48:28.768486 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:28.768450 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlq8p" May 20 21:48:28.769118 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:28.768594 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlq8p" podUID="b65cd3c8-efd2-4553-99d9-2afbaa703796" May 20 21:48:29.768787 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:29.768746 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wbvb" May 20 21:48:29.769272 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:29.768901 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wbvb" podUID="872c529b-f04d-4f44-be10-283c11ff49e0" May 20 21:48:30.767773 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:30.767738 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlq8p" May 20 21:48:30.767958 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:30.767853 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlq8p" podUID="b65cd3c8-efd2-4553-99d9-2afbaa703796" May 20 21:48:31.768537 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:31.768501 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wbvb" May 20 21:48:31.768951 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:31.768629 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wbvb" podUID="872c529b-f04d-4f44-be10-283c11ff49e0" May 20 21:48:32.768594 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:32.768558 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlq8p" May 20 21:48:32.769036 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:32.768675 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlq8p" podUID="b65cd3c8-efd2-4553-99d9-2afbaa703796" May 20 21:48:33.771496 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:33.771472 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wbvb" May 20 21:48:33.771938 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:33.771586 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wbvb" podUID="872c529b-f04d-4f44-be10-283c11ff49e0" May 20 21:48:34.768761 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:34.768726 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlq8p" May 20 21:48:34.768933 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:34.768848 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlq8p" podUID="b65cd3c8-efd2-4553-99d9-2afbaa703796" May 20 21:48:35.337055 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:35.337016 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/872c529b-f04d-4f44-be10-283c11ff49e0-metrics-certs\") pod \"network-metrics-daemon-6wbvb\" (UID: \"872c529b-f04d-4f44-be10-283c11ff49e0\") " pod="openshift-multus/network-metrics-daemon-6wbvb" May 20 21:48:35.337512 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:35.337187 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 21:48:35.337512 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:35.337250 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/872c529b-f04d-4f44-be10-283c11ff49e0-metrics-certs podName:872c529b-f04d-4f44-be10-283c11ff49e0 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:51.337234826 +0000 UTC m=+34.199655738 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/872c529b-f04d-4f44-be10-283c11ff49e0-metrics-certs") pod "network-metrics-daemon-6wbvb" (UID: "872c529b-f04d-4f44-be10-283c11ff49e0") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 21:48:35.538154 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:35.538094 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fdq2d\" (UniqueName: \"kubernetes.io/projected/b65cd3c8-efd2-4553-99d9-2afbaa703796-kube-api-access-fdq2d\") pod \"network-check-target-qlq8p\" (UID: \"b65cd3c8-efd2-4553-99d9-2afbaa703796\") " pod="openshift-network-diagnostics/network-check-target-qlq8p" May 20 21:48:35.538319 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:35.538295 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 21:48:35.538404 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:35.538329 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 21:48:35.538404 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:35.538343 2581 projected.go:194] Error preparing data for projected volume kube-api-access-fdq2d for pod openshift-network-diagnostics/network-check-target-qlq8p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 21:48:35.538477 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:35.538411 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b65cd3c8-efd2-4553-99d9-2afbaa703796-kube-api-access-fdq2d podName:b65cd3c8-efd2-4553-99d9-2afbaa703796 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:51.538390669 +0000 UTC m=+34.400811580 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fdq2d" (UniqueName: "kubernetes.io/projected/b65cd3c8-efd2-4553-99d9-2afbaa703796-kube-api-access-fdq2d") pod "network-check-target-qlq8p" (UID: "b65cd3c8-efd2-4553-99d9-2afbaa703796") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 21:48:35.768620 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:35.768533 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wbvb" May 20 21:48:35.768770 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:35.768670 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wbvb" podUID="872c529b-f04d-4f44-be10-283c11ff49e0" May 20 21:48:36.768375 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:36.768331 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlq8p" May 20 21:48:36.768845 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:36.768445 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlq8p" podUID="b65cd3c8-efd2-4553-99d9-2afbaa703796" May 20 21:48:37.769020 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:37.768990 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wbvb" May 20 21:48:37.769389 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:37.769105 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wbvb" podUID="872c529b-f04d-4f44-be10-283c11ff49e0" May 20 21:48:38.769134 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:38.768689 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlq8p" May 20 21:48:38.769995 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:38.769258 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlq8p" podUID="b65cd3c8-efd2-4553-99d9-2afbaa703796" May 20 21:48:38.921031 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:38.921010 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jgks5_8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a/ovn-acl-logging/0.log" May 20 21:48:38.921323 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:38.921302 2581 generic.go:358] "Generic (PLEG): container finished" podID="8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a" containerID="002b57b0ce88736e5bdbc37a01bc3b589e1dabb42a400c7436fcf7f1fe9a0fcc" exitCode=1 May 20 21:48:38.921389 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:38.921368 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" event={"ID":"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a","Type":"ContainerStarted","Data":"6051bfa5f6dc5da741759dde3747172c6ba0b1b9aa77d7984f96fde0015f4645"} May 20 21:48:38.921433 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:38.921401 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" event={"ID":"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a","Type":"ContainerStarted","Data":"07949ad6108d1279fcddc4eb407729be665f1f14427e6e06d85b8f6b62491007"} May 20 21:48:38.921433 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:38.921410 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" event={"ID":"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a","Type":"ContainerStarted","Data":"61b943bd20922b68035c6e205bb17f2047e3606f6b5e751a739bf73e6009c221"} May 20 21:48:38.921433 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:38.921418 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" event={"ID":"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a","Type":"ContainerStarted","Data":"526c06df80b663150df65a3b9a5c3d325ca9740915b99d1712f4654e794f533a"} May 20 21:48:38.921433 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:38.921427 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" event={"ID":"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a","Type":"ContainerDied","Data":"002b57b0ce88736e5bdbc37a01bc3b589e1dabb42a400c7436fcf7f1fe9a0fcc"} May 20 21:48:38.921574 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:38.921440 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" event={"ID":"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a","Type":"ContainerStarted","Data":"733bb6b4afb314748ec37c83db46072b13e09b7694ac15975c5056dca72f142b"} May 20 21:48:38.922458 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:38.922435 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rg5q8" event={"ID":"b5bc4f12-7530-4f15-9365-5c88a796caf6","Type":"ContainerStarted","Data":"d9e9bba98c824723489259ed672e70ed539a1c1dd3038b589f6a224e81b427a1"} May 20 21:48:38.923733 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:38.923703 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-q2tcg" event={"ID":"34b2cd4e-11b6-4278-8c16-9241eebd6cef","Type":"ContainerStarted","Data":"6ca74c8039ed784d7179e7370338c8bed88e96cb5a6def46bfaa0422db2fc0d6"} May 20 21:48:38.925128 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:38.925106 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tjnqv" event={"ID":"adaf6994-2a90-4542-a2e5-2e415a29094b","Type":"ContainerStarted","Data":"a8d4692b1040f7a1b89d0650f23a1cd1056b2dfaea779cdac3496067f83b36f9"} May 20 21:48:38.926563 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:38.926537 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vhwkk" event={"ID":"30a53acd-d1d9-480d-885b-ebccb4ef3734","Type":"ContainerStarted","Data":"7b1e68cb2872ea48480062fd5394586938feb3b714d0dbf70b959701ac90dd5f"} May 20 21:48:38.927896 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:38.927867 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x5q4l" event={"ID":"b7fbcb26-e155-4cf8-89ba-17e5c52f3f8c","Type":"ContainerStarted","Data":"d9d5ef0a977d02d4c33df6b207662fea617bd0de736fff261db3b788f379a051"} May 20 21:48:38.929172 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:38.929152 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwn2w" event={"ID":"24350846-e9be-481f-9301-3ebb3f081f66","Type":"ContainerStarted","Data":"1ebe318cc2a2f423913fd7ca106cef9b3aa4c67808d1ac3d2e53cd512058ffb6"} May 20 21:48:38.930509 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:38.930486 2581 generic.go:358] "Generic (PLEG): container finished" podID="585dc410-8720-4e83-926c-486addf85ada" containerID="6380c31bb80be8d4ed4dbc22182bf780eda643f603cb1e900c39caabd29c6959" exitCode=0 May 20 21:48:38.930575 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:38.930520 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g76b4" event={"ID":"585dc410-8720-4e83-926c-486addf85ada","Type":"ContainerDied","Data":"6380c31bb80be8d4ed4dbc22182bf780eda643f603cb1e900c39caabd29c6959"} May 20 21:48:38.959675 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:38.959613 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rg5q8" podStartSLOduration=4.067073869 podStartE2EDuration="21.959593236s" podCreationTimestamp="2026-05-20 21:48:17 +0000 UTC" firstStartedPulling="2026-05-20 21:48:20.189730503 +0000 UTC m=+3.052151414" lastFinishedPulling="2026-05-20 21:48:38.082249869 +0000 UTC m=+20.944670781" observedRunningTime="2026-05-20 21:48:38.942359352 +0000 UTC m=+21.804780264" watchObservedRunningTime="2026-05-20 21:48:38.959593236 +0000 UTC m=+21.822014166" May 20 21:48:38.960168 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:38.960130 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-tjnqv" podStartSLOduration=4.063519844 podStartE2EDuration="21.960115609s" podCreationTimestamp="2026-05-20 21:48:17 +0000 UTC" firstStartedPulling="2026-05-20 21:48:20.199522797 +0000 UTC m=+3.061943718" lastFinishedPulling="2026-05-20 21:48:38.096118575 +0000 UTC m=+20.958539483" observedRunningTime="2026-05-20 21:48:38.959519353 +0000 UTC m=+21.821940489" watchObservedRunningTime="2026-05-20 21:48:38.960115609 +0000 UTC m=+21.822536541" May 20 21:48:38.993869 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:38.993817 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-x5q4l" podStartSLOduration=4.107029265 podStartE2EDuration="21.993800174s" podCreationTimestamp="2026-05-20 21:48:17 +0000 UTC" firstStartedPulling="2026-05-20 21:48:20.194843153 +0000 UTC m=+3.057264075" lastFinishedPulling="2026-05-20 21:48:38.081614062 +0000 UTC m=+20.944034984" observedRunningTime="2026-05-20 21:48:38.993654142 +0000 UTC m=+21.856075074" watchObservedRunningTime="2026-05-20 21:48:38.993800174 +0000 UTC m=+21.856221104" May 20 21:48:39.009418 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:39.009366 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-q2tcg" podStartSLOduration=8.813534708 podStartE2EDuration="22.009346801s" podCreationTimestamp="2026-05-20 21:48:17 +0000 UTC" firstStartedPulling="2026-05-20 21:48:20.189000705 +0000 UTC m=+3.051421614" lastFinishedPulling="2026-05-20 21:48:33.384812799 +0000 UTC m=+16.247233707" observedRunningTime="2026-05-20 21:48:39.009174324 +0000 UTC m=+21.871595266" watchObservedRunningTime="2026-05-20 21:48:39.009346801 +0000 UTC m=+21.871767754" May 20 21:48:39.038003 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:39.037948 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vhwkk" podStartSLOduration=4.155977421 podStartE2EDuration="22.037932537s" podCreationTimestamp="2026-05-20 21:48:17 +0000 UTC" firstStartedPulling="2026-05-20 21:48:20.198659108 +0000 UTC m=+3.061080025" lastFinishedPulling="2026-05-20 21:48:38.080614228 +0000 UTC m=+20.943035141" observedRunningTime="2026-05-20 21:48:39.037551624 +0000 UTC m=+21.899972582" watchObservedRunningTime="2026-05-20 21:48:39.037932537 +0000 UTC m=+21.900353482" May 20 21:48:39.349884 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:39.349772 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 20 21:48:39.666894 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:39.666779 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-20T21:48:39.349794798Z","UUID":"96aef1ba-e94b-4b14-95d3-0e19ef67d5d9","Handler":null,"Name":"","Endpoint":""} May 20 21:48:39.668684 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:39.668658 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 20 21:48:39.668684 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:39.668688 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 20 21:48:39.768333 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:39.768296 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wbvb" May 20 21:48:39.768529 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:39.768460 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wbvb" podUID="872c529b-f04d-4f44-be10-283c11ff49e0" May 20 21:48:39.934436 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:39.934347 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwn2w" event={"ID":"24350846-e9be-481f-9301-3ebb3f081f66","Type":"ContainerStarted","Data":"9f9cc4d2fcc7ae82ee5ce99002ce3592e2d0f262664b899d65d6528ff4637c72"} May 20 21:48:39.935813 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:39.935768 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z8k7q" event={"ID":"9db1d15c-abcc-4519-9725-abe198e92979","Type":"ContainerStarted","Data":"28380139c57029ed6e2821291fc639fa35e772a01c7a4f75628c8e3672ce38d5"} May 20 21:48:39.950997 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:39.950954 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-z8k7q" podStartSLOduration=5.070059865 podStartE2EDuration="22.950941852s" podCreationTimestamp="2026-05-20 21:48:17 +0000 UTC" firstStartedPulling="2026-05-20 21:48:20.200250968 +0000 UTC m=+3.062671888" lastFinishedPulling="2026-05-20 21:48:38.081132963 +0000 UTC m=+20.943553875" observedRunningTime="2026-05-20 21:48:39.950646972 +0000 UTC m=+22.813067903" watchObservedRunningTime="2026-05-20 21:48:39.950941852 +0000 UTC m=+22.813362781" May 20 21:48:40.209401 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:40.209316 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-q2tcg" May 20 21:48:40.768543 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:40.768468 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlq8p" May 20 21:48:40.768712 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:40.768622 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlq8p" podUID="b65cd3c8-efd2-4553-99d9-2afbaa703796" May 20 21:48:40.939644 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:40.939598 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwn2w" event={"ID":"24350846-e9be-481f-9301-3ebb3f081f66","Type":"ContainerStarted","Data":"d525c5ded5dfe9b874879574299e6416c5493fb1e47c6b6f6d48485e974ecf13"} May 20 21:48:40.971340 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:40.971286 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mwn2w" podStartSLOduration=3.8070639269999997 podStartE2EDuration="23.971271278s" podCreationTimestamp="2026-05-20 21:48:17 +0000 UTC" firstStartedPulling="2026-05-20 21:48:20.202804307 +0000 UTC m=+3.065225229" lastFinishedPulling="2026-05-20 21:48:40.36701167 +0000 UTC m=+23.229432580" observedRunningTime="2026-05-20 21:48:40.971222253 +0000 UTC m=+23.833643208" watchObservedRunningTime="2026-05-20 21:48:40.971271278 +0000 UTC m=+23.833692209" May 20 21:48:41.768093 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:41.768059 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wbvb" May 20 21:48:41.768295 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:41.768209 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wbvb" podUID="872c529b-f04d-4f44-be10-283c11ff49e0" May 20 21:48:41.788559 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:41.788524 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-q2tcg" May 20 21:48:41.789294 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:41.789269 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-q2tcg" May 20 21:48:41.944416 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:41.944390 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jgks5_8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a/ovn-acl-logging/0.log" May 20 21:48:41.944858 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:41.944766 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" event={"ID":"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a","Type":"ContainerStarted","Data":"f50b658ed8448bf7b0331c1686b5f5847d5d1131af8afa7be086e11081e4a29c"} May 20 21:48:41.945551 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:41.945526 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-q2tcg" May 20 21:48:42.768393 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:42.768359 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlq8p" May 20 21:48:42.768604 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:42.768476 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlq8p" podUID="b65cd3c8-efd2-4553-99d9-2afbaa703796" May 20 21:48:43.768195 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:43.767992 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wbvb" May 20 21:48:43.768920 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:43.768283 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wbvb" podUID="872c529b-f04d-4f44-be10-283c11ff49e0" May 20 21:48:43.950602 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:43.950565 2581 generic.go:358] "Generic (PLEG): container finished" podID="585dc410-8720-4e83-926c-486addf85ada" containerID="68edba346126776aacb76f34b6b04ad9d6ceb8b1ff731743f8f58d5d26980f06" exitCode=0 May 20 21:48:43.950602 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:43.950600 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g76b4" event={"ID":"585dc410-8720-4e83-926c-486addf85ada","Type":"ContainerDied","Data":"68edba346126776aacb76f34b6b04ad9d6ceb8b1ff731743f8f58d5d26980f06"} May 20 21:48:43.953746 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:43.953728 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jgks5_8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a/ovn-acl-logging/0.log" May 20 21:48:43.954046 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:43.954017 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" event={"ID":"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a","Type":"ContainerStarted","Data":"ce63764fc50dd66ca827cb2ecd1c4a6eae4e7142bc2bfd5ebbc1aa6d49cbc46b"} May 20 21:48:43.954357 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:43.954336 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:43.954457 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:43.954363 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:43.954606 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:43.954516 2581 scope.go:117] "RemoveContainer" containerID="002b57b0ce88736e5bdbc37a01bc3b589e1dabb42a400c7436fcf7f1fe9a0fcc" May 20 21:48:43.973191 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:43.973172 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:44.768479 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:44.768444 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlq8p" May 20 21:48:44.768870 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:44.768570 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlq8p" podUID="b65cd3c8-efd2-4553-99d9-2afbaa703796" May 20 21:48:44.957975 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:44.957941 2581 generic.go:358] "Generic (PLEG): container finished" podID="585dc410-8720-4e83-926c-486addf85ada" containerID="5bf6e7b24c9b54e21e326ff99a9f72418406308c17adfad0d200d720e7977678" exitCode=0 May 20 21:48:44.958137 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:44.958032 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g76b4" event={"ID":"585dc410-8720-4e83-926c-486addf85ada","Type":"ContainerDied","Data":"5bf6e7b24c9b54e21e326ff99a9f72418406308c17adfad0d200d720e7977678"} May 20 21:48:44.961532 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:44.961512 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jgks5_8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a/ovn-acl-logging/0.log" May 20 21:48:44.961868 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:44.961840 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" event={"ID":"8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a","Type":"ContainerStarted","Data":"9de3d71f1f4d326fac7737ead83fdf623064f6d1b3398a2aa6e9c38fb6ed5275"} May 20 21:48:44.962209 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:44.962192 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:44.978217 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:44.978195 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:48:45.007121 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:45.007058 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" podStartSLOduration=9.984708699 podStartE2EDuration="28.007039217s" podCreationTimestamp="2026-05-20 21:48:17 +0000 UTC" firstStartedPulling="2026-05-20 21:48:20.192110545 +0000 UTC m=+3.054531463" lastFinishedPulling="2026-05-20 21:48:38.214441072 +0000 UTC m=+21.076861981" observedRunningTime="2026-05-20 21:48:45.005406833 +0000 UTC m=+27.867827762" watchObservedRunningTime="2026-05-20 21:48:45.007039217 +0000 UTC m=+27.869460146" May 20 21:48:45.133945 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:45.133914 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6wbvb"] May 20 21:48:45.134116 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:45.134038 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wbvb" May 20 21:48:45.134179 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:45.134148 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wbvb" podUID="872c529b-f04d-4f44-be10-283c11ff49e0" May 20 21:48:45.137086 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:45.137048 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qlq8p"] May 20 21:48:45.137222 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:45.137144 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlq8p" May 20 21:48:45.137285 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:45.137240 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlq8p" podUID="b65cd3c8-efd2-4553-99d9-2afbaa703796" May 20 21:48:45.965945 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:45.965753 2581 generic.go:358] "Generic (PLEG): container finished" podID="585dc410-8720-4e83-926c-486addf85ada" containerID="7489c2dce5517cb9381626afd17e0aeef0826118c4f3111106270bcc52dd924e" exitCode=0 May 20 21:48:45.966406 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:45.965840 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g76b4" event={"ID":"585dc410-8720-4e83-926c-486addf85ada","Type":"ContainerDied","Data":"7489c2dce5517cb9381626afd17e0aeef0826118c4f3111106270bcc52dd924e"} May 20 21:48:46.768712 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:46.768681 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlq8p" May 20 21:48:46.768903 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:46.768693 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wbvb" May 20 21:48:46.768903 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:46.768817 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlq8p" podUID="b65cd3c8-efd2-4553-99d9-2afbaa703796" May 20 21:48:46.768903 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:46.768879 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wbvb" podUID="872c529b-f04d-4f44-be10-283c11ff49e0" May 20 21:48:48.768743 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:48.768704 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlq8p" May 20 21:48:48.769271 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:48.768705 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wbvb" May 20 21:48:48.769271 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:48.768836 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlq8p" podUID="b65cd3c8-efd2-4553-99d9-2afbaa703796" May 20 21:48:48.769271 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:48.768925 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wbvb" podUID="872c529b-f04d-4f44-be10-283c11ff49e0" May 20 21:48:50.767985 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:50.767948 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlq8p" May 20 21:48:50.768672 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:50.767948 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wbvb" May 20 21:48:50.768672 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:50.768091 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qlq8p" podUID="b65cd3c8-efd2-4553-99d9-2afbaa703796" May 20 21:48:50.768672 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:50.768155 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6wbvb" podUID="872c529b-f04d-4f44-be10-283c11ff49e0" May 20 21:48:50.931697 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:50.931654 2581 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-137.ec2.internal" event="NodeReady" May 20 21:48:50.931883 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:50.931833 2581 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 20 21:48:50.977449 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:50.977363 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hcsxv"] May 20 21:48:51.042375 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:51.042335 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bbvpk"] May 20 21:48:51.042553 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:51.042508 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hcsxv" May 20 21:48:51.045583 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:51.045545 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2fk4m\"" May 20 21:48:51.045583 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:51.045544 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 20 21:48:51.045786 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:51.045593 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 20 21:48:51.055172 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:51.055150 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bbvpk"] May 20 21:48:51.055291 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:51.055179 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hcsxv"] May 20 21:48:51.055291 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:51.055278 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bbvpk" May 20 21:48:51.058026 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:51.058000 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-n5njn\"" May 20 21:48:51.058268 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:51.058025 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 20 21:48:51.058268 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:51.058033 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 20 21:48:51.058268 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:51.058031 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 20 21:48:51.150382 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:51.150343 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqvbl\" (UniqueName: \"kubernetes.io/projected/1d9a5e80-3f7c-4c29-abbc-04a9004ec9df-kube-api-access-sqvbl\") pod \"dns-default-hcsxv\" (UID: \"1d9a5e80-3f7c-4c29-abbc-04a9004ec9df\") " pod="openshift-dns/dns-default-hcsxv" May 20 21:48:51.150571 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:51.150409 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d9a5e80-3f7c-4c29-abbc-04a9004ec9df-tmp-dir\") pod \"dns-default-hcsxv\" (UID: \"1d9a5e80-3f7c-4c29-abbc-04a9004ec9df\") " pod="openshift-dns/dns-default-hcsxv" May 20 21:48:51.150571 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:51.150496 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d9a5e80-3f7c-4c29-abbc-04a9004ec9df-metrics-tls\") pod \"dns-default-hcsxv\" (UID: \"1d9a5e80-3f7c-4c29-abbc-04a9004ec9df\") " pod="openshift-dns/dns-default-hcsxv" May 20 21:48:51.150571 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:51.150554 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl8wg\" (UniqueName: \"kubernetes.io/projected/99598051-0e0d-4e2f-ac40-6a2d142b4183-kube-api-access-zl8wg\") pod \"ingress-canary-bbvpk\" (UID: \"99598051-0e0d-4e2f-ac40-6a2d142b4183\") " pod="openshift-ingress-canary/ingress-canary-bbvpk" May 20 21:48:51.150738 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:51.150583 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1d9a5e80-3f7c-4c29-abbc-04a9004ec9df-config-volume\") pod \"dns-default-hcsxv\" (UID: \"1d9a5e80-3f7c-4c29-abbc-04a9004ec9df\") " pod="openshift-dns/dns-default-hcsxv" May 20 21:48:51.150738 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:51.150626 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/99598051-0e0d-4e2f-ac40-6a2d142b4183-cert\") pod \"ingress-canary-bbvpk\" (UID: \"99598051-0e0d-4e2f-ac40-6a2d142b4183\") " pod="openshift-ingress-canary/ingress-canary-bbvpk" May 20 21:48:51.251068 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:51.250989 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d9a5e80-3f7c-4c29-abbc-04a9004ec9df-tmp-dir\") pod \"dns-default-hcsxv\" (UID: \"1d9a5e80-3f7c-4c29-abbc-04a9004ec9df\") " pod="openshift-dns/dns-default-hcsxv" May 20 21:48:51.251068 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:51.251053 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d9a5e80-3f7c-4c29-abbc-04a9004ec9df-metrics-tls\") pod \"dns-default-hcsxv\" (UID: \"1d9a5e80-3f7c-4c29-abbc-04a9004ec9df\") " pod="openshift-dns/dns-default-hcsxv" May 20 21:48:51.251297 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:51.251091 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zl8wg\" (UniqueName: \"kubernetes.io/projected/99598051-0e0d-4e2f-ac40-6a2d142b4183-kube-api-access-zl8wg\") pod \"ingress-canary-bbvpk\" (UID: \"99598051-0e0d-4e2f-ac40-6a2d142b4183\") " pod="openshift-ingress-canary/ingress-canary-bbvpk" May 20 21:48:51.251297 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:51.251117 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1d9a5e80-3f7c-4c29-abbc-04a9004ec9df-config-volume\") pod \"dns-default-hcsxv\" (UID: \"1d9a5e80-3f7c-4c29-abbc-04a9004ec9df\") " pod="openshift-dns/dns-default-hcsxv" May 20 21:48:51.251297 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:51.251147 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/99598051-0e0d-4e2f-ac40-6a2d142b4183-cert\") pod \"ingress-canary-bbvpk\" (UID: \"99598051-0e0d-4e2f-ac40-6a2d142b4183\") " pod="openshift-ingress-canary/ingress-canary-bbvpk" May 20 21:48:51.251297 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:51.251195 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sqvbl\" (UniqueName: \"kubernetes.io/projected/1d9a5e80-3f7c-4c29-abbc-04a9004ec9df-kube-api-access-sqvbl\") pod \"dns-default-hcsxv\" (UID: \"1d9a5e80-3f7c-4c29-abbc-04a9004ec9df\") " pod="openshift-dns/dns-default-hcsxv" May 20 21:48:51.251297 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:51.251199 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 21:48:51.251297 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:51.251266 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d9a5e80-3f7c-4c29-abbc-04a9004ec9df-metrics-tls podName:1d9a5e80-3f7c-4c29-abbc-04a9004ec9df nodeName:}" failed. No retries permitted until 2026-05-20 21:48:51.751245858 +0000 UTC m=+34.613666783 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1d9a5e80-3f7c-4c29-abbc-04a9004ec9df-metrics-tls") pod "dns-default-hcsxv" (UID: "1d9a5e80-3f7c-4c29-abbc-04a9004ec9df") : secret "dns-default-metrics-tls" not found May 20 21:48:51.251598 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:51.251297 2581 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 21:48:51.251598 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:51.251356 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99598051-0e0d-4e2f-ac40-6a2d142b4183-cert podName:99598051-0e0d-4e2f-ac40-6a2d142b4183 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:51.751343237 +0000 UTC m=+34.613764145 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/99598051-0e0d-4e2f-ac40-6a2d142b4183-cert") pod "ingress-canary-bbvpk" (UID: "99598051-0e0d-4e2f-ac40-6a2d142b4183") : secret "canary-serving-cert" not found May 20 21:48:51.251598 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:51.251374 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d9a5e80-3f7c-4c29-abbc-04a9004ec9df-tmp-dir\") pod \"dns-default-hcsxv\" (UID: \"1d9a5e80-3f7c-4c29-abbc-04a9004ec9df\") " pod="openshift-dns/dns-default-hcsxv" May 20 21:48:51.251757 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:51.251729 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1d9a5e80-3f7c-4c29-abbc-04a9004ec9df-config-volume\") pod \"dns-default-hcsxv\" (UID: \"1d9a5e80-3f7c-4c29-abbc-04a9004ec9df\") " pod="openshift-dns/dns-default-hcsxv" May 20 21:48:51.262021 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:51.261996 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqvbl\" (UniqueName: \"kubernetes.io/projected/1d9a5e80-3f7c-4c29-abbc-04a9004ec9df-kube-api-access-sqvbl\") pod \"dns-default-hcsxv\" (UID: \"1d9a5e80-3f7c-4c29-abbc-04a9004ec9df\") " pod="openshift-dns/dns-default-hcsxv" May 20 21:48:51.262217 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:51.262195 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl8wg\" (UniqueName: \"kubernetes.io/projected/99598051-0e0d-4e2f-ac40-6a2d142b4183-kube-api-access-zl8wg\") pod \"ingress-canary-bbvpk\" (UID: \"99598051-0e0d-4e2f-ac40-6a2d142b4183\") " pod="openshift-ingress-canary/ingress-canary-bbvpk" May 20 21:48:51.351690 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:51.351653 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/872c529b-f04d-4f44-be10-283c11ff49e0-metrics-certs\") pod \"network-metrics-daemon-6wbvb\" (UID: \"872c529b-f04d-4f44-be10-283c11ff49e0\") " pod="openshift-multus/network-metrics-daemon-6wbvb" May 20 21:48:51.351843 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:51.351800 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 20 21:48:51.351887 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:51.351870 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/872c529b-f04d-4f44-be10-283c11ff49e0-metrics-certs podName:872c529b-f04d-4f44-be10-283c11ff49e0 nodeName:}" failed. No retries permitted until 2026-05-20 21:49:23.351854263 +0000 UTC m=+66.214275187 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/872c529b-f04d-4f44-be10-283c11ff49e0-metrics-certs") pod "network-metrics-daemon-6wbvb" (UID: "872c529b-f04d-4f44-be10-283c11ff49e0") : object "openshift-multus"/"metrics-daemon-secret" not registered May 20 21:48:51.553004 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:51.552920 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fdq2d\" (UniqueName: \"kubernetes.io/projected/b65cd3c8-efd2-4553-99d9-2afbaa703796-kube-api-access-fdq2d\") pod \"network-check-target-qlq8p\" (UID: \"b65cd3c8-efd2-4553-99d9-2afbaa703796\") " pod="openshift-network-diagnostics/network-check-target-qlq8p" May 20 21:48:51.553157 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:51.553109 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 20 21:48:51.553157 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:51.553129 2581 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 20 21:48:51.553157 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:51.553142 2581 projected.go:194] Error preparing data for projected volume kube-api-access-fdq2d for pod openshift-network-diagnostics/network-check-target-qlq8p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 21:48:51.553268 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:51.553192 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b65cd3c8-efd2-4553-99d9-2afbaa703796-kube-api-access-fdq2d podName:b65cd3c8-efd2-4553-99d9-2afbaa703796 nodeName:}" failed. No retries permitted until 2026-05-20 21:49:23.553178774 +0000 UTC m=+66.415599683 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fdq2d" (UniqueName: "kubernetes.io/projected/b65cd3c8-efd2-4553-99d9-2afbaa703796-kube-api-access-fdq2d") pod "network-check-target-qlq8p" (UID: "b65cd3c8-efd2-4553-99d9-2afbaa703796") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 20 21:48:51.754386 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:51.754347 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d9a5e80-3f7c-4c29-abbc-04a9004ec9df-metrics-tls\") pod \"dns-default-hcsxv\" (UID: \"1d9a5e80-3f7c-4c29-abbc-04a9004ec9df\") " pod="openshift-dns/dns-default-hcsxv" May 20 21:48:51.754557 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:51.754404 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/99598051-0e0d-4e2f-ac40-6a2d142b4183-cert\") pod \"ingress-canary-bbvpk\" (UID: \"99598051-0e0d-4e2f-ac40-6a2d142b4183\") " pod="openshift-ingress-canary/ingress-canary-bbvpk" May 20 21:48:51.754557 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:51.754540 2581 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 21:48:51.754664 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:51.754611 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99598051-0e0d-4e2f-ac40-6a2d142b4183-cert podName:99598051-0e0d-4e2f-ac40-6a2d142b4183 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:52.754591396 +0000 UTC m=+35.617012303 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/99598051-0e0d-4e2f-ac40-6a2d142b4183-cert") pod "ingress-canary-bbvpk" (UID: "99598051-0e0d-4e2f-ac40-6a2d142b4183") : secret "canary-serving-cert" not found May 20 21:48:51.754664 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:51.754540 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 21:48:51.754779 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:51.754706 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d9a5e80-3f7c-4c29-abbc-04a9004ec9df-metrics-tls podName:1d9a5e80-3f7c-4c29-abbc-04a9004ec9df nodeName:}" failed. No retries permitted until 2026-05-20 21:48:52.754683692 +0000 UTC m=+35.617104622 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1d9a5e80-3f7c-4c29-abbc-04a9004ec9df-metrics-tls") pod "dns-default-hcsxv" (UID: "1d9a5e80-3f7c-4c29-abbc-04a9004ec9df") : secret "dns-default-metrics-tls" not found May 20 21:48:51.980274 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:51.980242 2581 generic.go:358] "Generic (PLEG): container finished" podID="585dc410-8720-4e83-926c-486addf85ada" containerID="cb549dad17d85077c481aac275843537a63a30949675a074468063f6f36cb0c5" exitCode=0 May 20 21:48:51.980690 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:51.980328 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g76b4" event={"ID":"585dc410-8720-4e83-926c-486addf85ada","Type":"ContainerDied","Data":"cb549dad17d85077c481aac275843537a63a30949675a074468063f6f36cb0c5"} May 20 21:48:52.761967 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:52.761934 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/99598051-0e0d-4e2f-ac40-6a2d142b4183-cert\") pod \"ingress-canary-bbvpk\" (UID: \"99598051-0e0d-4e2f-ac40-6a2d142b4183\") " pod="openshift-ingress-canary/ingress-canary-bbvpk" May 20 21:48:52.762226 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:52.762010 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d9a5e80-3f7c-4c29-abbc-04a9004ec9df-metrics-tls\") pod \"dns-default-hcsxv\" (UID: \"1d9a5e80-3f7c-4c29-abbc-04a9004ec9df\") " pod="openshift-dns/dns-default-hcsxv" May 20 21:48:52.762226 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:52.762114 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 21:48:52.762226 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:52.762130 2581 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 21:48:52.762226 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:52.762164 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d9a5e80-3f7c-4c29-abbc-04a9004ec9df-metrics-tls podName:1d9a5e80-3f7c-4c29-abbc-04a9004ec9df nodeName:}" failed. No retries permitted until 2026-05-20 21:48:54.762150278 +0000 UTC m=+37.624571191 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1d9a5e80-3f7c-4c29-abbc-04a9004ec9df-metrics-tls") pod "dns-default-hcsxv" (UID: "1d9a5e80-3f7c-4c29-abbc-04a9004ec9df") : secret "dns-default-metrics-tls" not found May 20 21:48:52.762226 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:52.762188 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99598051-0e0d-4e2f-ac40-6a2d142b4183-cert podName:99598051-0e0d-4e2f-ac40-6a2d142b4183 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:54.762172136 +0000 UTC m=+37.624593046 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/99598051-0e0d-4e2f-ac40-6a2d142b4183-cert") pod "ingress-canary-bbvpk" (UID: "99598051-0e0d-4e2f-ac40-6a2d142b4183") : secret "canary-serving-cert" not found May 20 21:48:52.768485 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:52.768464 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlq8p" May 20 21:48:52.768568 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:52.768463 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wbvb" May 20 21:48:52.771930 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:52.771911 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 20 21:48:52.771930 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:52.771922 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6x7hr\"" May 20 21:48:52.772108 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:52.771931 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 20 21:48:52.772108 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:52.771987 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 20 21:48:52.772108 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:52.772014 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5n7z5\"" May 20 21:48:52.984637 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:52.984598 2581 generic.go:358] "Generic (PLEG): container finished" podID="585dc410-8720-4e83-926c-486addf85ada" containerID="353e270b67c4dd24313643fb6fad1c116bba1618881c3cc52bd8ac1bf8dda100" exitCode=0 May 20 21:48:52.985029 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:52.984658 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g76b4" event={"ID":"585dc410-8720-4e83-926c-486addf85ada","Type":"ContainerDied","Data":"353e270b67c4dd24313643fb6fad1c116bba1618881c3cc52bd8ac1bf8dda100"} May 20 21:48:53.989598 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:53.989413 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g76b4" event={"ID":"585dc410-8720-4e83-926c-486addf85ada","Type":"ContainerStarted","Data":"6be0af51da80c2d686ccb87523c3f2a63c71822f1ac5e32811fac31ff9409b15"} May 20 21:48:54.010381 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:54.010341 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-g76b4" podStartSLOduration=5.518539345 podStartE2EDuration="37.010326959s" podCreationTimestamp="2026-05-20 21:48:17 +0000 UTC" firstStartedPulling="2026-05-20 21:48:20.198438479 +0000 UTC m=+3.060859387" lastFinishedPulling="2026-05-20 21:48:51.690226081 +0000 UTC m=+34.552647001" observedRunningTime="2026-05-20 21:48:54.010212281 +0000 UTC m=+36.872633210" watchObservedRunningTime="2026-05-20 21:48:54.010326959 +0000 UTC m=+36.872747883" May 20 21:48:54.774041 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:54.774005 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d9a5e80-3f7c-4c29-abbc-04a9004ec9df-metrics-tls\") pod \"dns-default-hcsxv\" (UID: \"1d9a5e80-3f7c-4c29-abbc-04a9004ec9df\") " pod="openshift-dns/dns-default-hcsxv" May 20 21:48:54.774203 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:54.774049 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/99598051-0e0d-4e2f-ac40-6a2d142b4183-cert\") pod \"ingress-canary-bbvpk\" (UID: \"99598051-0e0d-4e2f-ac40-6a2d142b4183\") " pod="openshift-ingress-canary/ingress-canary-bbvpk" May 20 21:48:54.774203 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:54.774191 2581 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 21:48:54.774335 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:54.774195 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 21:48:54.774335 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:54.774244 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99598051-0e0d-4e2f-ac40-6a2d142b4183-cert podName:99598051-0e0d-4e2f-ac40-6a2d142b4183 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:58.774230323 +0000 UTC m=+41.636651231 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/99598051-0e0d-4e2f-ac40-6a2d142b4183-cert") pod "ingress-canary-bbvpk" (UID: "99598051-0e0d-4e2f-ac40-6a2d142b4183") : secret "canary-serving-cert" not found May 20 21:48:54.774335 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:54.774257 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d9a5e80-3f7c-4c29-abbc-04a9004ec9df-metrics-tls podName:1d9a5e80-3f7c-4c29-abbc-04a9004ec9df nodeName:}" failed. No retries permitted until 2026-05-20 21:48:58.774250929 +0000 UTC m=+41.636671836 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1d9a5e80-3f7c-4c29-abbc-04a9004ec9df-metrics-tls") pod "dns-default-hcsxv" (UID: "1d9a5e80-3f7c-4c29-abbc-04a9004ec9df") : secret "dns-default-metrics-tls" not found May 20 21:48:58.801703 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:58.801656 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d9a5e80-3f7c-4c29-abbc-04a9004ec9df-metrics-tls\") pod \"dns-default-hcsxv\" (UID: \"1d9a5e80-3f7c-4c29-abbc-04a9004ec9df\") " pod="openshift-dns/dns-default-hcsxv" May 20 21:48:58.802245 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:48:58.801713 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/99598051-0e0d-4e2f-ac40-6a2d142b4183-cert\") pod \"ingress-canary-bbvpk\" (UID: \"99598051-0e0d-4e2f-ac40-6a2d142b4183\") " pod="openshift-ingress-canary/ingress-canary-bbvpk" May 20 21:48:58.802245 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:58.801805 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 21:48:58.802245 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:58.801914 2581 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 21:48:58.802245 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:58.801935 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d9a5e80-3f7c-4c29-abbc-04a9004ec9df-metrics-tls podName:1d9a5e80-3f7c-4c29-abbc-04a9004ec9df nodeName:}" failed. No retries permitted until 2026-05-20 21:49:06.801917545 +0000 UTC m=+49.664338453 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1d9a5e80-3f7c-4c29-abbc-04a9004ec9df-metrics-tls") pod "dns-default-hcsxv" (UID: "1d9a5e80-3f7c-4c29-abbc-04a9004ec9df") : secret "dns-default-metrics-tls" not found May 20 21:48:58.802245 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:48:58.801965 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99598051-0e0d-4e2f-ac40-6a2d142b4183-cert podName:99598051-0e0d-4e2f-ac40-6a2d142b4183 nodeName:}" failed. No retries permitted until 2026-05-20 21:49:06.80194835 +0000 UTC m=+49.664369261 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/99598051-0e0d-4e2f-ac40-6a2d142b4183-cert") pod "ingress-canary-bbvpk" (UID: "99598051-0e0d-4e2f-ac40-6a2d142b4183") : secret "canary-serving-cert" not found May 20 21:49:06.859297 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:49:06.859259 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d9a5e80-3f7c-4c29-abbc-04a9004ec9df-metrics-tls\") pod \"dns-default-hcsxv\" (UID: \"1d9a5e80-3f7c-4c29-abbc-04a9004ec9df\") " pod="openshift-dns/dns-default-hcsxv" May 20 21:49:06.859297 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:49:06.859303 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/99598051-0e0d-4e2f-ac40-6a2d142b4183-cert\") pod \"ingress-canary-bbvpk\" (UID: \"99598051-0e0d-4e2f-ac40-6a2d142b4183\") " pod="openshift-ingress-canary/ingress-canary-bbvpk" May 20 21:49:06.859800 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:49:06.859418 2581 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 21:49:06.859800 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:49:06.859419 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 21:49:06.859800 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:49:06.859476 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99598051-0e0d-4e2f-ac40-6a2d142b4183-cert podName:99598051-0e0d-4e2f-ac40-6a2d142b4183 nodeName:}" failed. No retries permitted until 2026-05-20 21:49:22.859458214 +0000 UTC m=+65.721879124 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/99598051-0e0d-4e2f-ac40-6a2d142b4183-cert") pod "ingress-canary-bbvpk" (UID: "99598051-0e0d-4e2f-ac40-6a2d142b4183") : secret "canary-serving-cert" not found May 20 21:49:06.859800 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:49:06.859494 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d9a5e80-3f7c-4c29-abbc-04a9004ec9df-metrics-tls podName:1d9a5e80-3f7c-4c29-abbc-04a9004ec9df nodeName:}" failed. No retries permitted until 2026-05-20 21:49:22.859485149 +0000 UTC m=+65.721906061 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1d9a5e80-3f7c-4c29-abbc-04a9004ec9df-metrics-tls") pod "dns-default-hcsxv" (UID: "1d9a5e80-3f7c-4c29-abbc-04a9004ec9df") : secret "dns-default-metrics-tls" not found May 20 21:49:16.977949 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:49:16.977924 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jgks5" May 20 21:49:22.860789 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:49:22.860752 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d9a5e80-3f7c-4c29-abbc-04a9004ec9df-metrics-tls\") pod \"dns-default-hcsxv\" (UID: \"1d9a5e80-3f7c-4c29-abbc-04a9004ec9df\") " pod="openshift-dns/dns-default-hcsxv" May 20 21:49:22.860789 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:49:22.860796 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/99598051-0e0d-4e2f-ac40-6a2d142b4183-cert\") pod \"ingress-canary-bbvpk\" (UID: \"99598051-0e0d-4e2f-ac40-6a2d142b4183\") " pod="openshift-ingress-canary/ingress-canary-bbvpk" May 20 21:49:22.861235 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:49:22.860894 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 21:49:22.861235 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:49:22.860908 2581 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 21:49:22.861235 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:49:22.860961 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d9a5e80-3f7c-4c29-abbc-04a9004ec9df-metrics-tls podName:1d9a5e80-3f7c-4c29-abbc-04a9004ec9df nodeName:}" failed. No retries permitted until 2026-05-20 21:49:54.860944581 +0000 UTC m=+97.723365489 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1d9a5e80-3f7c-4c29-abbc-04a9004ec9df-metrics-tls") pod "dns-default-hcsxv" (UID: "1d9a5e80-3f7c-4c29-abbc-04a9004ec9df") : secret "dns-default-metrics-tls" not found May 20 21:49:22.861235 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:49:22.860975 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99598051-0e0d-4e2f-ac40-6a2d142b4183-cert podName:99598051-0e0d-4e2f-ac40-6a2d142b4183 nodeName:}" failed. No retries permitted until 2026-05-20 21:49:54.860968955 +0000 UTC m=+97.723389863 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/99598051-0e0d-4e2f-ac40-6a2d142b4183-cert") pod "ingress-canary-bbvpk" (UID: "99598051-0e0d-4e2f-ac40-6a2d142b4183") : secret "canary-serving-cert" not found May 20 21:49:23.364150 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:49:23.364114 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/872c529b-f04d-4f44-be10-283c11ff49e0-metrics-certs\") pod \"network-metrics-daemon-6wbvb\" (UID: \"872c529b-f04d-4f44-be10-283c11ff49e0\") " pod="openshift-multus/network-metrics-daemon-6wbvb" May 20 21:49:23.366715 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:49:23.366693 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 20 21:49:23.374826 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:49:23.374803 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 20 21:49:23.374948 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:49:23.374874 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/872c529b-f04d-4f44-be10-283c11ff49e0-metrics-certs podName:872c529b-f04d-4f44-be10-283c11ff49e0 nodeName:}" failed. No retries permitted until 2026-05-20 21:50:27.374854305 +0000 UTC m=+130.237275212 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/872c529b-f04d-4f44-be10-283c11ff49e0-metrics-certs") pod "network-metrics-daemon-6wbvb" (UID: "872c529b-f04d-4f44-be10-283c11ff49e0") : secret "metrics-daemon-secret" not found May 20 21:49:23.565456 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:49:23.565416 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fdq2d\" (UniqueName: \"kubernetes.io/projected/b65cd3c8-efd2-4553-99d9-2afbaa703796-kube-api-access-fdq2d\") pod \"network-check-target-qlq8p\" (UID: \"b65cd3c8-efd2-4553-99d9-2afbaa703796\") " pod="openshift-network-diagnostics/network-check-target-qlq8p" May 20 21:49:23.568146 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:49:23.568125 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 20 21:49:23.578688 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:49:23.578660 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 20 21:49:23.589760 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:49:23.589729 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdq2d\" (UniqueName: \"kubernetes.io/projected/b65cd3c8-efd2-4553-99d9-2afbaa703796-kube-api-access-fdq2d\") pod \"network-check-target-qlq8p\" (UID: \"b65cd3c8-efd2-4553-99d9-2afbaa703796\") " pod="openshift-network-diagnostics/network-check-target-qlq8p" May 20 21:49:23.680581 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:49:23.680487 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6x7hr\"" May 20 21:49:23.688758 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:49:23.688731 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qlq8p" May 20 21:49:23.876991 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:49:23.876844 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qlq8p"] May 20 21:49:23.879645 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:49:23.879609 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb65cd3c8_efd2_4553_99d9_2afbaa703796.slice/crio-de55e04945a413ffe13a3b0063886bf293ded331338e4da017c78bab9f28dfbb WatchSource:0}: Error finding container de55e04945a413ffe13a3b0063886bf293ded331338e4da017c78bab9f28dfbb: Status 404 returned error can't find the container with id de55e04945a413ffe13a3b0063886bf293ded331338e4da017c78bab9f28dfbb May 20 21:49:24.044341 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:49:24.044253 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qlq8p" event={"ID":"b65cd3c8-efd2-4553-99d9-2afbaa703796","Type":"ContainerStarted","Data":"de55e04945a413ffe13a3b0063886bf293ded331338e4da017c78bab9f28dfbb"} May 20 21:49:27.051925 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:49:27.051809 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qlq8p" event={"ID":"b65cd3c8-efd2-4553-99d9-2afbaa703796","Type":"ContainerStarted","Data":"5954b4292aa149d67312b3af3c6ec727b8d63f7da61031983dea576e0b6322de"} May 20 21:49:27.052345 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:49:27.051946 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qlq8p" May 20 21:49:27.069273 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:49:27.069225 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qlq8p" podStartSLOduration=67.523411917 podStartE2EDuration="1m10.069210485s" podCreationTimestamp="2026-05-20 21:48:17 +0000 UTC" firstStartedPulling="2026-05-20 21:49:23.881620971 +0000 UTC m=+66.744041878" lastFinishedPulling="2026-05-20 21:49:26.427419536 +0000 UTC m=+69.289840446" observedRunningTime="2026-05-20 21:49:27.068671906 +0000 UTC m=+69.931092837" watchObservedRunningTime="2026-05-20 21:49:27.069210485 +0000 UTC m=+69.931631393" May 20 21:49:54.881884 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:49:54.881821 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d9a5e80-3f7c-4c29-abbc-04a9004ec9df-metrics-tls\") pod \"dns-default-hcsxv\" (UID: \"1d9a5e80-3f7c-4c29-abbc-04a9004ec9df\") " pod="openshift-dns/dns-default-hcsxv" May 20 21:49:54.881884 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:49:54.881893 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/99598051-0e0d-4e2f-ac40-6a2d142b4183-cert\") pod \"ingress-canary-bbvpk\" (UID: \"99598051-0e0d-4e2f-ac40-6a2d142b4183\") " pod="openshift-ingress-canary/ingress-canary-bbvpk" May 20 21:49:54.882428 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:49:54.881987 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 21:49:54.882428 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:49:54.882065 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d9a5e80-3f7c-4c29-abbc-04a9004ec9df-metrics-tls podName:1d9a5e80-3f7c-4c29-abbc-04a9004ec9df nodeName:}" failed. No retries permitted until 2026-05-20 21:50:58.882050456 +0000 UTC m=+161.744471364 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1d9a5e80-3f7c-4c29-abbc-04a9004ec9df-metrics-tls") pod "dns-default-hcsxv" (UID: "1d9a5e80-3f7c-4c29-abbc-04a9004ec9df") : secret "dns-default-metrics-tls" not found May 20 21:49:54.882428 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:49:54.881997 2581 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 21:49:54.882428 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:49:54.882145 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99598051-0e0d-4e2f-ac40-6a2d142b4183-cert podName:99598051-0e0d-4e2f-ac40-6a2d142b4183 nodeName:}" failed. No retries permitted until 2026-05-20 21:50:58.88212906 +0000 UTC m=+161.744549967 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/99598051-0e0d-4e2f-ac40-6a2d142b4183-cert") pod "ingress-canary-bbvpk" (UID: "99598051-0e0d-4e2f-ac40-6a2d142b4183") : secret "canary-serving-cert" not found May 20 21:49:58.055941 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:49:58.055903 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qlq8p" May 20 21:50:27.387980 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:27.387937 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/872c529b-f04d-4f44-be10-283c11ff49e0-metrics-certs\") pod \"network-metrics-daemon-6wbvb\" (UID: \"872c529b-f04d-4f44-be10-283c11ff49e0\") " pod="openshift-multus/network-metrics-daemon-6wbvb" May 20 21:50:27.388452 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:50:27.388053 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 20 21:50:27.388452 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:50:27.388124 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/872c529b-f04d-4f44-be10-283c11ff49e0-metrics-certs podName:872c529b-f04d-4f44-be10-283c11ff49e0 nodeName:}" failed. No retries permitted until 2026-05-20 21:52:29.388110617 +0000 UTC m=+252.250531524 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/872c529b-f04d-4f44-be10-283c11ff49e0-metrics-certs") pod "network-metrics-daemon-6wbvb" (UID: "872c529b-f04d-4f44-be10-283c11ff49e0") : secret "metrics-daemon-secret" not found May 20 21:50:52.924616 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:52.924582 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-gmqwx"] May 20 21:50:52.926294 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:52.926276 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-gmqwx" May 20 21:50:52.928583 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:52.928556 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" May 20 21:50:52.928720 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:52.928625 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" May 20 21:50:52.929525 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:52.929510 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-2rj8k\"" May 20 21:50:52.934844 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:52.934821 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-gmqwx"] May 20 21:50:53.024339 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.024304 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-hkq7r"] May 20 21:50:53.026357 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.026342 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hkq7r" May 20 21:50:53.028700 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.028681 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" May 20 21:50:53.028821 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.028800 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-hdssg\"" May 20 21:50:53.028904 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.028892 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" May 20 21:50:53.028970 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.028946 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" May 20 21:50:53.038997 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.038970 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-hkq7r"] May 20 21:50:53.063768 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.063739 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bcn7\" (UniqueName: \"kubernetes.io/projected/40863a5e-89b6-4b83-a059-2a96c35d94eb-kube-api-access-6bcn7\") pod \"volume-data-source-validator-5cf8c89d64-gmqwx\" (UID: \"40863a5e-89b6-4b83-a059-2a96c35d94eb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-gmqwx" May 20 21:50:53.123315 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.123287 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-nb6qc"] May 20 21:50:53.125130 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.125113 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-nb6qc" May 20 21:50:53.128966 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.128937 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" May 20 21:50:53.129097 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.128982 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" May 20 21:50:53.129097 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.129039 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" May 20 21:50:53.129707 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.129691 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-ms7gk\"" May 20 21:50:53.129792 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.129692 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" May 20 21:50:53.130611 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.130586 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wrfmh"] May 20 21:50:53.132409 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.132390 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wrfmh" May 20 21:50:53.142983 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.142963 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-nb6qc"] May 20 21:50:53.143158 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.143147 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" May 20 21:50:53.143435 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.143419 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-k2jmw\"" May 20 21:50:53.143879 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.143867 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" May 20 21:50:53.144331 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.144316 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" May 20 21:50:53.144390 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.144358 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" May 20 21:50:53.146954 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.146935 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z"] May 20 21:50:53.148952 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.148933 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z" May 20 21:50:53.152232 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.152214 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wrfmh"] May 20 21:50:53.152315 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:50:53.152210 2581 reflector.go:200] "Failed to watch" err="failed to list *v1.Secret: secrets \"image-registry-private-configuration\" is forbidden: User \"system:node:ip-10-0-129-137.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-129-137.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" type="*v1.Secret" May 20 21:50:53.153722 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.153701 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-n8st6\"" May 20 21:50:53.153816 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.153760 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 20 21:50:53.153816 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.153795 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 20 21:50:53.164877 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.164855 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7frsn\" (UniqueName: \"kubernetes.io/projected/e1ef06ef-f0e5-44e1-9006-27123ad29a3a-kube-api-access-7frsn\") pod \"cluster-samples-operator-697587599-hkq7r\" (UID: \"e1ef06ef-f0e5-44e1-9006-27123ad29a3a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hkq7r" May 20 21:50:53.164978 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.164890 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1ef06ef-f0e5-44e1-9006-27123ad29a3a-samples-operator-tls\") pod \"cluster-samples-operator-697587599-hkq7r\" (UID: \"e1ef06ef-f0e5-44e1-9006-27123ad29a3a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hkq7r" May 20 21:50:53.164978 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.164916 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6bcn7\" (UniqueName: \"kubernetes.io/projected/40863a5e-89b6-4b83-a059-2a96c35d94eb-kube-api-access-6bcn7\") pod \"volume-data-source-validator-5cf8c89d64-gmqwx\" (UID: \"40863a5e-89b6-4b83-a059-2a96c35d94eb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-gmqwx" May 20 21:50:53.173359 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.173321 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z"] May 20 21:50:53.183268 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.183219 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 20 21:50:53.186321 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.186296 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bcn7\" (UniqueName: \"kubernetes.io/projected/40863a5e-89b6-4b83-a059-2a96c35d94eb-kube-api-access-6bcn7\") pod \"volume-data-source-validator-5cf8c89d64-gmqwx\" (UID: \"40863a5e-89b6-4b83-a059-2a96c35d94eb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-gmqwx" May 20 21:50:53.234856 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.234814 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-gmqwx" May 20 21:50:53.265706 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.265672 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm8ms\" (UniqueName: \"kubernetes.io/projected/e1f6a66d-0f04-48f9-ba0d-2bd45bf6b350-kube-api-access-fm8ms\") pod \"kube-storage-version-migrator-operator-565644f49-wrfmh\" (UID: \"e1f6a66d-0f04-48f9-ba0d-2bd45bf6b350\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wrfmh" May 20 21:50:53.265706 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.265714 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/093a54ec-c0b5-436c-a3e3-3b01b3168279-registry-tls\") pod \"image-registry-5cb8f8d8dc-nfg8z\" (UID: \"093a54ec-c0b5-436c-a3e3-3b01b3168279\") " pod="openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z" May 20 21:50:53.265881 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.265827 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7frsn\" (UniqueName: \"kubernetes.io/projected/e1ef06ef-f0e5-44e1-9006-27123ad29a3a-kube-api-access-7frsn\") pod \"cluster-samples-operator-697587599-hkq7r\" (UID: \"e1ef06ef-f0e5-44e1-9006-27123ad29a3a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hkq7r" May 20 21:50:53.265881 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.265856 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bc5f1e17-5a1a-4735-bfa3-47c5c8982daf-serving-cert\") pod \"service-ca-operator-57b5b68b8-nb6qc\" (UID: \"bc5f1e17-5a1a-4735-bfa3-47c5c8982daf\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-nb6qc" May 20 21:50:53.265946 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.265885 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bc5f1e17-5a1a-4735-bfa3-47c5c8982daf-config\") pod \"service-ca-operator-57b5b68b8-nb6qc\" (UID: \"bc5f1e17-5a1a-4735-bfa3-47c5c8982daf\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-nb6qc" May 20 21:50:53.265946 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.265917 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/093a54ec-c0b5-436c-a3e3-3b01b3168279-trusted-ca\") pod \"image-registry-5cb8f8d8dc-nfg8z\" (UID: \"093a54ec-c0b5-436c-a3e3-3b01b3168279\") " pod="openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z" May 20 21:50:53.266009 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.265943 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e1f6a66d-0f04-48f9-ba0d-2bd45bf6b350-config\") pod \"kube-storage-version-migrator-operator-565644f49-wrfmh\" (UID: \"e1f6a66d-0f04-48f9-ba0d-2bd45bf6b350\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wrfmh" May 20 21:50:53.266009 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.265959 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/093a54ec-c0b5-436c-a3e3-3b01b3168279-ca-trust-extracted\") pod \"image-registry-5cb8f8d8dc-nfg8z\" (UID: \"093a54ec-c0b5-436c-a3e3-3b01b3168279\") " pod="openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z" May 20 21:50:53.266070 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.266006 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e1f6a66d-0f04-48f9-ba0d-2bd45bf6b350-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-wrfmh\" (UID: \"e1f6a66d-0f04-48f9-ba0d-2bd45bf6b350\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wrfmh" May 20 21:50:53.266070 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.266046 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/093a54ec-c0b5-436c-a3e3-3b01b3168279-installation-pull-secrets\") pod \"image-registry-5cb8f8d8dc-nfg8z\" (UID: \"093a54ec-c0b5-436c-a3e3-3b01b3168279\") " pod="openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z" May 20 21:50:53.266213 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.266105 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1ef06ef-f0e5-44e1-9006-27123ad29a3a-samples-operator-tls\") pod \"cluster-samples-operator-697587599-hkq7r\" (UID: \"e1ef06ef-f0e5-44e1-9006-27123ad29a3a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hkq7r" May 20 21:50:53.266213 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:50:53.266203 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 20 21:50:53.266282 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.266211 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khdzv\" (UniqueName: \"kubernetes.io/projected/bc5f1e17-5a1a-4735-bfa3-47c5c8982daf-kube-api-access-khdzv\") pod \"service-ca-operator-57b5b68b8-nb6qc\" (UID: \"bc5f1e17-5a1a-4735-bfa3-47c5c8982daf\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-nb6qc" May 20 21:50:53.266282 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.266240 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/093a54ec-c0b5-436c-a3e3-3b01b3168279-image-registry-private-configuration\") pod \"image-registry-5cb8f8d8dc-nfg8z\" (UID: \"093a54ec-c0b5-436c-a3e3-3b01b3168279\") " pod="openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z" May 20 21:50:53.266282 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:50:53.266252 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1ef06ef-f0e5-44e1-9006-27123ad29a3a-samples-operator-tls podName:e1ef06ef-f0e5-44e1-9006-27123ad29a3a nodeName:}" failed. No retries permitted until 2026-05-20 21:50:53.766235446 +0000 UTC m=+156.628656355 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e1ef06ef-f0e5-44e1-9006-27123ad29a3a-samples-operator-tls") pod "cluster-samples-operator-697587599-hkq7r" (UID: "e1ef06ef-f0e5-44e1-9006-27123ad29a3a") : secret "samples-operator-tls" not found May 20 21:50:53.266282 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.266277 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/093a54ec-c0b5-436c-a3e3-3b01b3168279-registry-certificates\") pod \"image-registry-5cb8f8d8dc-nfg8z\" (UID: \"093a54ec-c0b5-436c-a3e3-3b01b3168279\") " pod="openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z" May 20 21:50:53.266411 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.266296 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/093a54ec-c0b5-436c-a3e3-3b01b3168279-bound-sa-token\") pod \"image-registry-5cb8f8d8dc-nfg8z\" (UID: \"093a54ec-c0b5-436c-a3e3-3b01b3168279\") " pod="openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z" May 20 21:50:53.266411 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.266326 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lm8wd\" (UniqueName: \"kubernetes.io/projected/093a54ec-c0b5-436c-a3e3-3b01b3168279-kube-api-access-lm8wd\") pod \"image-registry-5cb8f8d8dc-nfg8z\" (UID: \"093a54ec-c0b5-436c-a3e3-3b01b3168279\") " pod="openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z" May 20 21:50:53.275006 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.274986 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7frsn\" (UniqueName: \"kubernetes.io/projected/e1ef06ef-f0e5-44e1-9006-27123ad29a3a-kube-api-access-7frsn\") pod \"cluster-samples-operator-697587599-hkq7r\" (UID: \"e1ef06ef-f0e5-44e1-9006-27123ad29a3a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hkq7r" May 20 21:50:53.354390 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.354359 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-gmqwx"] May 20 21:50:53.357535 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:50:53.357503 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40863a5e_89b6_4b83_a059_2a96c35d94eb.slice/crio-35dd7b8bc9ec205eb7837963b16f39124f5593f4a76e5dca31cf675584fe9951 WatchSource:0}: Error finding container 35dd7b8bc9ec205eb7837963b16f39124f5593f4a76e5dca31cf675584fe9951: Status 404 returned error can't find the container with id 35dd7b8bc9ec205eb7837963b16f39124f5593f4a76e5dca31cf675584fe9951 May 20 21:50:53.367219 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.367197 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bc5f1e17-5a1a-4735-bfa3-47c5c8982daf-serving-cert\") pod \"service-ca-operator-57b5b68b8-nb6qc\" (UID: \"bc5f1e17-5a1a-4735-bfa3-47c5c8982daf\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-nb6qc" May 20 21:50:53.367311 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.367230 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bc5f1e17-5a1a-4735-bfa3-47c5c8982daf-config\") pod \"service-ca-operator-57b5b68b8-nb6qc\" (UID: \"bc5f1e17-5a1a-4735-bfa3-47c5c8982daf\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-nb6qc" May 20 21:50:53.367311 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.367246 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/093a54ec-c0b5-436c-a3e3-3b01b3168279-trusted-ca\") pod \"image-registry-5cb8f8d8dc-nfg8z\" (UID: \"093a54ec-c0b5-436c-a3e3-3b01b3168279\") " pod="openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z" May 20 21:50:53.367311 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.367268 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e1f6a66d-0f04-48f9-ba0d-2bd45bf6b350-config\") pod \"kube-storage-version-migrator-operator-565644f49-wrfmh\" (UID: \"e1f6a66d-0f04-48f9-ba0d-2bd45bf6b350\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wrfmh" May 20 21:50:53.367311 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.367291 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/093a54ec-c0b5-436c-a3e3-3b01b3168279-ca-trust-extracted\") pod \"image-registry-5cb8f8d8dc-nfg8z\" (UID: \"093a54ec-c0b5-436c-a3e3-3b01b3168279\") " pod="openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z" May 20 21:50:53.367311 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.367311 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e1f6a66d-0f04-48f9-ba0d-2bd45bf6b350-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-wrfmh\" (UID: \"e1f6a66d-0f04-48f9-ba0d-2bd45bf6b350\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wrfmh" May 20 21:50:53.367507 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.367328 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/093a54ec-c0b5-436c-a3e3-3b01b3168279-installation-pull-secrets\") pod \"image-registry-5cb8f8d8dc-nfg8z\" (UID: \"093a54ec-c0b5-436c-a3e3-3b01b3168279\") " pod="openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z" May 20 21:50:53.367507 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.367375 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-khdzv\" (UniqueName: \"kubernetes.io/projected/bc5f1e17-5a1a-4735-bfa3-47c5c8982daf-kube-api-access-khdzv\") pod \"service-ca-operator-57b5b68b8-nb6qc\" (UID: \"bc5f1e17-5a1a-4735-bfa3-47c5c8982daf\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-nb6qc" May 20 21:50:53.367679 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.367653 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/093a54ec-c0b5-436c-a3e3-3b01b3168279-image-registry-private-configuration\") pod \"image-registry-5cb8f8d8dc-nfg8z\" (UID: \"093a54ec-c0b5-436c-a3e3-3b01b3168279\") " pod="openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z" May 20 21:50:53.367743 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.367692 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/093a54ec-c0b5-436c-a3e3-3b01b3168279-registry-certificates\") pod \"image-registry-5cb8f8d8dc-nfg8z\" (UID: \"093a54ec-c0b5-436c-a3e3-3b01b3168279\") " pod="openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z" May 20 21:50:53.367743 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.367725 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/093a54ec-c0b5-436c-a3e3-3b01b3168279-bound-sa-token\") pod \"image-registry-5cb8f8d8dc-nfg8z\" (UID: \"093a54ec-c0b5-436c-a3e3-3b01b3168279\") " pod="openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z" May 20 21:50:53.367854 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.367745 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/093a54ec-c0b5-436c-a3e3-3b01b3168279-ca-trust-extracted\") pod \"image-registry-5cb8f8d8dc-nfg8z\" (UID: \"093a54ec-c0b5-436c-a3e3-3b01b3168279\") " pod="openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z" May 20 21:50:53.367854 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.367757 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lm8wd\" (UniqueName: \"kubernetes.io/projected/093a54ec-c0b5-436c-a3e3-3b01b3168279-kube-api-access-lm8wd\") pod \"image-registry-5cb8f8d8dc-nfg8z\" (UID: \"093a54ec-c0b5-436c-a3e3-3b01b3168279\") " pod="openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z" May 20 21:50:53.367854 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.367825 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fm8ms\" (UniqueName: \"kubernetes.io/projected/e1f6a66d-0f04-48f9-ba0d-2bd45bf6b350-kube-api-access-fm8ms\") pod \"kube-storage-version-migrator-operator-565644f49-wrfmh\" (UID: \"e1f6a66d-0f04-48f9-ba0d-2bd45bf6b350\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wrfmh" May 20 21:50:53.368069 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.367858 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/093a54ec-c0b5-436c-a3e3-3b01b3168279-registry-tls\") pod \"image-registry-5cb8f8d8dc-nfg8z\" (UID: \"093a54ec-c0b5-436c-a3e3-3b01b3168279\") " pod="openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z" May 20 21:50:53.368069 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.367904 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bc5f1e17-5a1a-4735-bfa3-47c5c8982daf-config\") pod \"service-ca-operator-57b5b68b8-nb6qc\" (UID: \"bc5f1e17-5a1a-4735-bfa3-47c5c8982daf\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-nb6qc" May 20 21:50:53.368069 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.367918 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e1f6a66d-0f04-48f9-ba0d-2bd45bf6b350-config\") pod \"kube-storage-version-migrator-operator-565644f49-wrfmh\" (UID: \"e1f6a66d-0f04-48f9-ba0d-2bd45bf6b350\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wrfmh" May 20 21:50:53.368069 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:50:53.367966 2581 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 20 21:50:53.368069 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:50:53.367980 2581 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z: secret "image-registry-tls" not found May 20 21:50:53.368069 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:50:53.368029 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/093a54ec-c0b5-436c-a3e3-3b01b3168279-registry-tls podName:093a54ec-c0b5-436c-a3e3-3b01b3168279 nodeName:}" failed. No retries permitted until 2026-05-20 21:50:53.868010547 +0000 UTC m=+156.730431460 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/093a54ec-c0b5-436c-a3e3-3b01b3168279-registry-tls") pod "image-registry-5cb8f8d8dc-nfg8z" (UID: "093a54ec-c0b5-436c-a3e3-3b01b3168279") : secret "image-registry-tls" not found May 20 21:50:53.368432 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.368417 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/093a54ec-c0b5-436c-a3e3-3b01b3168279-registry-certificates\") pod \"image-registry-5cb8f8d8dc-nfg8z\" (UID: \"093a54ec-c0b5-436c-a3e3-3b01b3168279\") " pod="openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z" May 20 21:50:53.368528 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.368511 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/093a54ec-c0b5-436c-a3e3-3b01b3168279-trusted-ca\") pod \"image-registry-5cb8f8d8dc-nfg8z\" (UID: \"093a54ec-c0b5-436c-a3e3-3b01b3168279\") " pod="openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z" May 20 21:50:53.369897 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.369879 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/093a54ec-c0b5-436c-a3e3-3b01b3168279-installation-pull-secrets\") pod \"image-registry-5cb8f8d8dc-nfg8z\" (UID: \"093a54ec-c0b5-436c-a3e3-3b01b3168279\") " pod="openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z" May 20 21:50:53.370165 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.370148 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e1f6a66d-0f04-48f9-ba0d-2bd45bf6b350-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-wrfmh\" (UID: \"e1f6a66d-0f04-48f9-ba0d-2bd45bf6b350\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wrfmh" May 20 21:50:53.370244 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.370190 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bc5f1e17-5a1a-4735-bfa3-47c5c8982daf-serving-cert\") pod \"service-ca-operator-57b5b68b8-nb6qc\" (UID: \"bc5f1e17-5a1a-4735-bfa3-47c5c8982daf\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-nb6qc" May 20 21:50:53.375945 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.375923 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khdzv\" (UniqueName: \"kubernetes.io/projected/bc5f1e17-5a1a-4735-bfa3-47c5c8982daf-kube-api-access-khdzv\") pod \"service-ca-operator-57b5b68b8-nb6qc\" (UID: \"bc5f1e17-5a1a-4735-bfa3-47c5c8982daf\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-nb6qc" May 20 21:50:53.376045 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.376014 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm8ms\" (UniqueName: \"kubernetes.io/projected/e1f6a66d-0f04-48f9-ba0d-2bd45bf6b350-kube-api-access-fm8ms\") pod \"kube-storage-version-migrator-operator-565644f49-wrfmh\" (UID: \"e1f6a66d-0f04-48f9-ba0d-2bd45bf6b350\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wrfmh" May 20 21:50:53.376214 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.376189 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/093a54ec-c0b5-436c-a3e3-3b01b3168279-bound-sa-token\") pod \"image-registry-5cb8f8d8dc-nfg8z\" (UID: \"093a54ec-c0b5-436c-a3e3-3b01b3168279\") " pod="openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z" May 20 21:50:53.376342 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.376324 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lm8wd\" (UniqueName: \"kubernetes.io/projected/093a54ec-c0b5-436c-a3e3-3b01b3168279-kube-api-access-lm8wd\") pod \"image-registry-5cb8f8d8dc-nfg8z\" (UID: \"093a54ec-c0b5-436c-a3e3-3b01b3168279\") " pod="openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z" May 20 21:50:53.434676 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.434586 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-nb6qc" May 20 21:50:53.439972 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.439952 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wrfmh" May 20 21:50:53.559986 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.559947 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-nb6qc"] May 20 21:50:53.562887 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:50:53.562857 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc5f1e17_5a1a_4735_bfa3_47c5c8982daf.slice/crio-7a0ecd4798680211950389466e8f94accc89cf655324ce8918b496c78a06b6ab WatchSource:0}: Error finding container 7a0ecd4798680211950389466e8f94accc89cf655324ce8918b496c78a06b6ab: Status 404 returned error can't find the container with id 7a0ecd4798680211950389466e8f94accc89cf655324ce8918b496c78a06b6ab May 20 21:50:53.577135 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.577106 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wrfmh"] May 20 21:50:53.580148 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:50:53.580124 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1f6a66d_0f04_48f9_ba0d_2bd45bf6b350.slice/crio-e25c30971b7bced1aa04fe8cd3db54fbd2e62a147cf6f064b6a769d1c2fe0bb2 WatchSource:0}: Error finding container e25c30971b7bced1aa04fe8cd3db54fbd2e62a147cf6f064b6a769d1c2fe0bb2: Status 404 returned error can't find the container with id e25c30971b7bced1aa04fe8cd3db54fbd2e62a147cf6f064b6a769d1c2fe0bb2 May 20 21:50:53.771142 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.771048 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1ef06ef-f0e5-44e1-9006-27123ad29a3a-samples-operator-tls\") pod \"cluster-samples-operator-697587599-hkq7r\" (UID: \"e1ef06ef-f0e5-44e1-9006-27123ad29a3a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hkq7r" May 20 21:50:53.771306 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:50:53.771225 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 20 21:50:53.774864 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:50:53.772777 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1ef06ef-f0e5-44e1-9006-27123ad29a3a-samples-operator-tls podName:e1ef06ef-f0e5-44e1-9006-27123ad29a3a nodeName:}" failed. No retries permitted until 2026-05-20 21:50:54.772750108 +0000 UTC m=+157.635171023 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e1ef06ef-f0e5-44e1-9006-27123ad29a3a-samples-operator-tls") pod "cluster-samples-operator-697587599-hkq7r" (UID: "e1ef06ef-f0e5-44e1-9006-27123ad29a3a") : secret "samples-operator-tls" not found May 20 21:50:53.872155 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:53.872118 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/093a54ec-c0b5-436c-a3e3-3b01b3168279-registry-tls\") pod \"image-registry-5cb8f8d8dc-nfg8z\" (UID: \"093a54ec-c0b5-436c-a3e3-3b01b3168279\") " pod="openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z" May 20 21:50:53.872323 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:50:53.872304 2581 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 20 21:50:53.872404 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:50:53.872330 2581 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z: secret "image-registry-tls" not found May 20 21:50:53.872450 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:50:53.872441 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/093a54ec-c0b5-436c-a3e3-3b01b3168279-registry-tls podName:093a54ec-c0b5-436c-a3e3-3b01b3168279 nodeName:}" failed. No retries permitted until 2026-05-20 21:50:54.872415662 +0000 UTC m=+157.734836585 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/093a54ec-c0b5-436c-a3e3-3b01b3168279-registry-tls") pod "image-registry-5cb8f8d8dc-nfg8z" (UID: "093a54ec-c0b5-436c-a3e3-3b01b3168279") : secret "image-registry-tls" not found May 20 21:50:54.054022 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:50:54.053917 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hcsxv" podUID="1d9a5e80-3f7c-4c29-abbc-04a9004ec9df" May 20 21:50:54.065260 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:50:54.065214 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-bbvpk" podUID="99598051-0e0d-4e2f-ac40-6a2d142b4183" May 20 21:50:54.218778 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:54.218736 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-nb6qc" event={"ID":"bc5f1e17-5a1a-4735-bfa3-47c5c8982daf","Type":"ContainerStarted","Data":"7a0ecd4798680211950389466e8f94accc89cf655324ce8918b496c78a06b6ab"} May 20 21:50:54.219869 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:54.219813 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wrfmh" event={"ID":"e1f6a66d-0f04-48f9-ba0d-2bd45bf6b350","Type":"ContainerStarted","Data":"e25c30971b7bced1aa04fe8cd3db54fbd2e62a147cf6f064b6a769d1c2fe0bb2"} May 20 21:50:54.221047 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:54.221026 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hcsxv" May 20 21:50:54.221047 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:54.221029 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-gmqwx" event={"ID":"40863a5e-89b6-4b83-a059-2a96c35d94eb","Type":"ContainerStarted","Data":"35dd7b8bc9ec205eb7837963b16f39124f5593f4a76e5dca31cf675584fe9951"} May 20 21:50:54.223220 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:54.223199 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 20 21:50:54.231404 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:54.231343 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/093a54ec-c0b5-436c-a3e3-3b01b3168279-image-registry-private-configuration\") pod \"image-registry-5cb8f8d8dc-nfg8z\" (UID: \"093a54ec-c0b5-436c-a3e3-3b01b3168279\") " pod="openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z" May 20 21:50:54.782503 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:54.782461 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1ef06ef-f0e5-44e1-9006-27123ad29a3a-samples-operator-tls\") pod \"cluster-samples-operator-697587599-hkq7r\" (UID: \"e1ef06ef-f0e5-44e1-9006-27123ad29a3a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hkq7r" May 20 21:50:54.782700 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:50:54.782649 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 20 21:50:54.782770 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:50:54.782746 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1ef06ef-f0e5-44e1-9006-27123ad29a3a-samples-operator-tls podName:e1ef06ef-f0e5-44e1-9006-27123ad29a3a nodeName:}" failed. No retries permitted until 2026-05-20 21:50:56.782722086 +0000 UTC m=+159.645142994 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e1ef06ef-f0e5-44e1-9006-27123ad29a3a-samples-operator-tls") pod "cluster-samples-operator-697587599-hkq7r" (UID: "e1ef06ef-f0e5-44e1-9006-27123ad29a3a") : secret "samples-operator-tls" not found May 20 21:50:54.883512 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:54.883425 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/093a54ec-c0b5-436c-a3e3-3b01b3168279-registry-tls\") pod \"image-registry-5cb8f8d8dc-nfg8z\" (UID: \"093a54ec-c0b5-436c-a3e3-3b01b3168279\") " pod="openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z" May 20 21:50:54.883695 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:50:54.883608 2581 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 20 21:50:54.883695 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:50:54.883631 2581 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z: secret "image-registry-tls" not found May 20 21:50:54.883805 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:50:54.883717 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/093a54ec-c0b5-436c-a3e3-3b01b3168279-registry-tls podName:093a54ec-c0b5-436c-a3e3-3b01b3168279 nodeName:}" failed. No retries permitted until 2026-05-20 21:50:56.883694333 +0000 UTC m=+159.746115246 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/093a54ec-c0b5-436c-a3e3-3b01b3168279-registry-tls") pod "image-registry-5cb8f8d8dc-nfg8z" (UID: "093a54ec-c0b5-436c-a3e3-3b01b3168279") : secret "image-registry-tls" not found May 20 21:50:55.224595 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:55.224507 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-gmqwx" event={"ID":"40863a5e-89b6-4b83-a059-2a96c35d94eb","Type":"ContainerStarted","Data":"12bb515abce8b475ebb90e0e19f99e2bb94ff6ca57171479ca91388f6c5c8dbc"} May 20 21:50:55.240022 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:55.239955 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-gmqwx" podStartSLOduration=2.030560061 podStartE2EDuration="3.239937204s" podCreationTimestamp="2026-05-20 21:50:52 +0000 UTC" firstStartedPulling="2026-05-20 21:50:53.359293052 +0000 UTC m=+156.221713959" lastFinishedPulling="2026-05-20 21:50:54.568670188 +0000 UTC m=+157.431091102" observedRunningTime="2026-05-20 21:50:55.239691261 +0000 UTC m=+158.102112190" watchObservedRunningTime="2026-05-20 21:50:55.239937204 +0000 UTC m=+158.102358135" May 20 21:50:55.782200 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:50:55.782147 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-6wbvb" podUID="872c529b-f04d-4f44-be10-283c11ff49e0" May 20 21:50:56.227440 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:56.227401 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wrfmh" event={"ID":"e1f6a66d-0f04-48f9-ba0d-2bd45bf6b350","Type":"ContainerStarted","Data":"67e1c44369db779383062ad15cde2371d003ea97127d4ae1c8ca74e57dec39be"} May 20 21:50:56.228681 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:56.228657 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-nb6qc" event={"ID":"bc5f1e17-5a1a-4735-bfa3-47c5c8982daf","Type":"ContainerStarted","Data":"1e52120195ade03fb2331a32cafe6f3042e59aa3eebd65f977619def43f39fc5"} May 20 21:50:56.244549 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:56.244497 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wrfmh" podStartSLOduration=0.809059154 podStartE2EDuration="3.244480818s" podCreationTimestamp="2026-05-20 21:50:53 +0000 UTC" firstStartedPulling="2026-05-20 21:50:53.581883795 +0000 UTC m=+156.444304706" lastFinishedPulling="2026-05-20 21:50:56.017305458 +0000 UTC m=+158.879726370" observedRunningTime="2026-05-20 21:50:56.244041541 +0000 UTC m=+159.106462472" watchObservedRunningTime="2026-05-20 21:50:56.244480818 +0000 UTC m=+159.106901749" May 20 21:50:56.258047 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:56.257988 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-nb6qc" podStartSLOduration=0.802287648 podStartE2EDuration="3.257971481s" podCreationTimestamp="2026-05-20 21:50:53 +0000 UTC" firstStartedPulling="2026-05-20 21:50:53.564755749 +0000 UTC m=+156.427176657" lastFinishedPulling="2026-05-20 21:50:56.020439567 +0000 UTC m=+158.882860490" observedRunningTime="2026-05-20 21:50:56.257684281 +0000 UTC m=+159.120105213" watchObservedRunningTime="2026-05-20 21:50:56.257971481 +0000 UTC m=+159.120392413" May 20 21:50:56.804243 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:56.804203 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1ef06ef-f0e5-44e1-9006-27123ad29a3a-samples-operator-tls\") pod \"cluster-samples-operator-697587599-hkq7r\" (UID: \"e1ef06ef-f0e5-44e1-9006-27123ad29a3a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hkq7r" May 20 21:50:56.804477 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:50:56.804367 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 20 21:50:56.804477 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:50:56.804437 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1ef06ef-f0e5-44e1-9006-27123ad29a3a-samples-operator-tls podName:e1ef06ef-f0e5-44e1-9006-27123ad29a3a nodeName:}" failed. No retries permitted until 2026-05-20 21:51:00.804420708 +0000 UTC m=+163.666841615 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e1ef06ef-f0e5-44e1-9006-27123ad29a3a-samples-operator-tls") pod "cluster-samples-operator-697587599-hkq7r" (UID: "e1ef06ef-f0e5-44e1-9006-27123ad29a3a") : secret "samples-operator-tls" not found May 20 21:50:56.905223 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:56.905133 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/093a54ec-c0b5-436c-a3e3-3b01b3168279-registry-tls\") pod \"image-registry-5cb8f8d8dc-nfg8z\" (UID: \"093a54ec-c0b5-436c-a3e3-3b01b3168279\") " pod="openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z" May 20 21:50:56.905401 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:50:56.905289 2581 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 20 21:50:56.905401 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:50:56.905310 2581 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z: secret "image-registry-tls" not found May 20 21:50:56.905401 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:50:56.905368 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/093a54ec-c0b5-436c-a3e3-3b01b3168279-registry-tls podName:093a54ec-c0b5-436c-a3e3-3b01b3168279 nodeName:}" failed. No retries permitted until 2026-05-20 21:51:00.905351282 +0000 UTC m=+163.767772189 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/093a54ec-c0b5-436c-a3e3-3b01b3168279-registry-tls") pod "image-registry-5cb8f8d8dc-nfg8z" (UID: "093a54ec-c0b5-436c-a3e3-3b01b3168279") : secret "image-registry-tls" not found May 20 21:50:57.266617 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:57.266575 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-52hlp"] May 20 21:50:57.269851 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:57.269827 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-52hlp" May 20 21:50:57.272352 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:57.272330 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" May 20 21:50:57.273281 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:57.273267 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" May 20 21:50:57.273372 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:57.273290 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-8hfcs\"" May 20 21:50:57.277754 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:57.277704 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-52hlp"] May 20 21:50:57.410463 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:57.410413 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqgxp\" (UniqueName: \"kubernetes.io/projected/60a657dd-734e-43c3-9b9d-e939b199b5fe-kube-api-access-dqgxp\") pod \"migrator-b985f5d89-52hlp\" (UID: \"60a657dd-734e-43c3-9b9d-e939b199b5fe\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-52hlp" May 20 21:50:57.511055 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:57.511014 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dqgxp\" (UniqueName: \"kubernetes.io/projected/60a657dd-734e-43c3-9b9d-e939b199b5fe-kube-api-access-dqgxp\") pod \"migrator-b985f5d89-52hlp\" (UID: \"60a657dd-734e-43c3-9b9d-e939b199b5fe\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-52hlp" May 20 21:50:57.518605 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:57.518536 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqgxp\" (UniqueName: \"kubernetes.io/projected/60a657dd-734e-43c3-9b9d-e939b199b5fe-kube-api-access-dqgxp\") pod \"migrator-b985f5d89-52hlp\" (UID: \"60a657dd-734e-43c3-9b9d-e939b199b5fe\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-52hlp" May 20 21:50:57.581145 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:57.581115 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-52hlp" May 20 21:50:57.705880 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:57.705727 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-52hlp"] May 20 21:50:57.708280 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:50:57.708249 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60a657dd_734e_43c3_9b9d_e939b199b5fe.slice/crio-85eca5dcd47a42ceca51ce7a25d3ad2e52aa93fa774bc781ad6df1d3564587fe WatchSource:0}: Error finding container 85eca5dcd47a42ceca51ce7a25d3ad2e52aa93fa774bc781ad6df1d3564587fe: Status 404 returned error can't find the container with id 85eca5dcd47a42ceca51ce7a25d3ad2e52aa93fa774bc781ad6df1d3564587fe May 20 21:50:58.234421 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:58.234380 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-52hlp" event={"ID":"60a657dd-734e-43c3-9b9d-e939b199b5fe","Type":"ContainerStarted","Data":"85eca5dcd47a42ceca51ce7a25d3ad2e52aa93fa774bc781ad6df1d3564587fe"} May 20 21:50:58.831244 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:58.831226 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x5q4l_b7fbcb26-e155-4cf8-89ba-17e5c52f3f8c/dns-node-resolver/0.log" May 20 21:50:58.922776 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:58.922735 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d9a5e80-3f7c-4c29-abbc-04a9004ec9df-metrics-tls\") pod \"dns-default-hcsxv\" (UID: \"1d9a5e80-3f7c-4c29-abbc-04a9004ec9df\") " pod="openshift-dns/dns-default-hcsxv" May 20 21:50:58.922776 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:58.922781 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/99598051-0e0d-4e2f-ac40-6a2d142b4183-cert\") pod \"ingress-canary-bbvpk\" (UID: \"99598051-0e0d-4e2f-ac40-6a2d142b4183\") " pod="openshift-ingress-canary/ingress-canary-bbvpk" May 20 21:50:58.922989 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:50:58.922873 2581 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 20 21:50:58.922989 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:50:58.922920 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99598051-0e0d-4e2f-ac40-6a2d142b4183-cert podName:99598051-0e0d-4e2f-ac40-6a2d142b4183 nodeName:}" failed. No retries permitted until 2026-05-20 21:53:00.92290691 +0000 UTC m=+283.785327819 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/99598051-0e0d-4e2f-ac40-6a2d142b4183-cert") pod "ingress-canary-bbvpk" (UID: "99598051-0e0d-4e2f-ac40-6a2d142b4183") : secret "canary-serving-cert" not found May 20 21:50:58.922989 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:50:58.922875 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 20 21:50:58.923184 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:50:58.922997 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d9a5e80-3f7c-4c29-abbc-04a9004ec9df-metrics-tls podName:1d9a5e80-3f7c-4c29-abbc-04a9004ec9df nodeName:}" failed. No retries permitted until 2026-05-20 21:53:00.922983352 +0000 UTC m=+283.785404260 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1d9a5e80-3f7c-4c29-abbc-04a9004ec9df-metrics-tls") pod "dns-default-hcsxv" (UID: "1d9a5e80-3f7c-4c29-abbc-04a9004ec9df") : secret "dns-default-metrics-tls" not found May 20 21:50:59.239544 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:59.239508 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-52hlp" event={"ID":"60a657dd-734e-43c3-9b9d-e939b199b5fe","Type":"ContainerStarted","Data":"9c4a1cccc6153b2f124ce6e89c1bc6fe95533771d1079f37470b44ee5079eb37"} May 20 21:50:59.239544 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:59.239547 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-52hlp" event={"ID":"60a657dd-734e-43c3-9b9d-e939b199b5fe","Type":"ContainerStarted","Data":"6802832062bc129df7a94c43a98ccb08213e774c592e381179ae98bccfbe05c2"} May 20 21:50:59.254244 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:59.254198 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-52hlp" podStartSLOduration=1.27174088 podStartE2EDuration="2.2541519s" podCreationTimestamp="2026-05-20 21:50:57 +0000 UTC" firstStartedPulling="2026-05-20 21:50:57.709903164 +0000 UTC m=+160.572324072" lastFinishedPulling="2026-05-20 21:50:58.692314181 +0000 UTC m=+161.554735092" observedRunningTime="2026-05-20 21:50:59.253629258 +0000 UTC m=+162.116050201" watchObservedRunningTime="2026-05-20 21:50:59.2541519 +0000 UTC m=+162.116572878" May 20 21:50:59.806204 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:59.806163 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-tv5mn"] May 20 21:50:59.809089 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:59.809059 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-tv5mn" May 20 21:50:59.811431 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:59.811406 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" May 20 21:50:59.811565 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:59.811449 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" May 20 21:50:59.811698 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:59.811685 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" May 20 21:50:59.812526 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:59.812510 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-k5xj8\"" May 20 21:50:59.812561 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:59.812526 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" May 20 21:50:59.816789 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:59.816766 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-tv5mn"] May 20 21:50:59.828711 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:59.828688 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8f0b173b-dbed-4cbb-90e8-0b0fe35066f2-signing-cabundle\") pod \"service-ca-67d667c7d-tv5mn\" (UID: \"8f0b173b-dbed-4cbb-90e8-0b0fe35066f2\") " pod="openshift-service-ca/service-ca-67d667c7d-tv5mn" May 20 21:50:59.828834 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:59.828732 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs5r2\" (UniqueName: \"kubernetes.io/projected/8f0b173b-dbed-4cbb-90e8-0b0fe35066f2-kube-api-access-bs5r2\") pod \"service-ca-67d667c7d-tv5mn\" (UID: \"8f0b173b-dbed-4cbb-90e8-0b0fe35066f2\") " pod="openshift-service-ca/service-ca-67d667c7d-tv5mn" May 20 21:50:59.828834 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:59.828815 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8f0b173b-dbed-4cbb-90e8-0b0fe35066f2-signing-key\") pod \"service-ca-67d667c7d-tv5mn\" (UID: \"8f0b173b-dbed-4cbb-90e8-0b0fe35066f2\") " pod="openshift-service-ca/service-ca-67d667c7d-tv5mn" May 20 21:50:59.835826 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:59.835784 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vhwkk_30a53acd-d1d9-480d-885b-ebccb4ef3734/node-ca/0.log" May 20 21:50:59.929331 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:59.929299 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8f0b173b-dbed-4cbb-90e8-0b0fe35066f2-signing-cabundle\") pod \"service-ca-67d667c7d-tv5mn\" (UID: \"8f0b173b-dbed-4cbb-90e8-0b0fe35066f2\") " pod="openshift-service-ca/service-ca-67d667c7d-tv5mn" May 20 21:50:59.929452 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:59.929342 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bs5r2\" (UniqueName: \"kubernetes.io/projected/8f0b173b-dbed-4cbb-90e8-0b0fe35066f2-kube-api-access-bs5r2\") pod \"service-ca-67d667c7d-tv5mn\" (UID: \"8f0b173b-dbed-4cbb-90e8-0b0fe35066f2\") " pod="openshift-service-ca/service-ca-67d667c7d-tv5mn" May 20 21:50:59.929537 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:59.929510 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8f0b173b-dbed-4cbb-90e8-0b0fe35066f2-signing-key\") pod \"service-ca-67d667c7d-tv5mn\" (UID: \"8f0b173b-dbed-4cbb-90e8-0b0fe35066f2\") " pod="openshift-service-ca/service-ca-67d667c7d-tv5mn" May 20 21:50:59.930025 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:59.930008 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8f0b173b-dbed-4cbb-90e8-0b0fe35066f2-signing-cabundle\") pod \"service-ca-67d667c7d-tv5mn\" (UID: \"8f0b173b-dbed-4cbb-90e8-0b0fe35066f2\") " pod="openshift-service-ca/service-ca-67d667c7d-tv5mn" May 20 21:50:59.931941 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:59.931922 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8f0b173b-dbed-4cbb-90e8-0b0fe35066f2-signing-key\") pod \"service-ca-67d667c7d-tv5mn\" (UID: \"8f0b173b-dbed-4cbb-90e8-0b0fe35066f2\") " pod="openshift-service-ca/service-ca-67d667c7d-tv5mn" May 20 21:50:59.936710 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:50:59.936691 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs5r2\" (UniqueName: \"kubernetes.io/projected/8f0b173b-dbed-4cbb-90e8-0b0fe35066f2-kube-api-access-bs5r2\") pod \"service-ca-67d667c7d-tv5mn\" (UID: \"8f0b173b-dbed-4cbb-90e8-0b0fe35066f2\") " pod="openshift-service-ca/service-ca-67d667c7d-tv5mn" May 20 21:51:00.118522 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:00.118495 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-tv5mn" May 20 21:51:00.236559 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:00.236522 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-tv5mn"] May 20 21:51:00.240281 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:51:00.240252 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f0b173b_dbed_4cbb_90e8_0b0fe35066f2.slice/crio-944b0103a816c33f853d3c15b7b1db69323402d1826ff96b8c14c987f31b8c07 WatchSource:0}: Error finding container 944b0103a816c33f853d3c15b7b1db69323402d1826ff96b8c14c987f31b8c07: Status 404 returned error can't find the container with id 944b0103a816c33f853d3c15b7b1db69323402d1826ff96b8c14c987f31b8c07 May 20 21:51:00.835563 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:00.835517 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1ef06ef-f0e5-44e1-9006-27123ad29a3a-samples-operator-tls\") pod \"cluster-samples-operator-697587599-hkq7r\" (UID: \"e1ef06ef-f0e5-44e1-9006-27123ad29a3a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hkq7r" May 20 21:51:00.835740 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:51:00.835661 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 20 21:51:00.835740 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:51:00.835730 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1ef06ef-f0e5-44e1-9006-27123ad29a3a-samples-operator-tls podName:e1ef06ef-f0e5-44e1-9006-27123ad29a3a nodeName:}" failed. No retries permitted until 2026-05-20 21:51:08.83571387 +0000 UTC m=+171.698134778 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e1ef06ef-f0e5-44e1-9006-27123ad29a3a-samples-operator-tls") pod "cluster-samples-operator-697587599-hkq7r" (UID: "e1ef06ef-f0e5-44e1-9006-27123ad29a3a") : secret "samples-operator-tls" not found May 20 21:51:00.935969 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:00.935925 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/093a54ec-c0b5-436c-a3e3-3b01b3168279-registry-tls\") pod \"image-registry-5cb8f8d8dc-nfg8z\" (UID: \"093a54ec-c0b5-436c-a3e3-3b01b3168279\") " pod="openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z" May 20 21:51:00.936446 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:51:00.936105 2581 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 20 21:51:00.936446 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:51:00.936131 2581 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z: secret "image-registry-tls" not found May 20 21:51:00.936446 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:51:00.936204 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/093a54ec-c0b5-436c-a3e3-3b01b3168279-registry-tls podName:093a54ec-c0b5-436c-a3e3-3b01b3168279 nodeName:}" failed. No retries permitted until 2026-05-20 21:51:08.936183025 +0000 UTC m=+171.798603950 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/093a54ec-c0b5-436c-a3e3-3b01b3168279-registry-tls") pod "image-registry-5cb8f8d8dc-nfg8z" (UID: "093a54ec-c0b5-436c-a3e3-3b01b3168279") : secret "image-registry-tls" not found May 20 21:51:01.245888 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:01.245795 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-tv5mn" event={"ID":"8f0b173b-dbed-4cbb-90e8-0b0fe35066f2","Type":"ContainerStarted","Data":"6dc2d7d5ce3ce3e7f7d536aedd177f7d8a4a02a05a4694f4bb90a27debbbc344"} May 20 21:51:01.245888 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:01.245836 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-tv5mn" event={"ID":"8f0b173b-dbed-4cbb-90e8-0b0fe35066f2","Type":"ContainerStarted","Data":"944b0103a816c33f853d3c15b7b1db69323402d1826ff96b8c14c987f31b8c07"} May 20 21:51:01.264606 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:01.264558 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-tv5mn" podStartSLOduration=2.264543326 podStartE2EDuration="2.264543326s" podCreationTimestamp="2026-05-20 21:50:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 21:51:01.26299872 +0000 UTC m=+164.125419641" watchObservedRunningTime="2026-05-20 21:51:01.264543326 +0000 UTC m=+164.126964255" May 20 21:51:08.768092 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:08.768031 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bbvpk" May 20 21:51:08.768092 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:08.768040 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wbvb" May 20 21:51:08.909407 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:08.909366 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1ef06ef-f0e5-44e1-9006-27123ad29a3a-samples-operator-tls\") pod \"cluster-samples-operator-697587599-hkq7r\" (UID: \"e1ef06ef-f0e5-44e1-9006-27123ad29a3a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hkq7r" May 20 21:51:08.911730 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:08.911707 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1ef06ef-f0e5-44e1-9006-27123ad29a3a-samples-operator-tls\") pod \"cluster-samples-operator-697587599-hkq7r\" (UID: \"e1ef06ef-f0e5-44e1-9006-27123ad29a3a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hkq7r" May 20 21:51:08.935731 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:08.935703 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hkq7r" May 20 21:51:09.010999 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:09.010815 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/093a54ec-c0b5-436c-a3e3-3b01b3168279-registry-tls\") pod \"image-registry-5cb8f8d8dc-nfg8z\" (UID: \"093a54ec-c0b5-436c-a3e3-3b01b3168279\") " pod="openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z" May 20 21:51:09.014361 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:09.014301 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/093a54ec-c0b5-436c-a3e3-3b01b3168279-registry-tls\") pod \"image-registry-5cb8f8d8dc-nfg8z\" (UID: \"093a54ec-c0b5-436c-a3e3-3b01b3168279\") " pod="openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z" May 20 21:51:09.058643 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:09.058565 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-hkq7r"] May 20 21:51:09.059289 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:09.059267 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z" May 20 21:51:09.181738 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:09.181705 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z"] May 20 21:51:09.184924 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:51:09.184899 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod093a54ec_c0b5_436c_a3e3_3b01b3168279.slice/crio-d878507573818c2eab8d4773a9a9fd2d1d36c2dc2aebd658956c912b157d0aac WatchSource:0}: Error finding container d878507573818c2eab8d4773a9a9fd2d1d36c2dc2aebd658956c912b157d0aac: Status 404 returned error can't find the container with id d878507573818c2eab8d4773a9a9fd2d1d36c2dc2aebd658956c912b157d0aac May 20 21:51:09.265874 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:09.265835 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hkq7r" event={"ID":"e1ef06ef-f0e5-44e1-9006-27123ad29a3a","Type":"ContainerStarted","Data":"f6773eb94c8e80463b0c4c9c3575335ef191a416f32f015cd9336e4da598c204"} May 20 21:51:09.267157 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:09.267131 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z" event={"ID":"093a54ec-c0b5-436c-a3e3-3b01b3168279","Type":"ContainerStarted","Data":"9376301dac03c82fdff7265387bd5b36c635e3063453c46fe589f38d685ba42f"} May 20 21:51:09.267248 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:09.267163 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z" event={"ID":"093a54ec-c0b5-436c-a3e3-3b01b3168279","Type":"ContainerStarted","Data":"d878507573818c2eab8d4773a9a9fd2d1d36c2dc2aebd658956c912b157d0aac"} May 20 21:51:09.267248 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:09.267238 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z" May 20 21:51:09.284503 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:09.284461 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z" podStartSLOduration=16.284446935 podStartE2EDuration="16.284446935s" podCreationTimestamp="2026-05-20 21:50:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 21:51:09.283864349 +0000 UTC m=+172.146285280" watchObservedRunningTime="2026-05-20 21:51:09.284446935 +0000 UTC m=+172.146867903" May 20 21:51:11.274567 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:11.274534 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hkq7r" event={"ID":"e1ef06ef-f0e5-44e1-9006-27123ad29a3a","Type":"ContainerStarted","Data":"aae8eebce143cd071abf0a6a49f2e941ebd411f6f572bda6faa1f85a2d73214c"} May 20 21:51:11.274567 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:11.274571 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hkq7r" event={"ID":"e1ef06ef-f0e5-44e1-9006-27123ad29a3a","Type":"ContainerStarted","Data":"c6d145f02135737daae4eeaad2b95801987a53055ba56d439e92a66aa58c98bd"} May 20 21:51:11.289467 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:11.289425 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-hkq7r" podStartSLOduration=16.82133817 podStartE2EDuration="18.289410534s" podCreationTimestamp="2026-05-20 21:50:53 +0000 UTC" firstStartedPulling="2026-05-20 21:51:09.114507466 +0000 UTC m=+171.976928386" lastFinishedPulling="2026-05-20 21:51:10.58257984 +0000 UTC m=+173.445000750" observedRunningTime="2026-05-20 21:51:11.288986746 +0000 UTC m=+174.151407687" watchObservedRunningTime="2026-05-20 21:51:11.289410534 +0000 UTC m=+174.151831464" May 20 21:51:18.742838 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:18.742802 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-g65q5"] May 20 21:51:18.747670 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:18.747647 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-g65q5" May 20 21:51:18.749235 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:18.749210 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z"] May 20 21:51:18.750774 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:18.750751 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 20 21:51:18.750893 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:18.750837 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4kzp2\"" May 20 21:51:18.751423 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:18.751400 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 20 21:51:18.751538 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:18.751400 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 20 21:51:18.751538 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:18.751411 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 20 21:51:18.764400 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:18.764376 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-g65q5"] May 20 21:51:18.781915 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:18.781888 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/21265fbc-2f7c-4414-9505-4bb586055f1f-data-volume\") pod \"insights-runtime-extractor-g65q5\" (UID: \"21265fbc-2f7c-4414-9505-4bb586055f1f\") " pod="openshift-insights/insights-runtime-extractor-g65q5" May 20 21:51:18.782060 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:18.781936 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxd9g\" (UniqueName: \"kubernetes.io/projected/21265fbc-2f7c-4414-9505-4bb586055f1f-kube-api-access-rxd9g\") pod \"insights-runtime-extractor-g65q5\" (UID: \"21265fbc-2f7c-4414-9505-4bb586055f1f\") " pod="openshift-insights/insights-runtime-extractor-g65q5" May 20 21:51:18.782060 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:18.781965 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/21265fbc-2f7c-4414-9505-4bb586055f1f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g65q5\" (UID: \"21265fbc-2f7c-4414-9505-4bb586055f1f\") " pod="openshift-insights/insights-runtime-extractor-g65q5" May 20 21:51:18.782060 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:18.781985 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/21265fbc-2f7c-4414-9505-4bb586055f1f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g65q5\" (UID: \"21265fbc-2f7c-4414-9505-4bb586055f1f\") " pod="openshift-insights/insights-runtime-extractor-g65q5" May 20 21:51:18.782198 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:18.782139 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/21265fbc-2f7c-4414-9505-4bb586055f1f-crio-socket\") pod \"insights-runtime-extractor-g65q5\" (UID: \"21265fbc-2f7c-4414-9505-4bb586055f1f\") " pod="openshift-insights/insights-runtime-extractor-g65q5" May 20 21:51:18.883283 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:18.883247 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/21265fbc-2f7c-4414-9505-4bb586055f1f-crio-socket\") pod \"insights-runtime-extractor-g65q5\" (UID: \"21265fbc-2f7c-4414-9505-4bb586055f1f\") " pod="openshift-insights/insights-runtime-extractor-g65q5" May 20 21:51:18.883443 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:18.883305 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/21265fbc-2f7c-4414-9505-4bb586055f1f-data-volume\") pod \"insights-runtime-extractor-g65q5\" (UID: \"21265fbc-2f7c-4414-9505-4bb586055f1f\") " pod="openshift-insights/insights-runtime-extractor-g65q5" May 20 21:51:18.883443 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:18.883351 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rxd9g\" (UniqueName: \"kubernetes.io/projected/21265fbc-2f7c-4414-9505-4bb586055f1f-kube-api-access-rxd9g\") pod \"insights-runtime-extractor-g65q5\" (UID: \"21265fbc-2f7c-4414-9505-4bb586055f1f\") " pod="openshift-insights/insights-runtime-extractor-g65q5" May 20 21:51:18.883443 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:18.883375 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/21265fbc-2f7c-4414-9505-4bb586055f1f-crio-socket\") pod \"insights-runtime-extractor-g65q5\" (UID: \"21265fbc-2f7c-4414-9505-4bb586055f1f\") " pod="openshift-insights/insights-runtime-extractor-g65q5" May 20 21:51:18.883443 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:18.883380 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/21265fbc-2f7c-4414-9505-4bb586055f1f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g65q5\" (UID: \"21265fbc-2f7c-4414-9505-4bb586055f1f\") " pod="openshift-insights/insights-runtime-extractor-g65q5" May 20 21:51:18.883443 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:18.883420 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/21265fbc-2f7c-4414-9505-4bb586055f1f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g65q5\" (UID: \"21265fbc-2f7c-4414-9505-4bb586055f1f\") " pod="openshift-insights/insights-runtime-extractor-g65q5" May 20 21:51:18.883709 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:18.883689 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/21265fbc-2f7c-4414-9505-4bb586055f1f-data-volume\") pod \"insights-runtime-extractor-g65q5\" (UID: \"21265fbc-2f7c-4414-9505-4bb586055f1f\") " pod="openshift-insights/insights-runtime-extractor-g65q5" May 20 21:51:18.884006 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:18.883988 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/21265fbc-2f7c-4414-9505-4bb586055f1f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g65q5\" (UID: \"21265fbc-2f7c-4414-9505-4bb586055f1f\") " pod="openshift-insights/insights-runtime-extractor-g65q5" May 20 21:51:18.885858 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:18.885835 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/21265fbc-2f7c-4414-9505-4bb586055f1f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g65q5\" (UID: \"21265fbc-2f7c-4414-9505-4bb586055f1f\") " pod="openshift-insights/insights-runtime-extractor-g65q5" May 20 21:51:18.895406 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:18.895377 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxd9g\" (UniqueName: \"kubernetes.io/projected/21265fbc-2f7c-4414-9505-4bb586055f1f-kube-api-access-rxd9g\") pod \"insights-runtime-extractor-g65q5\" (UID: \"21265fbc-2f7c-4414-9505-4bb586055f1f\") " pod="openshift-insights/insights-runtime-extractor-g65q5" May 20 21:51:19.057688 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:19.057602 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-g65q5" May 20 21:51:19.184054 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:19.184022 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-g65q5"] May 20 21:51:19.187119 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:51:19.187064 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21265fbc_2f7c_4414_9505_4bb586055f1f.slice/crio-6d37b67a93644209a0a67ddf55ab71885f178a81627bbe8075a8931ce4dd73f0 WatchSource:0}: Error finding container 6d37b67a93644209a0a67ddf55ab71885f178a81627bbe8075a8931ce4dd73f0: Status 404 returned error can't find the container with id 6d37b67a93644209a0a67ddf55ab71885f178a81627bbe8075a8931ce4dd73f0 May 20 21:51:19.293408 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:19.293377 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g65q5" event={"ID":"21265fbc-2f7c-4414-9505-4bb586055f1f","Type":"ContainerStarted","Data":"b0bed1a559e8dfb6075d812b24b1a45645da4604b3892a4e60c0026e460b423e"} May 20 21:51:19.293408 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:19.293411 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g65q5" event={"ID":"21265fbc-2f7c-4414-9505-4bb586055f1f","Type":"ContainerStarted","Data":"6d37b67a93644209a0a67ddf55ab71885f178a81627bbe8075a8931ce4dd73f0"} May 20 21:51:20.299268 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:20.299183 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g65q5" event={"ID":"21265fbc-2f7c-4414-9505-4bb586055f1f","Type":"ContainerStarted","Data":"7aaced747eb928fbb1f75e2e948132a2f74a74aad23b56d60aa49144904f71b0"} May 20 21:51:22.309428 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:22.309392 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g65q5" event={"ID":"21265fbc-2f7c-4414-9505-4bb586055f1f","Type":"ContainerStarted","Data":"26ab06f34d4e21e0f66ba01a3c41a2dc850221f95c744175001afe6a5aa11cf4"} May 20 21:51:22.329183 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:22.329133 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-g65q5" podStartSLOduration=2.154196493 podStartE2EDuration="4.329119758s" podCreationTimestamp="2026-05-20 21:51:18 +0000 UTC" firstStartedPulling="2026-05-20 21:51:19.240133767 +0000 UTC m=+182.102554676" lastFinishedPulling="2026-05-20 21:51:21.415057033 +0000 UTC m=+184.277477941" observedRunningTime="2026-05-20 21:51:22.328053721 +0000 UTC m=+185.190474651" watchObservedRunningTime="2026-05-20 21:51:22.329119758 +0000 UTC m=+185.191540688" May 20 21:51:27.220721 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:27.220686 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-7t258"] May 20 21:51:27.222705 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:27.222687 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-7t258" May 20 21:51:27.225117 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:27.225071 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" May 20 21:51:27.225239 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:27.225118 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-2bc7d\"" May 20 21:51:27.232576 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:27.232552 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-7t258"] May 20 21:51:27.360779 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:27.360737 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/69068108-28e3-4d3f-9d62-ed73c6bcacd4-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-7t258\" (UID: \"69068108-28e3-4d3f-9d62-ed73c6bcacd4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-7t258" May 20 21:51:27.461929 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:27.461895 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/69068108-28e3-4d3f-9d62-ed73c6bcacd4-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-7t258\" (UID: \"69068108-28e3-4d3f-9d62-ed73c6bcacd4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-7t258" May 20 21:51:27.464478 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:27.464453 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/69068108-28e3-4d3f-9d62-ed73c6bcacd4-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-7t258\" (UID: \"69068108-28e3-4d3f-9d62-ed73c6bcacd4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-7t258" May 20 21:51:27.531447 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:27.531357 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-7t258" May 20 21:51:27.670159 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:27.670134 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-7t258"] May 20 21:51:27.672543 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:51:27.672516 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69068108_28e3_4d3f_9d62_ed73c6bcacd4.slice/crio-fb04436708a30ffd82b642310a1f79ee204f3629d23f79e56ac474de2129356e WatchSource:0}: Error finding container fb04436708a30ffd82b642310a1f79ee204f3629d23f79e56ac474de2129356e: Status 404 returned error can't find the container with id fb04436708a30ffd82b642310a1f79ee204f3629d23f79e56ac474de2129356e May 20 21:51:28.327279 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:28.327228 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-7t258" event={"ID":"69068108-28e3-4d3f-9d62-ed73c6bcacd4","Type":"ContainerStarted","Data":"fb04436708a30ffd82b642310a1f79ee204f3629d23f79e56ac474de2129356e"} May 20 21:51:28.755600 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:28.755512 2581 patch_prober.go:28] interesting pod/image-registry-5cb8f8d8dc-nfg8z container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 20 21:51:28.755600 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:28.755569 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z" podUID="093a54ec-c0b5-436c-a3e3-3b01b3168279" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 20 21:51:29.333483 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:29.333449 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-7t258" event={"ID":"69068108-28e3-4d3f-9d62-ed73c6bcacd4","Type":"ContainerStarted","Data":"73d27841bb4a4dad4521a1daf06e3fb9bd3080ba3d1f50f1528feff87d9ad0d8"} May 20 21:51:29.333878 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:29.333579 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-7t258" May 20 21:51:29.338874 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:29.338853 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-7t258" May 20 21:51:29.348573 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:29.348534 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-7t258" podStartSLOduration=1.574574747 podStartE2EDuration="2.348522045s" podCreationTimestamp="2026-05-20 21:51:27 +0000 UTC" firstStartedPulling="2026-05-20 21:51:27.674562908 +0000 UTC m=+190.536983816" lastFinishedPulling="2026-05-20 21:51:28.448510206 +0000 UTC m=+191.310931114" observedRunningTime="2026-05-20 21:51:29.348148206 +0000 UTC m=+192.210569139" watchObservedRunningTime="2026-05-20 21:51:29.348522045 +0000 UTC m=+192.210942974" May 20 21:51:30.283562 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:30.283524 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-zz9cl"] May 20 21:51:30.285711 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:30.285694 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-zz9cl" May 20 21:51:30.289272 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:30.289243 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" May 20 21:51:30.289429 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:30.289298 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" May 20 21:51:30.290449 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:30.290423 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 20 21:51:30.290572 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:30.290434 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 20 21:51:30.290572 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:30.290443 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 20 21:51:30.290572 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:30.290451 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-7sgcl\"" May 20 21:51:30.294735 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:30.294705 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-zz9cl"] May 20 21:51:30.386363 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:30.386327 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32d9f655-7497-43d6-9ecc-0535fc122b12-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-zz9cl\" (UID: \"32d9f655-7497-43d6-9ecc-0535fc122b12\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zz9cl" May 20 21:51:30.386791 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:30.386421 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/32d9f655-7497-43d6-9ecc-0535fc122b12-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-zz9cl\" (UID: \"32d9f655-7497-43d6-9ecc-0535fc122b12\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zz9cl" May 20 21:51:30.386791 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:30.386466 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpbmn\" (UniqueName: \"kubernetes.io/projected/32d9f655-7497-43d6-9ecc-0535fc122b12-kube-api-access-dpbmn\") pod \"prometheus-operator-7779bbdd78-zz9cl\" (UID: \"32d9f655-7497-43d6-9ecc-0535fc122b12\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zz9cl" May 20 21:51:30.386791 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:30.386489 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/32d9f655-7497-43d6-9ecc-0535fc122b12-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-zz9cl\" (UID: \"32d9f655-7497-43d6-9ecc-0535fc122b12\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zz9cl" May 20 21:51:30.487004 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:30.486971 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/32d9f655-7497-43d6-9ecc-0535fc122b12-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-zz9cl\" (UID: \"32d9f655-7497-43d6-9ecc-0535fc122b12\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zz9cl" May 20 21:51:30.487214 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:30.487022 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dpbmn\" (UniqueName: \"kubernetes.io/projected/32d9f655-7497-43d6-9ecc-0535fc122b12-kube-api-access-dpbmn\") pod \"prometheus-operator-7779bbdd78-zz9cl\" (UID: \"32d9f655-7497-43d6-9ecc-0535fc122b12\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zz9cl" May 20 21:51:30.487214 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:30.487044 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/32d9f655-7497-43d6-9ecc-0535fc122b12-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-zz9cl\" (UID: \"32d9f655-7497-43d6-9ecc-0535fc122b12\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zz9cl" May 20 21:51:30.487214 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:30.487116 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32d9f655-7497-43d6-9ecc-0535fc122b12-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-zz9cl\" (UID: \"32d9f655-7497-43d6-9ecc-0535fc122b12\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zz9cl" May 20 21:51:30.487732 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:30.487710 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32d9f655-7497-43d6-9ecc-0535fc122b12-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-zz9cl\" (UID: \"32d9f655-7497-43d6-9ecc-0535fc122b12\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zz9cl" May 20 21:51:30.489580 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:30.489554 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/32d9f655-7497-43d6-9ecc-0535fc122b12-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-zz9cl\" (UID: \"32d9f655-7497-43d6-9ecc-0535fc122b12\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zz9cl" May 20 21:51:30.489706 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:30.489562 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/32d9f655-7497-43d6-9ecc-0535fc122b12-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-zz9cl\" (UID: \"32d9f655-7497-43d6-9ecc-0535fc122b12\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zz9cl" May 20 21:51:30.494714 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:30.494690 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpbmn\" (UniqueName: \"kubernetes.io/projected/32d9f655-7497-43d6-9ecc-0535fc122b12-kube-api-access-dpbmn\") pod \"prometheus-operator-7779bbdd78-zz9cl\" (UID: \"32d9f655-7497-43d6-9ecc-0535fc122b12\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-zz9cl" May 20 21:51:30.595118 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:30.595064 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-zz9cl" May 20 21:51:30.717522 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:30.717495 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-zz9cl"] May 20 21:51:30.719906 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:51:30.719867 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32d9f655_7497_43d6_9ecc_0535fc122b12.slice/crio-d473f68c9247ce6abaa911b5f1cbef9d4bc8f7a0796ac0b4f84c185fdbceaa05 WatchSource:0}: Error finding container d473f68c9247ce6abaa911b5f1cbef9d4bc8f7a0796ac0b4f84c185fdbceaa05: Status 404 returned error can't find the container with id d473f68c9247ce6abaa911b5f1cbef9d4bc8f7a0796ac0b4f84c185fdbceaa05 May 20 21:51:31.340264 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:31.340072 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-zz9cl" event={"ID":"32d9f655-7497-43d6-9ecc-0535fc122b12","Type":"ContainerStarted","Data":"d473f68c9247ce6abaa911b5f1cbef9d4bc8f7a0796ac0b4f84c185fdbceaa05"} May 20 21:51:32.344401 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:32.344367 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-zz9cl" event={"ID":"32d9f655-7497-43d6-9ecc-0535fc122b12","Type":"ContainerStarted","Data":"e0c2cae5105b5d4fafdf615db38769df61a002e8678248e1b11ce09895586055"} May 20 21:51:32.344760 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:32.344406 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-zz9cl" event={"ID":"32d9f655-7497-43d6-9ecc-0535fc122b12","Type":"ContainerStarted","Data":"1b803a2a19e4077a9489e87718486935f1b77c8bdc29155179672bb71a85d1e2"} May 20 21:51:32.360834 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:32.360784 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-zz9cl" podStartSLOduration=1.192261154 podStartE2EDuration="2.360769707s" podCreationTimestamp="2026-05-20 21:51:30 +0000 UTC" firstStartedPulling="2026-05-20 21:51:30.721714991 +0000 UTC m=+193.584135898" lastFinishedPulling="2026-05-20 21:51:31.890223543 +0000 UTC m=+194.752644451" observedRunningTime="2026-05-20 21:51:32.36056075 +0000 UTC m=+195.222981680" watchObservedRunningTime="2026-05-20 21:51:32.360769707 +0000 UTC m=+195.223190636" May 20 21:51:34.634007 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.633967 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-96d2b"] May 20 21:51:34.637488 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.637467 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-b2fhf"] May 20 21:51:34.637643 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.637624 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-96d2b" May 20 21:51:34.640143 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.639984 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-b2fhf" May 20 21:51:34.640986 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.640965 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 20 21:51:34.641121 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.641058 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tp2js\"" May 20 21:51:34.642590 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.642321 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 20 21:51:34.642590 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.642432 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 20 21:51:34.643033 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.642993 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" May 20 21:51:34.643141 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.643032 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-6ggrl\"" May 20 21:51:34.643322 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.643307 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" May 20 21:51:34.643398 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.643339 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" May 20 21:51:34.662625 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.662599 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-b2fhf"] May 20 21:51:34.728837 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.728802 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3ccab590-13e6-40fa-abcd-200a0e6c52db-node-exporter-wtmp\") pod \"node-exporter-96d2b\" (UID: \"3ccab590-13e6-40fa-abcd-200a0e6c52db\") " pod="openshift-monitoring/node-exporter-96d2b" May 20 21:51:34.729001 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.728864 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c19723c-ff40-490c-aeb2-5a6cea8164e8-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-b2fhf\" (UID: \"7c19723c-ff40-490c-aeb2-5a6cea8164e8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-b2fhf" May 20 21:51:34.729001 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.728896 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3ccab590-13e6-40fa-abcd-200a0e6c52db-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-96d2b\" (UID: \"3ccab590-13e6-40fa-abcd-200a0e6c52db\") " pod="openshift-monitoring/node-exporter-96d2b" May 20 21:51:34.729001 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.728925 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3ccab590-13e6-40fa-abcd-200a0e6c52db-node-exporter-accelerators-collector-config\") pod \"node-exporter-96d2b\" (UID: \"3ccab590-13e6-40fa-abcd-200a0e6c52db\") " pod="openshift-monitoring/node-exporter-96d2b" May 20 21:51:34.729001 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.728956 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7c19723c-ff40-490c-aeb2-5a6cea8164e8-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-b2fhf\" (UID: \"7c19723c-ff40-490c-aeb2-5a6cea8164e8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-b2fhf" May 20 21:51:34.729229 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.729029 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3ccab590-13e6-40fa-abcd-200a0e6c52db-node-exporter-textfile\") pod \"node-exporter-96d2b\" (UID: \"3ccab590-13e6-40fa-abcd-200a0e6c52db\") " pod="openshift-monitoring/node-exporter-96d2b" May 20 21:51:34.729229 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.729054 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pczz2\" (UniqueName: \"kubernetes.io/projected/3ccab590-13e6-40fa-abcd-200a0e6c52db-kube-api-access-pczz2\") pod \"node-exporter-96d2b\" (UID: \"3ccab590-13e6-40fa-abcd-200a0e6c52db\") " pod="openshift-monitoring/node-exporter-96d2b" May 20 21:51:34.729229 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.729095 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7c19723c-ff40-490c-aeb2-5a6cea8164e8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-b2fhf\" (UID: \"7c19723c-ff40-490c-aeb2-5a6cea8164e8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-b2fhf" May 20 21:51:34.729229 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.729150 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3ccab590-13e6-40fa-abcd-200a0e6c52db-root\") pod \"node-exporter-96d2b\" (UID: \"3ccab590-13e6-40fa-abcd-200a0e6c52db\") " pod="openshift-monitoring/node-exporter-96d2b" May 20 21:51:34.729229 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.729172 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r77v9\" (UniqueName: \"kubernetes.io/projected/7c19723c-ff40-490c-aeb2-5a6cea8164e8-kube-api-access-r77v9\") pod \"kube-state-metrics-54fd6bc5c4-b2fhf\" (UID: \"7c19723c-ff40-490c-aeb2-5a6cea8164e8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-b2fhf" May 20 21:51:34.729229 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.729188 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ccab590-13e6-40fa-abcd-200a0e6c52db-sys\") pod \"node-exporter-96d2b\" (UID: \"3ccab590-13e6-40fa-abcd-200a0e6c52db\") " pod="openshift-monitoring/node-exporter-96d2b" May 20 21:51:34.729229 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.729207 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c19723c-ff40-490c-aeb2-5a6cea8164e8-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-b2fhf\" (UID: \"7c19723c-ff40-490c-aeb2-5a6cea8164e8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-b2fhf" May 20 21:51:34.729229 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.729227 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7c19723c-ff40-490c-aeb2-5a6cea8164e8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-b2fhf\" (UID: \"7c19723c-ff40-490c-aeb2-5a6cea8164e8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-b2fhf" May 20 21:51:34.729520 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.729287 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3ccab590-13e6-40fa-abcd-200a0e6c52db-node-exporter-tls\") pod \"node-exporter-96d2b\" (UID: \"3ccab590-13e6-40fa-abcd-200a0e6c52db\") " pod="openshift-monitoring/node-exporter-96d2b" May 20 21:51:34.729520 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.729303 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ccab590-13e6-40fa-abcd-200a0e6c52db-metrics-client-ca\") pod \"node-exporter-96d2b\" (UID: \"3ccab590-13e6-40fa-abcd-200a0e6c52db\") " pod="openshift-monitoring/node-exporter-96d2b" May 20 21:51:34.830047 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.830001 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r77v9\" (UniqueName: \"kubernetes.io/projected/7c19723c-ff40-490c-aeb2-5a6cea8164e8-kube-api-access-r77v9\") pod \"kube-state-metrics-54fd6bc5c4-b2fhf\" (UID: \"7c19723c-ff40-490c-aeb2-5a6cea8164e8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-b2fhf" May 20 21:51:34.830285 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.830055 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ccab590-13e6-40fa-abcd-200a0e6c52db-sys\") pod \"node-exporter-96d2b\" (UID: \"3ccab590-13e6-40fa-abcd-200a0e6c52db\") " pod="openshift-monitoring/node-exporter-96d2b" May 20 21:51:34.830285 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.830136 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ccab590-13e6-40fa-abcd-200a0e6c52db-sys\") pod \"node-exporter-96d2b\" (UID: \"3ccab590-13e6-40fa-abcd-200a0e6c52db\") " pod="openshift-monitoring/node-exporter-96d2b" May 20 21:51:34.830285 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.830196 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c19723c-ff40-490c-aeb2-5a6cea8164e8-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-b2fhf\" (UID: \"7c19723c-ff40-490c-aeb2-5a6cea8164e8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-b2fhf" May 20 21:51:34.830285 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.830251 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7c19723c-ff40-490c-aeb2-5a6cea8164e8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-b2fhf\" (UID: \"7c19723c-ff40-490c-aeb2-5a6cea8164e8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-b2fhf" May 20 21:51:34.830510 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.830301 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3ccab590-13e6-40fa-abcd-200a0e6c52db-node-exporter-tls\") pod \"node-exporter-96d2b\" (UID: \"3ccab590-13e6-40fa-abcd-200a0e6c52db\") " pod="openshift-monitoring/node-exporter-96d2b" May 20 21:51:34.830510 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:51:34.830419 2581 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found May 20 21:51:34.830510 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:51:34.830480 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ccab590-13e6-40fa-abcd-200a0e6c52db-node-exporter-tls podName:3ccab590-13e6-40fa-abcd-200a0e6c52db nodeName:}" failed. No retries permitted until 2026-05-20 21:51:35.330457337 +0000 UTC m=+198.192878259 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/3ccab590-13e6-40fa-abcd-200a0e6c52db-node-exporter-tls") pod "node-exporter-96d2b" (UID: "3ccab590-13e6-40fa-abcd-200a0e6c52db") : secret "node-exporter-tls" not found May 20 21:51:34.830694 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.830327 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ccab590-13e6-40fa-abcd-200a0e6c52db-metrics-client-ca\") pod \"node-exporter-96d2b\" (UID: \"3ccab590-13e6-40fa-abcd-200a0e6c52db\") " pod="openshift-monitoring/node-exporter-96d2b" May 20 21:51:34.830759 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.830746 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3ccab590-13e6-40fa-abcd-200a0e6c52db-node-exporter-wtmp\") pod \"node-exporter-96d2b\" (UID: \"3ccab590-13e6-40fa-abcd-200a0e6c52db\") " pod="openshift-monitoring/node-exporter-96d2b" May 20 21:51:34.830826 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.830798 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c19723c-ff40-490c-aeb2-5a6cea8164e8-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-b2fhf\" (UID: \"7c19723c-ff40-490c-aeb2-5a6cea8164e8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-b2fhf" May 20 21:51:34.830923 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.830907 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3ccab590-13e6-40fa-abcd-200a0e6c52db-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-96d2b\" (UID: \"3ccab590-13e6-40fa-abcd-200a0e6c52db\") " pod="openshift-monitoring/node-exporter-96d2b" May 20 21:51:34.831026 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.831004 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ccab590-13e6-40fa-abcd-200a0e6c52db-metrics-client-ca\") pod \"node-exporter-96d2b\" (UID: \"3ccab590-13e6-40fa-abcd-200a0e6c52db\") " pod="openshift-monitoring/node-exporter-96d2b" May 20 21:51:34.831130 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.830931 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3ccab590-13e6-40fa-abcd-200a0e6c52db-node-exporter-wtmp\") pod \"node-exporter-96d2b\" (UID: \"3ccab590-13e6-40fa-abcd-200a0e6c52db\") " pod="openshift-monitoring/node-exporter-96d2b" May 20 21:51:34.831234 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.831214 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3ccab590-13e6-40fa-abcd-200a0e6c52db-node-exporter-accelerators-collector-config\") pod \"node-exporter-96d2b\" (UID: \"3ccab590-13e6-40fa-abcd-200a0e6c52db\") " pod="openshift-monitoring/node-exporter-96d2b" May 20 21:51:34.831360 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.831342 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7c19723c-ff40-490c-aeb2-5a6cea8164e8-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-b2fhf\" (UID: \"7c19723c-ff40-490c-aeb2-5a6cea8164e8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-b2fhf" May 20 21:51:34.832350 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.831743 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3ccab590-13e6-40fa-abcd-200a0e6c52db-node-exporter-textfile\") pod \"node-exporter-96d2b\" (UID: \"3ccab590-13e6-40fa-abcd-200a0e6c52db\") " pod="openshift-monitoring/node-exporter-96d2b" May 20 21:51:34.832350 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.831768 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7c19723c-ff40-490c-aeb2-5a6cea8164e8-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-b2fhf\" (UID: \"7c19723c-ff40-490c-aeb2-5a6cea8164e8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-b2fhf" May 20 21:51:34.832350 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.831777 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pczz2\" (UniqueName: \"kubernetes.io/projected/3ccab590-13e6-40fa-abcd-200a0e6c52db-kube-api-access-pczz2\") pod \"node-exporter-96d2b\" (UID: \"3ccab590-13e6-40fa-abcd-200a0e6c52db\") " pod="openshift-monitoring/node-exporter-96d2b" May 20 21:51:34.832350 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.831823 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7c19723c-ff40-490c-aeb2-5a6cea8164e8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-b2fhf\" (UID: \"7c19723c-ff40-490c-aeb2-5a6cea8164e8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-b2fhf" May 20 21:51:34.832350 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.831892 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3ccab590-13e6-40fa-abcd-200a0e6c52db-root\") pod \"node-exporter-96d2b\" (UID: \"3ccab590-13e6-40fa-abcd-200a0e6c52db\") " pod="openshift-monitoring/node-exporter-96d2b" May 20 21:51:34.832350 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.831964 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3ccab590-13e6-40fa-abcd-200a0e6c52db-root\") pod \"node-exporter-96d2b\" (UID: \"3ccab590-13e6-40fa-abcd-200a0e6c52db\") " pod="openshift-monitoring/node-exporter-96d2b" May 20 21:51:34.832350 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.831559 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3ccab590-13e6-40fa-abcd-200a0e6c52db-node-exporter-accelerators-collector-config\") pod \"node-exporter-96d2b\" (UID: \"3ccab590-13e6-40fa-abcd-200a0e6c52db\") " pod="openshift-monitoring/node-exporter-96d2b" May 20 21:51:34.832350 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.832260 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3ccab590-13e6-40fa-abcd-200a0e6c52db-node-exporter-textfile\") pod \"node-exporter-96d2b\" (UID: \"3ccab590-13e6-40fa-abcd-200a0e6c52db\") " pod="openshift-monitoring/node-exporter-96d2b" May 20 21:51:34.832350 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.831668 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c19723c-ff40-490c-aeb2-5a6cea8164e8-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-b2fhf\" (UID: \"7c19723c-ff40-490c-aeb2-5a6cea8164e8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-b2fhf" May 20 21:51:34.832823 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.832553 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7c19723c-ff40-490c-aeb2-5a6cea8164e8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-b2fhf\" (UID: \"7c19723c-ff40-490c-aeb2-5a6cea8164e8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-b2fhf" May 20 21:51:34.833360 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.833335 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7c19723c-ff40-490c-aeb2-5a6cea8164e8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-b2fhf\" (UID: \"7c19723c-ff40-490c-aeb2-5a6cea8164e8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-b2fhf" May 20 21:51:34.833654 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.833633 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c19723c-ff40-490c-aeb2-5a6cea8164e8-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-b2fhf\" (UID: \"7c19723c-ff40-490c-aeb2-5a6cea8164e8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-b2fhf" May 20 21:51:34.834327 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.834305 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3ccab590-13e6-40fa-abcd-200a0e6c52db-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-96d2b\" (UID: \"3ccab590-13e6-40fa-abcd-200a0e6c52db\") " pod="openshift-monitoring/node-exporter-96d2b" May 20 21:51:34.839457 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.839435 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r77v9\" (UniqueName: \"kubernetes.io/projected/7c19723c-ff40-490c-aeb2-5a6cea8164e8-kube-api-access-r77v9\") pod \"kube-state-metrics-54fd6bc5c4-b2fhf\" (UID: \"7c19723c-ff40-490c-aeb2-5a6cea8164e8\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-b2fhf" May 20 21:51:34.839770 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.839750 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pczz2\" (UniqueName: \"kubernetes.io/projected/3ccab590-13e6-40fa-abcd-200a0e6c52db-kube-api-access-pczz2\") pod \"node-exporter-96d2b\" (UID: \"3ccab590-13e6-40fa-abcd-200a0e6c52db\") " pod="openshift-monitoring/node-exporter-96d2b" May 20 21:51:34.956058 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:34.955974 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-b2fhf" May 20 21:51:35.094770 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:35.094691 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-b2fhf"] May 20 21:51:35.097387 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:51:35.097359 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c19723c_ff40_490c_aeb2_5a6cea8164e8.slice/crio-3608969c2ff0ff5a9a54db074534df8d1fa5ae550edce77e382c3557cee1af0e WatchSource:0}: Error finding container 3608969c2ff0ff5a9a54db074534df8d1fa5ae550edce77e382c3557cee1af0e: Status 404 returned error can't find the container with id 3608969c2ff0ff5a9a54db074534df8d1fa5ae550edce77e382c3557cee1af0e May 20 21:51:35.335642 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:35.335609 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3ccab590-13e6-40fa-abcd-200a0e6c52db-node-exporter-tls\") pod \"node-exporter-96d2b\" (UID: \"3ccab590-13e6-40fa-abcd-200a0e6c52db\") " pod="openshift-monitoring/node-exporter-96d2b" May 20 21:51:35.338024 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:35.337996 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3ccab590-13e6-40fa-abcd-200a0e6c52db-node-exporter-tls\") pod \"node-exporter-96d2b\" (UID: \"3ccab590-13e6-40fa-abcd-200a0e6c52db\") " pod="openshift-monitoring/node-exporter-96d2b" May 20 21:51:35.356701 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:35.356660 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-b2fhf" event={"ID":"7c19723c-ff40-490c-aeb2-5a6cea8164e8","Type":"ContainerStarted","Data":"3608969c2ff0ff5a9a54db074534df8d1fa5ae550edce77e382c3557cee1af0e"} May 20 21:51:35.550560 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:35.550519 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-96d2b" May 20 21:51:35.558684 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:51:35.558655 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ccab590_13e6_40fa_abcd_200a0e6c52db.slice/crio-f9e274a792aeaeb8a02735788dde783d0a71e5cd3098e2cf81b182baa517e272 WatchSource:0}: Error finding container f9e274a792aeaeb8a02735788dde783d0a71e5cd3098e2cf81b182baa517e272: Status 404 returned error can't find the container with id f9e274a792aeaeb8a02735788dde783d0a71e5cd3098e2cf81b182baa517e272 May 20 21:51:36.360889 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:36.360847 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-96d2b" event={"ID":"3ccab590-13e6-40fa-abcd-200a0e6c52db","Type":"ContainerStarted","Data":"f9e274a792aeaeb8a02735788dde783d0a71e5cd3098e2cf81b182baa517e272"} May 20 21:51:37.365395 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:37.365295 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-b2fhf" event={"ID":"7c19723c-ff40-490c-aeb2-5a6cea8164e8","Type":"ContainerStarted","Data":"5c36ee8aa1554a8f14cd97abbfbf59f75b72698e0cd644691efd48f2737e691d"} May 20 21:51:37.365395 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:37.365338 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-b2fhf" event={"ID":"7c19723c-ff40-490c-aeb2-5a6cea8164e8","Type":"ContainerStarted","Data":"733d50912953c9f577c7a8be1314838acb504b1ed27eb05c72081bc7fa2a1c55"} May 20 21:51:37.365395 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:37.365348 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-b2fhf" event={"ID":"7c19723c-ff40-490c-aeb2-5a6cea8164e8","Type":"ContainerStarted","Data":"2d2ee7a79f286a8e2c99f7d4b569a24e93cb3a55dbe862669f1729cec00ce951"} May 20 21:51:37.366617 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:37.366589 2581 generic.go:358] "Generic (PLEG): container finished" podID="3ccab590-13e6-40fa-abcd-200a0e6c52db" containerID="9d156ac69a11c34a56a7594afea092aea8d0e9fa2646904dbf8ac3f865d58c8d" exitCode=0 May 20 21:51:37.366701 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:37.366640 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-96d2b" event={"ID":"3ccab590-13e6-40fa-abcd-200a0e6c52db","Type":"ContainerDied","Data":"9d156ac69a11c34a56a7594afea092aea8d0e9fa2646904dbf8ac3f865d58c8d"} May 20 21:51:37.382686 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:37.382638 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-b2fhf" podStartSLOduration=1.6434411 podStartE2EDuration="3.382624012s" podCreationTimestamp="2026-05-20 21:51:34 +0000 UTC" firstStartedPulling="2026-05-20 21:51:35.099709887 +0000 UTC m=+197.962130796" lastFinishedPulling="2026-05-20 21:51:36.838892799 +0000 UTC m=+199.701313708" observedRunningTime="2026-05-20 21:51:37.381240245 +0000 UTC m=+200.243661176" watchObservedRunningTime="2026-05-20 21:51:37.382624012 +0000 UTC m=+200.245044943" May 20 21:51:38.375025 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:38.374982 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-96d2b" event={"ID":"3ccab590-13e6-40fa-abcd-200a0e6c52db","Type":"ContainerStarted","Data":"1bef3fc4f1292ba2e327faac9811fdbb021b451f79c5f4a8c069a8796216f58d"} May 20 21:51:38.375025 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:38.375030 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-96d2b" event={"ID":"3ccab590-13e6-40fa-abcd-200a0e6c52db","Type":"ContainerStarted","Data":"eaca92df80d0ef44cdad4405be8bff325dfc40343e6b45bbb2a2ec031d9ba71b"} May 20 21:51:38.395249 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:38.395203 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-96d2b" podStartSLOduration=3.118774212 podStartE2EDuration="4.395189181s" podCreationTimestamp="2026-05-20 21:51:34 +0000 UTC" firstStartedPulling="2026-05-20 21:51:35.56031016 +0000 UTC m=+198.422731068" lastFinishedPulling="2026-05-20 21:51:36.836725117 +0000 UTC m=+199.699146037" observedRunningTime="2026-05-20 21:51:38.394189631 +0000 UTC m=+201.256610562" watchObservedRunningTime="2026-05-20 21:51:38.395189181 +0000 UTC m=+201.257610111" May 20 21:51:38.753634 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:38.753553 2581 patch_prober.go:28] interesting pod/image-registry-5cb8f8d8dc-nfg8z container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 20 21:51:38.753634 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:38.753607 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z" podUID="093a54ec-c0b5-436c-a3e3-3b01b3168279" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 20 21:51:39.064126 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:39.064063 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-f55845df4-dxpsk"] May 20 21:51:39.068056 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:39.068024 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-f55845df4-dxpsk" May 20 21:51:39.070831 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:39.070809 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" May 20 21:51:39.071941 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:39.071918 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" May 20 21:51:39.071941 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:39.071934 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" May 20 21:51:39.071941 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:39.071945 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 20 21:51:39.072285 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:39.071994 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-c4nsjtvslnfnb\"" May 20 21:51:39.072285 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:39.072030 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-vcv79\"" May 20 21:51:39.079662 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:39.079638 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-f55845df4-dxpsk"] May 20 21:51:39.174887 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:39.174850 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0ee2c77-be7d-4f31-a68d-c77d9b3a8b0e-client-ca-bundle\") pod \"metrics-server-f55845df4-dxpsk\" (UID: \"f0ee2c77-be7d-4f31-a68d-c77d9b3a8b0e\") " pod="openshift-monitoring/metrics-server-f55845df4-dxpsk" May 20 21:51:39.174887 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:39.174891 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-484zs\" (UniqueName: \"kubernetes.io/projected/f0ee2c77-be7d-4f31-a68d-c77d9b3a8b0e-kube-api-access-484zs\") pod \"metrics-server-f55845df4-dxpsk\" (UID: \"f0ee2c77-be7d-4f31-a68d-c77d9b3a8b0e\") " pod="openshift-monitoring/metrics-server-f55845df4-dxpsk" May 20 21:51:39.175155 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:39.174929 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f0ee2c77-be7d-4f31-a68d-c77d9b3a8b0e-secret-metrics-server-tls\") pod \"metrics-server-f55845df4-dxpsk\" (UID: \"f0ee2c77-be7d-4f31-a68d-c77d9b3a8b0e\") " pod="openshift-monitoring/metrics-server-f55845df4-dxpsk" May 20 21:51:39.175155 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:39.174946 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f0ee2c77-be7d-4f31-a68d-c77d9b3a8b0e-audit-log\") pod \"metrics-server-f55845df4-dxpsk\" (UID: \"f0ee2c77-be7d-4f31-a68d-c77d9b3a8b0e\") " pod="openshift-monitoring/metrics-server-f55845df4-dxpsk" May 20 21:51:39.175155 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:39.175040 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0ee2c77-be7d-4f31-a68d-c77d9b3a8b0e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f55845df4-dxpsk\" (UID: \"f0ee2c77-be7d-4f31-a68d-c77d9b3a8b0e\") " pod="openshift-monitoring/metrics-server-f55845df4-dxpsk" May 20 21:51:39.175155 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:39.175112 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f0ee2c77-be7d-4f31-a68d-c77d9b3a8b0e-metrics-server-audit-profiles\") pod \"metrics-server-f55845df4-dxpsk\" (UID: \"f0ee2c77-be7d-4f31-a68d-c77d9b3a8b0e\") " pod="openshift-monitoring/metrics-server-f55845df4-dxpsk" May 20 21:51:39.175155 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:39.175154 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f0ee2c77-be7d-4f31-a68d-c77d9b3a8b0e-secret-metrics-server-client-certs\") pod \"metrics-server-f55845df4-dxpsk\" (UID: \"f0ee2c77-be7d-4f31-a68d-c77d9b3a8b0e\") " pod="openshift-monitoring/metrics-server-f55845df4-dxpsk" May 20 21:51:39.276039 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:39.275993 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f0ee2c77-be7d-4f31-a68d-c77d9b3a8b0e-metrics-server-audit-profiles\") pod \"metrics-server-f55845df4-dxpsk\" (UID: \"f0ee2c77-be7d-4f31-a68d-c77d9b3a8b0e\") " pod="openshift-monitoring/metrics-server-f55845df4-dxpsk" May 20 21:51:39.276236 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:39.276069 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f0ee2c77-be7d-4f31-a68d-c77d9b3a8b0e-secret-metrics-server-client-certs\") pod \"metrics-server-f55845df4-dxpsk\" (UID: \"f0ee2c77-be7d-4f31-a68d-c77d9b3a8b0e\") " pod="openshift-monitoring/metrics-server-f55845df4-dxpsk" May 20 21:51:39.276236 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:39.276152 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0ee2c77-be7d-4f31-a68d-c77d9b3a8b0e-client-ca-bundle\") pod \"metrics-server-f55845df4-dxpsk\" (UID: \"f0ee2c77-be7d-4f31-a68d-c77d9b3a8b0e\") " pod="openshift-monitoring/metrics-server-f55845df4-dxpsk" May 20 21:51:39.276236 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:39.276170 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-484zs\" (UniqueName: \"kubernetes.io/projected/f0ee2c77-be7d-4f31-a68d-c77d9b3a8b0e-kube-api-access-484zs\") pod \"metrics-server-f55845df4-dxpsk\" (UID: \"f0ee2c77-be7d-4f31-a68d-c77d9b3a8b0e\") " pod="openshift-monitoring/metrics-server-f55845df4-dxpsk" May 20 21:51:39.276236 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:39.276198 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f0ee2c77-be7d-4f31-a68d-c77d9b3a8b0e-secret-metrics-server-tls\") pod \"metrics-server-f55845df4-dxpsk\" (UID: \"f0ee2c77-be7d-4f31-a68d-c77d9b3a8b0e\") " pod="openshift-monitoring/metrics-server-f55845df4-dxpsk" May 20 21:51:39.276236 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:39.276213 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f0ee2c77-be7d-4f31-a68d-c77d9b3a8b0e-audit-log\") pod \"metrics-server-f55845df4-dxpsk\" (UID: \"f0ee2c77-be7d-4f31-a68d-c77d9b3a8b0e\") " pod="openshift-monitoring/metrics-server-f55845df4-dxpsk" May 20 21:51:39.276500 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:39.276268 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0ee2c77-be7d-4f31-a68d-c77d9b3a8b0e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f55845df4-dxpsk\" (UID: \"f0ee2c77-be7d-4f31-a68d-c77d9b3a8b0e\") " pod="openshift-monitoring/metrics-server-f55845df4-dxpsk" May 20 21:51:39.276657 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:39.276630 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f0ee2c77-be7d-4f31-a68d-c77d9b3a8b0e-audit-log\") pod \"metrics-server-f55845df4-dxpsk\" (UID: \"f0ee2c77-be7d-4f31-a68d-c77d9b3a8b0e\") " pod="openshift-monitoring/metrics-server-f55845df4-dxpsk" May 20 21:51:39.276890 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:39.276868 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0ee2c77-be7d-4f31-a68d-c77d9b3a8b0e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f55845df4-dxpsk\" (UID: \"f0ee2c77-be7d-4f31-a68d-c77d9b3a8b0e\") " pod="openshift-monitoring/metrics-server-f55845df4-dxpsk" May 20 21:51:39.277023 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:39.277003 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f0ee2c77-be7d-4f31-a68d-c77d9b3a8b0e-metrics-server-audit-profiles\") pod \"metrics-server-f55845df4-dxpsk\" (UID: \"f0ee2c77-be7d-4f31-a68d-c77d9b3a8b0e\") " pod="openshift-monitoring/metrics-server-f55845df4-dxpsk" May 20 21:51:39.278666 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:39.278634 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f0ee2c77-be7d-4f31-a68d-c77d9b3a8b0e-secret-metrics-server-tls\") pod \"metrics-server-f55845df4-dxpsk\" (UID: \"f0ee2c77-be7d-4f31-a68d-c77d9b3a8b0e\") " pod="openshift-monitoring/metrics-server-f55845df4-dxpsk" May 20 21:51:39.278965 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:39.278950 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0ee2c77-be7d-4f31-a68d-c77d9b3a8b0e-client-ca-bundle\") pod \"metrics-server-f55845df4-dxpsk\" (UID: \"f0ee2c77-be7d-4f31-a68d-c77d9b3a8b0e\") " pod="openshift-monitoring/metrics-server-f55845df4-dxpsk" May 20 21:51:39.279045 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:39.279028 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f0ee2c77-be7d-4f31-a68d-c77d9b3a8b0e-secret-metrics-server-client-certs\") pod \"metrics-server-f55845df4-dxpsk\" (UID: \"f0ee2c77-be7d-4f31-a68d-c77d9b3a8b0e\") " pod="openshift-monitoring/metrics-server-f55845df4-dxpsk" May 20 21:51:39.286897 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:39.286872 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-484zs\" (UniqueName: \"kubernetes.io/projected/f0ee2c77-be7d-4f31-a68d-c77d9b3a8b0e-kube-api-access-484zs\") pod \"metrics-server-f55845df4-dxpsk\" (UID: \"f0ee2c77-be7d-4f31-a68d-c77d9b3a8b0e\") " pod="openshift-monitoring/metrics-server-f55845df4-dxpsk" May 20 21:51:39.377676 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:39.377587 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-f55845df4-dxpsk" May 20 21:51:39.515257 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:39.515224 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-f55845df4-dxpsk"] May 20 21:51:39.518132 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:51:39.518103 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0ee2c77_be7d_4f31_a68d_c77d9b3a8b0e.slice/crio-78ad59b80b3153676303737f9b8062d7e1a2b4c1da05fedb359cb2d738f7b2a0 WatchSource:0}: Error finding container 78ad59b80b3153676303737f9b8062d7e1a2b4c1da05fedb359cb2d738f7b2a0: Status 404 returned error can't find the container with id 78ad59b80b3153676303737f9b8062d7e1a2b4c1da05fedb359cb2d738f7b2a0 May 20 21:51:40.380410 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:40.380374 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-f55845df4-dxpsk" event={"ID":"f0ee2c77-be7d-4f31-a68d-c77d9b3a8b0e","Type":"ContainerStarted","Data":"78ad59b80b3153676303737f9b8062d7e1a2b4c1da05fedb359cb2d738f7b2a0"} May 20 21:51:40.836657 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:40.836621 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 20 21:51:40.842823 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:40.842793 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:40.846764 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:40.846687 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 20 21:51:40.846764 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:40.846706 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 20 21:51:40.846764 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:40.846686 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 20 21:51:40.846764 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:40.846753 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 20 21:51:40.847148 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:40.846925 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 20 21:51:40.847769 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:40.847685 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 20 21:51:40.847892 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:40.847818 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9kb4j10jtljp2\"" May 20 21:51:40.847892 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:40.847833 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 20 21:51:40.848028 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:40.847903 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 20 21:51:40.848028 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:40.847985 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 20 21:51:40.848171 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:40.848129 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rzf75\"" May 20 21:51:40.848171 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:40.848167 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 20 21:51:40.848402 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:40.848367 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 20 21:51:40.850434 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:40.850413 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 20 21:51:40.857425 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:40.857400 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 20 21:51:40.991712 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:40.991668 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:40.991933 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:40.991727 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2k5w\" (UniqueName: \"kubernetes.io/projected/de995e4f-8389-4f12-a6fc-a43716da17b4-kube-api-access-k2k5w\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:40.991933 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:40.991768 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de995e4f-8389-4f12-a6fc-a43716da17b4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:40.991933 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:40.991796 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/de995e4f-8389-4f12-a6fc-a43716da17b4-config-out\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:40.991933 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:40.991821 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:40.991933 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:40.991851 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:40.991933 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:40.991929 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-web-config\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:40.992245 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:40.992004 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de995e4f-8389-4f12-a6fc-a43716da17b4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:40.992245 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:40.992038 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:40.992245 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:40.992060 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de995e4f-8389-4f12-a6fc-a43716da17b4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:40.992245 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:40.992173 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de995e4f-8389-4f12-a6fc-a43716da17b4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:40.992424 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:40.992249 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/de995e4f-8389-4f12-a6fc-a43716da17b4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:40.992424 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:40.992277 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/de995e4f-8389-4f12-a6fc-a43716da17b4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:40.992424 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:40.992306 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/de995e4f-8389-4f12-a6fc-a43716da17b4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:40.992424 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:40.992338 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:40.992424 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:40.992372 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:40.992663 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:40.992433 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-config\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:40.992663 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:40.992460 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:41.093660 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:41.093567 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:41.093660 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:41.093632 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:41.093914 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:41.093664 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-config\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:41.093914 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:41.093692 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:41.093914 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:41.093746 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:41.093914 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:41.093773 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k2k5w\" (UniqueName: \"kubernetes.io/projected/de995e4f-8389-4f12-a6fc-a43716da17b4-kube-api-access-k2k5w\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:41.093914 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:41.093813 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de995e4f-8389-4f12-a6fc-a43716da17b4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:41.093914 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:41.093842 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/de995e4f-8389-4f12-a6fc-a43716da17b4-config-out\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:41.093914 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:41.093867 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:41.093914 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:41.093901 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:41.094356 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:41.093940 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-web-config\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:41.094356 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:41.093981 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de995e4f-8389-4f12-a6fc-a43716da17b4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:41.094356 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:41.094014 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:41.094356 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:41.094044 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de995e4f-8389-4f12-a6fc-a43716da17b4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:41.094356 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:41.094108 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de995e4f-8389-4f12-a6fc-a43716da17b4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:41.094356 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:41.094166 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/de995e4f-8389-4f12-a6fc-a43716da17b4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:41.094356 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:41.094192 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/de995e4f-8389-4f12-a6fc-a43716da17b4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:41.094356 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:41.094221 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/de995e4f-8389-4f12-a6fc-a43716da17b4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:41.095006 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:41.094975 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de995e4f-8389-4f12-a6fc-a43716da17b4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:41.095396 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:41.095364 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de995e4f-8389-4f12-a6fc-a43716da17b4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:41.096035 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:41.096006 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de995e4f-8389-4f12-a6fc-a43716da17b4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:41.096471 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:41.096443 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/de995e4f-8389-4f12-a6fc-a43716da17b4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:41.097297 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:41.097270 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/de995e4f-8389-4f12-a6fc-a43716da17b4-config-out\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:41.097621 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:41.097598 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:41.098602 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:41.098463 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de995e4f-8389-4f12-a6fc-a43716da17b4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:41.099736 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:41.099709 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/de995e4f-8389-4f12-a6fc-a43716da17b4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:41.100451 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:41.100416 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-config\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:41.100992 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:41.100731 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/de995e4f-8389-4f12-a6fc-a43716da17b4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:41.102909 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:41.102845 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:41.103560 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:41.103298 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:41.103560 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:41.103365 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:41.103720 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:41.103692 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-web-config\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:41.103777 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:41.103736 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:41.104146 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:41.104110 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:41.104774 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:41.104751 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:41.106594 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:41.106525 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2k5w\" (UniqueName: \"kubernetes.io/projected/de995e4f-8389-4f12-a6fc-a43716da17b4-kube-api-access-k2k5w\") pod \"prometheus-k8s-0\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:41.159545 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:41.159486 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:41.312661 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:41.312615 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 20 21:51:41.316422 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:51:41.316390 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde995e4f_8389_4f12_a6fc_a43716da17b4.slice/crio-b1f0f2eb4dd1bddfcf235b3f52574ad941dd4d89001f9c41d6aa6fa67f7ac099 WatchSource:0}: Error finding container b1f0f2eb4dd1bddfcf235b3f52574ad941dd4d89001f9c41d6aa6fa67f7ac099: Status 404 returned error can't find the container with id b1f0f2eb4dd1bddfcf235b3f52574ad941dd4d89001f9c41d6aa6fa67f7ac099 May 20 21:51:41.384659 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:41.384565 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de995e4f-8389-4f12-a6fc-a43716da17b4","Type":"ContainerStarted","Data":"b1f0f2eb4dd1bddfcf235b3f52574ad941dd4d89001f9c41d6aa6fa67f7ac099"} May 20 21:51:41.385957 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:41.385926 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-f55845df4-dxpsk" event={"ID":"f0ee2c77-be7d-4f31-a68d-c77d9b3a8b0e","Type":"ContainerStarted","Data":"4e85f36b4d8744dd7d094b60b2eed01bb128b00cf5748d35d0861e8d00274308"} May 20 21:51:41.405665 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:41.405604 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-f55845df4-dxpsk" podStartSLOduration=0.705796937 podStartE2EDuration="2.405588112s" podCreationTimestamp="2026-05-20 21:51:39 +0000 UTC" firstStartedPulling="2026-05-20 21:51:39.520482443 +0000 UTC m=+202.382903350" lastFinishedPulling="2026-05-20 21:51:41.22027361 +0000 UTC m=+204.082694525" observedRunningTime="2026-05-20 21:51:41.404775012 +0000 UTC m=+204.267195952" watchObservedRunningTime="2026-05-20 21:51:41.405588112 +0000 UTC m=+204.268009042" May 20 21:51:42.390660 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:42.390627 2581 generic.go:358] "Generic (PLEG): container finished" podID="de995e4f-8389-4f12-a6fc-a43716da17b4" containerID="f9bc9dd216e0adcf6d9c75538e35c3d2b897249afe8443ef8d7db2eea49bbfe6" exitCode=0 May 20 21:51:42.391117 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:42.390721 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de995e4f-8389-4f12-a6fc-a43716da17b4","Type":"ContainerDied","Data":"f9bc9dd216e0adcf6d9c75538e35c3d2b897249afe8443ef8d7db2eea49bbfe6"} May 20 21:51:43.771530 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:43.771453 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z" podUID="093a54ec-c0b5-436c-a3e3-3b01b3168279" containerName="registry" containerID="cri-o://9376301dac03c82fdff7265387bd5b36c635e3063453c46fe589f38d685ba42f" gracePeriod=30 May 20 21:51:44.033616 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:44.033547 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z" May 20 21:51:44.125749 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:44.125717 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/093a54ec-c0b5-436c-a3e3-3b01b3168279-image-registry-private-configuration\") pod \"093a54ec-c0b5-436c-a3e3-3b01b3168279\" (UID: \"093a54ec-c0b5-436c-a3e3-3b01b3168279\") " May 20 21:51:44.125889 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:44.125765 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/093a54ec-c0b5-436c-a3e3-3b01b3168279-ca-trust-extracted\") pod \"093a54ec-c0b5-436c-a3e3-3b01b3168279\" (UID: \"093a54ec-c0b5-436c-a3e3-3b01b3168279\") " May 20 21:51:44.125889 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:44.125791 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/093a54ec-c0b5-436c-a3e3-3b01b3168279-installation-pull-secrets\") pod \"093a54ec-c0b5-436c-a3e3-3b01b3168279\" (UID: \"093a54ec-c0b5-436c-a3e3-3b01b3168279\") " May 20 21:51:44.125889 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:44.125823 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lm8wd\" (UniqueName: \"kubernetes.io/projected/093a54ec-c0b5-436c-a3e3-3b01b3168279-kube-api-access-lm8wd\") pod \"093a54ec-c0b5-436c-a3e3-3b01b3168279\" (UID: \"093a54ec-c0b5-436c-a3e3-3b01b3168279\") " May 20 21:51:44.125889 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:44.125843 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/093a54ec-c0b5-436c-a3e3-3b01b3168279-registry-certificates\") pod \"093a54ec-c0b5-436c-a3e3-3b01b3168279\" (UID: \"093a54ec-c0b5-436c-a3e3-3b01b3168279\") " May 20 21:51:44.126311 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:44.126284 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/093a54ec-c0b5-436c-a3e3-3b01b3168279-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "093a54ec-c0b5-436c-a3e3-3b01b3168279" (UID: "093a54ec-c0b5-436c-a3e3-3b01b3168279"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 21:51:44.128136 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:44.128106 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/093a54ec-c0b5-436c-a3e3-3b01b3168279-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "093a54ec-c0b5-436c-a3e3-3b01b3168279" (UID: "093a54ec-c0b5-436c-a3e3-3b01b3168279"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 21:51:44.128243 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:44.128161 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/093a54ec-c0b5-436c-a3e3-3b01b3168279-kube-api-access-lm8wd" (OuterVolumeSpecName: "kube-api-access-lm8wd") pod "093a54ec-c0b5-436c-a3e3-3b01b3168279" (UID: "093a54ec-c0b5-436c-a3e3-3b01b3168279"). InnerVolumeSpecName "kube-api-access-lm8wd". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 21:51:44.128243 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:44.128168 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/093a54ec-c0b5-436c-a3e3-3b01b3168279-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "093a54ec-c0b5-436c-a3e3-3b01b3168279" (UID: "093a54ec-c0b5-436c-a3e3-3b01b3168279"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 21:51:44.134111 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:44.134066 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/093a54ec-c0b5-436c-a3e3-3b01b3168279-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "093a54ec-c0b5-436c-a3e3-3b01b3168279" (UID: "093a54ec-c0b5-436c-a3e3-3b01b3168279"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 21:51:44.226401 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:44.226362 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/093a54ec-c0b5-436c-a3e3-3b01b3168279-registry-tls\") pod \"093a54ec-c0b5-436c-a3e3-3b01b3168279\" (UID: \"093a54ec-c0b5-436c-a3e3-3b01b3168279\") " May 20 21:51:44.226401 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:44.226420 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/093a54ec-c0b5-436c-a3e3-3b01b3168279-trusted-ca\") pod \"093a54ec-c0b5-436c-a3e3-3b01b3168279\" (UID: \"093a54ec-c0b5-436c-a3e3-3b01b3168279\") " May 20 21:51:44.226634 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:44.226437 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/093a54ec-c0b5-436c-a3e3-3b01b3168279-bound-sa-token\") pod \"093a54ec-c0b5-436c-a3e3-3b01b3168279\" (UID: \"093a54ec-c0b5-436c-a3e3-3b01b3168279\") " May 20 21:51:44.226716 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:44.226697 2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/093a54ec-c0b5-436c-a3e3-3b01b3168279-image-registry-private-configuration\") on node \"ip-10-0-129-137.ec2.internal\" DevicePath \"\"" May 20 21:51:44.226753 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:44.226725 2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/093a54ec-c0b5-436c-a3e3-3b01b3168279-ca-trust-extracted\") on node \"ip-10-0-129-137.ec2.internal\" DevicePath \"\"" May 20 21:51:44.226753 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:44.226742 2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/093a54ec-c0b5-436c-a3e3-3b01b3168279-installation-pull-secrets\") on node \"ip-10-0-129-137.ec2.internal\" DevicePath \"\"" May 20 21:51:44.226818 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:44.226756 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lm8wd\" (UniqueName: \"kubernetes.io/projected/093a54ec-c0b5-436c-a3e3-3b01b3168279-kube-api-access-lm8wd\") on node \"ip-10-0-129-137.ec2.internal\" DevicePath \"\"" May 20 21:51:44.226818 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:44.226772 2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/093a54ec-c0b5-436c-a3e3-3b01b3168279-registry-certificates\") on node \"ip-10-0-129-137.ec2.internal\" DevicePath \"\"" May 20 21:51:44.226910 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:44.226841 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/093a54ec-c0b5-436c-a3e3-3b01b3168279-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "093a54ec-c0b5-436c-a3e3-3b01b3168279" (UID: "093a54ec-c0b5-436c-a3e3-3b01b3168279"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 21:51:44.228788 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:44.228760 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/093a54ec-c0b5-436c-a3e3-3b01b3168279-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "093a54ec-c0b5-436c-a3e3-3b01b3168279" (UID: "093a54ec-c0b5-436c-a3e3-3b01b3168279"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 21:51:44.228902 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:44.228821 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/093a54ec-c0b5-436c-a3e3-3b01b3168279-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "093a54ec-c0b5-436c-a3e3-3b01b3168279" (UID: "093a54ec-c0b5-436c-a3e3-3b01b3168279"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 21:51:44.327416 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:44.327376 2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/093a54ec-c0b5-436c-a3e3-3b01b3168279-registry-tls\") on node \"ip-10-0-129-137.ec2.internal\" DevicePath \"\"" May 20 21:51:44.327416 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:44.327411 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/093a54ec-c0b5-436c-a3e3-3b01b3168279-trusted-ca\") on node \"ip-10-0-129-137.ec2.internal\" DevicePath \"\"" May 20 21:51:44.327416 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:44.327421 2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/093a54ec-c0b5-436c-a3e3-3b01b3168279-bound-sa-token\") on node \"ip-10-0-129-137.ec2.internal\" DevicePath \"\"" May 20 21:51:44.399125 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:44.399060 2581 generic.go:358] "Generic (PLEG): container finished" podID="093a54ec-c0b5-436c-a3e3-3b01b3168279" containerID="9376301dac03c82fdff7265387bd5b36c635e3063453c46fe589f38d685ba42f" exitCode=0 May 20 21:51:44.399315 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:44.399136 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z" event={"ID":"093a54ec-c0b5-436c-a3e3-3b01b3168279","Type":"ContainerDied","Data":"9376301dac03c82fdff7265387bd5b36c635e3063453c46fe589f38d685ba42f"} May 20 21:51:44.399315 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:44.399154 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z" May 20 21:51:44.399315 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:44.399176 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z" event={"ID":"093a54ec-c0b5-436c-a3e3-3b01b3168279","Type":"ContainerDied","Data":"d878507573818c2eab8d4773a9a9fd2d1d36c2dc2aebd658956c912b157d0aac"} May 20 21:51:44.399315 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:44.399196 2581 scope.go:117] "RemoveContainer" containerID="9376301dac03c82fdff7265387bd5b36c635e3063453c46fe589f38d685ba42f" May 20 21:51:44.421881 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:44.421855 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z"] May 20 21:51:44.424830 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:44.424802 2581 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5cb8f8d8dc-nfg8z"] May 20 21:51:45.062691 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:45.062668 2581 scope.go:117] "RemoveContainer" containerID="9376301dac03c82fdff7265387bd5b36c635e3063453c46fe589f38d685ba42f" May 20 21:51:45.063060 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:51:45.063039 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9376301dac03c82fdff7265387bd5b36c635e3063453c46fe589f38d685ba42f\": container with ID starting with 9376301dac03c82fdff7265387bd5b36c635e3063453c46fe589f38d685ba42f not found: ID does not exist" containerID="9376301dac03c82fdff7265387bd5b36c635e3063453c46fe589f38d685ba42f" May 20 21:51:45.063142 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:45.063071 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9376301dac03c82fdff7265387bd5b36c635e3063453c46fe589f38d685ba42f"} err="failed to get container status \"9376301dac03c82fdff7265387bd5b36c635e3063453c46fe589f38d685ba42f\": rpc error: code = NotFound desc = could not find container \"9376301dac03c82fdff7265387bd5b36c635e3063453c46fe589f38d685ba42f\": container with ID starting with 9376301dac03c82fdff7265387bd5b36c635e3063453c46fe589f38d685ba42f not found: ID does not exist" May 20 21:51:45.404586 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:45.404494 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de995e4f-8389-4f12-a6fc-a43716da17b4","Type":"ContainerStarted","Data":"21753f2370cade405dbf7f2b1d495931772af0739f2da9bbbe5929a4dbb77173"} May 20 21:51:45.404586 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:45.404529 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de995e4f-8389-4f12-a6fc-a43716da17b4","Type":"ContainerStarted","Data":"0e34a1949f56ce466851039099f6b8e99882aede66e88619b6a46d05294cdb0c"} May 20 21:51:45.775273 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:45.775193 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="093a54ec-c0b5-436c-a3e3-3b01b3168279" path="/var/lib/kubelet/pods/093a54ec-c0b5-436c-a3e3-3b01b3168279/volumes" May 20 21:51:47.412723 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:47.412686 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de995e4f-8389-4f12-a6fc-a43716da17b4","Type":"ContainerStarted","Data":"b75136dbd3a38eaed74eee0eec843ff89b137404de9e26051db43f0312abb371"} May 20 21:51:47.412723 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:47.412731 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de995e4f-8389-4f12-a6fc-a43716da17b4","Type":"ContainerStarted","Data":"e96ea73200e1ed7bd0ac214a19f795009b2c33a9beb5b0a045872f7c5eac8b17"} May 20 21:51:47.413154 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:47.412742 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de995e4f-8389-4f12-a6fc-a43716da17b4","Type":"ContainerStarted","Data":"17b3ce7c0e4c707c88f918cef0b79287439d1f01012c828193d304ef4b448347"} May 20 21:51:47.413154 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:47.412751 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de995e4f-8389-4f12-a6fc-a43716da17b4","Type":"ContainerStarted","Data":"ffe8b0bb1a51cc544be3f00ed4acffa2eb799bcc0fc79e4b4f28bbabd12333da"} May 20 21:51:47.445205 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:47.444729 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.934916847 podStartE2EDuration="7.44471151s" podCreationTimestamp="2026-05-20 21:51:40 +0000 UTC" firstStartedPulling="2026-05-20 21:51:41.3190047 +0000 UTC m=+204.181425622" lastFinishedPulling="2026-05-20 21:51:46.828799366 +0000 UTC m=+209.691220285" observedRunningTime="2026-05-20 21:51:47.440177451 +0000 UTC m=+210.302598384" watchObservedRunningTime="2026-05-20 21:51:47.44471151 +0000 UTC m=+210.307132444" May 20 21:51:51.159657 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:51.159624 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 20 21:51:59.377972 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:59.377934 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-f55845df4-dxpsk" May 20 21:51:59.377972 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:51:59.377980 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-f55845df4-dxpsk" May 20 21:52:07.472980 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:07.472937 2581 generic.go:358] "Generic (PLEG): container finished" podID="bc5f1e17-5a1a-4735-bfa3-47c5c8982daf" containerID="1e52120195ade03fb2331a32cafe6f3042e59aa3eebd65f977619def43f39fc5" exitCode=0 May 20 21:52:07.473382 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:07.473010 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-nb6qc" event={"ID":"bc5f1e17-5a1a-4735-bfa3-47c5c8982daf","Type":"ContainerDied","Data":"1e52120195ade03fb2331a32cafe6f3042e59aa3eebd65f977619def43f39fc5"} May 20 21:52:07.473382 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:07.473358 2581 scope.go:117] "RemoveContainer" containerID="1e52120195ade03fb2331a32cafe6f3042e59aa3eebd65f977619def43f39fc5" May 20 21:52:08.477345 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:08.477310 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-nb6qc" event={"ID":"bc5f1e17-5a1a-4735-bfa3-47c5c8982daf","Type":"ContainerStarted","Data":"34a2643adff388bdc31baa83945ac78b3afea1ccbc64833a7f4823d058a08163"} May 20 21:52:19.383865 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:19.383835 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-f55845df4-dxpsk" May 20 21:52:19.387653 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:19.387628 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-f55845df4-dxpsk" May 20 21:52:27.531489 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:27.531407 2581 generic.go:358] "Generic (PLEG): container finished" podID="e1f6a66d-0f04-48f9-ba0d-2bd45bf6b350" containerID="67e1c44369db779383062ad15cde2371d003ea97127d4ae1c8ca74e57dec39be" exitCode=0 May 20 21:52:27.531942 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:27.531487 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wrfmh" event={"ID":"e1f6a66d-0f04-48f9-ba0d-2bd45bf6b350","Type":"ContainerDied","Data":"67e1c44369db779383062ad15cde2371d003ea97127d4ae1c8ca74e57dec39be"} May 20 21:52:27.531942 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:27.531836 2581 scope.go:117] "RemoveContainer" containerID="67e1c44369db779383062ad15cde2371d003ea97127d4ae1c8ca74e57dec39be" May 20 21:52:28.535603 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:28.535567 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wrfmh" event={"ID":"e1f6a66d-0f04-48f9-ba0d-2bd45bf6b350","Type":"ContainerStarted","Data":"6040ce26e5fcaa40d3dfeffe6c9d19419745b1a8e415a2418432f0c009aa4a2a"} May 20 21:52:29.426697 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:29.426659 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/872c529b-f04d-4f44-be10-283c11ff49e0-metrics-certs\") pod \"network-metrics-daemon-6wbvb\" (UID: \"872c529b-f04d-4f44-be10-283c11ff49e0\") " pod="openshift-multus/network-metrics-daemon-6wbvb" May 20 21:52:29.428936 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:29.428912 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/872c529b-f04d-4f44-be10-283c11ff49e0-metrics-certs\") pod \"network-metrics-daemon-6wbvb\" (UID: \"872c529b-f04d-4f44-be10-283c11ff49e0\") " pod="openshift-multus/network-metrics-daemon-6wbvb" May 20 21:52:29.471402 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:29.471376 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5n7z5\"" May 20 21:52:29.479403 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:29.479376 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6wbvb" May 20 21:52:29.601911 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:29.601879 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6wbvb"] May 20 21:52:29.604670 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:52:29.604639 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod872c529b_f04d_4f44_be10_283c11ff49e0.slice/crio-c3bd3f87acff70fa7d4c6b9852991cb342ff0cb425ff70312bd405f82dbd9ac6 WatchSource:0}: Error finding container c3bd3f87acff70fa7d4c6b9852991cb342ff0cb425ff70312bd405f82dbd9ac6: Status 404 returned error can't find the container with id c3bd3f87acff70fa7d4c6b9852991cb342ff0cb425ff70312bd405f82dbd9ac6 May 20 21:52:30.542522 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:30.542490 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6wbvb" event={"ID":"872c529b-f04d-4f44-be10-283c11ff49e0","Type":"ContainerStarted","Data":"c3bd3f87acff70fa7d4c6b9852991cb342ff0cb425ff70312bd405f82dbd9ac6"} May 20 21:52:31.202602 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:31.202573 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-b2fhf_7c19723c-ff40-490c-aeb2-5a6cea8164e8/kube-state-metrics/0.log" May 20 21:52:31.390392 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:31.390361 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-b2fhf_7c19723c-ff40-490c-aeb2-5a6cea8164e8/kube-rbac-proxy-main/0.log" May 20 21:52:31.547424 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:31.547337 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6wbvb" event={"ID":"872c529b-f04d-4f44-be10-283c11ff49e0","Type":"ContainerStarted","Data":"00a781fa4aa158bd3868c76a42657ca0e350dac1576479a83d357549fc80cc48"} May 20 21:52:31.547424 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:31.547375 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6wbvb" event={"ID":"872c529b-f04d-4f44-be10-283c11ff49e0","Type":"ContainerStarted","Data":"3f8b47852014cf6e8c80f6e2688a318d6a6110bab15f71ba3afe5bcc2cdf0cb2"} May 20 21:52:31.567451 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:31.567402 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6wbvb" podStartSLOduration=253.684217859 podStartE2EDuration="4m14.567383698s" podCreationTimestamp="2026-05-20 21:48:17 +0000 UTC" firstStartedPulling="2026-05-20 21:52:29.606532382 +0000 UTC m=+252.468953290" lastFinishedPulling="2026-05-20 21:52:30.489698216 +0000 UTC m=+253.352119129" observedRunningTime="2026-05-20 21:52:31.566647978 +0000 UTC m=+254.429068909" watchObservedRunningTime="2026-05-20 21:52:31.567383698 +0000 UTC m=+254.429804627" May 20 21:52:31.590857 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:31.590830 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-b2fhf_7c19723c-ff40-490c-aeb2-5a6cea8164e8/kube-rbac-proxy-self/0.log" May 20 21:52:31.790150 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:31.790119 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-f55845df4-dxpsk_f0ee2c77-be7d-4f31-a68d-c77d9b3a8b0e/metrics-server/0.log" May 20 21:52:32.190577 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:32.190544 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-96d2b_3ccab590-13e6-40fa-abcd-200a0e6c52db/init-textfile/0.log" May 20 21:52:32.391487 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:32.391460 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-96d2b_3ccab590-13e6-40fa-abcd-200a0e6c52db/node-exporter/0.log" May 20 21:52:32.590334 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:32.590310 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-96d2b_3ccab590-13e6-40fa-abcd-200a0e6c52db/kube-rbac-proxy/0.log" May 20 21:52:34.590484 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:34.590456 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_de995e4f-8389-4f12-a6fc-a43716da17b4/init-config-reloader/0.log" May 20 21:52:34.792680 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:34.792637 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_de995e4f-8389-4f12-a6fc-a43716da17b4/prometheus/0.log" May 20 21:52:34.991261 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:34.991189 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_de995e4f-8389-4f12-a6fc-a43716da17b4/config-reloader/0.log" May 20 21:52:35.191912 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:35.191883 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_de995e4f-8389-4f12-a6fc-a43716da17b4/thanos-sidecar/0.log" May 20 21:52:35.390933 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:35.390907 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_de995e4f-8389-4f12-a6fc-a43716da17b4/kube-rbac-proxy-web/0.log" May 20 21:52:35.590794 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:35.590767 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_de995e4f-8389-4f12-a6fc-a43716da17b4/kube-rbac-proxy/0.log" May 20 21:52:35.791132 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:35.791022 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_de995e4f-8389-4f12-a6fc-a43716da17b4/kube-rbac-proxy-thanos/0.log" May 20 21:52:35.992058 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:35.992027 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-zz9cl_32d9f655-7497-43d6-9ecc-0535fc122b12/prometheus-operator/0.log" May 20 21:52:36.190531 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:36.190498 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-zz9cl_32d9f655-7497-43d6-9ecc-0535fc122b12/kube-rbac-proxy/0.log" May 20 21:52:36.390900 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:36.390871 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-7t258_69068108-28e3-4d3f-9d62-ed73c6bcacd4/prometheus-operator-admission-webhook/0.log" May 20 21:52:41.159879 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:41.159836 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:41.180372 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:41.180343 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:41.190893 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:41.190872 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x5q4l_b7fbcb26-e155-4cf8-89ba-17e5c52f3f8c/dns-node-resolver/0.log" May 20 21:52:41.594746 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:41.594720 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:42.392569 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:42.392537 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vhwkk_30a53acd-d1d9-480d-885b-ebccb4ef3734/node-ca/0.log" May 20 21:52:57.222011 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:52:57.221962 2581 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hcsxv" podUID="1d9a5e80-3f7c-4c29-abbc-04a9004ec9df" May 20 21:52:57.624369 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:57.624337 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hcsxv" May 20 21:52:59.235779 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.235739 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 20 21:52:59.236298 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.236215 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="de995e4f-8389-4f12-a6fc-a43716da17b4" containerName="prometheus" containerID="cri-o://0e34a1949f56ce466851039099f6b8e99882aede66e88619b6a46d05294cdb0c" gracePeriod=600 May 20 21:52:59.236298 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.236247 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="de995e4f-8389-4f12-a6fc-a43716da17b4" containerName="kube-rbac-proxy" containerID="cri-o://e96ea73200e1ed7bd0ac214a19f795009b2c33a9beb5b0a045872f7c5eac8b17" gracePeriod=600 May 20 21:52:59.236298 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.236265 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="de995e4f-8389-4f12-a6fc-a43716da17b4" containerName="thanos-sidecar" containerID="cri-o://ffe8b0bb1a51cc544be3f00ed4acffa2eb799bcc0fc79e4b4f28bbabd12333da" gracePeriod=600 May 20 21:52:59.236473 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.236319 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="de995e4f-8389-4f12-a6fc-a43716da17b4" containerName="kube-rbac-proxy-web" containerID="cri-o://17b3ce7c0e4c707c88f918cef0b79287439d1f01012c828193d304ef4b448347" gracePeriod=600 May 20 21:52:59.236473 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.236275 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="de995e4f-8389-4f12-a6fc-a43716da17b4" containerName="kube-rbac-proxy-thanos" containerID="cri-o://b75136dbd3a38eaed74eee0eec843ff89b137404de9e26051db43f0312abb371" gracePeriod=600 May 20 21:52:59.236473 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.236374 2581 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="de995e4f-8389-4f12-a6fc-a43716da17b4" containerName="config-reloader" containerID="cri-o://21753f2370cade405dbf7f2b1d495931772af0739f2da9bbbe5929a4dbb77173" gracePeriod=600 May 20 21:52:59.491196 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.490707 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.579399 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.579370 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/de995e4f-8389-4f12-a6fc-a43716da17b4-config-out\") pod \"de995e4f-8389-4f12-a6fc-a43716da17b4\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " May 20 21:52:59.579566 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.579408 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-secret-prometheus-k8s-tls\") pod \"de995e4f-8389-4f12-a6fc-a43716da17b4\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " May 20 21:52:59.579566 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.579437 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de995e4f-8389-4f12-a6fc-a43716da17b4-prometheus-trusted-ca-bundle\") pod \"de995e4f-8389-4f12-a6fc-a43716da17b4\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " May 20 21:52:59.579566 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.579472 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/de995e4f-8389-4f12-a6fc-a43716da17b4-prometheus-k8s-db\") pod \"de995e4f-8389-4f12-a6fc-a43716da17b4\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " May 20 21:52:59.579566 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.579498 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-secret-grpc-tls\") pod \"de995e4f-8389-4f12-a6fc-a43716da17b4\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " May 20 21:52:59.579566 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.579530 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"de995e4f-8389-4f12-a6fc-a43716da17b4\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " May 20 21:52:59.579566 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.579554 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"de995e4f-8389-4f12-a6fc-a43716da17b4\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " May 20 21:52:59.579886 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.579593 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-secret-metrics-client-certs\") pod \"de995e4f-8389-4f12-a6fc-a43716da17b4\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " May 20 21:52:59.579886 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.579846 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de995e4f-8389-4f12-a6fc-a43716da17b4-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "de995e4f-8389-4f12-a6fc-a43716da17b4" (UID: "de995e4f-8389-4f12-a6fc-a43716da17b4"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 21:52:59.579993 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.579964 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-thanos-prometheus-http-client-file\") pod \"de995e4f-8389-4f12-a6fc-a43716da17b4\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " May 20 21:52:59.580048 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.580010 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/de995e4f-8389-4f12-a6fc-a43716da17b4-prometheus-k8s-rulefiles-0\") pod \"de995e4f-8389-4f12-a6fc-a43716da17b4\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " May 20 21:52:59.580129 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.580045 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-config\") pod \"de995e4f-8389-4f12-a6fc-a43716da17b4\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " May 20 21:52:59.580129 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.580103 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de995e4f-8389-4f12-a6fc-a43716da17b4-configmap-metrics-client-ca\") pod \"de995e4f-8389-4f12-a6fc-a43716da17b4\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " May 20 21:52:59.580238 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.580142 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de995e4f-8389-4f12-a6fc-a43716da17b4-configmap-serving-certs-ca-bundle\") pod \"de995e4f-8389-4f12-a6fc-a43716da17b4\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " May 20 21:52:59.580238 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.580176 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-secret-kube-rbac-proxy\") pod \"de995e4f-8389-4f12-a6fc-a43716da17b4\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " May 20 21:52:59.580238 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.580211 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/de995e4f-8389-4f12-a6fc-a43716da17b4-tls-assets\") pod \"de995e4f-8389-4f12-a6fc-a43716da17b4\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " May 20 21:52:59.580381 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.580242 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-web-config\") pod \"de995e4f-8389-4f12-a6fc-a43716da17b4\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " May 20 21:52:59.580381 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.580287 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2k5w\" (UniqueName: \"kubernetes.io/projected/de995e4f-8389-4f12-a6fc-a43716da17b4-kube-api-access-k2k5w\") pod \"de995e4f-8389-4f12-a6fc-a43716da17b4\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " May 20 21:52:59.580381 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.580324 2581 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de995e4f-8389-4f12-a6fc-a43716da17b4-configmap-kubelet-serving-ca-bundle\") pod \"de995e4f-8389-4f12-a6fc-a43716da17b4\" (UID: \"de995e4f-8389-4f12-a6fc-a43716da17b4\") " May 20 21:52:59.580813 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.580697 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de995e4f-8389-4f12-a6fc-a43716da17b4-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "de995e4f-8389-4f12-a6fc-a43716da17b4" (UID: "de995e4f-8389-4f12-a6fc-a43716da17b4"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 21:52:59.582272 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.581957 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de995e4f-8389-4f12-a6fc-a43716da17b4-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "de995e4f-8389-4f12-a6fc-a43716da17b4" (UID: "de995e4f-8389-4f12-a6fc-a43716da17b4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 21:52:59.583093 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.583045 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de995e4f-8389-4f12-a6fc-a43716da17b4-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "de995e4f-8389-4f12-a6fc-a43716da17b4" (UID: "de995e4f-8389-4f12-a6fc-a43716da17b4"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 21:52:59.583213 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.583192 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "de995e4f-8389-4f12-a6fc-a43716da17b4" (UID: "de995e4f-8389-4f12-a6fc-a43716da17b4"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 21:52:59.583453 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.583429 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de995e4f-8389-4f12-a6fc-a43716da17b4-prometheus-trusted-ca-bundle\") on node \"ip-10-0-129-137.ec2.internal\" DevicePath \"\"" May 20 21:52:59.583453 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.583438 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de995e4f-8389-4f12-a6fc-a43716da17b4-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "de995e4f-8389-4f12-a6fc-a43716da17b4" (UID: "de995e4f-8389-4f12-a6fc-a43716da17b4"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 21:52:59.583613 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.583479 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/de995e4f-8389-4f12-a6fc-a43716da17b4-prometheus-k8s-db\") on node \"ip-10-0-129-137.ec2.internal\" DevicePath \"\"" May 20 21:52:59.583613 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.583500 2581 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-secret-grpc-tls\") on node \"ip-10-0-129-137.ec2.internal\" DevicePath \"\"" May 20 21:52:59.583613 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.583517 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/de995e4f-8389-4f12-a6fc-a43716da17b4-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-129-137.ec2.internal\" DevicePath \"\"" May 20 21:52:59.583613 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.583550 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de995e4f-8389-4f12-a6fc-a43716da17b4-configmap-metrics-client-ca\") on node \"ip-10-0-129-137.ec2.internal\" DevicePath \"\"" May 20 21:52:59.583848 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.583829 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de995e4f-8389-4f12-a6fc-a43716da17b4-config-out" (OuterVolumeSpecName: "config-out") pod "de995e4f-8389-4f12-a6fc-a43716da17b4" (UID: "de995e4f-8389-4f12-a6fc-a43716da17b4"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 20 21:52:59.584132 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.584110 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de995e4f-8389-4f12-a6fc-a43716da17b4-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "de995e4f-8389-4f12-a6fc-a43716da17b4" (UID: "de995e4f-8389-4f12-a6fc-a43716da17b4"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 20 21:52:59.584374 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.584350 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "de995e4f-8389-4f12-a6fc-a43716da17b4" (UID: "de995e4f-8389-4f12-a6fc-a43716da17b4"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 21:52:59.584374 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.584374 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-config" (OuterVolumeSpecName: "config") pod "de995e4f-8389-4f12-a6fc-a43716da17b4" (UID: "de995e4f-8389-4f12-a6fc-a43716da17b4"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 21:52:59.584530 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.584443 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "de995e4f-8389-4f12-a6fc-a43716da17b4" (UID: "de995e4f-8389-4f12-a6fc-a43716da17b4"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 21:52:59.584530 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.584459 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "de995e4f-8389-4f12-a6fc-a43716da17b4" (UID: "de995e4f-8389-4f12-a6fc-a43716da17b4"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 21:52:59.584530 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.584472 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "de995e4f-8389-4f12-a6fc-a43716da17b4" (UID: "de995e4f-8389-4f12-a6fc-a43716da17b4"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 21:52:59.584530 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.584507 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "de995e4f-8389-4f12-a6fc-a43716da17b4" (UID: "de995e4f-8389-4f12-a6fc-a43716da17b4"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 21:52:59.584945 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.584925 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "de995e4f-8389-4f12-a6fc-a43716da17b4" (UID: "de995e4f-8389-4f12-a6fc-a43716da17b4"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 21:52:59.584986 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.584950 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de995e4f-8389-4f12-a6fc-a43716da17b4-kube-api-access-k2k5w" (OuterVolumeSpecName: "kube-api-access-k2k5w") pod "de995e4f-8389-4f12-a6fc-a43716da17b4" (UID: "de995e4f-8389-4f12-a6fc-a43716da17b4"). InnerVolumeSpecName "kube-api-access-k2k5w". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 21:52:59.585451 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.585433 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de995e4f-8389-4f12-a6fc-a43716da17b4-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "de995e4f-8389-4f12-a6fc-a43716da17b4" (UID: "de995e4f-8389-4f12-a6fc-a43716da17b4"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 20 21:52:59.594761 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.594737 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-web-config" (OuterVolumeSpecName: "web-config") pod "de995e4f-8389-4f12-a6fc-a43716da17b4" (UID: "de995e4f-8389-4f12-a6fc-a43716da17b4"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 20 21:52:59.632469 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.632436 2581 generic.go:358] "Generic (PLEG): container finished" podID="de995e4f-8389-4f12-a6fc-a43716da17b4" containerID="b75136dbd3a38eaed74eee0eec843ff89b137404de9e26051db43f0312abb371" exitCode=0 May 20 21:52:59.632469 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.632462 2581 generic.go:358] "Generic (PLEG): container finished" podID="de995e4f-8389-4f12-a6fc-a43716da17b4" containerID="e96ea73200e1ed7bd0ac214a19f795009b2c33a9beb5b0a045872f7c5eac8b17" exitCode=0 May 20 21:52:59.632469 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.632468 2581 generic.go:358] "Generic (PLEG): container finished" podID="de995e4f-8389-4f12-a6fc-a43716da17b4" containerID="17b3ce7c0e4c707c88f918cef0b79287439d1f01012c828193d304ef4b448347" exitCode=0 May 20 21:52:59.632469 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.632474 2581 generic.go:358] "Generic (PLEG): container finished" podID="de995e4f-8389-4f12-a6fc-a43716da17b4" containerID="ffe8b0bb1a51cc544be3f00ed4acffa2eb799bcc0fc79e4b4f28bbabd12333da" exitCode=0 May 20 21:52:59.632469 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.632479 2581 generic.go:358] "Generic (PLEG): container finished" podID="de995e4f-8389-4f12-a6fc-a43716da17b4" containerID="21753f2370cade405dbf7f2b1d495931772af0739f2da9bbbe5929a4dbb77173" exitCode=0 May 20 21:52:59.632753 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.632485 2581 generic.go:358] "Generic (PLEG): container finished" podID="de995e4f-8389-4f12-a6fc-a43716da17b4" containerID="0e34a1949f56ce466851039099f6b8e99882aede66e88619b6a46d05294cdb0c" exitCode=0 May 20 21:52:59.632753 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.632522 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de995e4f-8389-4f12-a6fc-a43716da17b4","Type":"ContainerDied","Data":"b75136dbd3a38eaed74eee0eec843ff89b137404de9e26051db43f0312abb371"} May 20 21:52:59.632753 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.632551 2581 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.632753 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.632563 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de995e4f-8389-4f12-a6fc-a43716da17b4","Type":"ContainerDied","Data":"e96ea73200e1ed7bd0ac214a19f795009b2c33a9beb5b0a045872f7c5eac8b17"} May 20 21:52:59.632753 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.632574 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de995e4f-8389-4f12-a6fc-a43716da17b4","Type":"ContainerDied","Data":"17b3ce7c0e4c707c88f918cef0b79287439d1f01012c828193d304ef4b448347"} May 20 21:52:59.632753 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.632584 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de995e4f-8389-4f12-a6fc-a43716da17b4","Type":"ContainerDied","Data":"ffe8b0bb1a51cc544be3f00ed4acffa2eb799bcc0fc79e4b4f28bbabd12333da"} May 20 21:52:59.632753 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.632593 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de995e4f-8389-4f12-a6fc-a43716da17b4","Type":"ContainerDied","Data":"21753f2370cade405dbf7f2b1d495931772af0739f2da9bbbe5929a4dbb77173"} May 20 21:52:59.632753 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.632602 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de995e4f-8389-4f12-a6fc-a43716da17b4","Type":"ContainerDied","Data":"0e34a1949f56ce466851039099f6b8e99882aede66e88619b6a46d05294cdb0c"} May 20 21:52:59.632753 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.632611 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"de995e4f-8389-4f12-a6fc-a43716da17b4","Type":"ContainerDied","Data":"b1f0f2eb4dd1bddfcf235b3f52574ad941dd4d89001f9c41d6aa6fa67f7ac099"} May 20 21:52:59.632753 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.632627 2581 scope.go:117] "RemoveContainer" containerID="b75136dbd3a38eaed74eee0eec843ff89b137404de9e26051db43f0312abb371" May 20 21:52:59.642693 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.642676 2581 scope.go:117] "RemoveContainer" containerID="e96ea73200e1ed7bd0ac214a19f795009b2c33a9beb5b0a045872f7c5eac8b17" May 20 21:52:59.649448 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.649430 2581 scope.go:117] "RemoveContainer" containerID="17b3ce7c0e4c707c88f918cef0b79287439d1f01012c828193d304ef4b448347" May 20 21:52:59.656904 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.656884 2581 scope.go:117] "RemoveContainer" containerID="ffe8b0bb1a51cc544be3f00ed4acffa2eb799bcc0fc79e4b4f28bbabd12333da" May 20 21:52:59.657389 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.657362 2581 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 20 21:52:59.663399 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.663368 2581 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 20 21:52:59.664228 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.664213 2581 scope.go:117] "RemoveContainer" containerID="21753f2370cade405dbf7f2b1d495931772af0739f2da9bbbe5929a4dbb77173" May 20 21:52:59.670603 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.670580 2581 scope.go:117] "RemoveContainer" containerID="0e34a1949f56ce466851039099f6b8e99882aede66e88619b6a46d05294cdb0c" May 20 21:52:59.677773 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.677747 2581 scope.go:117] "RemoveContainer" containerID="f9bc9dd216e0adcf6d9c75538e35c3d2b897249afe8443ef8d7db2eea49bbfe6" May 20 21:52:59.684103 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.684002 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2k5w\" (UniqueName: \"kubernetes.io/projected/de995e4f-8389-4f12-a6fc-a43716da17b4-kube-api-access-k2k5w\") on node \"ip-10-0-129-137.ec2.internal\" DevicePath \"\"" May 20 21:52:59.684103 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.684021 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de995e4f-8389-4f12-a6fc-a43716da17b4-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-129-137.ec2.internal\" DevicePath \"\"" May 20 21:52:59.684103 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.684037 2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/de995e4f-8389-4f12-a6fc-a43716da17b4-config-out\") on node \"ip-10-0-129-137.ec2.internal\" DevicePath \"\"" May 20 21:52:59.684103 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.684051 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-secret-prometheus-k8s-tls\") on node \"ip-10-0-129-137.ec2.internal\" DevicePath \"\"" May 20 21:52:59.684103 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.684064 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-129-137.ec2.internal\" DevicePath \"\"" May 20 21:52:59.684103 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.684094 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-129-137.ec2.internal\" DevicePath \"\"" May 20 21:52:59.684363 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.684111 2581 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-secret-metrics-client-certs\") on node \"ip-10-0-129-137.ec2.internal\" DevicePath \"\"" May 20 21:52:59.684363 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.684127 2581 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-thanos-prometheus-http-client-file\") on node \"ip-10-0-129-137.ec2.internal\" DevicePath \"\"" May 20 21:52:59.684363 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.684140 2581 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-config\") on node \"ip-10-0-129-137.ec2.internal\" DevicePath \"\"" May 20 21:52:59.684363 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.684152 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de995e4f-8389-4f12-a6fc-a43716da17b4-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-129-137.ec2.internal\" DevicePath \"\"" May 20 21:52:59.684363 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.684166 2581 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-secret-kube-rbac-proxy\") on node \"ip-10-0-129-137.ec2.internal\" DevicePath \"\"" May 20 21:52:59.684363 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.684178 2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/de995e4f-8389-4f12-a6fc-a43716da17b4-tls-assets\") on node \"ip-10-0-129-137.ec2.internal\" DevicePath \"\"" May 20 21:52:59.684363 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.684153 2581 scope.go:117] "RemoveContainer" containerID="b75136dbd3a38eaed74eee0eec843ff89b137404de9e26051db43f0312abb371" May 20 21:52:59.684363 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.684190 2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/de995e4f-8389-4f12-a6fc-a43716da17b4-web-config\") on node \"ip-10-0-129-137.ec2.internal\" DevicePath \"\"" May 20 21:52:59.684662 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:52:59.684506 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b75136dbd3a38eaed74eee0eec843ff89b137404de9e26051db43f0312abb371\": container with ID starting with b75136dbd3a38eaed74eee0eec843ff89b137404de9e26051db43f0312abb371 not found: ID does not exist" containerID="b75136dbd3a38eaed74eee0eec843ff89b137404de9e26051db43f0312abb371" May 20 21:52:59.684662 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.684531 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b75136dbd3a38eaed74eee0eec843ff89b137404de9e26051db43f0312abb371"} err="failed to get container status \"b75136dbd3a38eaed74eee0eec843ff89b137404de9e26051db43f0312abb371\": rpc error: code = NotFound desc = could not find container \"b75136dbd3a38eaed74eee0eec843ff89b137404de9e26051db43f0312abb371\": container with ID starting with b75136dbd3a38eaed74eee0eec843ff89b137404de9e26051db43f0312abb371 not found: ID does not exist" May 20 21:52:59.684662 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.684550 2581 scope.go:117] "RemoveContainer" containerID="e96ea73200e1ed7bd0ac214a19f795009b2c33a9beb5b0a045872f7c5eac8b17" May 20 21:52:59.684842 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:52:59.684822 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e96ea73200e1ed7bd0ac214a19f795009b2c33a9beb5b0a045872f7c5eac8b17\": container with ID starting with e96ea73200e1ed7bd0ac214a19f795009b2c33a9beb5b0a045872f7c5eac8b17 not found: ID does not exist" containerID="e96ea73200e1ed7bd0ac214a19f795009b2c33a9beb5b0a045872f7c5eac8b17" May 20 21:52:59.684901 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.684855 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e96ea73200e1ed7bd0ac214a19f795009b2c33a9beb5b0a045872f7c5eac8b17"} err="failed to get container status \"e96ea73200e1ed7bd0ac214a19f795009b2c33a9beb5b0a045872f7c5eac8b17\": rpc error: code = NotFound desc = could not find container \"e96ea73200e1ed7bd0ac214a19f795009b2c33a9beb5b0a045872f7c5eac8b17\": container with ID starting with e96ea73200e1ed7bd0ac214a19f795009b2c33a9beb5b0a045872f7c5eac8b17 not found: ID does not exist" May 20 21:52:59.684901 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.684881 2581 scope.go:117] "RemoveContainer" containerID="17b3ce7c0e4c707c88f918cef0b79287439d1f01012c828193d304ef4b448347" May 20 21:52:59.685206 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:52:59.685184 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17b3ce7c0e4c707c88f918cef0b79287439d1f01012c828193d304ef4b448347\": container with ID starting with 17b3ce7c0e4c707c88f918cef0b79287439d1f01012c828193d304ef4b448347 not found: ID does not exist" containerID="17b3ce7c0e4c707c88f918cef0b79287439d1f01012c828193d304ef4b448347" May 20 21:52:59.685304 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.685216 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17b3ce7c0e4c707c88f918cef0b79287439d1f01012c828193d304ef4b448347"} err="failed to get container status \"17b3ce7c0e4c707c88f918cef0b79287439d1f01012c828193d304ef4b448347\": rpc error: code = NotFound desc = could not find container \"17b3ce7c0e4c707c88f918cef0b79287439d1f01012c828193d304ef4b448347\": container with ID starting with 17b3ce7c0e4c707c88f918cef0b79287439d1f01012c828193d304ef4b448347 not found: ID does not exist" May 20 21:52:59.685304 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.685236 2581 scope.go:117] "RemoveContainer" containerID="ffe8b0bb1a51cc544be3f00ed4acffa2eb799bcc0fc79e4b4f28bbabd12333da" May 20 21:52:59.685650 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:52:59.685522 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffe8b0bb1a51cc544be3f00ed4acffa2eb799bcc0fc79e4b4f28bbabd12333da\": container with ID starting with ffe8b0bb1a51cc544be3f00ed4acffa2eb799bcc0fc79e4b4f28bbabd12333da not found: ID does not exist" containerID="ffe8b0bb1a51cc544be3f00ed4acffa2eb799bcc0fc79e4b4f28bbabd12333da" May 20 21:52:59.685650 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.685552 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffe8b0bb1a51cc544be3f00ed4acffa2eb799bcc0fc79e4b4f28bbabd12333da"} err="failed to get container status \"ffe8b0bb1a51cc544be3f00ed4acffa2eb799bcc0fc79e4b4f28bbabd12333da\": rpc error: code = NotFound desc = could not find container \"ffe8b0bb1a51cc544be3f00ed4acffa2eb799bcc0fc79e4b4f28bbabd12333da\": container with ID starting with ffe8b0bb1a51cc544be3f00ed4acffa2eb799bcc0fc79e4b4f28bbabd12333da not found: ID does not exist" May 20 21:52:59.685650 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.685572 2581 scope.go:117] "RemoveContainer" containerID="21753f2370cade405dbf7f2b1d495931772af0739f2da9bbbe5929a4dbb77173" May 20 21:52:59.685977 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:52:59.685929 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21753f2370cade405dbf7f2b1d495931772af0739f2da9bbbe5929a4dbb77173\": container with ID starting with 21753f2370cade405dbf7f2b1d495931772af0739f2da9bbbe5929a4dbb77173 not found: ID does not exist" containerID="21753f2370cade405dbf7f2b1d495931772af0739f2da9bbbe5929a4dbb77173" May 20 21:52:59.686050 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.685986 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21753f2370cade405dbf7f2b1d495931772af0739f2da9bbbe5929a4dbb77173"} err="failed to get container status \"21753f2370cade405dbf7f2b1d495931772af0739f2da9bbbe5929a4dbb77173\": rpc error: code = NotFound desc = could not find container \"21753f2370cade405dbf7f2b1d495931772af0739f2da9bbbe5929a4dbb77173\": container with ID starting with 21753f2370cade405dbf7f2b1d495931772af0739f2da9bbbe5929a4dbb77173 not found: ID does not exist" May 20 21:52:59.686050 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.686008 2581 scope.go:117] "RemoveContainer" containerID="0e34a1949f56ce466851039099f6b8e99882aede66e88619b6a46d05294cdb0c" May 20 21:52:59.686376 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:52:59.686344 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e34a1949f56ce466851039099f6b8e99882aede66e88619b6a46d05294cdb0c\": container with ID starting with 0e34a1949f56ce466851039099f6b8e99882aede66e88619b6a46d05294cdb0c not found: ID does not exist" containerID="0e34a1949f56ce466851039099f6b8e99882aede66e88619b6a46d05294cdb0c" May 20 21:52:59.686462 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.686380 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e34a1949f56ce466851039099f6b8e99882aede66e88619b6a46d05294cdb0c"} err="failed to get container status \"0e34a1949f56ce466851039099f6b8e99882aede66e88619b6a46d05294cdb0c\": rpc error: code = NotFound desc = could not find container \"0e34a1949f56ce466851039099f6b8e99882aede66e88619b6a46d05294cdb0c\": container with ID starting with 0e34a1949f56ce466851039099f6b8e99882aede66e88619b6a46d05294cdb0c not found: ID does not exist" May 20 21:52:59.686462 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.686395 2581 scope.go:117] "RemoveContainer" containerID="f9bc9dd216e0adcf6d9c75538e35c3d2b897249afe8443ef8d7db2eea49bbfe6" May 20 21:52:59.686650 ip-10-0-129-137 kubenswrapper[2581]: E0520 21:52:59.686633 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9bc9dd216e0adcf6d9c75538e35c3d2b897249afe8443ef8d7db2eea49bbfe6\": container with ID starting with f9bc9dd216e0adcf6d9c75538e35c3d2b897249afe8443ef8d7db2eea49bbfe6 not found: ID does not exist" containerID="f9bc9dd216e0adcf6d9c75538e35c3d2b897249afe8443ef8d7db2eea49bbfe6" May 20 21:52:59.686694 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.686652 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9bc9dd216e0adcf6d9c75538e35c3d2b897249afe8443ef8d7db2eea49bbfe6"} err="failed to get container status \"f9bc9dd216e0adcf6d9c75538e35c3d2b897249afe8443ef8d7db2eea49bbfe6\": rpc error: code = NotFound desc = could not find container \"f9bc9dd216e0adcf6d9c75538e35c3d2b897249afe8443ef8d7db2eea49bbfe6\": container with ID starting with f9bc9dd216e0adcf6d9c75538e35c3d2b897249afe8443ef8d7db2eea49bbfe6 not found: ID does not exist" May 20 21:52:59.686694 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.686677 2581 scope.go:117] "RemoveContainer" containerID="b75136dbd3a38eaed74eee0eec843ff89b137404de9e26051db43f0312abb371" May 20 21:52:59.686917 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.686884 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b75136dbd3a38eaed74eee0eec843ff89b137404de9e26051db43f0312abb371"} err="failed to get container status \"b75136dbd3a38eaed74eee0eec843ff89b137404de9e26051db43f0312abb371\": rpc error: code = NotFound desc = could not find container \"b75136dbd3a38eaed74eee0eec843ff89b137404de9e26051db43f0312abb371\": container with ID starting with b75136dbd3a38eaed74eee0eec843ff89b137404de9e26051db43f0312abb371 not found: ID does not exist" May 20 21:52:59.686917 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.686911 2581 scope.go:117] "RemoveContainer" containerID="e96ea73200e1ed7bd0ac214a19f795009b2c33a9beb5b0a045872f7c5eac8b17" May 20 21:52:59.687237 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.687219 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e96ea73200e1ed7bd0ac214a19f795009b2c33a9beb5b0a045872f7c5eac8b17"} err="failed to get container status \"e96ea73200e1ed7bd0ac214a19f795009b2c33a9beb5b0a045872f7c5eac8b17\": rpc error: code = NotFound desc = could not find container \"e96ea73200e1ed7bd0ac214a19f795009b2c33a9beb5b0a045872f7c5eac8b17\": container with ID starting with e96ea73200e1ed7bd0ac214a19f795009b2c33a9beb5b0a045872f7c5eac8b17 not found: ID does not exist" May 20 21:52:59.687296 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.687238 2581 scope.go:117] "RemoveContainer" containerID="17b3ce7c0e4c707c88f918cef0b79287439d1f01012c828193d304ef4b448347" May 20 21:52:59.687480 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.687459 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17b3ce7c0e4c707c88f918cef0b79287439d1f01012c828193d304ef4b448347"} err="failed to get container status \"17b3ce7c0e4c707c88f918cef0b79287439d1f01012c828193d304ef4b448347\": rpc error: code = NotFound desc = could not find container \"17b3ce7c0e4c707c88f918cef0b79287439d1f01012c828193d304ef4b448347\": container with ID starting with 17b3ce7c0e4c707c88f918cef0b79287439d1f01012c828193d304ef4b448347 not found: ID does not exist" May 20 21:52:59.687546 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.687482 2581 scope.go:117] "RemoveContainer" containerID="ffe8b0bb1a51cc544be3f00ed4acffa2eb799bcc0fc79e4b4f28bbabd12333da" May 20 21:52:59.687733 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.687712 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffe8b0bb1a51cc544be3f00ed4acffa2eb799bcc0fc79e4b4f28bbabd12333da"} err="failed to get container status \"ffe8b0bb1a51cc544be3f00ed4acffa2eb799bcc0fc79e4b4f28bbabd12333da\": rpc error: code = NotFound desc = could not find container \"ffe8b0bb1a51cc544be3f00ed4acffa2eb799bcc0fc79e4b4f28bbabd12333da\": container with ID starting with ffe8b0bb1a51cc544be3f00ed4acffa2eb799bcc0fc79e4b4f28bbabd12333da not found: ID does not exist" May 20 21:52:59.687833 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.687733 2581 scope.go:117] "RemoveContainer" containerID="21753f2370cade405dbf7f2b1d495931772af0739f2da9bbbe5929a4dbb77173" May 20 21:52:59.687898 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.687855 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 20 21:52:59.687970 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.687953 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21753f2370cade405dbf7f2b1d495931772af0739f2da9bbbe5929a4dbb77173"} err="failed to get container status \"21753f2370cade405dbf7f2b1d495931772af0739f2da9bbbe5929a4dbb77173\": rpc error: code = NotFound desc = could not find container \"21753f2370cade405dbf7f2b1d495931772af0739f2da9bbbe5929a4dbb77173\": container with ID starting with 21753f2370cade405dbf7f2b1d495931772af0739f2da9bbbe5929a4dbb77173 not found: ID does not exist" May 20 21:52:59.688012 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.687971 2581 scope.go:117] "RemoveContainer" containerID="0e34a1949f56ce466851039099f6b8e99882aede66e88619b6a46d05294cdb0c" May 20 21:52:59.688176 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.688162 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de995e4f-8389-4f12-a6fc-a43716da17b4" containerName="thanos-sidecar" May 20 21:52:59.688176 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.688177 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="de995e4f-8389-4f12-a6fc-a43716da17b4" containerName="thanos-sidecar" May 20 21:52:59.688258 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.688186 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de995e4f-8389-4f12-a6fc-a43716da17b4" containerName="config-reloader" May 20 21:52:59.688258 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.688192 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="de995e4f-8389-4f12-a6fc-a43716da17b4" containerName="config-reloader" May 20 21:52:59.688258 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.688201 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de995e4f-8389-4f12-a6fc-a43716da17b4" containerName="init-config-reloader" May 20 21:52:59.688258 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.688207 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="de995e4f-8389-4f12-a6fc-a43716da17b4" containerName="init-config-reloader" May 20 21:52:59.688258 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.688205 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e34a1949f56ce466851039099f6b8e99882aede66e88619b6a46d05294cdb0c"} err="failed to get container status \"0e34a1949f56ce466851039099f6b8e99882aede66e88619b6a46d05294cdb0c\": rpc error: code = NotFound desc = could not find container \"0e34a1949f56ce466851039099f6b8e99882aede66e88619b6a46d05294cdb0c\": container with ID starting with 0e34a1949f56ce466851039099f6b8e99882aede66e88619b6a46d05294cdb0c not found: ID does not exist" May 20 21:52:59.688258 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.688213 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de995e4f-8389-4f12-a6fc-a43716da17b4" containerName="kube-rbac-proxy-web" May 20 21:52:59.688258 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.688219 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="de995e4f-8389-4f12-a6fc-a43716da17b4" containerName="kube-rbac-proxy-web" May 20 21:52:59.688258 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.688234 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de995e4f-8389-4f12-a6fc-a43716da17b4" containerName="kube-rbac-proxy-thanos" May 20 21:52:59.688258 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.688240 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="de995e4f-8389-4f12-a6fc-a43716da17b4" containerName="kube-rbac-proxy-thanos" May 20 21:52:59.688258 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.688247 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de995e4f-8389-4f12-a6fc-a43716da17b4" containerName="kube-rbac-proxy" May 20 21:52:59.688258 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.688253 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="de995e4f-8389-4f12-a6fc-a43716da17b4" containerName="kube-rbac-proxy" May 20 21:52:59.688258 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.688261 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de995e4f-8389-4f12-a6fc-a43716da17b4" containerName="prometheus" May 20 21:52:59.688677 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.688266 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="de995e4f-8389-4f12-a6fc-a43716da17b4" containerName="prometheus" May 20 21:52:59.688677 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.688273 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="093a54ec-c0b5-436c-a3e3-3b01b3168279" containerName="registry" May 20 21:52:59.688677 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.688278 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="093a54ec-c0b5-436c-a3e3-3b01b3168279" containerName="registry" May 20 21:52:59.688677 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.688219 2581 scope.go:117] "RemoveContainer" containerID="f9bc9dd216e0adcf6d9c75538e35c3d2b897249afe8443ef8d7db2eea49bbfe6" May 20 21:52:59.688677 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.688320 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="de995e4f-8389-4f12-a6fc-a43716da17b4" containerName="thanos-sidecar" May 20 21:52:59.688677 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.688328 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="de995e4f-8389-4f12-a6fc-a43716da17b4" containerName="kube-rbac-proxy-web" May 20 21:52:59.688677 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.688334 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="093a54ec-c0b5-436c-a3e3-3b01b3168279" containerName="registry" May 20 21:52:59.688677 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.688340 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="de995e4f-8389-4f12-a6fc-a43716da17b4" containerName="config-reloader" May 20 21:52:59.688677 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.688346 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="de995e4f-8389-4f12-a6fc-a43716da17b4" containerName="prometheus" May 20 21:52:59.688677 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.688351 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="de995e4f-8389-4f12-a6fc-a43716da17b4" containerName="kube-rbac-proxy" May 20 21:52:59.688677 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.688357 2581 memory_manager.go:356] "RemoveStaleState removing state" podUID="de995e4f-8389-4f12-a6fc-a43716da17b4" containerName="kube-rbac-proxy-thanos" May 20 21:52:59.688677 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.688499 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9bc9dd216e0adcf6d9c75538e35c3d2b897249afe8443ef8d7db2eea49bbfe6"} err="failed to get container status \"f9bc9dd216e0adcf6d9c75538e35c3d2b897249afe8443ef8d7db2eea49bbfe6\": rpc error: code = NotFound desc = could not find container \"f9bc9dd216e0adcf6d9c75538e35c3d2b897249afe8443ef8d7db2eea49bbfe6\": container with ID starting with f9bc9dd216e0adcf6d9c75538e35c3d2b897249afe8443ef8d7db2eea49bbfe6 not found: ID does not exist" May 20 21:52:59.688677 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.688518 2581 scope.go:117] "RemoveContainer" containerID="b75136dbd3a38eaed74eee0eec843ff89b137404de9e26051db43f0312abb371" May 20 21:52:59.689217 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.688692 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b75136dbd3a38eaed74eee0eec843ff89b137404de9e26051db43f0312abb371"} err="failed to get container status \"b75136dbd3a38eaed74eee0eec843ff89b137404de9e26051db43f0312abb371\": rpc error: code = NotFound desc = could not find container \"b75136dbd3a38eaed74eee0eec843ff89b137404de9e26051db43f0312abb371\": container with ID starting with b75136dbd3a38eaed74eee0eec843ff89b137404de9e26051db43f0312abb371 not found: ID does not exist" May 20 21:52:59.689217 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.688704 2581 scope.go:117] "RemoveContainer" containerID="e96ea73200e1ed7bd0ac214a19f795009b2c33a9beb5b0a045872f7c5eac8b17" May 20 21:52:59.689217 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.688906 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e96ea73200e1ed7bd0ac214a19f795009b2c33a9beb5b0a045872f7c5eac8b17"} err="failed to get container status \"e96ea73200e1ed7bd0ac214a19f795009b2c33a9beb5b0a045872f7c5eac8b17\": rpc error: code = NotFound desc = could not find container \"e96ea73200e1ed7bd0ac214a19f795009b2c33a9beb5b0a045872f7c5eac8b17\": container with ID starting with e96ea73200e1ed7bd0ac214a19f795009b2c33a9beb5b0a045872f7c5eac8b17 not found: ID does not exist" May 20 21:52:59.689217 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.688923 2581 scope.go:117] "RemoveContainer" containerID="17b3ce7c0e4c707c88f918cef0b79287439d1f01012c828193d304ef4b448347" May 20 21:52:59.689585 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.689539 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17b3ce7c0e4c707c88f918cef0b79287439d1f01012c828193d304ef4b448347"} err="failed to get container status \"17b3ce7c0e4c707c88f918cef0b79287439d1f01012c828193d304ef4b448347\": rpc error: code = NotFound desc = could not find container \"17b3ce7c0e4c707c88f918cef0b79287439d1f01012c828193d304ef4b448347\": container with ID starting with 17b3ce7c0e4c707c88f918cef0b79287439d1f01012c828193d304ef4b448347 not found: ID does not exist" May 20 21:52:59.689585 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.689562 2581 scope.go:117] "RemoveContainer" containerID="ffe8b0bb1a51cc544be3f00ed4acffa2eb799bcc0fc79e4b4f28bbabd12333da" May 20 21:52:59.689837 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.689818 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffe8b0bb1a51cc544be3f00ed4acffa2eb799bcc0fc79e4b4f28bbabd12333da"} err="failed to get container status \"ffe8b0bb1a51cc544be3f00ed4acffa2eb799bcc0fc79e4b4f28bbabd12333da\": rpc error: code = NotFound desc = could not find container \"ffe8b0bb1a51cc544be3f00ed4acffa2eb799bcc0fc79e4b4f28bbabd12333da\": container with ID starting with ffe8b0bb1a51cc544be3f00ed4acffa2eb799bcc0fc79e4b4f28bbabd12333da not found: ID does not exist" May 20 21:52:59.689905 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.689838 2581 scope.go:117] "RemoveContainer" containerID="21753f2370cade405dbf7f2b1d495931772af0739f2da9bbbe5929a4dbb77173" May 20 21:52:59.690069 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.690051 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21753f2370cade405dbf7f2b1d495931772af0739f2da9bbbe5929a4dbb77173"} err="failed to get container status \"21753f2370cade405dbf7f2b1d495931772af0739f2da9bbbe5929a4dbb77173\": rpc error: code = NotFound desc = could not find container \"21753f2370cade405dbf7f2b1d495931772af0739f2da9bbbe5929a4dbb77173\": container with ID starting with 21753f2370cade405dbf7f2b1d495931772af0739f2da9bbbe5929a4dbb77173 not found: ID does not exist" May 20 21:52:59.690149 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.690070 2581 scope.go:117] "RemoveContainer" containerID="0e34a1949f56ce466851039099f6b8e99882aede66e88619b6a46d05294cdb0c" May 20 21:52:59.690364 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.690345 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e34a1949f56ce466851039099f6b8e99882aede66e88619b6a46d05294cdb0c"} err="failed to get container status \"0e34a1949f56ce466851039099f6b8e99882aede66e88619b6a46d05294cdb0c\": rpc error: code = NotFound desc = could not find container \"0e34a1949f56ce466851039099f6b8e99882aede66e88619b6a46d05294cdb0c\": container with ID starting with 0e34a1949f56ce466851039099f6b8e99882aede66e88619b6a46d05294cdb0c not found: ID does not exist" May 20 21:52:59.690411 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.690368 2581 scope.go:117] "RemoveContainer" containerID="f9bc9dd216e0adcf6d9c75538e35c3d2b897249afe8443ef8d7db2eea49bbfe6" May 20 21:52:59.690606 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.690577 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9bc9dd216e0adcf6d9c75538e35c3d2b897249afe8443ef8d7db2eea49bbfe6"} err="failed to get container status \"f9bc9dd216e0adcf6d9c75538e35c3d2b897249afe8443ef8d7db2eea49bbfe6\": rpc error: code = NotFound desc = could not find container \"f9bc9dd216e0adcf6d9c75538e35c3d2b897249afe8443ef8d7db2eea49bbfe6\": container with ID starting with f9bc9dd216e0adcf6d9c75538e35c3d2b897249afe8443ef8d7db2eea49bbfe6 not found: ID does not exist" May 20 21:52:59.690673 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.690609 2581 scope.go:117] "RemoveContainer" containerID="b75136dbd3a38eaed74eee0eec843ff89b137404de9e26051db43f0312abb371" May 20 21:52:59.690804 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.690786 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b75136dbd3a38eaed74eee0eec843ff89b137404de9e26051db43f0312abb371"} err="failed to get container status \"b75136dbd3a38eaed74eee0eec843ff89b137404de9e26051db43f0312abb371\": rpc error: code = NotFound desc = could not find container \"b75136dbd3a38eaed74eee0eec843ff89b137404de9e26051db43f0312abb371\": container with ID starting with b75136dbd3a38eaed74eee0eec843ff89b137404de9e26051db43f0312abb371 not found: ID does not exist" May 20 21:52:59.690869 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.690805 2581 scope.go:117] "RemoveContainer" containerID="e96ea73200e1ed7bd0ac214a19f795009b2c33a9beb5b0a045872f7c5eac8b17" May 20 21:52:59.691022 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.691004 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e96ea73200e1ed7bd0ac214a19f795009b2c33a9beb5b0a045872f7c5eac8b17"} err="failed to get container status \"e96ea73200e1ed7bd0ac214a19f795009b2c33a9beb5b0a045872f7c5eac8b17\": rpc error: code = NotFound desc = could not find container \"e96ea73200e1ed7bd0ac214a19f795009b2c33a9beb5b0a045872f7c5eac8b17\": container with ID starting with e96ea73200e1ed7bd0ac214a19f795009b2c33a9beb5b0a045872f7c5eac8b17 not found: ID does not exist" May 20 21:52:59.691071 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.691024 2581 scope.go:117] "RemoveContainer" containerID="17b3ce7c0e4c707c88f918cef0b79287439d1f01012c828193d304ef4b448347" May 20 21:52:59.691270 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.691252 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17b3ce7c0e4c707c88f918cef0b79287439d1f01012c828193d304ef4b448347"} err="failed to get container status \"17b3ce7c0e4c707c88f918cef0b79287439d1f01012c828193d304ef4b448347\": rpc error: code = NotFound desc = could not find container \"17b3ce7c0e4c707c88f918cef0b79287439d1f01012c828193d304ef4b448347\": container with ID starting with 17b3ce7c0e4c707c88f918cef0b79287439d1f01012c828193d304ef4b448347 not found: ID does not exist" May 20 21:52:59.691339 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.691272 2581 scope.go:117] "RemoveContainer" containerID="ffe8b0bb1a51cc544be3f00ed4acffa2eb799bcc0fc79e4b4f28bbabd12333da" May 20 21:52:59.691486 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.691469 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffe8b0bb1a51cc544be3f00ed4acffa2eb799bcc0fc79e4b4f28bbabd12333da"} err="failed to get container status \"ffe8b0bb1a51cc544be3f00ed4acffa2eb799bcc0fc79e4b4f28bbabd12333da\": rpc error: code = NotFound desc = could not find container \"ffe8b0bb1a51cc544be3f00ed4acffa2eb799bcc0fc79e4b4f28bbabd12333da\": container with ID starting with ffe8b0bb1a51cc544be3f00ed4acffa2eb799bcc0fc79e4b4f28bbabd12333da not found: ID does not exist" May 20 21:52:59.691527 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.691487 2581 scope.go:117] "RemoveContainer" containerID="21753f2370cade405dbf7f2b1d495931772af0739f2da9bbbe5929a4dbb77173" May 20 21:52:59.691682 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.691663 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21753f2370cade405dbf7f2b1d495931772af0739f2da9bbbe5929a4dbb77173"} err="failed to get container status \"21753f2370cade405dbf7f2b1d495931772af0739f2da9bbbe5929a4dbb77173\": rpc error: code = NotFound desc = could not find container \"21753f2370cade405dbf7f2b1d495931772af0739f2da9bbbe5929a4dbb77173\": container with ID starting with 21753f2370cade405dbf7f2b1d495931772af0739f2da9bbbe5929a4dbb77173 not found: ID does not exist" May 20 21:52:59.691723 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.691683 2581 scope.go:117] "RemoveContainer" containerID="0e34a1949f56ce466851039099f6b8e99882aede66e88619b6a46d05294cdb0c" May 20 21:52:59.691914 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.691897 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e34a1949f56ce466851039099f6b8e99882aede66e88619b6a46d05294cdb0c"} err="failed to get container status \"0e34a1949f56ce466851039099f6b8e99882aede66e88619b6a46d05294cdb0c\": rpc error: code = NotFound desc = could not find container \"0e34a1949f56ce466851039099f6b8e99882aede66e88619b6a46d05294cdb0c\": container with ID starting with 0e34a1949f56ce466851039099f6b8e99882aede66e88619b6a46d05294cdb0c not found: ID does not exist" May 20 21:52:59.691972 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.691915 2581 scope.go:117] "RemoveContainer" containerID="f9bc9dd216e0adcf6d9c75538e35c3d2b897249afe8443ef8d7db2eea49bbfe6" May 20 21:52:59.692119 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.692103 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9bc9dd216e0adcf6d9c75538e35c3d2b897249afe8443ef8d7db2eea49bbfe6"} err="failed to get container status \"f9bc9dd216e0adcf6d9c75538e35c3d2b897249afe8443ef8d7db2eea49bbfe6\": rpc error: code = NotFound desc = could not find container \"f9bc9dd216e0adcf6d9c75538e35c3d2b897249afe8443ef8d7db2eea49bbfe6\": container with ID starting with f9bc9dd216e0adcf6d9c75538e35c3d2b897249afe8443ef8d7db2eea49bbfe6 not found: ID does not exist" May 20 21:52:59.692166 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.692120 2581 scope.go:117] "RemoveContainer" containerID="b75136dbd3a38eaed74eee0eec843ff89b137404de9e26051db43f0312abb371" May 20 21:52:59.692317 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.692300 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b75136dbd3a38eaed74eee0eec843ff89b137404de9e26051db43f0312abb371"} err="failed to get container status \"b75136dbd3a38eaed74eee0eec843ff89b137404de9e26051db43f0312abb371\": rpc error: code = NotFound desc = could not find container \"b75136dbd3a38eaed74eee0eec843ff89b137404de9e26051db43f0312abb371\": container with ID starting with b75136dbd3a38eaed74eee0eec843ff89b137404de9e26051db43f0312abb371 not found: ID does not exist" May 20 21:52:59.692359 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.692318 2581 scope.go:117] "RemoveContainer" containerID="e96ea73200e1ed7bd0ac214a19f795009b2c33a9beb5b0a045872f7c5eac8b17" May 20 21:52:59.692502 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.692483 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e96ea73200e1ed7bd0ac214a19f795009b2c33a9beb5b0a045872f7c5eac8b17"} err="failed to get container status \"e96ea73200e1ed7bd0ac214a19f795009b2c33a9beb5b0a045872f7c5eac8b17\": rpc error: code = NotFound desc = could not find container \"e96ea73200e1ed7bd0ac214a19f795009b2c33a9beb5b0a045872f7c5eac8b17\": container with ID starting with e96ea73200e1ed7bd0ac214a19f795009b2c33a9beb5b0a045872f7c5eac8b17 not found: ID does not exist" May 20 21:52:59.692572 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.692503 2581 scope.go:117] "RemoveContainer" containerID="17b3ce7c0e4c707c88f918cef0b79287439d1f01012c828193d304ef4b448347" May 20 21:52:59.692701 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.692686 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17b3ce7c0e4c707c88f918cef0b79287439d1f01012c828193d304ef4b448347"} err="failed to get container status \"17b3ce7c0e4c707c88f918cef0b79287439d1f01012c828193d304ef4b448347\": rpc error: code = NotFound desc = could not find container \"17b3ce7c0e4c707c88f918cef0b79287439d1f01012c828193d304ef4b448347\": container with ID starting with 17b3ce7c0e4c707c88f918cef0b79287439d1f01012c828193d304ef4b448347 not found: ID does not exist" May 20 21:52:59.692749 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.692701 2581 scope.go:117] "RemoveContainer" containerID="ffe8b0bb1a51cc544be3f00ed4acffa2eb799bcc0fc79e4b4f28bbabd12333da" May 20 21:52:59.692868 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.692852 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffe8b0bb1a51cc544be3f00ed4acffa2eb799bcc0fc79e4b4f28bbabd12333da"} err="failed to get container status \"ffe8b0bb1a51cc544be3f00ed4acffa2eb799bcc0fc79e4b4f28bbabd12333da\": rpc error: code = NotFound desc = could not find container \"ffe8b0bb1a51cc544be3f00ed4acffa2eb799bcc0fc79e4b4f28bbabd12333da\": container with ID starting with ffe8b0bb1a51cc544be3f00ed4acffa2eb799bcc0fc79e4b4f28bbabd12333da not found: ID does not exist" May 20 21:52:59.692914 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.692867 2581 scope.go:117] "RemoveContainer" containerID="21753f2370cade405dbf7f2b1d495931772af0739f2da9bbbe5929a4dbb77173" May 20 21:52:59.693069 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.693049 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21753f2370cade405dbf7f2b1d495931772af0739f2da9bbbe5929a4dbb77173"} err="failed to get container status \"21753f2370cade405dbf7f2b1d495931772af0739f2da9bbbe5929a4dbb77173\": rpc error: code = NotFound desc = could not find container \"21753f2370cade405dbf7f2b1d495931772af0739f2da9bbbe5929a4dbb77173\": container with ID starting with 21753f2370cade405dbf7f2b1d495931772af0739f2da9bbbe5929a4dbb77173 not found: ID does not exist" May 20 21:52:59.693128 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.693096 2581 scope.go:117] "RemoveContainer" containerID="0e34a1949f56ce466851039099f6b8e99882aede66e88619b6a46d05294cdb0c" May 20 21:52:59.693299 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.693281 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e34a1949f56ce466851039099f6b8e99882aede66e88619b6a46d05294cdb0c"} err="failed to get container status \"0e34a1949f56ce466851039099f6b8e99882aede66e88619b6a46d05294cdb0c\": rpc error: code = NotFound desc = could not find container \"0e34a1949f56ce466851039099f6b8e99882aede66e88619b6a46d05294cdb0c\": container with ID starting with 0e34a1949f56ce466851039099f6b8e99882aede66e88619b6a46d05294cdb0c not found: ID does not exist" May 20 21:52:59.693346 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.693300 2581 scope.go:117] "RemoveContainer" containerID="f9bc9dd216e0adcf6d9c75538e35c3d2b897249afe8443ef8d7db2eea49bbfe6" May 20 21:52:59.693529 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.693509 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9bc9dd216e0adcf6d9c75538e35c3d2b897249afe8443ef8d7db2eea49bbfe6"} err="failed to get container status \"f9bc9dd216e0adcf6d9c75538e35c3d2b897249afe8443ef8d7db2eea49bbfe6\": rpc error: code = NotFound desc = could not find container \"f9bc9dd216e0adcf6d9c75538e35c3d2b897249afe8443ef8d7db2eea49bbfe6\": container with ID starting with f9bc9dd216e0adcf6d9c75538e35c3d2b897249afe8443ef8d7db2eea49bbfe6 not found: ID does not exist" May 20 21:52:59.693595 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.693531 2581 scope.go:117] "RemoveContainer" containerID="b75136dbd3a38eaed74eee0eec843ff89b137404de9e26051db43f0312abb371" May 20 21:52:59.693757 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.693728 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b75136dbd3a38eaed74eee0eec843ff89b137404de9e26051db43f0312abb371"} err="failed to get container status \"b75136dbd3a38eaed74eee0eec843ff89b137404de9e26051db43f0312abb371\": rpc error: code = NotFound desc = could not find container \"b75136dbd3a38eaed74eee0eec843ff89b137404de9e26051db43f0312abb371\": container with ID starting with b75136dbd3a38eaed74eee0eec843ff89b137404de9e26051db43f0312abb371 not found: ID does not exist" May 20 21:52:59.693757 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.693748 2581 scope.go:117] "RemoveContainer" containerID="e96ea73200e1ed7bd0ac214a19f795009b2c33a9beb5b0a045872f7c5eac8b17" May 20 21:52:59.693896 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.693806 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.694179 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.693989 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e96ea73200e1ed7bd0ac214a19f795009b2c33a9beb5b0a045872f7c5eac8b17"} err="failed to get container status \"e96ea73200e1ed7bd0ac214a19f795009b2c33a9beb5b0a045872f7c5eac8b17\": rpc error: code = NotFound desc = could not find container \"e96ea73200e1ed7bd0ac214a19f795009b2c33a9beb5b0a045872f7c5eac8b17\": container with ID starting with e96ea73200e1ed7bd0ac214a19f795009b2c33a9beb5b0a045872f7c5eac8b17 not found: ID does not exist" May 20 21:52:59.694179 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.694010 2581 scope.go:117] "RemoveContainer" containerID="17b3ce7c0e4c707c88f918cef0b79287439d1f01012c828193d304ef4b448347" May 20 21:52:59.694483 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.694460 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17b3ce7c0e4c707c88f918cef0b79287439d1f01012c828193d304ef4b448347"} err="failed to get container status \"17b3ce7c0e4c707c88f918cef0b79287439d1f01012c828193d304ef4b448347\": rpc error: code = NotFound desc = could not find container \"17b3ce7c0e4c707c88f918cef0b79287439d1f01012c828193d304ef4b448347\": container with ID starting with 17b3ce7c0e4c707c88f918cef0b79287439d1f01012c828193d304ef4b448347 not found: ID does not exist" May 20 21:52:59.694540 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.694487 2581 scope.go:117] "RemoveContainer" containerID="ffe8b0bb1a51cc544be3f00ed4acffa2eb799bcc0fc79e4b4f28bbabd12333da" May 20 21:52:59.694743 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.694722 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffe8b0bb1a51cc544be3f00ed4acffa2eb799bcc0fc79e4b4f28bbabd12333da"} err="failed to get container status \"ffe8b0bb1a51cc544be3f00ed4acffa2eb799bcc0fc79e4b4f28bbabd12333da\": rpc error: code = NotFound desc = could not find container \"ffe8b0bb1a51cc544be3f00ed4acffa2eb799bcc0fc79e4b4f28bbabd12333da\": container with ID starting with ffe8b0bb1a51cc544be3f00ed4acffa2eb799bcc0fc79e4b4f28bbabd12333da not found: ID does not exist" May 20 21:52:59.694816 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.694746 2581 scope.go:117] "RemoveContainer" containerID="21753f2370cade405dbf7f2b1d495931772af0739f2da9bbbe5929a4dbb77173" May 20 21:52:59.694974 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.694947 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21753f2370cade405dbf7f2b1d495931772af0739f2da9bbbe5929a4dbb77173"} err="failed to get container status \"21753f2370cade405dbf7f2b1d495931772af0739f2da9bbbe5929a4dbb77173\": rpc error: code = NotFound desc = could not find container \"21753f2370cade405dbf7f2b1d495931772af0739f2da9bbbe5929a4dbb77173\": container with ID starting with 21753f2370cade405dbf7f2b1d495931772af0739f2da9bbbe5929a4dbb77173 not found: ID does not exist" May 20 21:52:59.695018 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.694974 2581 scope.go:117] "RemoveContainer" containerID="0e34a1949f56ce466851039099f6b8e99882aede66e88619b6a46d05294cdb0c" May 20 21:52:59.695219 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.695199 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e34a1949f56ce466851039099f6b8e99882aede66e88619b6a46d05294cdb0c"} err="failed to get container status \"0e34a1949f56ce466851039099f6b8e99882aede66e88619b6a46d05294cdb0c\": rpc error: code = NotFound desc = could not find container \"0e34a1949f56ce466851039099f6b8e99882aede66e88619b6a46d05294cdb0c\": container with ID starting with 0e34a1949f56ce466851039099f6b8e99882aede66e88619b6a46d05294cdb0c not found: ID does not exist" May 20 21:52:59.695290 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.695220 2581 scope.go:117] "RemoveContainer" containerID="f9bc9dd216e0adcf6d9c75538e35c3d2b897249afe8443ef8d7db2eea49bbfe6" May 20 21:52:59.695500 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.695481 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9bc9dd216e0adcf6d9c75538e35c3d2b897249afe8443ef8d7db2eea49bbfe6"} err="failed to get container status \"f9bc9dd216e0adcf6d9c75538e35c3d2b897249afe8443ef8d7db2eea49bbfe6\": rpc error: code = NotFound desc = could not find container \"f9bc9dd216e0adcf6d9c75538e35c3d2b897249afe8443ef8d7db2eea49bbfe6\": container with ID starting with f9bc9dd216e0adcf6d9c75538e35c3d2b897249afe8443ef8d7db2eea49bbfe6 not found: ID does not exist" May 20 21:52:59.696705 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.696676 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 20 21:52:59.696705 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.696677 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 20 21:52:59.696844 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.696728 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 20 21:52:59.696844 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.696677 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9kb4j10jtljp2\"" May 20 21:52:59.696844 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.696734 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 20 21:52:59.697157 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.697132 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 20 21:52:59.697157 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.697149 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 20 21:52:59.697292 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.697261 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 20 21:52:59.697292 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.697280 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rzf75\"" May 20 21:52:59.697443 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.697430 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 20 21:52:59.697596 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.697581 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 20 21:52:59.697684 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.697669 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 20 21:52:59.700132 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.700111 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 20 21:52:59.703052 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.703031 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 20 21:52:59.704380 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.704357 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 20 21:52:59.772767 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.772686 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de995e4f-8389-4f12-a6fc-a43716da17b4" path="/var/lib/kubelet/pods/de995e4f-8389-4f12-a6fc-a43716da17b4/volumes" May 20 21:52:59.785298 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.785268 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/feede91a-c7e9-4878-9d53-3103dc3b363e-config\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.785442 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.785303 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feede91a-c7e9-4878-9d53-3103dc3b363e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.785442 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.785325 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/feede91a-c7e9-4878-9d53-3103dc3b363e-config-out\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.785442 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.785427 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/feede91a-c7e9-4878-9d53-3103dc3b363e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.785572 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.785455 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feede91a-c7e9-4878-9d53-3103dc3b363e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.785572 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.785474 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/feede91a-c7e9-4878-9d53-3103dc3b363e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.785572 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.785495 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/feede91a-c7e9-4878-9d53-3103dc3b363e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.785722 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.785566 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/feede91a-c7e9-4878-9d53-3103dc3b363e-web-config\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.785722 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.785613 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/feede91a-c7e9-4878-9d53-3103dc3b363e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.785722 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.785643 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/feede91a-c7e9-4878-9d53-3103dc3b363e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.785722 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.785678 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/feede91a-c7e9-4878-9d53-3103dc3b363e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.785876 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.785740 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feede91a-c7e9-4878-9d53-3103dc3b363e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.785876 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.785772 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/feede91a-c7e9-4878-9d53-3103dc3b363e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.785876 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.785792 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/feede91a-c7e9-4878-9d53-3103dc3b363e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.785876 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.785807 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/feede91a-c7e9-4878-9d53-3103dc3b363e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.785876 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.785829 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/feede91a-c7e9-4878-9d53-3103dc3b363e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.785876 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.785875 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5xkx\" (UniqueName: \"kubernetes.io/projected/feede91a-c7e9-4878-9d53-3103dc3b363e-kube-api-access-q5xkx\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.786065 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.785895 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/feede91a-c7e9-4878-9d53-3103dc3b363e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.887121 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.887055 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q5xkx\" (UniqueName: \"kubernetes.io/projected/feede91a-c7e9-4878-9d53-3103dc3b363e-kube-api-access-q5xkx\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.887302 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.887134 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/feede91a-c7e9-4878-9d53-3103dc3b363e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.887302 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.887165 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/feede91a-c7e9-4878-9d53-3103dc3b363e-config\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.887302 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.887190 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feede91a-c7e9-4878-9d53-3103dc3b363e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.887302 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.887216 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/feede91a-c7e9-4878-9d53-3103dc3b363e-config-out\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.887549 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.887475 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/feede91a-c7e9-4878-9d53-3103dc3b363e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.887549 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.887508 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feede91a-c7e9-4878-9d53-3103dc3b363e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.887549 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.887527 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/feede91a-c7e9-4878-9d53-3103dc3b363e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.887970 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.887943 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/feede91a-c7e9-4878-9d53-3103dc3b363e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.888072 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.887992 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feede91a-c7e9-4878-9d53-3103dc3b363e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.888072 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.887999 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/feede91a-c7e9-4878-9d53-3103dc3b363e-web-config\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.888072 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.888030 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/feede91a-c7e9-4878-9d53-3103dc3b363e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.888280 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.888215 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/feede91a-c7e9-4878-9d53-3103dc3b363e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.889239 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.888584 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feede91a-c7e9-4878-9d53-3103dc3b363e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.889239 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.888651 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/feede91a-c7e9-4878-9d53-3103dc3b363e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.889239 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.888697 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/feede91a-c7e9-4878-9d53-3103dc3b363e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.889239 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.888742 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feede91a-c7e9-4878-9d53-3103dc3b363e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.889239 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.888779 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/feede91a-c7e9-4878-9d53-3103dc3b363e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.889239 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.888814 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/feede91a-c7e9-4878-9d53-3103dc3b363e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.889239 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.888839 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/feede91a-c7e9-4878-9d53-3103dc3b363e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.889239 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.888881 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/feede91a-c7e9-4878-9d53-3103dc3b363e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.889718 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.889692 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/feede91a-c7e9-4878-9d53-3103dc3b363e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.889780 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.889729 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feede91a-c7e9-4878-9d53-3103dc3b363e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.890232 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.890186 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/feede91a-c7e9-4878-9d53-3103dc3b363e-config-out\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.890964 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.890603 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/feede91a-c7e9-4878-9d53-3103dc3b363e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.890964 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.890924 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/feede91a-c7e9-4878-9d53-3103dc3b363e-config\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.890964 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.890955 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/feede91a-c7e9-4878-9d53-3103dc3b363e-web-config\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.891752 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.891682 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/feede91a-c7e9-4878-9d53-3103dc3b363e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.891752 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.891706 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/feede91a-c7e9-4878-9d53-3103dc3b363e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.891958 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.891935 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/feede91a-c7e9-4878-9d53-3103dc3b363e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.892226 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.892211 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/feede91a-c7e9-4878-9d53-3103dc3b363e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.892784 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.892742 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/feede91a-c7e9-4878-9d53-3103dc3b363e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.895127 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.893197 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/feede91a-c7e9-4878-9d53-3103dc3b363e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.895127 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.893526 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/feede91a-c7e9-4878-9d53-3103dc3b363e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.897648 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.895755 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5xkx\" (UniqueName: \"kubernetes.io/projected/feede91a-c7e9-4878-9d53-3103dc3b363e-kube-api-access-q5xkx\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:52:59.898376 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:52:59.898358 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/feede91a-c7e9-4878-9d53-3103dc3b363e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"feede91a-c7e9-4878-9d53-3103dc3b363e\") " pod="openshift-monitoring/prometheus-k8s-0" May 20 21:53:00.005130 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:53:00.005065 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 20 21:53:00.137153 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:53:00.137127 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 20 21:53:00.140149 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:53:00.140122 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeede91a_c7e9_4878_9d53_3103dc3b363e.slice/crio-368406bfd422ad1cf22036f0b9972be901a5405a40dd8f4db5574bb91a7f51d6 WatchSource:0}: Error finding container 368406bfd422ad1cf22036f0b9972be901a5405a40dd8f4db5574bb91a7f51d6: Status 404 returned error can't find the container with id 368406bfd422ad1cf22036f0b9972be901a5405a40dd8f4db5574bb91a7f51d6 May 20 21:53:00.637722 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:53:00.637680 2581 generic.go:358] "Generic (PLEG): container finished" podID="feede91a-c7e9-4878-9d53-3103dc3b363e" containerID="16c72a63c5c7f42f897032ff6884549ec0a2d5d2430f876f602253ab37f86c25" exitCode=0 May 20 21:53:00.638168 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:53:00.637729 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"feede91a-c7e9-4878-9d53-3103dc3b363e","Type":"ContainerDied","Data":"16c72a63c5c7f42f897032ff6884549ec0a2d5d2430f876f602253ab37f86c25"} May 20 21:53:00.638168 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:53:00.637776 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"feede91a-c7e9-4878-9d53-3103dc3b363e","Type":"ContainerStarted","Data":"368406bfd422ad1cf22036f0b9972be901a5405a40dd8f4db5574bb91a7f51d6"} May 20 21:53:00.997724 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:53:00.997692 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d9a5e80-3f7c-4c29-abbc-04a9004ec9df-metrics-tls\") pod \"dns-default-hcsxv\" (UID: \"1d9a5e80-3f7c-4c29-abbc-04a9004ec9df\") " pod="openshift-dns/dns-default-hcsxv" May 20 21:53:00.997874 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:53:00.997853 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/99598051-0e0d-4e2f-ac40-6a2d142b4183-cert\") pod \"ingress-canary-bbvpk\" (UID: \"99598051-0e0d-4e2f-ac40-6a2d142b4183\") " pod="openshift-ingress-canary/ingress-canary-bbvpk" May 20 21:53:00.999981 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:53:00.999960 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d9a5e80-3f7c-4c29-abbc-04a9004ec9df-metrics-tls\") pod \"dns-default-hcsxv\" (UID: \"1d9a5e80-3f7c-4c29-abbc-04a9004ec9df\") " pod="openshift-dns/dns-default-hcsxv" May 20 21:53:01.000289 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:53:01.000271 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/99598051-0e0d-4e2f-ac40-6a2d142b4183-cert\") pod \"ingress-canary-bbvpk\" (UID: \"99598051-0e0d-4e2f-ac40-6a2d142b4183\") " pod="openshift-ingress-canary/ingress-canary-bbvpk" May 20 21:53:01.228259 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:53:01.228166 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2fk4m\"" May 20 21:53:01.236162 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:53:01.236137 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hcsxv" May 20 21:53:01.271916 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:53:01.271877 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-n5njn\"" May 20 21:53:01.279981 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:53:01.279950 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bbvpk" May 20 21:53:01.368651 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:53:01.368616 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hcsxv"] May 20 21:53:01.370360 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:53:01.370324 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d9a5e80_3f7c_4c29_abbc_04a9004ec9df.slice/crio-b52f620998d00d8565ee0fe2380d3a224503b41a8c0f73bd56b392d8fd344993 WatchSource:0}: Error finding container b52f620998d00d8565ee0fe2380d3a224503b41a8c0f73bd56b392d8fd344993: Status 404 returned error can't find the container with id b52f620998d00d8565ee0fe2380d3a224503b41a8c0f73bd56b392d8fd344993 May 20 21:53:01.425050 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:53:01.424817 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bbvpk"] May 20 21:53:01.427607 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:53:01.427576 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99598051_0e0d_4e2f_ac40_6a2d142b4183.slice/crio-43d5740002e577ddd7450e3b65841b8e9ef2c989c2908f8c74f38334e0d4114c WatchSource:0}: Error finding container 43d5740002e577ddd7450e3b65841b8e9ef2c989c2908f8c74f38334e0d4114c: Status 404 returned error can't find the container with id 43d5740002e577ddd7450e3b65841b8e9ef2c989c2908f8c74f38334e0d4114c May 20 21:53:01.643827 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:53:01.643777 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hcsxv" event={"ID":"1d9a5e80-3f7c-4c29-abbc-04a9004ec9df","Type":"ContainerStarted","Data":"b52f620998d00d8565ee0fe2380d3a224503b41a8c0f73bd56b392d8fd344993"} May 20 21:53:01.646594 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:53:01.646566 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"feede91a-c7e9-4878-9d53-3103dc3b363e","Type":"ContainerStarted","Data":"8b97a99b2320f16a3977e7295e0c02247956c629196f9f23f5028767663c3f7e"} May 20 21:53:01.646740 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:53:01.646601 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"feede91a-c7e9-4878-9d53-3103dc3b363e","Type":"ContainerStarted","Data":"7a620e4fc069c77589ebb1fae147b0fcab1daec90c9466f7519536d6389fdac1"} May 20 21:53:01.646740 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:53:01.646616 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"feede91a-c7e9-4878-9d53-3103dc3b363e","Type":"ContainerStarted","Data":"6ef705e45db84bbc1cc40b6e7575be127bbc14edb5a538a03d0efc5badb5092a"} May 20 21:53:01.646740 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:53:01.646630 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"feede91a-c7e9-4878-9d53-3103dc3b363e","Type":"ContainerStarted","Data":"4670aaf018b84351e11a5c918b6cd37fff66d78623e82a87ce353866d2064555"} May 20 21:53:01.646740 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:53:01.646642 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"feede91a-c7e9-4878-9d53-3103dc3b363e","Type":"ContainerStarted","Data":"1459205c5cdde71839c5daac79a8bf717a037529423be38d4279bd80967e4225"} May 20 21:53:01.646740 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:53:01.646653 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"feede91a-c7e9-4878-9d53-3103dc3b363e","Type":"ContainerStarted","Data":"f876fd71c83d7406a0de08a18a123011cf0db001552ce6f744d6d74e2e5a55cd"} May 20 21:53:01.647624 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:53:01.647601 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bbvpk" event={"ID":"99598051-0e0d-4e2f-ac40-6a2d142b4183","Type":"ContainerStarted","Data":"43d5740002e577ddd7450e3b65841b8e9ef2c989c2908f8c74f38334e0d4114c"} May 20 21:53:01.672871 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:53:01.672822 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.672802166 podStartE2EDuration="2.672802166s" podCreationTimestamp="2026-05-20 21:52:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 21:53:01.671299931 +0000 UTC m=+284.533720860" watchObservedRunningTime="2026-05-20 21:53:01.672802166 +0000 UTC m=+284.535223112" May 20 21:53:03.656150 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:53:03.656115 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bbvpk" event={"ID":"99598051-0e0d-4e2f-ac40-6a2d142b4183","Type":"ContainerStarted","Data":"173a4cadaf3fca20efcbdb0982f24eb5f5bc22e505393d4e58018772a550cc01"} May 20 21:53:03.657763 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:53:03.657738 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hcsxv" event={"ID":"1d9a5e80-3f7c-4c29-abbc-04a9004ec9df","Type":"ContainerStarted","Data":"c986b96e5ad6bcf2b40d9e2d885fdbeae0686d951b09401c29d95d36ca4f982f"} May 20 21:53:03.657763 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:53:03.657768 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hcsxv" event={"ID":"1d9a5e80-3f7c-4c29-abbc-04a9004ec9df","Type":"ContainerStarted","Data":"ef1d596fdb4945cd0653afc0f449d26702f0683da55aca149474c5c74a01c311"} May 20 21:53:03.657939 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:53:03.657851 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hcsxv" May 20 21:53:03.672478 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:53:03.672430 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bbvpk" podStartSLOduration=251.846436471 podStartE2EDuration="4m13.672414662s" podCreationTimestamp="2026-05-20 21:48:50 +0000 UTC" firstStartedPulling="2026-05-20 21:53:01.429494797 +0000 UTC m=+284.291915706" lastFinishedPulling="2026-05-20 21:53:03.255472989 +0000 UTC m=+286.117893897" observedRunningTime="2026-05-20 21:53:03.670892192 +0000 UTC m=+286.533313135" watchObservedRunningTime="2026-05-20 21:53:03.672414662 +0000 UTC m=+286.534835592" May 20 21:53:03.687777 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:53:03.687728 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-hcsxv" podStartSLOduration=251.806846514 podStartE2EDuration="4m13.687711411s" podCreationTimestamp="2026-05-20 21:48:50 +0000 UTC" firstStartedPulling="2026-05-20 21:53:01.372410528 +0000 UTC m=+284.234831436" lastFinishedPulling="2026-05-20 21:53:03.253275424 +0000 UTC m=+286.115696333" observedRunningTime="2026-05-20 21:53:03.687374655 +0000 UTC m=+286.549795608" watchObservedRunningTime="2026-05-20 21:53:03.687711411 +0000 UTC m=+286.550132341" May 20 21:53:05.005808 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:53:05.005759 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 20 21:53:13.664730 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:53:13.664700 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hcsxv" May 20 21:53:17.617977 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:53:17.617947 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jgks5_8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a/ovn-acl-logging/0.log" May 20 21:53:17.619476 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:53:17.619451 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jgks5_8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a/ovn-acl-logging/0.log" May 20 21:53:17.622048 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:53:17.622028 2581 kubelet.go:1628] "Image garbage collection succeeded" May 20 21:54:00.005934 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:54:00.005893 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 20 21:54:00.021766 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:54:00.021735 2581 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 20 21:54:00.839859 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:54:00.839832 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 20 21:54:10.910831 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:54:10.910789 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-4z57g"] May 20 21:54:10.913660 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:54:10.913641 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4z57g" May 20 21:54:10.916158 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:54:10.916134 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 20 21:54:10.921292 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:54:10.921267 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4z57g"] May 20 21:54:10.964470 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:54:10.964439 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52dd05b8-2e48-4579-b4c0-193b7ac0dc78-original-pull-secret\") pod \"global-pull-secret-syncer-4z57g\" (UID: \"52dd05b8-2e48-4579-b4c0-193b7ac0dc78\") " pod="kube-system/global-pull-secret-syncer-4z57g" May 20 21:54:10.964629 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:54:10.964491 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/52dd05b8-2e48-4579-b4c0-193b7ac0dc78-dbus\") pod \"global-pull-secret-syncer-4z57g\" (UID: \"52dd05b8-2e48-4579-b4c0-193b7ac0dc78\") " pod="kube-system/global-pull-secret-syncer-4z57g" May 20 21:54:10.964629 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:54:10.964619 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/52dd05b8-2e48-4579-b4c0-193b7ac0dc78-kubelet-config\") pod \"global-pull-secret-syncer-4z57g\" (UID: \"52dd05b8-2e48-4579-b4c0-193b7ac0dc78\") " pod="kube-system/global-pull-secret-syncer-4z57g" May 20 21:54:11.065920 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:54:11.065878 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52dd05b8-2e48-4579-b4c0-193b7ac0dc78-original-pull-secret\") pod \"global-pull-secret-syncer-4z57g\" (UID: \"52dd05b8-2e48-4579-b4c0-193b7ac0dc78\") " pod="kube-system/global-pull-secret-syncer-4z57g" May 20 21:54:11.066126 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:54:11.065929 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/52dd05b8-2e48-4579-b4c0-193b7ac0dc78-dbus\") pod \"global-pull-secret-syncer-4z57g\" (UID: \"52dd05b8-2e48-4579-b4c0-193b7ac0dc78\") " pod="kube-system/global-pull-secret-syncer-4z57g" May 20 21:54:11.066126 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:54:11.065994 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/52dd05b8-2e48-4579-b4c0-193b7ac0dc78-kubelet-config\") pod \"global-pull-secret-syncer-4z57g\" (UID: \"52dd05b8-2e48-4579-b4c0-193b7ac0dc78\") " pod="kube-system/global-pull-secret-syncer-4z57g" May 20 21:54:11.066126 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:54:11.066111 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/52dd05b8-2e48-4579-b4c0-193b7ac0dc78-kubelet-config\") pod \"global-pull-secret-syncer-4z57g\" (UID: \"52dd05b8-2e48-4579-b4c0-193b7ac0dc78\") " pod="kube-system/global-pull-secret-syncer-4z57g" May 20 21:54:11.066496 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:54:11.066191 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/52dd05b8-2e48-4579-b4c0-193b7ac0dc78-dbus\") pod \"global-pull-secret-syncer-4z57g\" (UID: \"52dd05b8-2e48-4579-b4c0-193b7ac0dc78\") " pod="kube-system/global-pull-secret-syncer-4z57g" May 20 21:54:11.068351 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:54:11.068327 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52dd05b8-2e48-4579-b4c0-193b7ac0dc78-original-pull-secret\") pod \"global-pull-secret-syncer-4z57g\" (UID: \"52dd05b8-2e48-4579-b4c0-193b7ac0dc78\") " pod="kube-system/global-pull-secret-syncer-4z57g" May 20 21:54:11.223430 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:54:11.223333 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4z57g" May 20 21:54:11.347660 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:54:11.347635 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4z57g"] May 20 21:54:11.350216 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:54:11.350186 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52dd05b8_2e48_4579_b4c0_193b7ac0dc78.slice/crio-d940495783819d51ae5d7465ba2d4751fc50a06310973fbf6b05ec1aaa4ef3a3 WatchSource:0}: Error finding container d940495783819d51ae5d7465ba2d4751fc50a06310973fbf6b05ec1aaa4ef3a3: Status 404 returned error can't find the container with id d940495783819d51ae5d7465ba2d4751fc50a06310973fbf6b05ec1aaa4ef3a3 May 20 21:54:11.351848 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:54:11.351832 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 20 21:54:11.861661 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:54:11.861623 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4z57g" event={"ID":"52dd05b8-2e48-4579-b4c0-193b7ac0dc78","Type":"ContainerStarted","Data":"d940495783819d51ae5d7465ba2d4751fc50a06310973fbf6b05ec1aaa4ef3a3"} May 20 21:54:15.879676 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:54:15.879637 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4z57g" event={"ID":"52dd05b8-2e48-4579-b4c0-193b7ac0dc78","Type":"ContainerStarted","Data":"68a50898e3433a2b7b38984eff85dcc90125353bdde3f94d07865b824f14d8ce"} May 20 21:54:15.893711 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:54:15.893657 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4z57g" podStartSLOduration=2.299462042 podStartE2EDuration="5.893641654s" podCreationTimestamp="2026-05-20 21:54:10 +0000 UTC" firstStartedPulling="2026-05-20 21:54:11.351983037 +0000 UTC m=+354.214403949" lastFinishedPulling="2026-05-20 21:54:14.946162649 +0000 UTC m=+357.808583561" observedRunningTime="2026-05-20 21:54:15.893175311 +0000 UTC m=+358.755596251" watchObservedRunningTime="2026-05-20 21:54:15.893641654 +0000 UTC m=+358.756062588" May 20 21:54:54.633881 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:54:54.633842 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-fls5r"] May 20 21:54:54.636215 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:54:54.636194 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-fls5r" May 20 21:54:54.638810 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:54:54.638784 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 20 21:54:54.638947 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:54:54.638784 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 20 21:54:54.639869 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:54:54.639850 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-9wpjf\"" May 20 21:54:54.646748 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:54:54.646721 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-fls5r"] May 20 21:54:54.732482 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:54:54.732442 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/881aef12-38a0-42a4-9650-1fe5c3d317d9-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-fls5r\" (UID: \"881aef12-38a0-42a4-9650-1fe5c3d317d9\") " pod="cert-manager/cert-manager-cainjector-68b757865b-fls5r" May 20 21:54:54.732658 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:54:54.732501 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxvvl\" (UniqueName: \"kubernetes.io/projected/881aef12-38a0-42a4-9650-1fe5c3d317d9-kube-api-access-fxvvl\") pod \"cert-manager-cainjector-68b757865b-fls5r\" (UID: \"881aef12-38a0-42a4-9650-1fe5c3d317d9\") " pod="cert-manager/cert-manager-cainjector-68b757865b-fls5r" May 20 21:54:54.833700 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:54:54.833664 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/881aef12-38a0-42a4-9650-1fe5c3d317d9-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-fls5r\" (UID: \"881aef12-38a0-42a4-9650-1fe5c3d317d9\") " pod="cert-manager/cert-manager-cainjector-68b757865b-fls5r" May 20 21:54:54.833878 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:54:54.833722 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fxvvl\" (UniqueName: \"kubernetes.io/projected/881aef12-38a0-42a4-9650-1fe5c3d317d9-kube-api-access-fxvvl\") pod \"cert-manager-cainjector-68b757865b-fls5r\" (UID: \"881aef12-38a0-42a4-9650-1fe5c3d317d9\") " pod="cert-manager/cert-manager-cainjector-68b757865b-fls5r" May 20 21:54:54.849276 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:54:54.849243 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/881aef12-38a0-42a4-9650-1fe5c3d317d9-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-fls5r\" (UID: \"881aef12-38a0-42a4-9650-1fe5c3d317d9\") " pod="cert-manager/cert-manager-cainjector-68b757865b-fls5r" May 20 21:54:54.849419 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:54:54.849361 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxvvl\" (UniqueName: \"kubernetes.io/projected/881aef12-38a0-42a4-9650-1fe5c3d317d9-kube-api-access-fxvvl\") pod \"cert-manager-cainjector-68b757865b-fls5r\" (UID: \"881aef12-38a0-42a4-9650-1fe5c3d317d9\") " pod="cert-manager/cert-manager-cainjector-68b757865b-fls5r" May 20 21:54:54.956831 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:54:54.956736 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-fls5r" May 20 21:54:55.096846 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:54:55.096817 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-fls5r"] May 20 21:54:55.099781 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:54:55.099739 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod881aef12_38a0_42a4_9650_1fe5c3d317d9.slice/crio-9c86015fac36fee0434741068bf22dbc43333db97e53da21bf72ba35276a8c56 WatchSource:0}: Error finding container 9c86015fac36fee0434741068bf22dbc43333db97e53da21bf72ba35276a8c56: Status 404 returned error can't find the container with id 9c86015fac36fee0434741068bf22dbc43333db97e53da21bf72ba35276a8c56 May 20 21:54:56.002310 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:54:56.002261 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-fls5r" event={"ID":"881aef12-38a0-42a4-9650-1fe5c3d317d9","Type":"ContainerStarted","Data":"9c86015fac36fee0434741068bf22dbc43333db97e53da21bf72ba35276a8c56"} May 20 21:54:59.013624 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:54:59.013580 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-fls5r" event={"ID":"881aef12-38a0-42a4-9650-1fe5c3d317d9","Type":"ContainerStarted","Data":"13977c5eeb7a8ed2ee4fd9e729a6ca3e5025c85af2fbc29af6c7d79cdbc84767"} May 20 21:54:59.030844 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:54:59.030775 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-fls5r" podStartSLOduration=1.814619157 podStartE2EDuration="5.030754247s" podCreationTimestamp="2026-05-20 21:54:54 +0000 UTC" firstStartedPulling="2026-05-20 21:54:55.101778398 +0000 UTC m=+397.964199306" lastFinishedPulling="2026-05-20 21:54:58.317913484 +0000 UTC m=+401.180334396" observedRunningTime="2026-05-20 21:54:59.030462735 +0000 UTC m=+401.892883665" watchObservedRunningTime="2026-05-20 21:54:59.030754247 +0000 UTC m=+401.893175183" May 20 21:55:01.986372 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:01.986336 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-k27s2"] May 20 21:55:01.989740 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:01.989723 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-k27s2" May 20 21:55:01.992307 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:01.992287 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-2q4g5\"" May 20 21:55:02.000520 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:02.000499 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-k27s2"] May 20 21:55:02.103608 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:02.103557 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zc8j9\" (UniqueName: \"kubernetes.io/projected/96ebcb1c-823a-4d04-902a-cc173c6170e8-kube-api-access-zc8j9\") pod \"cert-manager-79c8d999ff-k27s2\" (UID: \"96ebcb1c-823a-4d04-902a-cc173c6170e8\") " pod="cert-manager/cert-manager-79c8d999ff-k27s2" May 20 21:55:02.103791 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:02.103669 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/96ebcb1c-823a-4d04-902a-cc173c6170e8-bound-sa-token\") pod \"cert-manager-79c8d999ff-k27s2\" (UID: \"96ebcb1c-823a-4d04-902a-cc173c6170e8\") " pod="cert-manager/cert-manager-79c8d999ff-k27s2" May 20 21:55:02.204407 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:02.204354 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zc8j9\" (UniqueName: \"kubernetes.io/projected/96ebcb1c-823a-4d04-902a-cc173c6170e8-kube-api-access-zc8j9\") pod \"cert-manager-79c8d999ff-k27s2\" (UID: \"96ebcb1c-823a-4d04-902a-cc173c6170e8\") " pod="cert-manager/cert-manager-79c8d999ff-k27s2" May 20 21:55:02.204529 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:02.204460 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/96ebcb1c-823a-4d04-902a-cc173c6170e8-bound-sa-token\") pod \"cert-manager-79c8d999ff-k27s2\" (UID: \"96ebcb1c-823a-4d04-902a-cc173c6170e8\") " pod="cert-manager/cert-manager-79c8d999ff-k27s2" May 20 21:55:02.212637 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:02.212609 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/96ebcb1c-823a-4d04-902a-cc173c6170e8-bound-sa-token\") pod \"cert-manager-79c8d999ff-k27s2\" (UID: \"96ebcb1c-823a-4d04-902a-cc173c6170e8\") " pod="cert-manager/cert-manager-79c8d999ff-k27s2" May 20 21:55:02.212769 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:02.212749 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zc8j9\" (UniqueName: \"kubernetes.io/projected/96ebcb1c-823a-4d04-902a-cc173c6170e8-kube-api-access-zc8j9\") pod \"cert-manager-79c8d999ff-k27s2\" (UID: \"96ebcb1c-823a-4d04-902a-cc173c6170e8\") " pod="cert-manager/cert-manager-79c8d999ff-k27s2" May 20 21:55:02.298862 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:02.298774 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-k27s2" May 20 21:55:02.425555 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:02.425485 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-k27s2"] May 20 21:55:02.427804 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:55:02.427774 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod96ebcb1c_823a_4d04_902a_cc173c6170e8.slice/crio-d4ac5fca574f1f4cde26f16d89aaba96b239c663fae26c7805cc7773b6bc195d WatchSource:0}: Error finding container d4ac5fca574f1f4cde26f16d89aaba96b239c663fae26c7805cc7773b6bc195d: Status 404 returned error can't find the container with id d4ac5fca574f1f4cde26f16d89aaba96b239c663fae26c7805cc7773b6bc195d May 20 21:55:03.025707 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:03.025667 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-k27s2" event={"ID":"96ebcb1c-823a-4d04-902a-cc173c6170e8","Type":"ContainerStarted","Data":"72c4f29ec1a532a214d66397bff10e1896af91012b0fa9d1d16ef3217be0d6ac"} May 20 21:55:03.025707 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:03.025710 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-k27s2" event={"ID":"96ebcb1c-823a-4d04-902a-cc173c6170e8","Type":"ContainerStarted","Data":"d4ac5fca574f1f4cde26f16d89aaba96b239c663fae26c7805cc7773b6bc195d"} May 20 21:55:03.045986 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:03.045937 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-k27s2" podStartSLOduration=2.04592404 podStartE2EDuration="2.04592404s" podCreationTimestamp="2026-05-20 21:55:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 21:55:03.045454019 +0000 UTC m=+405.907874953" watchObservedRunningTime="2026-05-20 21:55:03.04592404 +0000 UTC m=+405.908344970" May 20 21:55:29.724383 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:29.724294 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c897df989-bmtc2"] May 20 21:55:29.727276 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:29.727260 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c897df989-bmtc2" May 20 21:55:29.733327 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:29.733300 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jb7vn\"" May 20 21:55:29.734928 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:29.734907 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 20 21:55:29.735043 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:29.734962 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 20 21:55:29.735043 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:29.734983 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 20 21:55:29.735043 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:29.734968 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 20 21:55:29.743049 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:29.743028 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b41ccacd-4863-4909-bc3d-a3a087a4332e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c897df989-bmtc2\" (UID: \"b41ccacd-4863-4909-bc3d-a3a087a4332e\") " pod="opendatahub/opendatahub-operator-controller-manager-6c897df989-bmtc2" May 20 21:55:29.743167 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:29.743089 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b41ccacd-4863-4909-bc3d-a3a087a4332e-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c897df989-bmtc2\" (UID: \"b41ccacd-4863-4909-bc3d-a3a087a4332e\") " pod="opendatahub/opendatahub-operator-controller-manager-6c897df989-bmtc2" May 20 21:55:29.743219 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:29.743162 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l9tq\" (UniqueName: \"kubernetes.io/projected/b41ccacd-4863-4909-bc3d-a3a087a4332e-kube-api-access-6l9tq\") pod \"opendatahub-operator-controller-manager-6c897df989-bmtc2\" (UID: \"b41ccacd-4863-4909-bc3d-a3a087a4332e\") " pod="opendatahub/opendatahub-operator-controller-manager-6c897df989-bmtc2" May 20 21:55:29.759316 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:29.759290 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c897df989-bmtc2"] May 20 21:55:29.844216 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:29.844180 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b41ccacd-4863-4909-bc3d-a3a087a4332e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c897df989-bmtc2\" (UID: \"b41ccacd-4863-4909-bc3d-a3a087a4332e\") " pod="opendatahub/opendatahub-operator-controller-manager-6c897df989-bmtc2" May 20 21:55:29.844401 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:29.844224 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b41ccacd-4863-4909-bc3d-a3a087a4332e-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c897df989-bmtc2\" (UID: \"b41ccacd-4863-4909-bc3d-a3a087a4332e\") " pod="opendatahub/opendatahub-operator-controller-manager-6c897df989-bmtc2" May 20 21:55:29.844401 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:29.844255 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6l9tq\" (UniqueName: \"kubernetes.io/projected/b41ccacd-4863-4909-bc3d-a3a087a4332e-kube-api-access-6l9tq\") pod \"opendatahub-operator-controller-manager-6c897df989-bmtc2\" (UID: \"b41ccacd-4863-4909-bc3d-a3a087a4332e\") " pod="opendatahub/opendatahub-operator-controller-manager-6c897df989-bmtc2" May 20 21:55:29.846765 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:29.846741 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b41ccacd-4863-4909-bc3d-a3a087a4332e-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c897df989-bmtc2\" (UID: \"b41ccacd-4863-4909-bc3d-a3a087a4332e\") " pod="opendatahub/opendatahub-operator-controller-manager-6c897df989-bmtc2" May 20 21:55:29.846880 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:29.846793 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b41ccacd-4863-4909-bc3d-a3a087a4332e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c897df989-bmtc2\" (UID: \"b41ccacd-4863-4909-bc3d-a3a087a4332e\") " pod="opendatahub/opendatahub-operator-controller-manager-6c897df989-bmtc2" May 20 21:55:29.856677 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:29.856652 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l9tq\" (UniqueName: \"kubernetes.io/projected/b41ccacd-4863-4909-bc3d-a3a087a4332e-kube-api-access-6l9tq\") pod \"opendatahub-operator-controller-manager-6c897df989-bmtc2\" (UID: \"b41ccacd-4863-4909-bc3d-a3a087a4332e\") " pod="opendatahub/opendatahub-operator-controller-manager-6c897df989-bmtc2" May 20 21:55:30.038331 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:30.038248 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c897df989-bmtc2" May 20 21:55:30.173549 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:30.173421 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c897df989-bmtc2"] May 20 21:55:30.176624 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:55:30.176587 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb41ccacd_4863_4909_bc3d_a3a087a4332e.slice/crio-ca3abc881d03807354a9ad18783d4744522a35557cad72fd532a9635a2415c53 WatchSource:0}: Error finding container ca3abc881d03807354a9ad18783d4744522a35557cad72fd532a9635a2415c53: Status 404 returned error can't find the container with id ca3abc881d03807354a9ad18783d4744522a35557cad72fd532a9635a2415c53 May 20 21:55:31.115794 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:31.115674 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c897df989-bmtc2" event={"ID":"b41ccacd-4863-4909-bc3d-a3a087a4332e","Type":"ContainerStarted","Data":"ca3abc881d03807354a9ad18783d4744522a35557cad72fd532a9635a2415c53"} May 20 21:55:33.123800 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:33.123764 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c897df989-bmtc2" event={"ID":"b41ccacd-4863-4909-bc3d-a3a087a4332e","Type":"ContainerStarted","Data":"499f73c56cf1f13fc5295f0cedd327fd185a333064e094d8dd8f4921cd1cd7fe"} May 20 21:55:33.124199 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:33.123884 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6c897df989-bmtc2" May 20 21:55:33.147021 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:33.146952 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6c897df989-bmtc2" podStartSLOduration=1.6854518440000001 podStartE2EDuration="4.146931171s" podCreationTimestamp="2026-05-20 21:55:29 +0000 UTC" firstStartedPulling="2026-05-20 21:55:30.17831356 +0000 UTC m=+433.040734468" lastFinishedPulling="2026-05-20 21:55:32.639792874 +0000 UTC m=+435.502213795" observedRunningTime="2026-05-20 21:55:33.144892172 +0000 UTC m=+436.007313104" watchObservedRunningTime="2026-05-20 21:55:33.146931171 +0000 UTC m=+436.009352102" May 20 21:55:37.955283 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:37.955245 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-8647c47685-cs9tl"] May 20 21:55:37.957890 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:37.957871 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8647c47685-cs9tl" May 20 21:55:37.961729 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:37.961692 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 20 21:55:37.962185 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:37.962167 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 20 21:55:37.962573 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:37.962556 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-z2px2\"" May 20 21:55:37.962916 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:37.962898 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 20 21:55:37.963300 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:37.963283 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 20 21:55:37.963685 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:37.963668 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 20 21:55:37.968183 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:37.968152 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8647c47685-cs9tl"] May 20 21:55:38.000389 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:38.000356 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7a1826a5-8e40-4212-bd02-448826512ad1-cert\") pod \"lws-controller-manager-8647c47685-cs9tl\" (UID: \"7a1826a5-8e40-4212-bd02-448826512ad1\") " pod="openshift-lws-operator/lws-controller-manager-8647c47685-cs9tl" May 20 21:55:38.000536 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:38.000407 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7a1826a5-8e40-4212-bd02-448826512ad1-manager-config\") pod \"lws-controller-manager-8647c47685-cs9tl\" (UID: \"7a1826a5-8e40-4212-bd02-448826512ad1\") " pod="openshift-lws-operator/lws-controller-manager-8647c47685-cs9tl" May 20 21:55:38.000536 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:38.000438 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7a1826a5-8e40-4212-bd02-448826512ad1-metrics-cert\") pod \"lws-controller-manager-8647c47685-cs9tl\" (UID: \"7a1826a5-8e40-4212-bd02-448826512ad1\") " pod="openshift-lws-operator/lws-controller-manager-8647c47685-cs9tl" May 20 21:55:38.000536 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:38.000463 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m975n\" (UniqueName: \"kubernetes.io/projected/7a1826a5-8e40-4212-bd02-448826512ad1-kube-api-access-m975n\") pod \"lws-controller-manager-8647c47685-cs9tl\" (UID: \"7a1826a5-8e40-4212-bd02-448826512ad1\") " pod="openshift-lws-operator/lws-controller-manager-8647c47685-cs9tl" May 20 21:55:38.101535 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:38.101495 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7a1826a5-8e40-4212-bd02-448826512ad1-metrics-cert\") pod \"lws-controller-manager-8647c47685-cs9tl\" (UID: \"7a1826a5-8e40-4212-bd02-448826512ad1\") " pod="openshift-lws-operator/lws-controller-manager-8647c47685-cs9tl" May 20 21:55:38.101535 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:38.101541 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m975n\" (UniqueName: \"kubernetes.io/projected/7a1826a5-8e40-4212-bd02-448826512ad1-kube-api-access-m975n\") pod \"lws-controller-manager-8647c47685-cs9tl\" (UID: \"7a1826a5-8e40-4212-bd02-448826512ad1\") " pod="openshift-lws-operator/lws-controller-manager-8647c47685-cs9tl" May 20 21:55:38.101811 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:38.101616 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7a1826a5-8e40-4212-bd02-448826512ad1-cert\") pod \"lws-controller-manager-8647c47685-cs9tl\" (UID: \"7a1826a5-8e40-4212-bd02-448826512ad1\") " pod="openshift-lws-operator/lws-controller-manager-8647c47685-cs9tl" May 20 21:55:38.101811 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:38.101662 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7a1826a5-8e40-4212-bd02-448826512ad1-manager-config\") pod \"lws-controller-manager-8647c47685-cs9tl\" (UID: \"7a1826a5-8e40-4212-bd02-448826512ad1\") " pod="openshift-lws-operator/lws-controller-manager-8647c47685-cs9tl" May 20 21:55:38.102382 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:38.102359 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7a1826a5-8e40-4212-bd02-448826512ad1-manager-config\") pod \"lws-controller-manager-8647c47685-cs9tl\" (UID: \"7a1826a5-8e40-4212-bd02-448826512ad1\") " pod="openshift-lws-operator/lws-controller-manager-8647c47685-cs9tl" May 20 21:55:38.104227 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:38.104201 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7a1826a5-8e40-4212-bd02-448826512ad1-metrics-cert\") pod \"lws-controller-manager-8647c47685-cs9tl\" (UID: \"7a1826a5-8e40-4212-bd02-448826512ad1\") " pod="openshift-lws-operator/lws-controller-manager-8647c47685-cs9tl" May 20 21:55:38.104338 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:38.104201 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7a1826a5-8e40-4212-bd02-448826512ad1-cert\") pod \"lws-controller-manager-8647c47685-cs9tl\" (UID: \"7a1826a5-8e40-4212-bd02-448826512ad1\") " pod="openshift-lws-operator/lws-controller-manager-8647c47685-cs9tl" May 20 21:55:38.109963 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:38.109942 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m975n\" (UniqueName: \"kubernetes.io/projected/7a1826a5-8e40-4212-bd02-448826512ad1-kube-api-access-m975n\") pod \"lws-controller-manager-8647c47685-cs9tl\" (UID: \"7a1826a5-8e40-4212-bd02-448826512ad1\") " pod="openshift-lws-operator/lws-controller-manager-8647c47685-cs9tl" May 20 21:55:38.274010 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:38.273919 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8647c47685-cs9tl" May 20 21:55:38.403800 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:38.403754 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8647c47685-cs9tl"] May 20 21:55:38.406501 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:55:38.406467 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a1826a5_8e40_4212_bd02_448826512ad1.slice/crio-41e3d6a1f631a3c56e20f00fbb273f77e96cc4c056e75a29fe9c1219995c17ee WatchSource:0}: Error finding container 41e3d6a1f631a3c56e20f00fbb273f77e96cc4c056e75a29fe9c1219995c17ee: Status 404 returned error can't find the container with id 41e3d6a1f631a3c56e20f00fbb273f77e96cc4c056e75a29fe9c1219995c17ee May 20 21:55:39.144638 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:39.144597 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8647c47685-cs9tl" event={"ID":"7a1826a5-8e40-4212-bd02-448826512ad1","Type":"ContainerStarted","Data":"41e3d6a1f631a3c56e20f00fbb273f77e96cc4c056e75a29fe9c1219995c17ee"} May 20 21:55:42.156024 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:42.155990 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8647c47685-cs9tl" event={"ID":"7a1826a5-8e40-4212-bd02-448826512ad1","Type":"ContainerStarted","Data":"fea0bb87b65972ea01a505c425adcee36e223f6b929ec2c447b308034284ba2d"} May 20 21:55:42.156427 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:42.156041 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-8647c47685-cs9tl" May 20 21:55:42.171457 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:42.171394 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-8647c47685-cs9tl" podStartSLOduration=2.429453829 podStartE2EDuration="5.171377921s" podCreationTimestamp="2026-05-20 21:55:37 +0000 UTC" firstStartedPulling="2026-05-20 21:55:38.408316694 +0000 UTC m=+441.270737603" lastFinishedPulling="2026-05-20 21:55:41.150240783 +0000 UTC m=+444.012661695" observedRunningTime="2026-05-20 21:55:42.170735825 +0000 UTC m=+445.033156782" watchObservedRunningTime="2026-05-20 21:55:42.171377921 +0000 UTC m=+445.033798852" May 20 21:55:44.129927 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:44.129897 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6c897df989-bmtc2" May 20 21:55:53.162385 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:55:53.162349 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-8647c47685-cs9tl" May 20 21:56:07.913211 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:56:07.913166 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6544789b6f-6d2tc"] May 20 21:56:07.919375 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:56:07.919353 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6544789b6f-6d2tc" May 20 21:56:07.922521 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:56:07.921808 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 20 21:56:07.922521 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:56:07.921966 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 20 21:56:07.922521 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:56:07.921966 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 20 21:56:07.923586 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:56:07.923563 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 20 21:56:07.923586 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:56:07.923577 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-g5r4p\"" May 20 21:56:07.925309 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:56:07.925288 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6544789b6f-6d2tc"] May 20 21:56:08.059031 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:56:08.058998 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c94e0b88-0446-4e81-9570-d811adb551bf-tmp\") pod \"kube-auth-proxy-6544789b6f-6d2tc\" (UID: \"c94e0b88-0446-4e81-9570-d811adb551bf\") " pod="openshift-ingress/kube-auth-proxy-6544789b6f-6d2tc" May 20 21:56:08.059031 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:56:08.059034 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8tv2\" (UniqueName: \"kubernetes.io/projected/c94e0b88-0446-4e81-9570-d811adb551bf-kube-api-access-f8tv2\") pod \"kube-auth-proxy-6544789b6f-6d2tc\" (UID: \"c94e0b88-0446-4e81-9570-d811adb551bf\") " pod="openshift-ingress/kube-auth-proxy-6544789b6f-6d2tc" May 20 21:56:08.059281 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:56:08.059147 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c94e0b88-0446-4e81-9570-d811adb551bf-tls-certs\") pod \"kube-auth-proxy-6544789b6f-6d2tc\" (UID: \"c94e0b88-0446-4e81-9570-d811adb551bf\") " pod="openshift-ingress/kube-auth-proxy-6544789b6f-6d2tc" May 20 21:56:08.159633 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:56:08.159594 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c94e0b88-0446-4e81-9570-d811adb551bf-tls-certs\") pod \"kube-auth-proxy-6544789b6f-6d2tc\" (UID: \"c94e0b88-0446-4e81-9570-d811adb551bf\") " pod="openshift-ingress/kube-auth-proxy-6544789b6f-6d2tc" May 20 21:56:08.159815 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:56:08.159694 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c94e0b88-0446-4e81-9570-d811adb551bf-tmp\") pod \"kube-auth-proxy-6544789b6f-6d2tc\" (UID: \"c94e0b88-0446-4e81-9570-d811adb551bf\") " pod="openshift-ingress/kube-auth-proxy-6544789b6f-6d2tc" May 20 21:56:08.159815 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:56:08.159724 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f8tv2\" (UniqueName: \"kubernetes.io/projected/c94e0b88-0446-4e81-9570-d811adb551bf-kube-api-access-f8tv2\") pod \"kube-auth-proxy-6544789b6f-6d2tc\" (UID: \"c94e0b88-0446-4e81-9570-d811adb551bf\") " pod="openshift-ingress/kube-auth-proxy-6544789b6f-6d2tc" May 20 21:56:08.162035 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:56:08.162007 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c94e0b88-0446-4e81-9570-d811adb551bf-tmp\") pod \"kube-auth-proxy-6544789b6f-6d2tc\" (UID: \"c94e0b88-0446-4e81-9570-d811adb551bf\") " pod="openshift-ingress/kube-auth-proxy-6544789b6f-6d2tc" May 20 21:56:08.162251 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:56:08.162236 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c94e0b88-0446-4e81-9570-d811adb551bf-tls-certs\") pod \"kube-auth-proxy-6544789b6f-6d2tc\" (UID: \"c94e0b88-0446-4e81-9570-d811adb551bf\") " pod="openshift-ingress/kube-auth-proxy-6544789b6f-6d2tc" May 20 21:56:08.166746 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:56:08.166696 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8tv2\" (UniqueName: \"kubernetes.io/projected/c94e0b88-0446-4e81-9570-d811adb551bf-kube-api-access-f8tv2\") pod \"kube-auth-proxy-6544789b6f-6d2tc\" (UID: \"c94e0b88-0446-4e81-9570-d811adb551bf\") " pod="openshift-ingress/kube-auth-proxy-6544789b6f-6d2tc" May 20 21:56:08.231444 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:56:08.231413 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6544789b6f-6d2tc" May 20 21:56:08.357597 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:56:08.357566 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6544789b6f-6d2tc"] May 20 21:56:08.361145 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:56:08.361111 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc94e0b88_0446_4e81_9570_d811adb551bf.slice/crio-adf26a671f9edf00ca6c696b9549888b760fc19ea4c02a52959c6eec1107b83e WatchSource:0}: Error finding container adf26a671f9edf00ca6c696b9549888b760fc19ea4c02a52959c6eec1107b83e: Status 404 returned error can't find the container with id adf26a671f9edf00ca6c696b9549888b760fc19ea4c02a52959c6eec1107b83e May 20 21:56:09.244521 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:56:09.244474 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6544789b6f-6d2tc" event={"ID":"c94e0b88-0446-4e81-9570-d811adb551bf","Type":"ContainerStarted","Data":"adf26a671f9edf00ca6c696b9549888b760fc19ea4c02a52959c6eec1107b83e"} May 20 21:56:11.253253 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:56:11.253214 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6544789b6f-6d2tc" event={"ID":"c94e0b88-0446-4e81-9570-d811adb551bf","Type":"ContainerStarted","Data":"d6dcf1825c407a6ec87a653c1481e39202008bbb4997fba67b50a0298c1c88da"} May 20 21:56:11.271065 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:56:11.271019 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6544789b6f-6d2tc" podStartSLOduration=1.527995068 podStartE2EDuration="4.271005504s" podCreationTimestamp="2026-05-20 21:56:07 +0000 UTC" firstStartedPulling="2026-05-20 21:56:08.36285167 +0000 UTC m=+471.225272577" lastFinishedPulling="2026-05-20 21:56:11.105862102 +0000 UTC m=+473.968283013" observedRunningTime="2026-05-20 21:56:11.26886245 +0000 UTC m=+474.131283377" watchObservedRunningTime="2026-05-20 21:56:11.271005504 +0000 UTC m=+474.133426433" May 20 21:57:43.680986 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:57:43.680950 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-xppjm"] May 20 21:57:43.684350 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:57:43.684330 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-xppjm" May 20 21:57:43.687157 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:57:43.687137 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-97wlc\"" May 20 21:57:43.687273 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:57:43.687256 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" May 20 21:57:43.688235 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:57:43.688210 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" May 20 21:57:43.688235 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:57:43.688224 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 20 21:57:43.688398 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:57:43.688215 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 20 21:57:43.694571 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:57:43.694548 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-xppjm"] May 20 21:57:43.797995 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:57:43.797963 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ae1be0d8-aad3-406c-8f90-c605544ee775-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-xppjm\" (UID: \"ae1be0d8-aad3-406c-8f90-c605544ee775\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-xppjm" May 20 21:57:43.798183 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:57:43.798055 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jtpz\" (UniqueName: \"kubernetes.io/projected/ae1be0d8-aad3-406c-8f90-c605544ee775-kube-api-access-8jtpz\") pod \"kuadrant-console-plugin-6cb54b5c86-xppjm\" (UID: \"ae1be0d8-aad3-406c-8f90-c605544ee775\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-xppjm" May 20 21:57:43.798183 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:57:43.798102 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae1be0d8-aad3-406c-8f90-c605544ee775-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-xppjm\" (UID: \"ae1be0d8-aad3-406c-8f90-c605544ee775\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-xppjm" May 20 21:57:43.899435 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:57:43.899400 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ae1be0d8-aad3-406c-8f90-c605544ee775-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-xppjm\" (UID: \"ae1be0d8-aad3-406c-8f90-c605544ee775\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-xppjm" May 20 21:57:43.899666 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:57:43.899583 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8jtpz\" (UniqueName: \"kubernetes.io/projected/ae1be0d8-aad3-406c-8f90-c605544ee775-kube-api-access-8jtpz\") pod \"kuadrant-console-plugin-6cb54b5c86-xppjm\" (UID: \"ae1be0d8-aad3-406c-8f90-c605544ee775\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-xppjm" May 20 21:57:43.899666 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:57:43.899647 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae1be0d8-aad3-406c-8f90-c605544ee775-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-xppjm\" (UID: \"ae1be0d8-aad3-406c-8f90-c605544ee775\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-xppjm" May 20 21:57:43.900274 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:57:43.900252 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ae1be0d8-aad3-406c-8f90-c605544ee775-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-xppjm\" (UID: \"ae1be0d8-aad3-406c-8f90-c605544ee775\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-xppjm" May 20 21:57:43.902144 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:57:43.902125 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ae1be0d8-aad3-406c-8f90-c605544ee775-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-xppjm\" (UID: \"ae1be0d8-aad3-406c-8f90-c605544ee775\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-xppjm" May 20 21:57:43.909110 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:57:43.909069 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jtpz\" (UniqueName: \"kubernetes.io/projected/ae1be0d8-aad3-406c-8f90-c605544ee775-kube-api-access-8jtpz\") pod \"kuadrant-console-plugin-6cb54b5c86-xppjm\" (UID: \"ae1be0d8-aad3-406c-8f90-c605544ee775\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-xppjm" May 20 21:57:43.994413 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:57:43.994333 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-xppjm" May 20 21:57:44.124829 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:57:44.124792 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-xppjm"] May 20 21:57:44.129922 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:57:44.129888 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podae1be0d8_aad3_406c_8f90_c605544ee775.slice/crio-0fdf53186e1296afe4c80cfaa7e500290e86372d203c9ea4a07f106789550462 WatchSource:0}: Error finding container 0fdf53186e1296afe4c80cfaa7e500290e86372d203c9ea4a07f106789550462: Status 404 returned error can't find the container with id 0fdf53186e1296afe4c80cfaa7e500290e86372d203c9ea4a07f106789550462 May 20 21:57:44.569496 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:57:44.569461 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-xppjm" event={"ID":"ae1be0d8-aad3-406c-8f90-c605544ee775","Type":"ContainerStarted","Data":"0fdf53186e1296afe4c80cfaa7e500290e86372d203c9ea4a07f106789550462"} May 20 21:58:05.664489 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:58:05.664456 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-xppjm" event={"ID":"ae1be0d8-aad3-406c-8f90-c605544ee775","Type":"ContainerStarted","Data":"4c86bfdb3f319e50be950108f28ac65dc9c06db759425fa386daaa5bfae22545"} May 20 21:58:05.682449 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:58:05.682389 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-xppjm" podStartSLOduration=1.259794885 podStartE2EDuration="22.68237239s" podCreationTimestamp="2026-05-20 21:57:43 +0000 UTC" firstStartedPulling="2026-05-20 21:57:44.131409076 +0000 UTC m=+566.993829997" lastFinishedPulling="2026-05-20 21:58:05.553986594 +0000 UTC m=+588.416407502" observedRunningTime="2026-05-20 21:58:05.681539008 +0000 UTC m=+588.543959940" watchObservedRunningTime="2026-05-20 21:58:05.68237239 +0000 UTC m=+588.544793322" May 20 21:58:17.642876 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:58:17.642848 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jgks5_8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a/ovn-acl-logging/0.log" May 20 21:58:17.643480 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:58:17.643379 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jgks5_8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a/ovn-acl-logging/0.log" May 20 21:58:44.341454 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:58:44.341415 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 21:58:44.384493 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:58:44.384455 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 21:58:44.384493 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:58:44.384484 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 21:58:44.384686 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:58:44.384583 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-46mvp" May 20 21:58:44.386870 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:58:44.386852 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 20 21:58:44.546334 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:58:44.546297 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8eb6042f-411c-43f3-8549-52b511b36a07-config-file\") pod \"limitador-limitador-78c99df468-46mvp\" (UID: \"8eb6042f-411c-43f3-8549-52b511b36a07\") " pod="kuadrant-system/limitador-limitador-78c99df468-46mvp" May 20 21:58:44.546561 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:58:44.546354 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmklc\" (UniqueName: \"kubernetes.io/projected/8eb6042f-411c-43f3-8549-52b511b36a07-kube-api-access-pmklc\") pod \"limitador-limitador-78c99df468-46mvp\" (UID: \"8eb6042f-411c-43f3-8549-52b511b36a07\") " pod="kuadrant-system/limitador-limitador-78c99df468-46mvp" May 20 21:58:44.647785 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:58:44.647692 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pmklc\" (UniqueName: \"kubernetes.io/projected/8eb6042f-411c-43f3-8549-52b511b36a07-kube-api-access-pmklc\") pod \"limitador-limitador-78c99df468-46mvp\" (UID: \"8eb6042f-411c-43f3-8549-52b511b36a07\") " pod="kuadrant-system/limitador-limitador-78c99df468-46mvp" May 20 21:58:44.647942 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:58:44.647817 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8eb6042f-411c-43f3-8549-52b511b36a07-config-file\") pod \"limitador-limitador-78c99df468-46mvp\" (UID: \"8eb6042f-411c-43f3-8549-52b511b36a07\") " pod="kuadrant-system/limitador-limitador-78c99df468-46mvp" May 20 21:58:44.648501 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:58:44.648473 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8eb6042f-411c-43f3-8549-52b511b36a07-config-file\") pod \"limitador-limitador-78c99df468-46mvp\" (UID: \"8eb6042f-411c-43f3-8549-52b511b36a07\") " pod="kuadrant-system/limitador-limitador-78c99df468-46mvp" May 20 21:58:44.656308 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:58:44.656284 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmklc\" (UniqueName: \"kubernetes.io/projected/8eb6042f-411c-43f3-8549-52b511b36a07-kube-api-access-pmklc\") pod \"limitador-limitador-78c99df468-46mvp\" (UID: \"8eb6042f-411c-43f3-8549-52b511b36a07\") " pod="kuadrant-system/limitador-limitador-78c99df468-46mvp" May 20 21:58:44.694926 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:58:44.694889 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-46mvp" May 20 21:58:44.827436 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:58:44.827405 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 21:58:44.830710 ip-10-0-129-137 kubenswrapper[2581]: W0520 21:58:44.830663 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eb6042f_411c_43f3_8549_52b511b36a07.slice/crio-f26db8c074e904f240f452d3c61d9e1650402cc55201f1656f6a483da00cb281 WatchSource:0}: Error finding container f26db8c074e904f240f452d3c61d9e1650402cc55201f1656f6a483da00cb281: Status 404 returned error can't find the container with id f26db8c074e904f240f452d3c61d9e1650402cc55201f1656f6a483da00cb281 May 20 21:58:45.804292 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:58:45.804251 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-46mvp" event={"ID":"8eb6042f-411c-43f3-8549-52b511b36a07","Type":"ContainerStarted","Data":"f26db8c074e904f240f452d3c61d9e1650402cc55201f1656f6a483da00cb281"} May 20 21:58:47.813380 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:58:47.813348 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-46mvp" event={"ID":"8eb6042f-411c-43f3-8549-52b511b36a07","Type":"ContainerStarted","Data":"48508532e04599ac96489dddc1c8229ac69906d35241a379cbf7d80c1e1c8617"} May 20 21:58:47.813764 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:58:47.813479 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-46mvp" May 20 21:58:47.830403 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:58:47.830357 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-46mvp" podStartSLOduration=1.293242631 podStartE2EDuration="3.830344225s" podCreationTimestamp="2026-05-20 21:58:44 +0000 UTC" firstStartedPulling="2026-05-20 21:58:44.832600094 +0000 UTC m=+627.695021006" lastFinishedPulling="2026-05-20 21:58:47.369701678 +0000 UTC m=+630.232122600" observedRunningTime="2026-05-20 21:58:47.828332705 +0000 UTC m=+630.690753637" watchObservedRunningTime="2026-05-20 21:58:47.830344225 +0000 UTC m=+630.692765154" May 20 21:58:58.817792 ip-10-0-129-137 kubenswrapper[2581]: I0520 21:58:58.817760 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-46mvp" May 20 22:00:58.639206 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:00:58.639167 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-76b949cbcb-5c8nm"] May 20 22:00:58.642480 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:00:58.642460 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-76b949cbcb-5c8nm" May 20 22:00:58.646470 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:00:58.646440 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" May 20 22:00:58.646916 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:00:58.646897 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 20 22:00:58.649812 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:00:58.649794 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-l6b9v\"" May 20 22:00:58.666179 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:00:58.666147 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-76b949cbcb-5c8nm"] May 20 22:00:58.731785 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:00:58.731745 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1711b375-3f7f-437f-bc85-dfb341eea195-maas-api-tls\") pod \"maas-api-76b949cbcb-5c8nm\" (UID: \"1711b375-3f7f-437f-bc85-dfb341eea195\") " pod="opendatahub/maas-api-76b949cbcb-5c8nm" May 20 22:00:58.731994 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:00:58.731799 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzjnr\" (UniqueName: \"kubernetes.io/projected/1711b375-3f7f-437f-bc85-dfb341eea195-kube-api-access-rzjnr\") pod \"maas-api-76b949cbcb-5c8nm\" (UID: \"1711b375-3f7f-437f-bc85-dfb341eea195\") " pod="opendatahub/maas-api-76b949cbcb-5c8nm" May 20 22:00:58.832937 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:00:58.832900 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1711b375-3f7f-437f-bc85-dfb341eea195-maas-api-tls\") pod \"maas-api-76b949cbcb-5c8nm\" (UID: \"1711b375-3f7f-437f-bc85-dfb341eea195\") " pod="opendatahub/maas-api-76b949cbcb-5c8nm" May 20 22:00:58.833131 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:00:58.832958 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rzjnr\" (UniqueName: \"kubernetes.io/projected/1711b375-3f7f-437f-bc85-dfb341eea195-kube-api-access-rzjnr\") pod \"maas-api-76b949cbcb-5c8nm\" (UID: \"1711b375-3f7f-437f-bc85-dfb341eea195\") " pod="opendatahub/maas-api-76b949cbcb-5c8nm" May 20 22:00:58.833131 ip-10-0-129-137 kubenswrapper[2581]: E0520 22:00:58.833065 2581 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found May 20 22:00:58.833210 ip-10-0-129-137 kubenswrapper[2581]: E0520 22:00:58.833155 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1711b375-3f7f-437f-bc85-dfb341eea195-maas-api-tls podName:1711b375-3f7f-437f-bc85-dfb341eea195 nodeName:}" failed. No retries permitted until 2026-05-20 22:00:59.333134727 +0000 UTC m=+762.195555651 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1711b375-3f7f-437f-bc85-dfb341eea195-maas-api-tls") pod "maas-api-76b949cbcb-5c8nm" (UID: "1711b375-3f7f-437f-bc85-dfb341eea195") : secret "maas-api-serving-cert" not found May 20 22:00:58.846289 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:00:58.846257 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzjnr\" (UniqueName: \"kubernetes.io/projected/1711b375-3f7f-437f-bc85-dfb341eea195-kube-api-access-rzjnr\") pod \"maas-api-76b949cbcb-5c8nm\" (UID: \"1711b375-3f7f-437f-bc85-dfb341eea195\") " pod="opendatahub/maas-api-76b949cbcb-5c8nm" May 20 22:00:59.201311 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:00:59.201274 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-wgpwb"] May 20 22:00:59.204553 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:00:59.204535 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-wgpwb" May 20 22:00:59.207108 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:00:59.207070 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-s8n68\"" May 20 22:00:59.207455 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:00:59.207442 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" May 20 22:00:59.215046 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:00:59.215022 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-wgpwb"] May 20 22:00:59.331222 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:00:59.331188 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:00:59.337179 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:00:59.337148 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1711b375-3f7f-437f-bc85-dfb341eea195-maas-api-tls\") pod \"maas-api-76b949cbcb-5c8nm\" (UID: \"1711b375-3f7f-437f-bc85-dfb341eea195\") " pod="opendatahub/maas-api-76b949cbcb-5c8nm" May 20 22:00:59.337327 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:00:59.337253 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndzwv\" (UniqueName: \"kubernetes.io/projected/e3339213-bab8-4945-8ffd-04bd7c94b2eb-kube-api-access-ndzwv\") pod \"payload-processing-58b6c8fdc7-wgpwb\" (UID: \"e3339213-bab8-4945-8ffd-04bd7c94b2eb\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-wgpwb" May 20 22:00:59.339755 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:00:59.339731 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1711b375-3f7f-437f-bc85-dfb341eea195-maas-api-tls\") pod \"maas-api-76b949cbcb-5c8nm\" (UID: \"1711b375-3f7f-437f-bc85-dfb341eea195\") " pod="opendatahub/maas-api-76b949cbcb-5c8nm" May 20 22:00:59.437928 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:00:59.437891 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ndzwv\" (UniqueName: \"kubernetes.io/projected/e3339213-bab8-4945-8ffd-04bd7c94b2eb-kube-api-access-ndzwv\") pod \"payload-processing-58b6c8fdc7-wgpwb\" (UID: \"e3339213-bab8-4945-8ffd-04bd7c94b2eb\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-wgpwb" May 20 22:00:59.445785 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:00:59.445761 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndzwv\" (UniqueName: \"kubernetes.io/projected/e3339213-bab8-4945-8ffd-04bd7c94b2eb-kube-api-access-ndzwv\") pod \"payload-processing-58b6c8fdc7-wgpwb\" (UID: \"e3339213-bab8-4945-8ffd-04bd7c94b2eb\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-wgpwb" May 20 22:00:59.515827 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:00:59.515737 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-wgpwb" May 20 22:00:59.552948 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:00:59.552567 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-76b949cbcb-5c8nm" May 20 22:00:59.651964 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:00:59.651910 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-wgpwb"] May 20 22:00:59.655498 ip-10-0-129-137 kubenswrapper[2581]: W0520 22:00:59.655423 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3339213_bab8_4945_8ffd_04bd7c94b2eb.slice/crio-c7f5fc7377fee0532ca9d8f9c285153f97bcdb73d0df9f645667215f9845a9fb WatchSource:0}: Error finding container c7f5fc7377fee0532ca9d8f9c285153f97bcdb73d0df9f645667215f9845a9fb: Status 404 returned error can't find the container with id c7f5fc7377fee0532ca9d8f9c285153f97bcdb73d0df9f645667215f9845a9fb May 20 22:00:59.657753 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:00:59.657732 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 20 22:00:59.696785 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:00:59.696646 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-76b949cbcb-5c8nm"] May 20 22:00:59.699508 ip-10-0-129-137 kubenswrapper[2581]: W0520 22:00:59.699487 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1711b375_3f7f_437f_bc85_dfb341eea195.slice/crio-50e4f882b8650faa618d5071d0584925e371823c198ed0668d8cb05dc12d495a WatchSource:0}: Error finding container 50e4f882b8650faa618d5071d0584925e371823c198ed0668d8cb05dc12d495a: Status 404 returned error can't find the container with id 50e4f882b8650faa618d5071d0584925e371823c198ed0668d8cb05dc12d495a May 20 22:01:00.246949 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:01:00.246912 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-wgpwb" event={"ID":"e3339213-bab8-4945-8ffd-04bd7c94b2eb","Type":"ContainerStarted","Data":"c7f5fc7377fee0532ca9d8f9c285153f97bcdb73d0df9f645667215f9845a9fb"} May 20 22:01:00.250367 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:01:00.250319 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-76b949cbcb-5c8nm" event={"ID":"1711b375-3f7f-437f-bc85-dfb341eea195","Type":"ContainerStarted","Data":"50e4f882b8650faa618d5071d0584925e371823c198ed0668d8cb05dc12d495a"} May 20 22:01:04.265934 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:01:04.265889 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-wgpwb" event={"ID":"e3339213-bab8-4945-8ffd-04bd7c94b2eb","Type":"ContainerStarted","Data":"10ca677380699f7bd7837072bfb8bb2520d2320eb13268d71075fb26bfc5bc1d"} May 20 22:01:04.266457 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:01:04.265989 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-wgpwb" May 20 22:01:04.267246 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:01:04.267226 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-76b949cbcb-5c8nm" event={"ID":"1711b375-3f7f-437f-bc85-dfb341eea195","Type":"ContainerStarted","Data":"b2e55978ab6faf6849f48b390adec0f4e3510790bbee9d4d3ccd413d91db5a80"} May 20 22:01:04.267389 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:01:04.267378 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-76b949cbcb-5c8nm" May 20 22:01:04.282959 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:01:04.282913 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-wgpwb" podStartSLOduration=1.74451201 podStartE2EDuration="5.282901587s" podCreationTimestamp="2026-05-20 22:00:59 +0000 UTC" firstStartedPulling="2026-05-20 22:00:59.657888389 +0000 UTC m=+762.520309297" lastFinishedPulling="2026-05-20 22:01:03.196277954 +0000 UTC m=+766.058698874" observedRunningTime="2026-05-20 22:01:04.280930383 +0000 UTC m=+767.143351337" watchObservedRunningTime="2026-05-20 22:01:04.282901587 +0000 UTC m=+767.145322517" May 20 22:01:04.297478 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:01:04.297402 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-76b949cbcb-5c8nm" podStartSLOduration=2.75693355 podStartE2EDuration="6.297388416s" podCreationTimestamp="2026-05-20 22:00:58 +0000 UTC" firstStartedPulling="2026-05-20 22:00:59.700824078 +0000 UTC m=+762.563244986" lastFinishedPulling="2026-05-20 22:01:03.241278941 +0000 UTC m=+766.103699852" observedRunningTime="2026-05-20 22:01:04.296633568 +0000 UTC m=+767.159054497" watchObservedRunningTime="2026-05-20 22:01:04.297388416 +0000 UTC m=+767.159809346" May 20 22:01:10.276276 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:01:10.276244 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-76b949cbcb-5c8nm" May 20 22:01:15.273689 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:01:15.273655 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-wgpwb" May 20 22:01:59.885892 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:01:59.885859 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:02:28.490457 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:02:28.485408 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:02:33.286031 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:02:33.285995 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:02:37.089972 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:02:37.089932 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:03:00.797086 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:03:00.797035 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7f69f8595d-mgrxp"] May 20 22:03:00.800531 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:03:00.800510 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f69f8595d-mgrxp" May 20 22:03:00.802933 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:03:00.802909 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" May 20 22:03:00.803981 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:03:00.803961 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" May 20 22:03:00.804053 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:03:00.803961 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-v9t8q\"" May 20 22:03:00.808608 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:03:00.808295 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f69f8595d-mgrxp"] May 20 22:03:00.941893 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:03:00.941858 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bcd8c5bf-6147-411e-aa26-ee82c19ac8d3-tls-cert\") pod \"authorino-7f69f8595d-mgrxp\" (UID: \"bcd8c5bf-6147-411e-aa26-ee82c19ac8d3\") " pod="kuadrant-system/authorino-7f69f8595d-mgrxp" May 20 22:03:00.941893 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:03:00.941903 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/bcd8c5bf-6147-411e-aa26-ee82c19ac8d3-oidc-ca\") pod \"authorino-7f69f8595d-mgrxp\" (UID: \"bcd8c5bf-6147-411e-aa26-ee82c19ac8d3\") " pod="kuadrant-system/authorino-7f69f8595d-mgrxp" May 20 22:03:00.942181 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:03:00.941943 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44t7j\" (UniqueName: \"kubernetes.io/projected/bcd8c5bf-6147-411e-aa26-ee82c19ac8d3-kube-api-access-44t7j\") pod \"authorino-7f69f8595d-mgrxp\" (UID: \"bcd8c5bf-6147-411e-aa26-ee82c19ac8d3\") " pod="kuadrant-system/authorino-7f69f8595d-mgrxp" May 20 22:03:01.043269 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:03:01.043229 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bcd8c5bf-6147-411e-aa26-ee82c19ac8d3-tls-cert\") pod \"authorino-7f69f8595d-mgrxp\" (UID: \"bcd8c5bf-6147-411e-aa26-ee82c19ac8d3\") " pod="kuadrant-system/authorino-7f69f8595d-mgrxp" May 20 22:03:01.043269 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:03:01.043271 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/bcd8c5bf-6147-411e-aa26-ee82c19ac8d3-oidc-ca\") pod \"authorino-7f69f8595d-mgrxp\" (UID: \"bcd8c5bf-6147-411e-aa26-ee82c19ac8d3\") " pod="kuadrant-system/authorino-7f69f8595d-mgrxp" May 20 22:03:01.043480 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:03:01.043302 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-44t7j\" (UniqueName: \"kubernetes.io/projected/bcd8c5bf-6147-411e-aa26-ee82c19ac8d3-kube-api-access-44t7j\") pod \"authorino-7f69f8595d-mgrxp\" (UID: \"bcd8c5bf-6147-411e-aa26-ee82c19ac8d3\") " pod="kuadrant-system/authorino-7f69f8595d-mgrxp" May 20 22:03:01.043866 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:03:01.043846 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/bcd8c5bf-6147-411e-aa26-ee82c19ac8d3-oidc-ca\") pod \"authorino-7f69f8595d-mgrxp\" (UID: \"bcd8c5bf-6147-411e-aa26-ee82c19ac8d3\") " pod="kuadrant-system/authorino-7f69f8595d-mgrxp" May 20 22:03:01.045701 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:03:01.045679 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bcd8c5bf-6147-411e-aa26-ee82c19ac8d3-tls-cert\") pod \"authorino-7f69f8595d-mgrxp\" (UID: \"bcd8c5bf-6147-411e-aa26-ee82c19ac8d3\") " pod="kuadrant-system/authorino-7f69f8595d-mgrxp" May 20 22:03:01.050683 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:03:01.050628 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44t7j\" (UniqueName: \"kubernetes.io/projected/bcd8c5bf-6147-411e-aa26-ee82c19ac8d3-kube-api-access-44t7j\") pod \"authorino-7f69f8595d-mgrxp\" (UID: \"bcd8c5bf-6147-411e-aa26-ee82c19ac8d3\") " pod="kuadrant-system/authorino-7f69f8595d-mgrxp" May 20 22:03:01.111824 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:03:01.111786 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f69f8595d-mgrxp" May 20 22:03:01.244878 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:03:01.244797 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f69f8595d-mgrxp"] May 20 22:03:01.252249 ip-10-0-129-137 kubenswrapper[2581]: W0520 22:03:01.252214 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbcd8c5bf_6147_411e_aa26_ee82c19ac8d3.slice/crio-dd0e9ea8a1d881e0121287c55301a5cfad3b40b8af3682990d77bcd2893a52b4 WatchSource:0}: Error finding container dd0e9ea8a1d881e0121287c55301a5cfad3b40b8af3682990d77bcd2893a52b4: Status 404 returned error can't find the container with id dd0e9ea8a1d881e0121287c55301a5cfad3b40b8af3682990d77bcd2893a52b4 May 20 22:03:01.673853 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:03:01.673813 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f69f8595d-mgrxp" event={"ID":"bcd8c5bf-6147-411e-aa26-ee82c19ac8d3","Type":"ContainerStarted","Data":"dd0e9ea8a1d881e0121287c55301a5cfad3b40b8af3682990d77bcd2893a52b4"} May 20 22:03:05.688421 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:03:05.688377 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f69f8595d-mgrxp" event={"ID":"bcd8c5bf-6147-411e-aa26-ee82c19ac8d3","Type":"ContainerStarted","Data":"26f1dd5519d11490039b85aade8ae4d4347a3ef3f7ada98acee7f7d9f5ee8054"} May 20 22:03:05.709245 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:03:05.709195 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7f69f8595d-mgrxp" podStartSLOduration=2.295373871 podStartE2EDuration="5.709180207s" podCreationTimestamp="2026-05-20 22:03:00 +0000 UTC" firstStartedPulling="2026-05-20 22:03:01.253457785 +0000 UTC m=+884.115878693" lastFinishedPulling="2026-05-20 22:03:04.667264121 +0000 UTC m=+887.529685029" observedRunningTime="2026-05-20 22:03:05.70804249 +0000 UTC m=+888.570463421" watchObservedRunningTime="2026-05-20 22:03:05.709180207 +0000 UTC m=+888.571601136" May 20 22:03:17.668603 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:03:17.668576 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jgks5_8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a/ovn-acl-logging/0.log" May 20 22:03:17.669071 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:03:17.668577 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jgks5_8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a/ovn-acl-logging/0.log" May 20 22:03:22.287249 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:03:22.287214 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:03:27.085970 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:03:27.085931 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:03:31.184061 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:03:31.184027 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:03:35.786159 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:03:35.786124 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:03:43.288754 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:03:43.288717 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:03:52.288973 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:03:52.288940 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:04:03.877712 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:04:03.877672 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:04:11.284873 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:04:11.284841 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:04:23.087402 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:04:23.087359 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:04:54.089186 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:04:54.089114 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:04:59.781487 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:04:59.781448 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:05:36.285230 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:05:36.285194 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:05:53.195643 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:05:53.195604 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:06:31.785897 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:06:31.785862 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:06:48.592886 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:06:48.592847 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:07:03.195170 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:07:03.195127 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:07:19.780171 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:07:19.780137 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:08:12.280931 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:08:12.280889 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:08:17.693211 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:08:17.693180 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jgks5_8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a/ovn-acl-logging/0.log" May 20 22:08:17.695233 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:08:17.695210 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jgks5_8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a/ovn-acl-logging/0.log" May 20 22:08:22.288002 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:08:22.287963 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:08:39.282468 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:08:39.282428 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:08:47.887516 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:08:47.887474 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:09:04.486462 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:09:04.486415 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:09:12.881126 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:09:12.881085 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:09:45.275567 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:09:45.275528 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:09:53.079269 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:09:53.079232 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:10:01.480902 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:10:01.480857 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:10:10.285148 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:10:10.285100 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:10:18.980620 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:10:18.980582 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:10:26.887239 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:10:26.887202 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:10:31.404951 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:10:31.404910 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:10:35.399946 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:10:35.399905 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:10:48.986600 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:10:48.986557 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:11:36.388580 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:11:36.388540 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:11:41.400182 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:11:41.400141 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:11:47.796498 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:11:47.796458 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:11:56.590317 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:11:56.590278 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:12:06.088118 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:12:06.088065 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:12:14.490139 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:12:14.490095 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:12:22.393627 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:12:22.393574 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:12:31.681531 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:12:31.681490 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:12:40.588145 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:12:40.588105 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:12:49.283014 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:12:49.282967 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:12:58.400428 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:12:58.400390 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:13:06.791363 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:13:06.791319 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:13:16.186358 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:13:16.186316 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:13:17.717316 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:13:17.717287 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jgks5_8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a/ovn-acl-logging/0.log" May 20 22:13:17.720800 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:13:17.720775 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jgks5_8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a/ovn-acl-logging/0.log" May 20 22:13:24.079589 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:13:24.079540 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:13:33.496353 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:13:33.496269 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:13:41.086563 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:13:41.086530 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:13:50.087739 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:13:50.087696 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:13:58.236128 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:13:58.235994 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:16:17.518464 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:16:17.514311 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:16:22.718490 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:16:22.718455 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:16:49.306727 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:16:49.306648 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:16:55.807990 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:16:55.807947 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:17:04.308216 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:17:04.308186 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:17:15.318687 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:17:15.318650 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:17:24.014422 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:17:24.014388 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:17:34.712041 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:17:34.712004 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:17:43.316116 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:17:43.316066 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:17:53.626298 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:17:53.626266 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:18:02.110190 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:18:02.110157 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:18:13.515175 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:18:13.515095 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:18:17.739793 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:18:17.739762 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jgks5_8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a/ovn-acl-logging/0.log" May 20 22:18:17.744638 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:18:17.744618 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jgks5_8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a/ovn-acl-logging/0.log" May 20 22:18:22.414897 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:18:22.414858 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:18:55.307231 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:18:55.307199 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:19:37.631413 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:19:37.631318 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:19:46.603249 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:19:46.603212 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:19:55.704915 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:19:55.704879 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:20:03.715069 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:20:03.715033 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:20:12.817834 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:20:12.817797 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:20:25.316111 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:20:25.316064 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:20:34.013629 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:20:34.013583 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:20:42.006006 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:20:42.005965 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:20:50.524794 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:20:50.524758 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:20:59.309167 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:20:59.309135 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:21:06.814091 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:21:06.814054 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:21:17.905344 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:21:17.905312 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:21:35.105977 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:21:35.105945 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:21:43.908246 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:21:43.908214 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:21:52.807518 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:21:52.807482 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:22:00.509333 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:22:00.509300 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:22:18.412748 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:22:18.412717 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:22:26.207430 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:22:26.207386 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:22:35.508142 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:22:35.508034 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:22:42.900749 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:22:42.900714 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:22:52.405477 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:22:52.405446 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:23:01.500971 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:23:01.500936 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:23:10.199110 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:23:10.199063 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:23:17.764013 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:23:17.763988 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jgks5_8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a/ovn-acl-logging/0.log" May 20 22:23:17.768943 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:23:17.768914 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jgks5_8bfe6a9d-ec12-4bb0-8b48-d409d2044e3a/ovn-acl-logging/0.log" May 20 22:23:22.997625 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:23:22.997597 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:23:31.409336 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:23:31.409285 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:23:43.000688 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:23:43.000655 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:23:52.908361 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:23:52.908323 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:23:58.705524 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:23:58.705443 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:24:08.709268 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:24:08.709233 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:24:16.399580 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:24:16.399541 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:24:33.693986 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:24:33.693940 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:24:41.306420 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:24:41.306374 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:24:50.916386 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:24:50.916347 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:24:58.706422 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:24:58.706383 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:25:21.804986 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:25:21.804948 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:25:34.402108 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:25:34.402004 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-46mvp"] May 20 22:25:38.893534 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:25:38.893502 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f69f8595d-mgrxp_bcd8c5bf-6147-411e-aa26-ee82c19ac8d3/authorino/0.log" May 20 22:25:43.375574 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:25:43.375531 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-76b949cbcb-5c8nm_1711b375-3f7f-437f-bc85-dfb341eea195/maas-api/0.log" May 20 22:25:43.852203 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:25:43.852160 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c897df989-bmtc2_b41ccacd-4863-4909-bc3d-a3a087a4332e/manager/0.log" May 20 22:25:45.393981 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:25:45.393950 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f69f8595d-mgrxp_bcd8c5bf-6147-411e-aa26-ee82c19ac8d3/authorino/0.log" May 20 22:25:45.718456 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:25:45.718380 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-xppjm_ae1be0d8-aad3-406c-8f90-c605544ee775/kuadrant-console-plugin/0.log" May 20 22:25:46.061178 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:25:46.061147 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-46mvp_8eb6042f-411c-43f3-8549-52b511b36a07/limitador/0.log" May 20 22:25:46.720122 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:25:46.720095 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6544789b6f-6d2tc_c94e0b88-0446-4e81-9570-d811adb551bf/kube-auth-proxy/0.log" May 20 22:25:47.065615 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:25:47.065582 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-wgpwb_e3339213-bab8-4945-8ffd-04bd7c94b2eb/payload-processing/0.log" May 20 22:25:51.850252 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:25:51.850216 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2wgpr/must-gather-q9zrv"] May 20 22:25:51.853576 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:25:51.853558 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2wgpr/must-gather-q9zrv" May 20 22:25:51.856313 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:25:51.856289 2581 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2wgpr\"/\"default-dockercfg-hdmrk\"" May 20 22:25:51.856468 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:25:51.856451 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2wgpr\"/\"openshift-service-ca.crt\"" May 20 22:25:51.857605 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:25:51.857589 2581 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2wgpr\"/\"kube-root-ca.crt\"" May 20 22:25:51.870904 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:25:51.870878 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2wgpr/must-gather-q9zrv"] May 20 22:25:51.933674 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:25:51.933634 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b716ba7b-db3e-4850-be22-0b839db2e38b-must-gather-output\") pod \"must-gather-q9zrv\" (UID: \"b716ba7b-db3e-4850-be22-0b839db2e38b\") " pod="openshift-must-gather-2wgpr/must-gather-q9zrv" May 20 22:25:51.933858 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:25:51.933740 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v79s2\" (UniqueName: \"kubernetes.io/projected/b716ba7b-db3e-4850-be22-0b839db2e38b-kube-api-access-v79s2\") pod \"must-gather-q9zrv\" (UID: \"b716ba7b-db3e-4850-be22-0b839db2e38b\") " pod="openshift-must-gather-2wgpr/must-gather-q9zrv" May 20 22:25:52.034713 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:25:52.034675 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v79s2\" (UniqueName: \"kubernetes.io/projected/b716ba7b-db3e-4850-be22-0b839db2e38b-kube-api-access-v79s2\") pod \"must-gather-q9zrv\" (UID: \"b716ba7b-db3e-4850-be22-0b839db2e38b\") " pod="openshift-must-gather-2wgpr/must-gather-q9zrv" May 20 22:25:52.034912 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:25:52.034746 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b716ba7b-db3e-4850-be22-0b839db2e38b-must-gather-output\") pod \"must-gather-q9zrv\" (UID: \"b716ba7b-db3e-4850-be22-0b839db2e38b\") " pod="openshift-must-gather-2wgpr/must-gather-q9zrv" May 20 22:25:52.035049 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:25:52.035031 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b716ba7b-db3e-4850-be22-0b839db2e38b-must-gather-output\") pod \"must-gather-q9zrv\" (UID: \"b716ba7b-db3e-4850-be22-0b839db2e38b\") " pod="openshift-must-gather-2wgpr/must-gather-q9zrv" May 20 22:25:52.043777 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:25:52.043745 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v79s2\" (UniqueName: \"kubernetes.io/projected/b716ba7b-db3e-4850-be22-0b839db2e38b-kube-api-access-v79s2\") pod \"must-gather-q9zrv\" (UID: \"b716ba7b-db3e-4850-be22-0b839db2e38b\") " pod="openshift-must-gather-2wgpr/must-gather-q9zrv" May 20 22:25:52.163840 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:25:52.163753 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2wgpr/must-gather-q9zrv" May 20 22:25:52.301994 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:25:52.301971 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2wgpr/must-gather-q9zrv"] May 20 22:25:52.304683 ip-10-0-129-137 kubenswrapper[2581]: W0520 22:25:52.304654 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb716ba7b_db3e_4850_be22_0b839db2e38b.slice/crio-6138c923994b6c93fbf5decc2794335b34eded3b1f6aaf35e224f6d0057c0860 WatchSource:0}: Error finding container 6138c923994b6c93fbf5decc2794335b34eded3b1f6aaf35e224f6d0057c0860: Status 404 returned error can't find the container with id 6138c923994b6c93fbf5decc2794335b34eded3b1f6aaf35e224f6d0057c0860 May 20 22:25:52.306341 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:25:52.306325 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 20 22:25:53.271398 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:25:53.271367 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2wgpr/must-gather-q9zrv" event={"ID":"b716ba7b-db3e-4850-be22-0b839db2e38b","Type":"ContainerStarted","Data":"6774a9b43194437ff5bd1eace0acc19f473beb433682e2f83af99e06c06e3234"} May 20 22:25:53.271742 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:25:53.271408 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2wgpr/must-gather-q9zrv" event={"ID":"b716ba7b-db3e-4850-be22-0b839db2e38b","Type":"ContainerStarted","Data":"6138c923994b6c93fbf5decc2794335b34eded3b1f6aaf35e224f6d0057c0860"} May 20 22:25:54.279991 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:25:54.279952 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2wgpr/must-gather-q9zrv" event={"ID":"b716ba7b-db3e-4850-be22-0b839db2e38b","Type":"ContainerStarted","Data":"c12e407432305dd85e8f5233bfc559e39e4170c4fa04670a8c97941760af4003"} May 20 22:25:54.300308 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:25:54.300252 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-2wgpr/must-gather-q9zrv" podStartSLOduration=2.429287721 podStartE2EDuration="3.300232984s" podCreationTimestamp="2026-05-20 22:25:51 +0000 UTC" firstStartedPulling="2026-05-20 22:25:52.306461165 +0000 UTC m=+2255.168882086" lastFinishedPulling="2026-05-20 22:25:53.177406441 +0000 UTC m=+2256.039827349" observedRunningTime="2026-05-20 22:25:54.298761318 +0000 UTC m=+2257.161182249" watchObservedRunningTime="2026-05-20 22:25:54.300232984 +0000 UTC m=+2257.162653914" May 20 22:25:54.778441 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:25:54.778406 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4z57g_52dd05b8-2e48-4579-b4c0-193b7ac0dc78/global-pull-secret-syncer/0.log" May 20 22:25:54.997842 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:25:54.997810 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-q2tcg_34b2cd4e-11b6-4278-8c16-9241eebd6cef/konnectivity-agent/0.log" May 20 22:25:55.054931 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:25:55.054848 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-137.ec2.internal_9bbe3a098905df03db04c6508916d305/haproxy/0.log" May 20 22:25:59.644725 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:25:59.644660 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f69f8595d-mgrxp_bcd8c5bf-6147-411e-aa26-ee82c19ac8d3/authorino/0.log" May 20 22:25:59.735439 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:25:59.735354 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-xppjm_ae1be0d8-aad3-406c-8f90-c605544ee775/kuadrant-console-plugin/0.log" May 20 22:25:59.873004 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:25:59.872966 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-46mvp_8eb6042f-411c-43f3-8549-52b511b36a07/limitador/0.log" May 20 22:26:01.888216 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:01.888188 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-b2fhf_7c19723c-ff40-490c-aeb2-5a6cea8164e8/kube-state-metrics/0.log" May 20 22:26:01.915368 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:01.915341 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-b2fhf_7c19723c-ff40-490c-aeb2-5a6cea8164e8/kube-rbac-proxy-main/0.log" May 20 22:26:01.943395 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:01.943359 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-b2fhf_7c19723c-ff40-490c-aeb2-5a6cea8164e8/kube-rbac-proxy-self/0.log" May 20 22:26:01.972258 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:01.972210 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-f55845df4-dxpsk_f0ee2c77-be7d-4f31-a68d-c77d9b3a8b0e/metrics-server/0.log" May 20 22:26:02.024884 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:02.024854 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-96d2b_3ccab590-13e6-40fa-abcd-200a0e6c52db/node-exporter/0.log" May 20 22:26:02.053200 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:02.053171 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-96d2b_3ccab590-13e6-40fa-abcd-200a0e6c52db/kube-rbac-proxy/0.log" May 20 22:26:02.073246 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:02.073217 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-96d2b_3ccab590-13e6-40fa-abcd-200a0e6c52db/init-textfile/0.log" May 20 22:26:02.334745 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:02.334710 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_feede91a-c7e9-4878-9d53-3103dc3b363e/prometheus/0.log" May 20 22:26:02.362744 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:02.362714 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_feede91a-c7e9-4878-9d53-3103dc3b363e/config-reloader/0.log" May 20 22:26:02.387511 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:02.387487 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_feede91a-c7e9-4878-9d53-3103dc3b363e/thanos-sidecar/0.log" May 20 22:26:02.414749 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:02.414721 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_feede91a-c7e9-4878-9d53-3103dc3b363e/kube-rbac-proxy-web/0.log" May 20 22:26:02.436493 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:02.436465 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_feede91a-c7e9-4878-9d53-3103dc3b363e/kube-rbac-proxy/0.log" May 20 22:26:02.465634 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:02.465604 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_feede91a-c7e9-4878-9d53-3103dc3b363e/kube-rbac-proxy-thanos/0.log" May 20 22:26:02.491452 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:02.491419 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_feede91a-c7e9-4878-9d53-3103dc3b363e/init-config-reloader/0.log" May 20 22:26:02.522253 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:02.522223 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-zz9cl_32d9f655-7497-43d6-9ecc-0535fc122b12/prometheus-operator/0.log" May 20 22:26:02.540661 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:02.540632 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-zz9cl_32d9f655-7497-43d6-9ecc-0535fc122b12/kube-rbac-proxy/0.log" May 20 22:26:02.566287 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:02.566258 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-7t258_69068108-28e3-4d3f-9d62-ed73c6bcacd4/prometheus-operator-admission-webhook/0.log" May 20 22:26:03.222417 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:03.222383 2581 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2wgpr/perf-node-gather-daemonset-d7675"] May 20 22:26:03.228817 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:03.228787 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-d7675" May 20 22:26:03.237143 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:03.237118 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2wgpr/perf-node-gather-daemonset-d7675"] May 20 22:26:03.350774 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:03.350725 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trm2p\" (UniqueName: \"kubernetes.io/projected/76ea0c53-2a18-475d-b0c4-fe413ecff9bd-kube-api-access-trm2p\") pod \"perf-node-gather-daemonset-d7675\" (UID: \"76ea0c53-2a18-475d-b0c4-fe413ecff9bd\") " pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-d7675" May 20 22:26:03.350774 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:03.350774 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76ea0c53-2a18-475d-b0c4-fe413ecff9bd-sys\") pod \"perf-node-gather-daemonset-d7675\" (UID: \"76ea0c53-2a18-475d-b0c4-fe413ecff9bd\") " pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-d7675" May 20 22:26:03.351036 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:03.350829 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/76ea0c53-2a18-475d-b0c4-fe413ecff9bd-lib-modules\") pod \"perf-node-gather-daemonset-d7675\" (UID: \"76ea0c53-2a18-475d-b0c4-fe413ecff9bd\") " pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-d7675" May 20 22:26:03.351036 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:03.350855 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/76ea0c53-2a18-475d-b0c4-fe413ecff9bd-podres\") pod \"perf-node-gather-daemonset-d7675\" (UID: \"76ea0c53-2a18-475d-b0c4-fe413ecff9bd\") " pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-d7675" May 20 22:26:03.351036 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:03.350894 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/76ea0c53-2a18-475d-b0c4-fe413ecff9bd-proc\") pod \"perf-node-gather-daemonset-d7675\" (UID: \"76ea0c53-2a18-475d-b0c4-fe413ecff9bd\") " pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-d7675" May 20 22:26:03.452206 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:03.452163 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-trm2p\" (UniqueName: \"kubernetes.io/projected/76ea0c53-2a18-475d-b0c4-fe413ecff9bd-kube-api-access-trm2p\") pod \"perf-node-gather-daemonset-d7675\" (UID: \"76ea0c53-2a18-475d-b0c4-fe413ecff9bd\") " pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-d7675" May 20 22:26:03.452397 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:03.452214 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76ea0c53-2a18-475d-b0c4-fe413ecff9bd-sys\") pod \"perf-node-gather-daemonset-d7675\" (UID: \"76ea0c53-2a18-475d-b0c4-fe413ecff9bd\") " pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-d7675" May 20 22:26:03.452397 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:03.452270 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/76ea0c53-2a18-475d-b0c4-fe413ecff9bd-lib-modules\") pod \"perf-node-gather-daemonset-d7675\" (UID: \"76ea0c53-2a18-475d-b0c4-fe413ecff9bd\") " pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-d7675" May 20 22:26:03.452397 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:03.452296 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/76ea0c53-2a18-475d-b0c4-fe413ecff9bd-podres\") pod \"perf-node-gather-daemonset-d7675\" (UID: \"76ea0c53-2a18-475d-b0c4-fe413ecff9bd\") " pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-d7675" May 20 22:26:03.452397 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:03.452337 2581 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/76ea0c53-2a18-475d-b0c4-fe413ecff9bd-proc\") pod \"perf-node-gather-daemonset-d7675\" (UID: \"76ea0c53-2a18-475d-b0c4-fe413ecff9bd\") " pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-d7675" May 20 22:26:03.452397 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:03.452353 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76ea0c53-2a18-475d-b0c4-fe413ecff9bd-sys\") pod \"perf-node-gather-daemonset-d7675\" (UID: \"76ea0c53-2a18-475d-b0c4-fe413ecff9bd\") " pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-d7675" May 20 22:26:03.452620 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:03.452417 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/76ea0c53-2a18-475d-b0c4-fe413ecff9bd-lib-modules\") pod \"perf-node-gather-daemonset-d7675\" (UID: \"76ea0c53-2a18-475d-b0c4-fe413ecff9bd\") " pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-d7675" May 20 22:26:03.452620 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:03.452433 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/76ea0c53-2a18-475d-b0c4-fe413ecff9bd-proc\") pod \"perf-node-gather-daemonset-d7675\" (UID: \"76ea0c53-2a18-475d-b0c4-fe413ecff9bd\") " pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-d7675" May 20 22:26:03.452620 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:03.452489 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/76ea0c53-2a18-475d-b0c4-fe413ecff9bd-podres\") pod \"perf-node-gather-daemonset-d7675\" (UID: \"76ea0c53-2a18-475d-b0c4-fe413ecff9bd\") " pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-d7675" May 20 22:26:03.462455 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:03.462423 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trm2p\" (UniqueName: \"kubernetes.io/projected/76ea0c53-2a18-475d-b0c4-fe413ecff9bd-kube-api-access-trm2p\") pod \"perf-node-gather-daemonset-d7675\" (UID: \"76ea0c53-2a18-475d-b0c4-fe413ecff9bd\") " pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-d7675" May 20 22:26:03.544302 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:03.544213 2581 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-d7675" May 20 22:26:03.705666 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:03.705632 2581 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2wgpr/perf-node-gather-daemonset-d7675"] May 20 22:26:03.709052 ip-10-0-129-137 kubenswrapper[2581]: W0520 22:26:03.709018 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod76ea0c53_2a18_475d_b0c4_fe413ecff9bd.slice/crio-b7f16a5aa59aa91b34bbe73e0e926392ceb29e09ea137bf6c36bce79ca994ad5 WatchSource:0}: Error finding container b7f16a5aa59aa91b34bbe73e0e926392ceb29e09ea137bf6c36bce79ca994ad5: Status 404 returned error can't find the container with id b7f16a5aa59aa91b34bbe73e0e926392ceb29e09ea137bf6c36bce79ca994ad5 May 20 22:26:04.325722 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:04.325676 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-d7675" event={"ID":"76ea0c53-2a18-475d-b0c4-fe413ecff9bd","Type":"ContainerStarted","Data":"8731730a7c5188ae711c4996cf4cb95bca3f57078b4c890903df2371d26dc12c"} May 20 22:26:04.325722 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:04.325726 2581 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-d7675" event={"ID":"76ea0c53-2a18-475d-b0c4-fe413ecff9bd","Type":"ContainerStarted","Data":"b7f16a5aa59aa91b34bbe73e0e926392ceb29e09ea137bf6c36bce79ca994ad5"} May 20 22:26:04.326613 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:04.326583 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-d7675" May 20 22:26:04.363434 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:04.363379 2581 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-d7675" podStartSLOduration=1.363363402 podStartE2EDuration="1.363363402s" podCreationTimestamp="2026-05-20 22:26:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 22:26:04.353748017 +0000 UTC m=+2267.216168949" watchObservedRunningTime="2026-05-20 22:26:04.363363402 +0000 UTC m=+2267.225784332" May 20 22:26:05.449867 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:05.449835 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-gmqwx_40863a5e-89b6-4b83-a059-2a96c35d94eb/volume-data-source-validator/0.log" May 20 22:26:06.398423 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:06.398383 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hcsxv_1d9a5e80-3f7c-4c29-abbc-04a9004ec9df/dns/0.log" May 20 22:26:06.431025 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:06.430990 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hcsxv_1d9a5e80-3f7c-4c29-abbc-04a9004ec9df/kube-rbac-proxy/0.log" May 20 22:26:06.591000 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:06.590965 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x5q4l_b7fbcb26-e155-4cf8-89ba-17e5c52f3f8c/dns-node-resolver/0.log" May 20 22:26:07.373810 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:07.373779 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vhwkk_30a53acd-d1d9-480d-885b-ebccb4ef3734/node-ca/0.log" May 20 22:26:08.551743 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:08.551709 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6544789b6f-6d2tc_c94e0b88-0446-4e81-9570-d811adb551bf/kube-auth-proxy/0.log" May 20 22:26:08.778409 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:08.778375 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-wgpwb_e3339213-bab8-4945-8ffd-04bd7c94b2eb/payload-processing/0.log" May 20 22:26:09.347719 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:09.347691 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bbvpk_99598051-0e0d-4e2f-ac40-6a2d142b4183/serve-healthcheck-canary/0.log" May 20 22:26:09.982480 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:09.982444 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g65q5_21265fbc-2f7c-4414-9505-4bb586055f1f/kube-rbac-proxy/0.log" May 20 22:26:10.007158 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:10.007125 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g65q5_21265fbc-2f7c-4414-9505-4bb586055f1f/exporter/0.log" May 20 22:26:10.031583 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:10.031549 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g65q5_21265fbc-2f7c-4414-9505-4bb586055f1f/extractor/0.log" May 20 22:26:11.343548 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:11.343521 2581 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-d7675" May 20 22:26:12.164231 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:12.164201 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-76b949cbcb-5c8nm_1711b375-3f7f-437f-bc85-dfb341eea195/maas-api/0.log" May 20 22:26:12.373479 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:12.373443 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c897df989-bmtc2_b41ccacd-4863-4909-bc3d-a3a087a4332e/manager/0.log" May 20 22:26:14.034273 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:14.034240 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-8647c47685-cs9tl_7a1826a5-8e40-4212-bd02-448826512ad1/manager/0.log" May 20 22:26:18.731320 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:18.731285 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-52hlp_60a657dd-734e-43c3-9b9d-e939b199b5fe/migrator/0.log" May 20 22:26:18.763815 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:18.763790 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-52hlp_60a657dd-734e-43c3-9b9d-e939b199b5fe/graceful-termination/0.log" May 20 22:26:19.159589 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:19.159556 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-wrfmh_e1f6a66d-0f04-48f9-ba0d-2bd45bf6b350/kube-storage-version-migrator-operator/1.log" May 20 22:26:19.161435 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:19.161410 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-wrfmh_e1f6a66d-0f04-48f9-ba0d-2bd45bf6b350/kube-storage-version-migrator-operator/0.log" May 20 22:26:20.754155 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:20.754123 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g76b4_585dc410-8720-4e83-926c-486addf85ada/kube-multus-additional-cni-plugins/0.log" May 20 22:26:20.809688 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:20.809657 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g76b4_585dc410-8720-4e83-926c-486addf85ada/egress-router-binary-copy/0.log" May 20 22:26:20.871563 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:20.871531 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g76b4_585dc410-8720-4e83-926c-486addf85ada/cni-plugins/0.log" May 20 22:26:20.921381 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:20.921343 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g76b4_585dc410-8720-4e83-926c-486addf85ada/bond-cni-plugin/0.log" May 20 22:26:20.953545 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:20.953439 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g76b4_585dc410-8720-4e83-926c-486addf85ada/routeoverride-cni/0.log" May 20 22:26:20.987817 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:20.987788 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g76b4_585dc410-8720-4e83-926c-486addf85ada/whereabouts-cni-bincopy/0.log" May 20 22:26:21.017642 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:21.017618 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g76b4_585dc410-8720-4e83-926c-486addf85ada/whereabouts-cni/0.log" May 20 22:26:21.159688 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:21.159660 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-tjnqv_adaf6994-2a90-4542-a2e5-2e415a29094b/kube-multus/0.log" May 20 22:26:21.201245 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:21.201214 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6wbvb_872c529b-f04d-4f44-be10-283c11ff49e0/network-metrics-daemon/0.log" May 20 22:26:21.227225 ip-10-0-129-137 kubenswrapper[2581]: I0520 22:26:21.227170 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6wbvb_872c529b-f04d-4f44-be10-283c11ff49e0/kube-rbac-proxy/0.log"