May 21 18:10:34.119270 ip-10-0-141-59 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 21 18:10:34.119284 ip-10-0-141-59 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 21 18:10:34.119294 ip-10-0-141-59 systemd[1]: kubelet.service: Failed with result 'resources'. May 21 18:10:34.119664 ip-10-0-141-59 systemd[1]: Failed to start Kubernetes Kubelet. May 21 18:10:44.157914 ip-10-0-141-59 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 21 18:10:44.157931 ip-10-0-141-59 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 7adab172cfaa48f4abea407b8ea958ea -- May 21 18:13:15.275862 ip-10-0-141-59 systemd[1]: Starting Kubernetes Kubelet... May 21 18:13:15.797688 ip-10-0-141-59 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 18:13:15.797688 ip-10-0-141-59 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 21 18:13:15.797688 ip-10-0-141-59 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 18:13:15.797688 ip-10-0-141-59 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 21 18:13:15.797688 ip-10-0-141-59 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 18:13:15.798696 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.798551 2567 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 21 18:13:15.803252 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803237 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 18:13:15.803252 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803252 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 18:13:15.803314 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803257 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 18:13:15.803314 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803261 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 18:13:15.803314 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803264 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 18:13:15.803314 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803268 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 18:13:15.803314 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803272 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 18:13:15.803314 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803275 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 18:13:15.803314 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803277 2567 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 18:13:15.803314 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803280 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 18:13:15.803314 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803283 2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 18:13:15.803314 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803286 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 18:13:15.803314 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803288 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 18:13:15.803314 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803291 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 18:13:15.803314 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803293 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 18:13:15.803314 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803296 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 18:13:15.803314 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803298 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 18:13:15.803314 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803307 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 18:13:15.803314 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803309 2567 feature_gate.go:328] unrecognized feature gate: Example May 21 18:13:15.803314 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803312 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 18:13:15.803314 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803315 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 18:13:15.803314 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803318 2567 feature_gate.go:328] unrecognized feature gate: Example2 May 21 18:13:15.803793 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803321 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 18:13:15.803793 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803323 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 18:13:15.803793 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803326 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 18:13:15.803793 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803329 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 18:13:15.803793 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803331 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 18:13:15.803793 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803334 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 18:13:15.803793 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803337 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 18:13:15.803793 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803339 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 18:13:15.803793 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803342 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 18:13:15.803793 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803344 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 18:13:15.803793 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803347 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 18:13:15.803793 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803349 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 18:13:15.803793 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803352 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 18:13:15.803793 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803354 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 18:13:15.803793 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803356 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 18:13:15.803793 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803359 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 18:13:15.803793 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803362 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 18:13:15.803793 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803364 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 18:13:15.803793 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803367 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 18:13:15.804243 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803369 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 18:13:15.804243 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803372 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 18:13:15.804243 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803375 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 18:13:15.804243 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803377 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 18:13:15.804243 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803379 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 18:13:15.804243 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803384 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 18:13:15.804243 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803387 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 18:13:15.804243 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803389 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 18:13:15.804243 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803392 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 18:13:15.804243 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803394 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 18:13:15.804243 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803396 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 18:13:15.804243 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803399 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 18:13:15.804243 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803401 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 18:13:15.804243 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803403 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 18:13:15.804243 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803407 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 18:13:15.804243 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803409 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 18:13:15.804243 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803412 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 18:13:15.804243 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803414 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 18:13:15.804243 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803417 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 18:13:15.804243 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803420 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 18:13:15.804723 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803423 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 18:13:15.804723 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803425 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 18:13:15.804723 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803428 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 18:13:15.804723 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803430 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 18:13:15.804723 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803433 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 18:13:15.804723 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803436 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 18:13:15.804723 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803438 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 18:13:15.804723 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803441 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 18:13:15.804723 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803443 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 18:13:15.804723 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803446 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 18:13:15.804723 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803448 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 18:13:15.804723 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803450 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 18:13:15.804723 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803453 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 18:13:15.804723 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803455 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 18:13:15.804723 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803458 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 18:13:15.804723 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803460 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 18:13:15.804723 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803463 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 18:13:15.804723 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803465 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 18:13:15.804723 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803468 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 18:13:15.804723 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803471 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 18:13:15.805231 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803473 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 18:13:15.805231 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803476 2567 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 18:13:15.805231 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803480 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 18:13:15.805231 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803484 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 18:13:15.805231 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803488 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 18:13:15.805231 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803879 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 18:13:15.805231 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803885 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 18:13:15.805231 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803889 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 18:13:15.805231 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803892 2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 18:13:15.805231 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803895 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 18:13:15.805231 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803898 2567 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 18:13:15.805231 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803901 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 18:13:15.805231 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803904 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 18:13:15.805231 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803906 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 18:13:15.805231 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803909 2567 feature_gate.go:328] unrecognized feature gate: Example May 21 18:13:15.805231 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803912 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 18:13:15.805231 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803915 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 18:13:15.805231 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803918 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 18:13:15.805231 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803921 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 18:13:15.805688 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803924 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 18:13:15.805688 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803927 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 18:13:15.805688 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803931 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 18:13:15.805688 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803933 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 18:13:15.805688 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803936 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 18:13:15.805688 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803939 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 18:13:15.805688 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803941 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 18:13:15.805688 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803943 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 18:13:15.805688 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803946 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 18:13:15.805688 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803950 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 18:13:15.805688 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803953 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 18:13:15.805688 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803957 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 18:13:15.805688 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803960 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 18:13:15.805688 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803962 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 18:13:15.805688 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803965 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 18:13:15.805688 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803967 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 18:13:15.805688 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803970 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 18:13:15.805688 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803972 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 18:13:15.806121 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803975 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 18:13:15.806121 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803978 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 18:13:15.806121 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803980 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 18:13:15.806121 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803983 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 18:13:15.806121 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803986 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 18:13:15.806121 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803988 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 18:13:15.806121 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803990 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 18:13:15.806121 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803994 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 18:13:15.806121 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803996 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 18:13:15.806121 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.803999 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 18:13:15.806121 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.804002 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 18:13:15.806121 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.804004 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 18:13:15.806121 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.804006 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 18:13:15.806121 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.804009 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 18:13:15.806121 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.804012 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 18:13:15.806121 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.804014 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 18:13:15.806121 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.804016 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 18:13:15.806121 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.804019 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 18:13:15.806121 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.804021 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 18:13:15.806121 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.804023 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 18:13:15.806612 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.804026 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 18:13:15.806612 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.804028 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 18:13:15.806612 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.804031 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 18:13:15.806612 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.804033 2567 feature_gate.go:328] unrecognized feature gate: Example2 May 21 18:13:15.806612 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.804035 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 18:13:15.806612 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.804039 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 18:13:15.806612 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.804042 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 18:13:15.806612 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.804045 2567 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 18:13:15.806612 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.804048 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 18:13:15.806612 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.804051 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 18:13:15.806612 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.804054 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 18:13:15.806612 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.804056 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 18:13:15.806612 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.804059 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 18:13:15.806612 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.804062 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 18:13:15.806612 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.804064 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 18:13:15.806612 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.804067 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 18:13:15.806612 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.804069 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 18:13:15.806612 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.804071 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 18:13:15.806612 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.804074 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 18:13:15.806612 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.804076 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 18:13:15.807110 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.804079 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 18:13:15.807110 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.804081 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 18:13:15.807110 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.804083 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 18:13:15.807110 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.804086 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 18:13:15.807110 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.804089 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 18:13:15.807110 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.804091 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 18:13:15.807110 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.804094 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 18:13:15.807110 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.804097 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 18:13:15.807110 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.804099 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 18:13:15.807110 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.804101 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 18:13:15.807110 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.804104 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 18:13:15.807110 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.804107 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 18:13:15.807110 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.804109 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 18:13:15.807110 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.804111 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 18:13:15.807110 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805419 2567 flags.go:64] FLAG: --address="0.0.0.0" May 21 18:13:15.807110 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805433 2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 21 18:13:15.807110 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805441 2567 flags.go:64] FLAG: --anonymous-auth="true" May 21 18:13:15.807110 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805446 2567 flags.go:64] FLAG: --application-metrics-count-limit="100" May 21 18:13:15.807110 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805450 2567 flags.go:64] FLAG: --authentication-token-webhook="false" May 21 18:13:15.807110 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805453 2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 21 18:13:15.807110 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805458 2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 21 18:13:15.807615 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805462 2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 21 18:13:15.807615 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805466 2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 21 18:13:15.807615 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805469 2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 21 18:13:15.807615 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805472 2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 21 18:13:15.807615 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805475 2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 21 18:13:15.807615 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805479 2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 21 18:13:15.807615 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805482 2567 flags.go:64] FLAG: --cgroup-root="" May 21 18:13:15.807615 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805485 2567 flags.go:64] FLAG: --cgroups-per-qos="true" May 21 18:13:15.807615 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805488 2567 flags.go:64] FLAG: --client-ca-file="" May 21 18:13:15.807615 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805490 2567 flags.go:64] FLAG: --cloud-config="" May 21 18:13:15.807615 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805493 2567 flags.go:64] FLAG: --cloud-provider="external" May 21 18:13:15.807615 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805496 2567 flags.go:64] FLAG: --cluster-dns="[]" May 21 18:13:15.807615 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805500 2567 flags.go:64] FLAG: --cluster-domain="" May 21 18:13:15.807615 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805503 2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 21 18:13:15.807615 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805506 2567 flags.go:64] FLAG: --config-dir="" May 21 18:13:15.807615 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805509 2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 21 18:13:15.807615 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805512 2567 flags.go:64] FLAG: --container-log-max-files="5" May 21 18:13:15.807615 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805516 2567 flags.go:64] FLAG: --container-log-max-size="10Mi" May 21 18:13:15.807615 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805520 2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 21 18:13:15.807615 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805523 2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 21 18:13:15.807615 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805527 2567 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 21 18:13:15.807615 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805530 2567 flags.go:64] FLAG: --contention-profiling="false" May 21 18:13:15.807615 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805533 2567 flags.go:64] FLAG: --cpu-cfs-quota="true" May 21 18:13:15.807615 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805536 2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 21 18:13:15.808180 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805539 2567 flags.go:64] FLAG: --cpu-manager-policy="none" May 21 18:13:15.808180 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805542 2567 flags.go:64] FLAG: --cpu-manager-policy-options="" May 21 18:13:15.808180 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805546 2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 21 18:13:15.808180 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805549 2567 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 21 18:13:15.808180 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805552 2567 flags.go:64] FLAG: --enable-debugging-handlers="true" May 21 18:13:15.808180 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805555 2567 flags.go:64] FLAG: --enable-load-reader="false" May 21 18:13:15.808180 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805558 2567 flags.go:64] FLAG: --enable-server="true" May 21 18:13:15.808180 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805561 2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 21 18:13:15.808180 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805566 2567 flags.go:64] FLAG: --event-burst="100" May 21 18:13:15.808180 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805570 2567 flags.go:64] FLAG: --event-qps="50" May 21 18:13:15.808180 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805583 2567 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 21 18:13:15.808180 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805587 2567 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 21 18:13:15.808180 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805590 2567 flags.go:64] FLAG: --eviction-hard="" May 21 18:13:15.808180 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805594 2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 21 18:13:15.808180 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805597 2567 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 21 18:13:15.808180 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805600 2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 21 18:13:15.808180 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805603 2567 flags.go:64] FLAG: --eviction-soft="" May 21 18:13:15.808180 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805606 2567 flags.go:64] FLAG: --eviction-soft-grace-period="" May 21 18:13:15.808180 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805609 2567 flags.go:64] FLAG: --exit-on-lock-contention="false" May 21 18:13:15.808180 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805612 2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 21 18:13:15.808180 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805615 2567 flags.go:64] FLAG: --experimental-mounter-path="" May 21 18:13:15.808180 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805617 2567 flags.go:64] FLAG: --fail-cgroupv1="false" May 21 18:13:15.808180 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805620 2567 flags.go:64] FLAG: --fail-swap-on="true" May 21 18:13:15.808180 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805623 2567 flags.go:64] FLAG: --feature-gates="" May 21 18:13:15.808180 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805627 2567 flags.go:64] FLAG: --file-check-frequency="20s" May 21 18:13:15.808789 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805630 2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 21 18:13:15.808789 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805633 2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 21 18:13:15.808789 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805638 2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 21 18:13:15.808789 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805641 2567 flags.go:64] FLAG: --healthz-port="10248" May 21 18:13:15.808789 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805645 2567 flags.go:64] FLAG: --help="false" May 21 18:13:15.808789 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805647 2567 flags.go:64] FLAG: --hostname-override="ip-10-0-141-59.ec2.internal" May 21 18:13:15.808789 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805650 2567 flags.go:64] FLAG: --housekeeping-interval="10s" May 21 18:13:15.808789 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805653 2567 flags.go:64] FLAG: --http-check-frequency="20s" May 21 18:13:15.808789 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805656 2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 21 18:13:15.808789 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805660 2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 21 18:13:15.808789 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805663 2567 flags.go:64] FLAG: --image-gc-high-threshold="85" May 21 18:13:15.808789 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805666 2567 flags.go:64] FLAG: --image-gc-low-threshold="80" May 21 18:13:15.808789 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805669 2567 flags.go:64] FLAG: --image-service-endpoint="" May 21 18:13:15.808789 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805671 2567 flags.go:64] FLAG: --kernel-memcg-notification="false" May 21 18:13:15.808789 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805675 2567 flags.go:64] FLAG: --kube-api-burst="100" May 21 18:13:15.808789 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805678 2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 21 18:13:15.808789 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805681 2567 flags.go:64] FLAG: --kube-api-qps="50" May 21 18:13:15.808789 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805683 2567 flags.go:64] FLAG: --kube-reserved="" May 21 18:13:15.808789 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805687 2567 flags.go:64] FLAG: --kube-reserved-cgroup="" May 21 18:13:15.808789 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805690 2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 21 18:13:15.808789 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805693 2567 flags.go:64] FLAG: --kubelet-cgroups="" May 21 18:13:15.808789 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805697 2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 21 18:13:15.808789 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805700 2567 flags.go:64] FLAG: --lock-file="" May 21 18:13:15.808789 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805702 2567 flags.go:64] FLAG: --log-cadvisor-usage="false" May 21 18:13:15.809357 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805705 2567 flags.go:64] FLAG: --log-flush-frequency="5s" May 21 18:13:15.809357 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805708 2567 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 21 18:13:15.809357 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805714 2567 flags.go:64] FLAG: --log-json-split-stream="false" May 21 18:13:15.809357 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805716 2567 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 21 18:13:15.809357 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805719 2567 flags.go:64] FLAG: --log-text-split-stream="false" May 21 18:13:15.809357 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805722 2567 flags.go:64] FLAG: --logging-format="text" May 21 18:13:15.809357 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805725 2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 21 18:13:15.809357 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805728 2567 flags.go:64] FLAG: --make-iptables-util-chains="true" May 21 18:13:15.809357 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805731 2567 flags.go:64] FLAG: --manifest-url="" May 21 18:13:15.809357 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805734 2567 flags.go:64] FLAG: --manifest-url-header="" May 21 18:13:15.809357 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805738 2567 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 21 18:13:15.809357 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805742 2567 flags.go:64] FLAG: --max-open-files="1000000" May 21 18:13:15.809357 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805746 2567 flags.go:64] FLAG: --max-pods="110" May 21 18:13:15.809357 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805749 2567 flags.go:64] FLAG: --maximum-dead-containers="-1" May 21 18:13:15.809357 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805752 2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 21 18:13:15.809357 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805755 2567 flags.go:64] FLAG: --memory-manager-policy="None" May 21 18:13:15.809357 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805758 2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 21 18:13:15.809357 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805761 2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 21 18:13:15.809357 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805764 2567 flags.go:64] FLAG: --node-ip="0.0.0.0" May 21 18:13:15.809357 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805767 2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 21 18:13:15.809357 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805774 2567 flags.go:64] FLAG: --node-status-max-images="50" May 21 18:13:15.809357 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805777 2567 flags.go:64] FLAG: --node-status-update-frequency="10s" May 21 18:13:15.809357 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805780 2567 flags.go:64] FLAG: --oom-score-adj="-999" May 21 18:13:15.809357 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805783 2567 flags.go:64] FLAG: --pod-cidr="" May 21 18:13:15.809983 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805786 2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 21 18:13:15.809983 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805792 2567 flags.go:64] FLAG: --pod-manifest-path="" May 21 18:13:15.809983 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805796 2567 flags.go:64] FLAG: --pod-max-pids="-1" May 21 18:13:15.809983 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805799 2567 flags.go:64] FLAG: --pods-per-core="0" May 21 18:13:15.809983 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805802 2567 flags.go:64] FLAG: --port="10250" May 21 18:13:15.809983 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805805 2567 flags.go:64] FLAG: --protect-kernel-defaults="false" May 21 18:13:15.809983 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805808 2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07f518db1752191c2" May 21 18:13:15.809983 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805811 2567 flags.go:64] FLAG: --qos-reserved="" May 21 18:13:15.809983 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805814 2567 flags.go:64] FLAG: --read-only-port="10255" May 21 18:13:15.809983 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805817 2567 flags.go:64] FLAG: --register-node="true" May 21 18:13:15.809983 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805820 2567 flags.go:64] FLAG: --register-schedulable="true" May 21 18:13:15.809983 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805823 2567 flags.go:64] FLAG: --register-with-taints="" May 21 18:13:15.809983 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805827 2567 flags.go:64] FLAG: --registry-burst="10" May 21 18:13:15.809983 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805829 2567 flags.go:64] FLAG: --registry-qps="5" May 21 18:13:15.809983 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805832 2567 flags.go:64] FLAG: --reserved-cpus="" May 21 18:13:15.809983 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805835 2567 flags.go:64] FLAG: --reserved-memory="" May 21 18:13:15.809983 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805838 2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 21 18:13:15.809983 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805841 2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 21 18:13:15.809983 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805844 2567 flags.go:64] FLAG: --rotate-certificates="false" May 21 18:13:15.809983 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805847 2567 flags.go:64] FLAG: --rotate-server-certificates="false" May 21 18:13:15.809983 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805851 2567 flags.go:64] FLAG: --runonce="false" May 21 18:13:15.809983 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805854 2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 21 18:13:15.809983 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805857 2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 21 18:13:15.809983 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805860 2567 flags.go:64] FLAG: --seccomp-default="false" May 21 18:13:15.809983 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805863 2567 flags.go:64] FLAG: --serialize-image-pulls="true" May 21 18:13:15.810568 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805866 2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 21 18:13:15.810568 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805869 2567 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 21 18:13:15.810568 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805872 2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 21 18:13:15.810568 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805875 2567 flags.go:64] FLAG: --storage-driver-password="root" May 21 18:13:15.810568 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805878 2567 flags.go:64] FLAG: --storage-driver-secure="false" May 21 18:13:15.810568 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805881 2567 flags.go:64] FLAG: --storage-driver-table="stats" May 21 18:13:15.810568 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805884 2567 flags.go:64] FLAG: --storage-driver-user="root" May 21 18:13:15.810568 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805887 2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 21 18:13:15.810568 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805890 2567 flags.go:64] FLAG: --sync-frequency="1m0s" May 21 18:13:15.810568 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805893 2567 flags.go:64] FLAG: --system-cgroups="" May 21 18:13:15.810568 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805895 2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 21 18:13:15.810568 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805901 2567 flags.go:64] FLAG: --system-reserved-cgroup="" May 21 18:13:15.810568 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805903 2567 flags.go:64] FLAG: --tls-cert-file="" May 21 18:13:15.810568 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805907 2567 flags.go:64] FLAG: --tls-cipher-suites="[]" May 21 18:13:15.810568 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805911 2567 flags.go:64] FLAG: --tls-min-version="" May 21 18:13:15.810568 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805913 2567 flags.go:64] FLAG: --tls-private-key-file="" May 21 18:13:15.810568 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805916 2567 flags.go:64] FLAG: --topology-manager-policy="none" May 21 18:13:15.810568 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805919 2567 flags.go:64] FLAG: --topology-manager-policy-options="" May 21 18:13:15.810568 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805922 2567 flags.go:64] FLAG: --topology-manager-scope="container" May 21 18:13:15.810568 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805925 2567 flags.go:64] FLAG: --v="2" May 21 18:13:15.810568 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805929 2567 flags.go:64] FLAG: --version="false" May 21 18:13:15.810568 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805935 2567 flags.go:64] FLAG: --vmodule="" May 21 18:13:15.810568 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805940 2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 21 18:13:15.810568 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.805943 2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 21 18:13:15.810568 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806045 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 18:13:15.811440 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806049 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 18:13:15.811440 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806052 2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 18:13:15.811440 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806055 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 18:13:15.811440 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806058 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 18:13:15.811440 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806061 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 18:13:15.811440 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806064 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 18:13:15.811440 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806067 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 18:13:15.811440 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806070 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 18:13:15.811440 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806073 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 18:13:15.811440 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806075 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 18:13:15.811440 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806078 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 18:13:15.811440 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806081 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 18:13:15.811440 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806083 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 18:13:15.811440 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806086 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 18:13:15.811440 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806088 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 18:13:15.811440 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806091 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 18:13:15.811440 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806093 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 18:13:15.811440 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806095 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 18:13:15.811440 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806098 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 18:13:15.811440 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806101 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 18:13:15.812286 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806104 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 18:13:15.812286 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806106 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 18:13:15.812286 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806108 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 18:13:15.812286 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806111 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 18:13:15.812286 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806114 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 18:13:15.812286 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806117 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 18:13:15.812286 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806121 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 18:13:15.812286 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806125 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 18:13:15.812286 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806128 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 18:13:15.812286 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806131 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 18:13:15.812286 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806134 2567 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 18:13:15.812286 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806136 2567 feature_gate.go:328] unrecognized feature gate: Example2 May 21 18:13:15.812286 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806139 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 18:13:15.812286 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806142 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 18:13:15.812286 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806144 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 18:13:15.812286 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806147 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 18:13:15.812286 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806150 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 18:13:15.812286 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806152 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 18:13:15.812286 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806155 2567 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 18:13:15.813067 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806157 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 18:13:15.813067 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806162 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 18:13:15.813067 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806164 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 18:13:15.813067 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806167 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 18:13:15.813067 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806169 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 18:13:15.813067 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806171 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 18:13:15.813067 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806174 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 18:13:15.813067 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806177 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 18:13:15.813067 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806179 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 18:13:15.813067 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806182 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 18:13:15.813067 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806184 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 18:13:15.813067 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806187 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 18:13:15.813067 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806189 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 18:13:15.813067 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806192 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 18:13:15.813067 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806194 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 18:13:15.813067 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806196 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 18:13:15.813067 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806199 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 18:13:15.813067 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806201 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 18:13:15.813067 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806204 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 18:13:15.813067 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806206 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 18:13:15.813772 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806208 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 18:13:15.813772 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806211 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 18:13:15.813772 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806214 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 18:13:15.813772 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806216 2567 feature_gate.go:328] unrecognized feature gate: Example May 21 18:13:15.813772 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806219 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 18:13:15.813772 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806221 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 18:13:15.813772 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806224 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 18:13:15.813772 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806227 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 18:13:15.813772 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806229 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 18:13:15.813772 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806231 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 18:13:15.813772 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806235 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 18:13:15.813772 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806237 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 18:13:15.813772 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806240 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 18:13:15.813772 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806244 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 18:13:15.813772 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806247 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 18:13:15.813772 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806249 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 18:13:15.813772 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806252 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 18:13:15.813772 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806255 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 18:13:15.813772 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806257 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 18:13:15.814551 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806259 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 18:13:15.814551 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806262 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 18:13:15.814551 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806264 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 18:13:15.814551 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806267 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 18:13:15.814551 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806269 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 18:13:15.814551 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806272 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 18:13:15.814551 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.806274 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 18:13:15.814551 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.807784 2567 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 18:13:15.816472 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.816451 2567 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 21 18:13:15.816472 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.816473 2567 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 21 18:13:15.816632 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816541 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 18:13:15.816632 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816548 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 18:13:15.816632 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816552 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 18:13:15.816632 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816557 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 18:13:15.816632 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816561 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 18:13:15.816632 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816567 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 18:13:15.816632 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816586 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 18:13:15.816632 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816591 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 18:13:15.816632 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816595 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 18:13:15.816632 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816599 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 18:13:15.816632 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816606 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 18:13:15.816632 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816612 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 18:13:15.816632 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816617 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 18:13:15.816632 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816623 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 18:13:15.816632 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816627 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 18:13:15.816632 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816631 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 18:13:15.816632 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816635 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 18:13:15.816632 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816639 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 18:13:15.816632 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816643 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 18:13:15.817449 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816649 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 18:13:15.817449 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816655 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 18:13:15.817449 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816659 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 18:13:15.817449 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816664 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 18:13:15.817449 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816668 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 18:13:15.817449 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816672 2567 feature_gate.go:328] unrecognized feature gate: Example May 21 18:13:15.817449 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816677 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 18:13:15.817449 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816681 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 18:13:15.817449 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816684 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 18:13:15.817449 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816689 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 18:13:15.817449 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816692 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 18:13:15.817449 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816696 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 18:13:15.817449 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816701 2567 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 18:13:15.817449 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816705 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 18:13:15.817449 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816709 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 18:13:15.817449 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816713 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 18:13:15.817449 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816716 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 18:13:15.817449 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816721 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 18:13:15.817449 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816724 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 18:13:15.817449 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816728 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 18:13:15.818006 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816732 2567 feature_gate.go:328] unrecognized feature gate: Example2 May 21 18:13:15.818006 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816736 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 18:13:15.818006 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816740 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 18:13:15.818006 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816743 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 18:13:15.818006 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816747 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 18:13:15.818006 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816751 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 18:13:15.818006 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816755 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 18:13:15.818006 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816760 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 18:13:15.818006 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816765 2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 18:13:15.818006 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816768 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 18:13:15.818006 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816772 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 18:13:15.818006 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816777 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 18:13:15.818006 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816781 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 18:13:15.818006 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816785 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 18:13:15.818006 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816789 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 18:13:15.818006 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816793 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 18:13:15.818006 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816797 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 18:13:15.818006 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816802 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 18:13:15.818006 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816806 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 18:13:15.818006 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816810 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 18:13:15.818522 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816815 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 18:13:15.818522 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816818 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 18:13:15.818522 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816822 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 18:13:15.818522 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816826 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 18:13:15.818522 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816830 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 18:13:15.818522 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816835 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 18:13:15.818522 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816839 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 18:13:15.818522 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816843 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 18:13:15.818522 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816848 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 18:13:15.818522 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816852 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 18:13:15.818522 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816856 2567 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 18:13:15.818522 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816859 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 18:13:15.818522 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816863 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 18:13:15.818522 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816867 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 18:13:15.818522 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816872 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 18:13:15.818522 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816876 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 18:13:15.818522 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816880 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 18:13:15.818522 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816884 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 18:13:15.818522 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816888 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 18:13:15.818522 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816892 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 18:13:15.819106 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816897 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 18:13:15.819106 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816901 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 18:13:15.819106 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816905 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 18:13:15.819106 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816909 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 18:13:15.819106 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816913 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 18:13:15.819106 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816919 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 18:13:15.819106 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.816923 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 18:13:15.819106 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.816930 2567 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 18:13:15.819106 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817083 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 18:13:15.819106 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817090 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 18:13:15.819106 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817094 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 18:13:15.819106 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817098 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 18:13:15.819106 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817102 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 18:13:15.819106 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817106 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 18:13:15.819106 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817110 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 18:13:15.819848 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817114 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 18:13:15.819848 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817118 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 18:13:15.819848 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817122 2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 18:13:15.819848 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817126 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 18:13:15.819848 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817130 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 18:13:15.819848 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817135 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 18:13:15.819848 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817139 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 18:13:15.819848 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817143 2567 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 18:13:15.819848 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817147 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 18:13:15.819848 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817151 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 18:13:15.819848 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817155 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 18:13:15.819848 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817159 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 18:13:15.819848 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817163 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 18:13:15.819848 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817167 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 18:13:15.819848 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817171 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 18:13:15.819848 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817175 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 18:13:15.819848 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817179 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 18:13:15.819848 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817183 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 18:13:15.819848 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817188 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 18:13:15.819848 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817191 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 18:13:15.820644 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817195 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 18:13:15.820644 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817199 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 18:13:15.820644 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817204 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 18:13:15.820644 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817208 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 18:13:15.820644 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817212 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 18:13:15.820644 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817216 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 18:13:15.820644 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817220 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 18:13:15.820644 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817224 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 18:13:15.820644 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817228 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 18:13:15.820644 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817232 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 18:13:15.820644 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817235 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 18:13:15.820644 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817240 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 18:13:15.820644 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817244 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 18:13:15.820644 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817248 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 18:13:15.820644 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817252 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 18:13:15.820644 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817256 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 18:13:15.820644 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817259 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 18:13:15.820644 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817263 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 18:13:15.820644 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817268 2567 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 18:13:15.820644 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817272 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 18:13:15.821484 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817275 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 18:13:15.821484 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817279 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 18:13:15.821484 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817283 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 18:13:15.821484 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817287 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 18:13:15.821484 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817291 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 18:13:15.821484 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817296 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 18:13:15.821484 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817300 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 18:13:15.821484 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817304 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 18:13:15.821484 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817308 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 18:13:15.821484 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817312 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 18:13:15.821484 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817316 2567 feature_gate.go:328] unrecognized feature gate: Example May 21 18:13:15.821484 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817321 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 18:13:15.821484 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817325 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 18:13:15.821484 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817329 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 18:13:15.821484 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817333 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 18:13:15.821484 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817337 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 18:13:15.821484 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817341 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 18:13:15.821484 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817345 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 18:13:15.821484 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817348 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 18:13:15.821484 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817352 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 18:13:15.822015 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817356 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 18:13:15.822015 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817360 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 18:13:15.822015 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817364 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 18:13:15.822015 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817368 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 18:13:15.822015 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817372 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 18:13:15.822015 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817376 2567 feature_gate.go:328] unrecognized feature gate: Example2 May 21 18:13:15.822015 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817380 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 18:13:15.822015 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817384 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 18:13:15.822015 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817388 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 18:13:15.822015 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817392 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 18:13:15.822015 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817396 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 18:13:15.822015 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817400 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 18:13:15.822015 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817405 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 18:13:15.822015 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817412 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 18:13:15.822015 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817418 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 18:13:15.822015 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817423 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 18:13:15.822015 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817430 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 18:13:15.822015 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817434 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 18:13:15.822015 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:15.817439 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 18:13:15.822512 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.817446 2567 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 18:13:15.822512 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.818419 2567 server.go:962] "Client rotation is on, will bootstrap in background" May 21 18:13:15.822512 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.822094 2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 21 18:13:15.823142 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.823130 2567 server.go:1019] "Starting client certificate rotation" May 21 18:13:15.823243 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.823226 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 18:13:15.823276 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.823257 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 18:13:15.850701 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.850681 2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 18:13:15.852647 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.852624 2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 18:13:15.868547 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.868526 2567 log.go:25] "Validated CRI v1 runtime API" May 21 18:13:15.874953 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.874936 2567 log.go:25] "Validated CRI v1 image API" May 21 18:13:15.876246 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.876228 2567 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 21 18:13:15.879944 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.879927 2567 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 18:13:15.880515 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.880499 2567 fs.go:135] Filesystem UUIDs: map[137d93ec-2e2a-4537-b657-8e9fd6dbe2b0:/dev/nvme0n1p3 5e5415e8-08b7-4be6-b5c2-519d96b293bd:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] May 21 18:13:15.880551 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.880517 2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 21 18:13:15.886493 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.886384 2567 manager.go:217] Machine: {Timestamp:2026-05-21 18:13:15.884692144 +0000 UTC m=+0.470178574 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3199470 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d9bbf3ea24848d388a1ef4c82df84 SystemUUID:ec2d9bbf-3ea2-4848-d388-a1ef4c82df84 BootID:7adab172-cfaa-48f4-abea-407b8ea958ea Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0d:91:ff:b3:21 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0d:91:ff:b3:21 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c6:f1:bf:34:e4:0b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 21 18:13:15.887525 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.887514 2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 21 18:13:15.887652 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.887640 2567 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 21 18:13:15.889729 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.889701 2567 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 21 18:13:15.889862 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.889731 2567 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-59.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 21 18:13:15.889907 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.889871 2567 topology_manager.go:138] "Creating topology manager with none policy" May 21 18:13:15.889907 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.889880 2567 container_manager_linux.go:306] "Creating device plugin manager" May 21 18:13:15.889907 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.889887 2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 18:13:15.890430 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.890420 2567 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 18:13:15.892290 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.892279 2567 state_mem.go:36] "Initialized new in-memory state store" May 21 18:13:15.892545 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.892536 2567 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 21 18:13:15.895290 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.895281 2567 kubelet.go:491] "Attempting to sync node with API server" May 21 18:13:15.895328 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.895295 2567 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 21 18:13:15.895328 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.895307 2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 21 18:13:15.895328 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.895316 2567 kubelet.go:397] "Adding apiserver pod source" May 21 18:13:15.895328 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.895324 2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 21 18:13:15.896840 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.896820 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 18:13:15.896840 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.896840 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 18:13:15.900143 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.900126 2567 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 21 18:13:15.902007 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.901989 2567 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 21 18:13:15.903598 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.903569 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 21 18:13:15.903665 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.903607 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 21 18:13:15.903665 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.903616 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 21 18:13:15.903665 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.903624 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 21 18:13:15.903665 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.903635 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 21 18:13:15.903665 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.903645 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 21 18:13:15.903665 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.903654 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 21 18:13:15.903665 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.903663 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 21 18:13:15.903894 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.903678 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 21 18:13:15.903894 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.903688 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 21 18:13:15.903894 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.903700 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 21 18:13:15.903894 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.903709 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 21 18:13:15.904611 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.904600 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 21 18:13:15.904673 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.904614 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 21 18:13:15.907194 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.907172 2567 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-59.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 21 18:13:15.907761 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:15.907733 2567 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-59.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 21 18:13:15.907761 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:15.907735 2567 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 21 18:13:15.909013 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.909000 2567 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 21 18:13:15.909068 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.909037 2567 server.go:1295] "Started kubelet" May 21 18:13:15.909162 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.909130 2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 21 18:13:15.909203 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.909123 2567 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 21 18:13:15.909757 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.909608 2567 server_v1.go:47] "podresources" method="list" useActivePods=true May 21 18:13:15.909868 ip-10-0-141-59 systemd[1]: Started Kubernetes Kubelet. May 21 18:13:15.912431 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.912417 2567 server.go:317] "Adding debug handlers to kubelet server" May 21 18:13:15.912783 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.912769 2567 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 21 18:13:15.917932 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.917912 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 21 18:13:15.919117 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.919101 2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 21 18:13:15.919541 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.919293 2567 volume_manager.go:295] "The desired_state_of_world populator starts" May 21 18:13:15.919541 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.919310 2567 volume_manager.go:297] "Starting Kubelet Volume Manager" May 21 18:13:15.919541 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.919346 2567 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 21 18:13:15.919541 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.919400 2567 reconstruct.go:97] "Volume reconstruction finished" May 21 18:13:15.919541 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.919412 2567 reconciler.go:26] "Reconciler: start to sync state" May 21 18:13:15.919867 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:15.919735 2567 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 21 18:13:15.919867 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.919853 2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 21 18:13:15.919939 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.919869 2567 factory.go:55] Registering systemd factory May 21 18:13:15.919939 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.919879 2567 factory.go:223] Registration of the systemd container factory successfully May 21 18:13:15.920107 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.920092 2567 factory.go:153] Registering CRI-O factory May 21 18:13:15.920166 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.920109 2567 factory.go:223] Registration of the crio container factory successfully May 21 18:13:15.920166 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.920122 2567 factory.go:103] Registering Raw factory May 21 18:13:15.920166 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.920131 2567 manager.go:1196] Started watching for new ooms in manager May 21 18:13:15.920442 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:15.920414 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-59.ec2.internal\" not found" May 21 18:13:15.921597 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.920952 2567 manager.go:319] Starting recovery of all containers May 21 18:13:15.921994 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.921969 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wb6vx" May 21 18:13:15.924271 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:15.924239 2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-59.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 21 18:13:15.924358 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:15.924326 2567 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 21 18:13:15.930630 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.930605 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wb6vx" May 21 18:13:15.930705 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:15.924491 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-59.ec2.internal.18b1a73a22090079 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-59.ec2.internal,UID:ip-10-0-141-59.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-59.ec2.internal,},FirstTimestamp:2026-05-21 18:13:15.909013625 +0000 UTC m=+0.494500051,LastTimestamp:2026-05-21 18:13:15.909013625 +0000 UTC m=+0.494500051,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-59.ec2.internal,}" May 21 18:13:15.934101 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.934083 2567 manager.go:324] Recovery completed May 21 18:13:15.938028 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.938017 2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 18:13:15.939844 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.939828 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasSufficientMemory" May 21 18:13:15.939909 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.939861 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasNoDiskPressure" May 21 18:13:15.939909 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.939874 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasSufficientPID" May 21 18:13:15.940380 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.940362 2567 cpu_manager.go:222] "Starting CPU manager" policy="none" May 21 18:13:15.940380 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.940377 2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 21 18:13:15.940468 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.940398 2567 state_mem.go:36] "Initialized new in-memory state store" May 21 18:13:15.941960 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:15.941892 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-59.ec2.internal.18b1a73a23df74ce default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-59.ec2.internal,UID:ip-10-0-141-59.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-59.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-59.ec2.internal,},FirstTimestamp:2026-05-21 18:13:15.939845326 +0000 UTC m=+0.525331751,LastTimestamp:2026-05-21 18:13:15.939845326 +0000 UTC m=+0.525331751,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-59.ec2.internal,}" May 21 18:13:15.942933 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.942921 2567 policy_none.go:49] "None policy: Start" May 21 18:13:15.942982 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.942937 2567 memory_manager.go:186] "Starting memorymanager" policy="None" May 21 18:13:15.942982 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.942947 2567 state_mem.go:35] "Initializing new in-memory state store" May 21 18:13:15.983462 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.977394 2567 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 21 18:13:15.983462 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.978624 2567 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 21 18:13:15.983462 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.978642 2567 status_manager.go:230] "Starting to sync pod status with apiserver" May 21 18:13:15.983462 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.978659 2567 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 21 18:13:15.983462 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.978665 2567 kubelet.go:2451] "Starting kubelet main sync loop" May 21 18:13:15.983462 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:15.978698 2567 kubelet.go:2475] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" May 21 18:13:15.983462 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.980545 2567 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 18:13:15.985157 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.985144 2567 manager.go:341] "Starting Device Plugin manager" May 21 18:13:15.985224 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:15.985212 2567 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 21 18:13:15.985277 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.985224 2567 server.go:85] "Starting device plugin registration server" May 21 18:13:15.985490 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.985477 2567 eviction_manager.go:189] "Eviction manager: starting control loop" May 21 18:13:15.985539 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.985495 2567 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 21 18:13:15.985642 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.985621 2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 21 18:13:15.985744 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.985703 2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 21 18:13:15.985744 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:15.985712 2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 21 18:13:15.986134 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:15.986114 2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 21 18:13:15.986193 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:15.986159 2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-59.ec2.internal\" not found" May 21 18:13:16.079021 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:16.078943 2567 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-59.ec2.internal"] May 21 18:13:16.079021 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:16.079020 2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 18:13:16.080071 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:16.080057 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasSufficientMemory" May 21 18:13:16.080160 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:16.080084 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasNoDiskPressure" May 21 18:13:16.080160 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:16.080093 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasSufficientPID" May 21 18:13:16.081496 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:16.081483 2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 18:13:16.081642 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:16.081622 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal" May 21 18:13:16.081682 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:16.081651 2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 18:13:16.082184 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:16.082160 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasSufficientMemory" May 21 18:13:16.082291 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:16.082192 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasNoDiskPressure" May 21 18:13:16.082291 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:16.082205 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasSufficientPID" May 21 18:13:16.082291 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:16.082163 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasSufficientMemory" May 21 18:13:16.082291 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:16.082265 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasNoDiskPressure" May 21 18:13:16.082291 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:16.082276 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasSufficientPID" May 21 18:13:16.083330 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:16.083317 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-59.ec2.internal" May 21 18:13:16.083383 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:16.083342 2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 18:13:16.083984 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:16.083970 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasSufficientMemory" May 21 18:13:16.084089 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:16.083997 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasNoDiskPressure" May 21 18:13:16.084089 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:16.084010 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasSufficientPID" May 21 18:13:16.086248 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:16.086235 2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 18:13:16.086836 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:16.086814 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasSufficientMemory" May 21 18:13:16.086916 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:16.086848 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasNoDiskPressure" May 21 18:13:16.086916 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:16.086864 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasSufficientPID" May 21 18:13:16.086916 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:16.086887 2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-59.ec2.internal" May 21 18:13:16.094796 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:16.094779 2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-59.ec2.internal" May 21 18:13:16.094871 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:16.094801 2567 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-59.ec2.internal\": node \"ip-10-0-141-59.ec2.internal\" not found" May 21 18:13:16.113135 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:16.113119 2567 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-59.ec2.internal\" not found" node="ip-10-0-141-59.ec2.internal" May 21 18:13:16.115875 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:16.115819 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-59.ec2.internal\" not found" May 21 18:13:16.117503 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:16.117489 2567 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-59.ec2.internal\" not found" node="ip-10-0-141-59.ec2.internal" May 21 18:13:16.119897 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:16.119881 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c74b687aae66fdce85b9519c288ee8b1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal\" (UID: \"c74b687aae66fdce85b9519c288ee8b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal" May 21 18:13:16.120009 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:16.119911 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c74b687aae66fdce85b9519c288ee8b1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal\" (UID: \"c74b687aae66fdce85b9519c288ee8b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal" May 21 18:13:16.120009 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:16.119937 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/865c2e3735c54eea4d9ac88d1c24d330-config\") pod \"kube-apiserver-proxy-ip-10-0-141-59.ec2.internal\" (UID: \"865c2e3735c54eea4d9ac88d1c24d330\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-59.ec2.internal" May 21 18:13:16.216102 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:16.216073 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-59.ec2.internal\" not found" May 21 18:13:16.220288 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:16.220273 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c74b687aae66fdce85b9519c288ee8b1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal\" (UID: \"c74b687aae66fdce85b9519c288ee8b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal" May 21 18:13:16.220371 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:16.220297 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c74b687aae66fdce85b9519c288ee8b1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal\" (UID: \"c74b687aae66fdce85b9519c288ee8b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal" May 21 18:13:16.220371 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:16.220313 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/865c2e3735c54eea4d9ac88d1c24d330-config\") pod \"kube-apiserver-proxy-ip-10-0-141-59.ec2.internal\" (UID: \"865c2e3735c54eea4d9ac88d1c24d330\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-59.ec2.internal" May 21 18:13:16.220371 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:16.220353 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/865c2e3735c54eea4d9ac88d1c24d330-config\") pod \"kube-apiserver-proxy-ip-10-0-141-59.ec2.internal\" (UID: \"865c2e3735c54eea4d9ac88d1c24d330\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-59.ec2.internal" May 21 18:13:16.220371 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:16.220354 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c74b687aae66fdce85b9519c288ee8b1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal\" (UID: \"c74b687aae66fdce85b9519c288ee8b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal" May 21 18:13:16.220371 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:16.220356 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c74b687aae66fdce85b9519c288ee8b1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal\" (UID: \"c74b687aae66fdce85b9519c288ee8b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal" May 21 18:13:16.316375 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:16.316345 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-59.ec2.internal\" not found" May 21 18:13:16.416087 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:16.416010 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal" May 21 18:13:16.416500 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:16.416471 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-59.ec2.internal\" not found" May 21 18:13:16.419872 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:16.419853 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-59.ec2.internal" May 21 18:13:16.517147 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:16.517111 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-59.ec2.internal\" not found" May 21 18:13:16.617566 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:16.617540 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-59.ec2.internal\" not found" May 21 18:13:16.718215 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:16.718134 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-59.ec2.internal\" not found" May 21 18:13:16.818649 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:16.818616 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-59.ec2.internal\" not found" May 21 18:13:16.822825 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:16.822812 2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 21 18:13:16.822966 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:16.822943 2567 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 18:13:16.918044 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:16.918012 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 21 18:13:16.919107 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:16.919091 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-59.ec2.internal\" not found" May 21 18:13:16.930123 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:16.930100 2567 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 18:13:16.932615 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:16.932591 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 18:08:15 +0000 UTC" deadline="2028-02-28 14:50:44.939775784 +0000 UTC" May 21 18:13:16.932615 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:16.932612 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15548h37m28.007166113s" May 21 18:13:16.956695 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:16.956673 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5j4bz" May 21 18:13:16.962366 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:16.962350 2567 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 21 18:13:16.963097 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:16.963082 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5j4bz" May 21 18:13:17.019989 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:17.019929 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-59.ec2.internal\" not found" May 21 18:13:17.054823 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:17.054776 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod865c2e3735c54eea4d9ac88d1c24d330.slice/crio-2961b4734ef800c4d838e541cb6b6be316405f337e7c845fd54d7246268793f2 WatchSource:0}: Error finding container 2961b4734ef800c4d838e541cb6b6be316405f337e7c845fd54d7246268793f2: Status 404 returned error can't find the container with id 2961b4734ef800c4d838e541cb6b6be316405f337e7c845fd54d7246268793f2 May 21 18:13:17.055015 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:17.055000 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc74b687aae66fdce85b9519c288ee8b1.slice/crio-9cf01c680e47f7abd6d393ee862b1d121298c8bdf55074796453e4ca743f9cb5 WatchSource:0}: Error finding container 9cf01c680e47f7abd6d393ee862b1d121298c8bdf55074796453e4ca743f9cb5: Status 404 returned error can't find the container with id 9cf01c680e47f7abd6d393ee862b1d121298c8bdf55074796453e4ca743f9cb5 May 21 18:13:17.060441 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.060395 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 18:13:17.117918 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.117892 2567 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 18:13:17.119985 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:17.119970 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-59.ec2.internal\" not found" May 21 18:13:17.220298 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:17.220263 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-59.ec2.internal\" not found" May 21 18:13:17.320790 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:17.320703 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-59.ec2.internal\" not found" May 21 18:13:17.334224 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.334205 2567 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 21 18:13:17.419462 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.419438 2567 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal" May 21 18:13:17.431149 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.431130 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 18:13:17.432263 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.432251 2567 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-59.ec2.internal" May 21 18:13:17.441159 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.441146 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 18:13:17.896740 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.896708 2567 apiserver.go:52] "Watching apiserver" May 21 18:13:17.903858 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.903830 2567 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 21 18:13:17.905464 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.905434 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-2n5jr","kube-system/konnectivity-agent-l82nt","kube-system/kube-apiserver-proxy-ip-10-0-141-59.ec2.internal","openshift-cluster-node-tuning-operator/tuned-5wfjk","openshift-dns/node-resolver-6h54k","openshift-image-registry/node-ca-fwkk2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal","openshift-multus/network-metrics-daemon-lk2c6","openshift-network-diagnostics/network-check-target-qfkc7","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnfz9","openshift-multus/multus-additional-cni-plugins-jx9sz","openshift-multus/multus-zkz67","openshift-network-operator/iptables-alerter-xzwnx"] May 21 18:13:17.907536 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.907483 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnfz9" May 21 18:13:17.908945 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.908925 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l82nt" May 21 18:13:17.910309 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.910288 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 21 18:13:17.910717 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.910522 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 21 18:13:17.910717 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.910540 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 21 18:13:17.910717 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.910614 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pskrn\"" May 21 18:13:17.911609 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.911271 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 21 18:13:17.911609 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.911351 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4r8nq\"" May 21 18:13:17.911609 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.911466 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 21 18:13:17.911609 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.911549 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5wfjk" May 21 18:13:17.913048 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.913031 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6h54k" May 21 18:13:17.913707 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.913687 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 21 18:13:17.913962 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.913940 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4lt6f\"" May 21 18:13:17.914203 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.914185 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 21 18:13:17.914772 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.914713 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fwkk2" May 21 18:13:17.915682 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.915442 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7kd5p\"" May 21 18:13:17.915788 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.915723 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 21 18:13:17.915952 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.915934 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 21 18:13:17.916051 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.916033 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfkc7" May 21 18:13:17.916117 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:17.916098 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfkc7" podUID="96d08281-69d3-4a00-ba5c-74771da205d3" May 21 18:13:17.916307 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.916290 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk2c6" May 21 18:13:17.916375 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:17.916344 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk2c6" podUID="80ec104c-46e1-4fb3-a8bc-f5664e798321" May 21 18:13:17.916672 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.916652 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 21 18:13:17.916898 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.916867 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7jkmh\"" May 21 18:13:17.917027 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.917010 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 21 18:13:17.917135 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.917118 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 21 18:13:17.920037 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.920018 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jx9sz" May 21 18:13:17.921943 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.921828 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:17.922204 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.922185 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 21 18:13:17.922503 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.922484 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 21 18:13:17.922615 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.922597 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 21 18:13:17.922708 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.922685 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 21 18:13:17.922918 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.922902 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hwvp9\"" May 21 18:13:17.923033 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.923016 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 21 18:13:17.923467 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.923450 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zkz67" May 21 18:13:17.923546 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.923460 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xzwnx" May 21 18:13:17.929027 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.924895 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 21 18:13:17.929027 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.926176 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 21 18:13:17.929027 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.926665 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 21 18:13:17.929027 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.927002 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 21 18:13:17.929027 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.927515 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ttvzl\"" May 21 18:13:17.929027 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.927541 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 21 18:13:17.929027 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.927655 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 21 18:13:17.929027 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.927803 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 21 18:13:17.929027 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.928046 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79474071-9b7b-4d06-b70e-c65abde6fc43-var-lib-kubelet\") pod \"tuned-5wfjk\" (UID: \"79474071-9b7b-4d06-b70e-c65abde6fc43\") " pod="openshift-cluster-node-tuning-operator/tuned-5wfjk" May 21 18:13:17.929027 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.928073 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whndp\" (UniqueName: \"kubernetes.io/projected/d9537e64-5ba3-4910-998c-e9d3deb97929-kube-api-access-whndp\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:17.929027 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.928112 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/868c9a60-0d4e-4bda-9e1d-8c1087daa9e5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jx9sz\" (UID: \"868c9a60-0d4e-4bda-9e1d-8c1087daa9e5\") " pod="openshift-multus/multus-additional-cni-plugins-jx9sz" May 21 18:13:17.929027 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.928138 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4b6958b0-ec19-4342-80d1-162637b9dd34-socket-dir\") pod \"aws-ebs-csi-driver-node-mnfz9\" (UID: \"4b6958b0-ec19-4342-80d1-162637b9dd34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnfz9" May 21 18:13:17.929027 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.928157 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/79474071-9b7b-4d06-b70e-c65abde6fc43-run\") pod \"tuned-5wfjk\" (UID: \"79474071-9b7b-4d06-b70e-c65abde6fc43\") " pod="openshift-cluster-node-tuning-operator/tuned-5wfjk" May 21 18:13:17.929027 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.928172 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/79474071-9b7b-4d06-b70e-c65abde6fc43-etc-tuned\") pod \"tuned-5wfjk\" (UID: \"79474071-9b7b-4d06-b70e-c65abde6fc43\") " pod="openshift-cluster-node-tuning-operator/tuned-5wfjk" May 21 18:13:17.929027 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.928204 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5v66\" (UniqueName: \"kubernetes.io/projected/e3c0da04-85d7-4c03-8f44-42c8748c4218-kube-api-access-c5v66\") pod \"node-ca-fwkk2\" (UID: \"e3c0da04-85d7-4c03-8f44-42c8748c4218\") " pod="openshift-image-registry/node-ca-fwkk2" May 21 18:13:17.929027 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.928226 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 21 18:13:17.929027 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.928382 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 21 18:13:17.929027 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.928367 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d9537e64-5ba3-4910-998c-e9d3deb97929-node-log\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:17.929027 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.928507 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d9537e64-5ba3-4910-998c-e9d3deb97929-log-socket\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:17.929027 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.928551 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d9537e64-5ba3-4910-998c-e9d3deb97929-etc-openvswitch\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:17.929027 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.928614 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d9537e64-5ba3-4910-998c-e9d3deb97929-ovnkube-script-lib\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:17.929027 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.928644 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4b6958b0-ec19-4342-80d1-162637b9dd34-registration-dir\") pod \"aws-ebs-csi-driver-node-mnfz9\" (UID: \"4b6958b0-ec19-4342-80d1-162637b9dd34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnfz9" May 21 18:13:17.930069 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.928827 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/79474071-9b7b-4d06-b70e-c65abde6fc43-etc-sysconfig\") pod \"tuned-5wfjk\" (UID: \"79474071-9b7b-4d06-b70e-c65abde6fc43\") " pod="openshift-cluster-node-tuning-operator/tuned-5wfjk" May 21 18:13:17.930069 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.928867 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/79474071-9b7b-4d06-b70e-c65abde6fc43-etc-sysctl-conf\") pod \"tuned-5wfjk\" (UID: \"79474071-9b7b-4d06-b70e-c65abde6fc43\") " pod="openshift-cluster-node-tuning-operator/tuned-5wfjk" May 21 18:13:17.930069 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.928918 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/79474071-9b7b-4d06-b70e-c65abde6fc43-etc-systemd\") pod \"tuned-5wfjk\" (UID: \"79474071-9b7b-4d06-b70e-c65abde6fc43\") " pod="openshift-cluster-node-tuning-operator/tuned-5wfjk" May 21 18:13:17.930069 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.928974 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5ec61c29-892e-485c-b233-01e2eafa1ff4-agent-certs\") pod \"konnectivity-agent-l82nt\" (UID: \"5ec61c29-892e-485c-b233-01e2eafa1ff4\") " pod="kube-system/konnectivity-agent-l82nt" May 21 18:13:17.930069 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.929003 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d9537e64-5ba3-4910-998c-e9d3deb97929-host-kubelet\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:17.930069 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.929030 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/79474071-9b7b-4d06-b70e-c65abde6fc43-host\") pod \"tuned-5wfjk\" (UID: \"79474071-9b7b-4d06-b70e-c65abde6fc43\") " pod="openshift-cluster-node-tuning-operator/tuned-5wfjk" May 21 18:13:17.930069 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.929058 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d9537e64-5ba3-4910-998c-e9d3deb97929-host-slash\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:17.930069 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.929112 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/868c9a60-0d4e-4bda-9e1d-8c1087daa9e5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jx9sz\" (UID: \"868c9a60-0d4e-4bda-9e1d-8c1087daa9e5\") " pod="openshift-multus/multus-additional-cni-plugins-jx9sz" May 21 18:13:17.930069 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.929156 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4b6958b0-ec19-4342-80d1-162637b9dd34-etc-selinux\") pod \"aws-ebs-csi-driver-node-mnfz9\" (UID: \"4b6958b0-ec19-4342-80d1-162637b9dd34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnfz9" May 21 18:13:17.930069 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.929183 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e3c0da04-85d7-4c03-8f44-42c8748c4218-serviceca\") pod \"node-ca-fwkk2\" (UID: \"e3c0da04-85d7-4c03-8f44-42c8748c4218\") " pod="openshift-image-registry/node-ca-fwkk2" May 21 18:13:17.930069 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.929212 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/806b4e1a-170a-44ac-b356-92e2c2337e02-hosts-file\") pod \"node-resolver-6h54k\" (UID: \"806b4e1a-170a-44ac-b356-92e2c2337e02\") " pod="openshift-dns/node-resolver-6h54k" May 21 18:13:17.930069 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.929231 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d9537e64-5ba3-4910-998c-e9d3deb97929-host-run-netns\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:17.930069 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.929301 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d9537e64-5ba3-4910-998c-e9d3deb97929-host-cni-bin\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:17.930069 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.929344 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj2jw\" (UniqueName: \"kubernetes.io/projected/868c9a60-0d4e-4bda-9e1d-8c1087daa9e5-kube-api-access-dj2jw\") pod \"multus-additional-cni-plugins-jx9sz\" (UID: \"868c9a60-0d4e-4bda-9e1d-8c1087daa9e5\") " pod="openshift-multus/multus-additional-cni-plugins-jx9sz" May 21 18:13:17.930069 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.929379 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4b6958b0-ec19-4342-80d1-162637b9dd34-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mnfz9\" (UID: \"4b6958b0-ec19-4342-80d1-162637b9dd34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnfz9" May 21 18:13:17.930069 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.929410 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e3c0da04-85d7-4c03-8f44-42c8748c4218-host\") pod \"node-ca-fwkk2\" (UID: \"e3c0da04-85d7-4c03-8f44-42c8748c4218\") " pod="openshift-image-registry/node-ca-fwkk2" May 21 18:13:17.930808 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.929492 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d9537e64-5ba3-4910-998c-e9d3deb97929-systemd-units\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:17.930808 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.929537 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d9537e64-5ba3-4910-998c-e9d3deb97929-run-ovn\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:17.930808 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.929787 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/79474071-9b7b-4d06-b70e-c65abde6fc43-lib-modules\") pod \"tuned-5wfjk\" (UID: \"79474071-9b7b-4d06-b70e-c65abde6fc43\") " pod="openshift-cluster-node-tuning-operator/tuned-5wfjk" May 21 18:13:17.930808 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.929838 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d9537e64-5ba3-4910-998c-e9d3deb97929-run-openvswitch\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:17.930808 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.929884 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d9537e64-5ba3-4910-998c-e9d3deb97929-ovn-node-metrics-cert\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:17.930808 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.929938 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/868c9a60-0d4e-4bda-9e1d-8c1087daa9e5-system-cni-dir\") pod \"multus-additional-cni-plugins-jx9sz\" (UID: \"868c9a60-0d4e-4bda-9e1d-8c1087daa9e5\") " pod="openshift-multus/multus-additional-cni-plugins-jx9sz" May 21 18:13:17.930808 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.929972 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjrd9\" (UniqueName: \"kubernetes.io/projected/4b6958b0-ec19-4342-80d1-162637b9dd34-kube-api-access-kjrd9\") pod \"aws-ebs-csi-driver-node-mnfz9\" (UID: \"4b6958b0-ec19-4342-80d1-162637b9dd34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnfz9" May 21 18:13:17.930808 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.930048 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/806b4e1a-170a-44ac-b356-92e2c2337e02-tmp-dir\") pod \"node-resolver-6h54k\" (UID: \"806b4e1a-170a-44ac-b356-92e2c2337e02\") " pod="openshift-dns/node-resolver-6h54k" May 21 18:13:17.930808 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.930118 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5ec61c29-892e-485c-b233-01e2eafa1ff4-konnectivity-ca\") pod \"konnectivity-agent-l82nt\" (UID: \"5ec61c29-892e-485c-b233-01e2eafa1ff4\") " pod="kube-system/konnectivity-agent-l82nt" May 21 18:13:17.930808 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.930151 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/868c9a60-0d4e-4bda-9e1d-8c1087daa9e5-os-release\") pod \"multus-additional-cni-plugins-jx9sz\" (UID: \"868c9a60-0d4e-4bda-9e1d-8c1087daa9e5\") " pod="openshift-multus/multus-additional-cni-plugins-jx9sz" May 21 18:13:17.930808 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.930212 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79474071-9b7b-4d06-b70e-c65abde6fc43-tmp\") pod \"tuned-5wfjk\" (UID: \"79474071-9b7b-4d06-b70e-c65abde6fc43\") " pod="openshift-cluster-node-tuning-operator/tuned-5wfjk" May 21 18:13:17.930808 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.930281 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7s5gb\" (UniqueName: \"kubernetes.io/projected/79474071-9b7b-4d06-b70e-c65abde6fc43-kube-api-access-7s5gb\") pod \"tuned-5wfjk\" (UID: \"79474071-9b7b-4d06-b70e-c65abde6fc43\") " pod="openshift-cluster-node-tuning-operator/tuned-5wfjk" May 21 18:13:17.930808 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.930314 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ssdb\" (UniqueName: \"kubernetes.io/projected/806b4e1a-170a-44ac-b356-92e2c2337e02-kube-api-access-2ssdb\") pod \"node-resolver-6h54k\" (UID: \"806b4e1a-170a-44ac-b356-92e2c2337e02\") " pod="openshift-dns/node-resolver-6h54k" May 21 18:13:17.930808 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.930340 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d9537e64-5ba3-4910-998c-e9d3deb97929-host-run-ovn-kubernetes\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:17.930808 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.930395 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/868c9a60-0d4e-4bda-9e1d-8c1087daa9e5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jx9sz\" (UID: \"868c9a60-0d4e-4bda-9e1d-8c1087daa9e5\") " pod="openshift-multus/multus-additional-cni-plugins-jx9sz" May 21 18:13:17.930808 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.930502 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80ec104c-46e1-4fb3-a8bc-f5664e798321-metrics-certs\") pod \"network-metrics-daemon-lk2c6\" (UID: \"80ec104c-46e1-4fb3-a8bc-f5664e798321\") " pod="openshift-multus/network-metrics-daemon-lk2c6" May 21 18:13:17.931502 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.930544 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d9537e64-5ba3-4910-998c-e9d3deb97929-run-systemd\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:17.931502 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.930592 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d9537e64-5ba3-4910-998c-e9d3deb97929-var-lib-openvswitch\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:17.931502 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.930731 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d9537e64-5ba3-4910-998c-e9d3deb97929-host-cni-netd\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:17.931502 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.930780 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/79474071-9b7b-4d06-b70e-c65abde6fc43-etc-modprobe-d\") pod \"tuned-5wfjk\" (UID: \"79474071-9b7b-4d06-b70e-c65abde6fc43\") " pod="openshift-cluster-node-tuning-operator/tuned-5wfjk" May 21 18:13:17.931502 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.930812 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/79474071-9b7b-4d06-b70e-c65abde6fc43-etc-sysctl-d\") pod \"tuned-5wfjk\" (UID: \"79474071-9b7b-4d06-b70e-c65abde6fc43\") " pod="openshift-cluster-node-tuning-operator/tuned-5wfjk" May 21 18:13:17.931502 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.930877 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7q6m\" (UniqueName: \"kubernetes.io/projected/96d08281-69d3-4a00-ba5c-74771da205d3-kube-api-access-f7q6m\") pod \"network-check-target-qfkc7\" (UID: \"96d08281-69d3-4a00-ba5c-74771da205d3\") " pod="openshift-network-diagnostics/network-check-target-qfkc7" May 21 18:13:17.931502 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.930942 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d9537e64-5ba3-4910-998c-e9d3deb97929-ovnkube-config\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:17.931502 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.930967 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/868c9a60-0d4e-4bda-9e1d-8c1087daa9e5-cnibin\") pod \"multus-additional-cni-plugins-jx9sz\" (UID: \"868c9a60-0d4e-4bda-9e1d-8c1087daa9e5\") " pod="openshift-multus/multus-additional-cni-plugins-jx9sz" May 21 18:13:17.931502 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.930998 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/868c9a60-0d4e-4bda-9e1d-8c1087daa9e5-cni-binary-copy\") pod \"multus-additional-cni-plugins-jx9sz\" (UID: \"868c9a60-0d4e-4bda-9e1d-8c1087daa9e5\") " pod="openshift-multus/multus-additional-cni-plugins-jx9sz" May 21 18:13:17.931502 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.931058 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4b6958b0-ec19-4342-80d1-162637b9dd34-device-dir\") pod \"aws-ebs-csi-driver-node-mnfz9\" (UID: \"4b6958b0-ec19-4342-80d1-162637b9dd34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnfz9" May 21 18:13:17.931502 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.931127 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g5dd\" (UniqueName: \"kubernetes.io/projected/80ec104c-46e1-4fb3-a8bc-f5664e798321-kube-api-access-9g5dd\") pod \"network-metrics-daemon-lk2c6\" (UID: \"80ec104c-46e1-4fb3-a8bc-f5664e798321\") " pod="openshift-multus/network-metrics-daemon-lk2c6" May 21 18:13:17.931502 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.931159 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d9537e64-5ba3-4910-998c-e9d3deb97929-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:17.931502 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.931185 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d9537e64-5ba3-4910-998c-e9d3deb97929-env-overrides\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:17.931502 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.931214 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4b6958b0-ec19-4342-80d1-162637b9dd34-sys-fs\") pod \"aws-ebs-csi-driver-node-mnfz9\" (UID: \"4b6958b0-ec19-4342-80d1-162637b9dd34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnfz9" May 21 18:13:17.931502 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.931242 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79474071-9b7b-4d06-b70e-c65abde6fc43-etc-kubernetes\") pod \"tuned-5wfjk\" (UID: \"79474071-9b7b-4d06-b70e-c65abde6fc43\") " pod="openshift-cluster-node-tuning-operator/tuned-5wfjk" May 21 18:13:17.931502 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.931276 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/79474071-9b7b-4d06-b70e-c65abde6fc43-sys\") pod \"tuned-5wfjk\" (UID: \"79474071-9b7b-4d06-b70e-c65abde6fc43\") " pod="openshift-cluster-node-tuning-operator/tuned-5wfjk" May 21 18:13:17.932255 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.931526 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 21 18:13:17.932255 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.932237 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rhn4h\"" May 21 18:13:17.932710 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.932693 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-g7bhq\"" May 21 18:13:17.963832 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.963802 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 18:08:16 +0000 UTC" deadline="2028-01-18 18:56:47.893743005 +0000 UTC" May 21 18:13:17.963832 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.963831 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14568h43m29.929915166s" May 21 18:13:17.985200 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.985139 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-59.ec2.internal" event={"ID":"865c2e3735c54eea4d9ac88d1c24d330","Type":"ContainerStarted","Data":"2961b4734ef800c4d838e541cb6b6be316405f337e7c845fd54d7246268793f2"} May 21 18:13:17.986409 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:17.986378 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal" event={"ID":"c74b687aae66fdce85b9519c288ee8b1","Type":"ContainerStarted","Data":"9cf01c680e47f7abd6d393ee862b1d121298c8bdf55074796453e4ca743f9cb5"} May 21 18:13:18.020206 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.020179 2567 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 21 18:13:18.031523 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.031496 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4b6958b0-ec19-4342-80d1-162637b9dd34-registration-dir\") pod \"aws-ebs-csi-driver-node-mnfz9\" (UID: \"4b6958b0-ec19-4342-80d1-162637b9dd34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnfz9" May 21 18:13:18.031523 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.031525 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/79474071-9b7b-4d06-b70e-c65abde6fc43-etc-sysconfig\") pod \"tuned-5wfjk\" (UID: \"79474071-9b7b-4d06-b70e-c65abde6fc43\") " pod="openshift-cluster-node-tuning-operator/tuned-5wfjk" May 21 18:13:18.031706 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.031545 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/79474071-9b7b-4d06-b70e-c65abde6fc43-etc-sysctl-conf\") pod \"tuned-5wfjk\" (UID: \"79474071-9b7b-4d06-b70e-c65abde6fc43\") " pod="openshift-cluster-node-tuning-operator/tuned-5wfjk" May 21 18:13:18.031706 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.031568 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/79474071-9b7b-4d06-b70e-c65abde6fc43-etc-systemd\") pod \"tuned-5wfjk\" (UID: \"79474071-9b7b-4d06-b70e-c65abde6fc43\") " pod="openshift-cluster-node-tuning-operator/tuned-5wfjk" May 21 18:13:18.031706 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.031611 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-host-var-lib-cni-bin\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.031706 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.031635 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4b6958b0-ec19-4342-80d1-162637b9dd34-registration-dir\") pod \"aws-ebs-csi-driver-node-mnfz9\" (UID: \"4b6958b0-ec19-4342-80d1-162637b9dd34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnfz9" May 21 18:13:18.031706 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.031670 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5ec61c29-892e-485c-b233-01e2eafa1ff4-agent-certs\") pod \"konnectivity-agent-l82nt\" (UID: \"5ec61c29-892e-485c-b233-01e2eafa1ff4\") " pod="kube-system/konnectivity-agent-l82nt" May 21 18:13:18.031706 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.031704 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d9537e64-5ba3-4910-998c-e9d3deb97929-host-kubelet\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:18.031935 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.031725 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/79474071-9b7b-4d06-b70e-c65abde6fc43-host\") pod \"tuned-5wfjk\" (UID: \"79474071-9b7b-4d06-b70e-c65abde6fc43\") " pod="openshift-cluster-node-tuning-operator/tuned-5wfjk" May 21 18:13:18.031935 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.031744 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d9537e64-5ba3-4910-998c-e9d3deb97929-host-slash\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:18.031935 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.031778 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/79474071-9b7b-4d06-b70e-c65abde6fc43-etc-sysctl-conf\") pod \"tuned-5wfjk\" (UID: \"79474071-9b7b-4d06-b70e-c65abde6fc43\") " pod="openshift-cluster-node-tuning-operator/tuned-5wfjk" May 21 18:13:18.031935 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.031826 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d9537e64-5ba3-4910-998c-e9d3deb97929-host-slash\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:18.032113 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.031968 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/868c9a60-0d4e-4bda-9e1d-8c1087daa9e5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jx9sz\" (UID: \"868c9a60-0d4e-4bda-9e1d-8c1087daa9e5\") " pod="openshift-multus/multus-additional-cni-plugins-jx9sz" May 21 18:13:18.032113 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.031980 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/79474071-9b7b-4d06-b70e-c65abde6fc43-host\") pod \"tuned-5wfjk\" (UID: \"79474071-9b7b-4d06-b70e-c65abde6fc43\") " pod="openshift-cluster-node-tuning-operator/tuned-5wfjk" May 21 18:13:18.032113 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.031972 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d9537e64-5ba3-4910-998c-e9d3deb97929-host-kubelet\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:18.032113 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.032009 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4b6958b0-ec19-4342-80d1-162637b9dd34-etc-selinux\") pod \"aws-ebs-csi-driver-node-mnfz9\" (UID: \"4b6958b0-ec19-4342-80d1-162637b9dd34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnfz9" May 21 18:13:18.032113 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.032013 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/79474071-9b7b-4d06-b70e-c65abde6fc43-etc-systemd\") pod \"tuned-5wfjk\" (UID: \"79474071-9b7b-4d06-b70e-c65abde6fc43\") " pod="openshift-cluster-node-tuning-operator/tuned-5wfjk" May 21 18:13:18.032113 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.032052 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/79474071-9b7b-4d06-b70e-c65abde6fc43-etc-sysconfig\") pod \"tuned-5wfjk\" (UID: \"79474071-9b7b-4d06-b70e-c65abde6fc43\") " pod="openshift-cluster-node-tuning-operator/tuned-5wfjk" May 21 18:13:18.032113 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.032096 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4b6958b0-ec19-4342-80d1-162637b9dd34-etc-selinux\") pod \"aws-ebs-csi-driver-node-mnfz9\" (UID: \"4b6958b0-ec19-4342-80d1-162637b9dd34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnfz9" May 21 18:13:18.032113 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.032101 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e3c0da04-85d7-4c03-8f44-42c8748c4218-serviceca\") pod \"node-ca-fwkk2\" (UID: \"e3c0da04-85d7-4c03-8f44-42c8748c4218\") " pod="openshift-image-registry/node-ca-fwkk2" May 21 18:13:18.032458 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.032149 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/868c9a60-0d4e-4bda-9e1d-8c1087daa9e5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jx9sz\" (UID: \"868c9a60-0d4e-4bda-9e1d-8c1087daa9e5\") " pod="openshift-multus/multus-additional-cni-plugins-jx9sz" May 21 18:13:18.032458 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.032156 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/806b4e1a-170a-44ac-b356-92e2c2337e02-hosts-file\") pod \"node-resolver-6h54k\" (UID: \"806b4e1a-170a-44ac-b356-92e2c2337e02\") " pod="openshift-dns/node-resolver-6h54k" May 21 18:13:18.032458 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.032197 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d9537e64-5ba3-4910-998c-e9d3deb97929-host-run-netns\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:18.032458 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.032217 2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 21 18:13:18.032458 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.032281 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d9537e64-5ba3-4910-998c-e9d3deb97929-host-cni-bin\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:18.032458 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.032296 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d9537e64-5ba3-4910-998c-e9d3deb97929-host-run-netns\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:18.032458 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.032311 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dj2jw\" (UniqueName: \"kubernetes.io/projected/868c9a60-0d4e-4bda-9e1d-8c1087daa9e5-kube-api-access-dj2jw\") pod \"multus-additional-cni-plugins-jx9sz\" (UID: \"868c9a60-0d4e-4bda-9e1d-8c1087daa9e5\") " pod="openshift-multus/multus-additional-cni-plugins-jx9sz" May 21 18:13:18.032458 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.032333 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d9537e64-5ba3-4910-998c-e9d3deb97929-host-cni-bin\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:18.032458 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.032343 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4b6958b0-ec19-4342-80d1-162637b9dd34-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mnfz9\" (UID: \"4b6958b0-ec19-4342-80d1-162637b9dd34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnfz9" May 21 18:13:18.032458 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.032384 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4b6958b0-ec19-4342-80d1-162637b9dd34-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mnfz9\" (UID: \"4b6958b0-ec19-4342-80d1-162637b9dd34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnfz9" May 21 18:13:18.032458 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.032402 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e3c0da04-85d7-4c03-8f44-42c8748c4218-host\") pod \"node-ca-fwkk2\" (UID: \"e3c0da04-85d7-4c03-8f44-42c8748c4218\") " pod="openshift-image-registry/node-ca-fwkk2" May 21 18:13:18.032963 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.032479 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-multus-cni-dir\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.032963 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.032501 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e3c0da04-85d7-4c03-8f44-42c8748c4218-host\") pod \"node-ca-fwkk2\" (UID: \"e3c0da04-85d7-4c03-8f44-42c8748c4218\") " pod="openshift-image-registry/node-ca-fwkk2" May 21 18:13:18.032963 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.032517 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/806b4e1a-170a-44ac-b356-92e2c2337e02-hosts-file\") pod \"node-resolver-6h54k\" (UID: \"806b4e1a-170a-44ac-b356-92e2c2337e02\") " pod="openshift-dns/node-resolver-6h54k" May 21 18:13:18.032963 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.032666 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d9537e64-5ba3-4910-998c-e9d3deb97929-systemd-units\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:18.032963 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.032719 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d9537e64-5ba3-4910-998c-e9d3deb97929-run-ovn\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:18.032963 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.032769 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/79474071-9b7b-4d06-b70e-c65abde6fc43-lib-modules\") pod \"tuned-5wfjk\" (UID: \"79474071-9b7b-4d06-b70e-c65abde6fc43\") " pod="openshift-cluster-node-tuning-operator/tuned-5wfjk" May 21 18:13:18.032963 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.032812 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-cnibin\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.032963 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.032819 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e3c0da04-85d7-4c03-8f44-42c8748c4218-serviceca\") pod \"node-ca-fwkk2\" (UID: \"e3c0da04-85d7-4c03-8f44-42c8748c4218\") " pod="openshift-image-registry/node-ca-fwkk2" May 21 18:13:18.032963 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.032841 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-host-var-lib-kubelet\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.032963 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.032867 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/650efcfa-3258-4d4e-bb7f-4d26aa341842-host-slash\") pod \"iptables-alerter-xzwnx\" (UID: \"650efcfa-3258-4d4e-bb7f-4d26aa341842\") " pod="openshift-network-operator/iptables-alerter-xzwnx" May 21 18:13:18.032963 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.032894 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d9537e64-5ba3-4910-998c-e9d3deb97929-run-openvswitch\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:18.032963 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.032895 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d9537e64-5ba3-4910-998c-e9d3deb97929-systemd-units\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:18.032963 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.032919 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d9537e64-5ba3-4910-998c-e9d3deb97929-ovn-node-metrics-cert\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:18.032963 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.032946 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/868c9a60-0d4e-4bda-9e1d-8c1087daa9e5-system-cni-dir\") pod \"multus-additional-cni-plugins-jx9sz\" (UID: \"868c9a60-0d4e-4bda-9e1d-8c1087daa9e5\") " pod="openshift-multus/multus-additional-cni-plugins-jx9sz" May 21 18:13:18.032963 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.032949 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d9537e64-5ba3-4910-998c-e9d3deb97929-run-ovn\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:18.032963 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.032967 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/79474071-9b7b-4d06-b70e-c65abde6fc43-lib-modules\") pod \"tuned-5wfjk\" (UID: \"79474071-9b7b-4d06-b70e-c65abde6fc43\") " pod="openshift-cluster-node-tuning-operator/tuned-5wfjk" May 21 18:13:18.033594 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.032972 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-system-cni-dir\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.033594 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.033019 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/868c9a60-0d4e-4bda-9e1d-8c1087daa9e5-system-cni-dir\") pod \"multus-additional-cni-plugins-jx9sz\" (UID: \"868c9a60-0d4e-4bda-9e1d-8c1087daa9e5\") " pod="openshift-multus/multus-additional-cni-plugins-jx9sz" May 21 18:13:18.033594 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.033021 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-multus-daemon-config\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.033594 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.033060 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kjrd9\" (UniqueName: \"kubernetes.io/projected/4b6958b0-ec19-4342-80d1-162637b9dd34-kube-api-access-kjrd9\") pod \"aws-ebs-csi-driver-node-mnfz9\" (UID: \"4b6958b0-ec19-4342-80d1-162637b9dd34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnfz9" May 21 18:13:18.033594 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.033079 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d9537e64-5ba3-4910-998c-e9d3deb97929-run-openvswitch\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:18.033594 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.033119 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-host-run-k8s-cni-cncf-io\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.033594 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.033145 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-multus-conf-dir\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.033594 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.033313 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-host-run-multus-certs\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.033594 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.033347 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/806b4e1a-170a-44ac-b356-92e2c2337e02-tmp-dir\") pod \"node-resolver-6h54k\" (UID: \"806b4e1a-170a-44ac-b356-92e2c2337e02\") " pod="openshift-dns/node-resolver-6h54k" May 21 18:13:18.033594 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.033380 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-hostroot\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.033594 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.033396 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/650efcfa-3258-4d4e-bb7f-4d26aa341842-iptables-alerter-script\") pod \"iptables-alerter-xzwnx\" (UID: \"650efcfa-3258-4d4e-bb7f-4d26aa341842\") " pod="openshift-network-operator/iptables-alerter-xzwnx" May 21 18:13:18.033594 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.033416 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5ec61c29-892e-485c-b233-01e2eafa1ff4-konnectivity-ca\") pod \"konnectivity-agent-l82nt\" (UID: \"5ec61c29-892e-485c-b233-01e2eafa1ff4\") " pod="kube-system/konnectivity-agent-l82nt" May 21 18:13:18.033594 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.033445 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/868c9a60-0d4e-4bda-9e1d-8c1087daa9e5-os-release\") pod \"multus-additional-cni-plugins-jx9sz\" (UID: \"868c9a60-0d4e-4bda-9e1d-8c1087daa9e5\") " pod="openshift-multus/multus-additional-cni-plugins-jx9sz" May 21 18:13:18.033594 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.033474 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79474071-9b7b-4d06-b70e-c65abde6fc43-tmp\") pod \"tuned-5wfjk\" (UID: \"79474071-9b7b-4d06-b70e-c65abde6fc43\") " pod="openshift-cluster-node-tuning-operator/tuned-5wfjk" May 21 18:13:18.033594 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.033486 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/868c9a60-0d4e-4bda-9e1d-8c1087daa9e5-os-release\") pod \"multus-additional-cni-plugins-jx9sz\" (UID: \"868c9a60-0d4e-4bda-9e1d-8c1087daa9e5\") " pod="openshift-multus/multus-additional-cni-plugins-jx9sz" May 21 18:13:18.033594 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.033509 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7s5gb\" (UniqueName: \"kubernetes.io/projected/79474071-9b7b-4d06-b70e-c65abde6fc43-kube-api-access-7s5gb\") pod \"tuned-5wfjk\" (UID: \"79474071-9b7b-4d06-b70e-c65abde6fc43\") " pod="openshift-cluster-node-tuning-operator/tuned-5wfjk" May 21 18:13:18.033594 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.033536 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2ssdb\" (UniqueName: \"kubernetes.io/projected/806b4e1a-170a-44ac-b356-92e2c2337e02-kube-api-access-2ssdb\") pod \"node-resolver-6h54k\" (UID: \"806b4e1a-170a-44ac-b356-92e2c2337e02\") " pod="openshift-dns/node-resolver-6h54k" May 21 18:13:18.034326 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.033561 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d9537e64-5ba3-4910-998c-e9d3deb97929-host-run-ovn-kubernetes\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:18.034326 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.033663 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/868c9a60-0d4e-4bda-9e1d-8c1087daa9e5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jx9sz\" (UID: \"868c9a60-0d4e-4bda-9e1d-8c1087daa9e5\") " pod="openshift-multus/multus-additional-cni-plugins-jx9sz" May 21 18:13:18.034326 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.033693 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80ec104c-46e1-4fb3-a8bc-f5664e798321-metrics-certs\") pod \"network-metrics-daemon-lk2c6\" (UID: \"80ec104c-46e1-4fb3-a8bc-f5664e798321\") " pod="openshift-multus/network-metrics-daemon-lk2c6" May 21 18:13:18.034326 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.033719 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-etc-kubernetes\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.034326 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.033744 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d9537e64-5ba3-4910-998c-e9d3deb97929-run-systemd\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:18.034326 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.033745 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/806b4e1a-170a-44ac-b356-92e2c2337e02-tmp-dir\") pod \"node-resolver-6h54k\" (UID: \"806b4e1a-170a-44ac-b356-92e2c2337e02\") " pod="openshift-dns/node-resolver-6h54k" May 21 18:13:18.034326 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.033795 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d9537e64-5ba3-4910-998c-e9d3deb97929-var-lib-openvswitch\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:18.034326 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.033813 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d9537e64-5ba3-4910-998c-e9d3deb97929-host-cni-netd\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:18.034326 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.033828 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/79474071-9b7b-4d06-b70e-c65abde6fc43-etc-modprobe-d\") pod \"tuned-5wfjk\" (UID: \"79474071-9b7b-4d06-b70e-c65abde6fc43\") " pod="openshift-cluster-node-tuning-operator/tuned-5wfjk" May 21 18:13:18.034326 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.033842 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/79474071-9b7b-4d06-b70e-c65abde6fc43-etc-sysctl-d\") pod \"tuned-5wfjk\" (UID: \"79474071-9b7b-4d06-b70e-c65abde6fc43\") " pod="openshift-cluster-node-tuning-operator/tuned-5wfjk" May 21 18:13:18.034326 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.033857 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-multus-socket-dir-parent\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.034326 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.033873 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f7q6m\" (UniqueName: \"kubernetes.io/projected/96d08281-69d3-4a00-ba5c-74771da205d3-kube-api-access-f7q6m\") pod \"network-check-target-qfkc7\" (UID: \"96d08281-69d3-4a00-ba5c-74771da205d3\") " pod="openshift-network-diagnostics/network-check-target-qfkc7" May 21 18:13:18.034326 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.033914 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d9537e64-5ba3-4910-998c-e9d3deb97929-ovnkube-config\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:18.034326 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.033939 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/868c9a60-0d4e-4bda-9e1d-8c1087daa9e5-cnibin\") pod \"multus-additional-cni-plugins-jx9sz\" (UID: \"868c9a60-0d4e-4bda-9e1d-8c1087daa9e5\") " pod="openshift-multus/multus-additional-cni-plugins-jx9sz" May 21 18:13:18.034326 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.034031 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/868c9a60-0d4e-4bda-9e1d-8c1087daa9e5-cni-binary-copy\") pod \"multus-additional-cni-plugins-jx9sz\" (UID: \"868c9a60-0d4e-4bda-9e1d-8c1087daa9e5\") " pod="openshift-multus/multus-additional-cni-plugins-jx9sz" May 21 18:13:18.034326 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.034047 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4b6958b0-ec19-4342-80d1-162637b9dd34-device-dir\") pod \"aws-ebs-csi-driver-node-mnfz9\" (UID: \"4b6958b0-ec19-4342-80d1-162637b9dd34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnfz9" May 21 18:13:18.034326 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.034091 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9g5dd\" (UniqueName: \"kubernetes.io/projected/80ec104c-46e1-4fb3-a8bc-f5664e798321-kube-api-access-9g5dd\") pod \"network-metrics-daemon-lk2c6\" (UID: \"80ec104c-46e1-4fb3-a8bc-f5664e798321\") " pod="openshift-multus/network-metrics-daemon-lk2c6" May 21 18:13:18.036664 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.034107 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-cni-binary-copy\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.036664 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.034136 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-host-var-lib-cni-multus\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.036664 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.034160 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d9537e64-5ba3-4910-998c-e9d3deb97929-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:18.036664 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.034188 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d9537e64-5ba3-4910-998c-e9d3deb97929-env-overrides\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:18.036664 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.034219 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4b6958b0-ec19-4342-80d1-162637b9dd34-sys-fs\") pod \"aws-ebs-csi-driver-node-mnfz9\" (UID: \"4b6958b0-ec19-4342-80d1-162637b9dd34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnfz9" May 21 18:13:18.036664 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.034233 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79474071-9b7b-4d06-b70e-c65abde6fc43-etc-kubernetes\") pod \"tuned-5wfjk\" (UID: \"79474071-9b7b-4d06-b70e-c65abde6fc43\") " pod="openshift-cluster-node-tuning-operator/tuned-5wfjk" May 21 18:13:18.036664 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.034246 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/79474071-9b7b-4d06-b70e-c65abde6fc43-sys\") pod \"tuned-5wfjk\" (UID: \"79474071-9b7b-4d06-b70e-c65abde6fc43\") " pod="openshift-cluster-node-tuning-operator/tuned-5wfjk" May 21 18:13:18.036664 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.034265 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79474071-9b7b-4d06-b70e-c65abde6fc43-var-lib-kubelet\") pod \"tuned-5wfjk\" (UID: \"79474071-9b7b-4d06-b70e-c65abde6fc43\") " pod="openshift-cluster-node-tuning-operator/tuned-5wfjk" May 21 18:13:18.036664 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.034298 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-whndp\" (UniqueName: \"kubernetes.io/projected/d9537e64-5ba3-4910-998c-e9d3deb97929-kube-api-access-whndp\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:18.036664 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.034368 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/868c9a60-0d4e-4bda-9e1d-8c1087daa9e5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jx9sz\" (UID: \"868c9a60-0d4e-4bda-9e1d-8c1087daa9e5\") " pod="openshift-multus/multus-additional-cni-plugins-jx9sz" May 21 18:13:18.036664 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.034487 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7x4j7\" (UniqueName: \"kubernetes.io/projected/650efcfa-3258-4d4e-bb7f-4d26aa341842-kube-api-access-7x4j7\") pod \"iptables-alerter-xzwnx\" (UID: \"650efcfa-3258-4d4e-bb7f-4d26aa341842\") " pod="openshift-network-operator/iptables-alerter-xzwnx" May 21 18:13:18.036664 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.034502 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d9537e64-5ba3-4910-998c-e9d3deb97929-ovnkube-config\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:18.036664 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.034526 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4b6958b0-ec19-4342-80d1-162637b9dd34-socket-dir\") pod \"aws-ebs-csi-driver-node-mnfz9\" (UID: \"4b6958b0-ec19-4342-80d1-162637b9dd34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnfz9" May 21 18:13:18.036664 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.034547 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/79474071-9b7b-4d06-b70e-c65abde6fc43-run\") pod \"tuned-5wfjk\" (UID: \"79474071-9b7b-4d06-b70e-c65abde6fc43\") " pod="openshift-cluster-node-tuning-operator/tuned-5wfjk" May 21 18:13:18.036664 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.034569 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/79474071-9b7b-4d06-b70e-c65abde6fc43-etc-tuned\") pod \"tuned-5wfjk\" (UID: \"79474071-9b7b-4d06-b70e-c65abde6fc43\") " pod="openshift-cluster-node-tuning-operator/tuned-5wfjk" May 21 18:13:18.036664 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.034610 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c5v66\" (UniqueName: \"kubernetes.io/projected/e3c0da04-85d7-4c03-8f44-42c8748c4218-kube-api-access-c5v66\") pod \"node-ca-fwkk2\" (UID: \"e3c0da04-85d7-4c03-8f44-42c8748c4218\") " pod="openshift-image-registry/node-ca-fwkk2" May 21 18:13:18.036664 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.034678 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-host-run-netns\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.037473 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.034679 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/868c9a60-0d4e-4bda-9e1d-8c1087daa9e5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jx9sz\" (UID: \"868c9a60-0d4e-4bda-9e1d-8c1087daa9e5\") " pod="openshift-multus/multus-additional-cni-plugins-jx9sz" May 21 18:13:18.037473 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.034710 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d9537e64-5ba3-4910-998c-e9d3deb97929-node-log\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:18.037473 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.034742 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/868c9a60-0d4e-4bda-9e1d-8c1087daa9e5-cnibin\") pod \"multus-additional-cni-plugins-jx9sz\" (UID: \"868c9a60-0d4e-4bda-9e1d-8c1087daa9e5\") " pod="openshift-multus/multus-additional-cni-plugins-jx9sz" May 21 18:13:18.037473 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.034767 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d9537e64-5ba3-4910-998c-e9d3deb97929-node-log\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:18.037473 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.034779 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d9537e64-5ba3-4910-998c-e9d3deb97929-log-socket\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:18.037473 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.034827 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d9537e64-5ba3-4910-998c-e9d3deb97929-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:18.037473 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.034838 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-os-release\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.037473 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.034885 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffbpj\" (UniqueName: \"kubernetes.io/projected/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-kube-api-access-ffbpj\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.037473 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.034915 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d9537e64-5ba3-4910-998c-e9d3deb97929-etc-openvswitch\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:18.037473 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:18.034921 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 18:13:18.037473 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.034940 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d9537e64-5ba3-4910-998c-e9d3deb97929-ovnkube-script-lib\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:18.037473 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:18.035006 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80ec104c-46e1-4fb3-a8bc-f5664e798321-metrics-certs podName:80ec104c-46e1-4fb3-a8bc-f5664e798321 nodeName:}" failed. No retries permitted until 2026-05-21 18:13:18.534974259 +0000 UTC m=+3.120460698 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/80ec104c-46e1-4fb3-a8bc-f5664e798321-metrics-certs") pod "network-metrics-daemon-lk2c6" (UID: "80ec104c-46e1-4fb3-a8bc-f5664e798321") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 18:13:18.037473 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.035238 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d9537e64-5ba3-4910-998c-e9d3deb97929-var-lib-openvswitch\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:18.037473 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.035282 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d9537e64-5ba3-4910-998c-e9d3deb97929-host-cni-netd\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:18.037473 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.035320 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/868c9a60-0d4e-4bda-9e1d-8c1087daa9e5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jx9sz\" (UID: \"868c9a60-0d4e-4bda-9e1d-8c1087daa9e5\") " pod="openshift-multus/multus-additional-cni-plugins-jx9sz" May 21 18:13:18.037473 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.035371 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/79474071-9b7b-4d06-b70e-c65abde6fc43-etc-modprobe-d\") pod \"tuned-5wfjk\" (UID: \"79474071-9b7b-4d06-b70e-c65abde6fc43\") " pod="openshift-cluster-node-tuning-operator/tuned-5wfjk" May 21 18:13:18.037473 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.035379 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4b6958b0-ec19-4342-80d1-162637b9dd34-device-dir\") pod \"aws-ebs-csi-driver-node-mnfz9\" (UID: \"4b6958b0-ec19-4342-80d1-162637b9dd34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnfz9" May 21 18:13:18.038441 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.035433 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d9537e64-5ba3-4910-998c-e9d3deb97929-run-systemd\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:18.038441 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.035476 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d9537e64-5ba3-4910-998c-e9d3deb97929-host-run-ovn-kubernetes\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:18.038441 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.035497 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/79474071-9b7b-4d06-b70e-c65abde6fc43-etc-sysctl-d\") pod \"tuned-5wfjk\" (UID: \"79474071-9b7b-4d06-b70e-c65abde6fc43\") " pod="openshift-cluster-node-tuning-operator/tuned-5wfjk" May 21 18:13:18.038441 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.035636 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d9537e64-5ba3-4910-998c-e9d3deb97929-ovnkube-script-lib\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:18.038441 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.035651 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d9537e64-5ba3-4910-998c-e9d3deb97929-log-socket\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:18.038441 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.035649 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5ec61c29-892e-485c-b233-01e2eafa1ff4-agent-certs\") pod \"konnectivity-agent-l82nt\" (UID: \"5ec61c29-892e-485c-b233-01e2eafa1ff4\") " pod="kube-system/konnectivity-agent-l82nt" May 21 18:13:18.038441 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.035806 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4b6958b0-ec19-4342-80d1-162637b9dd34-socket-dir\") pod \"aws-ebs-csi-driver-node-mnfz9\" (UID: \"4b6958b0-ec19-4342-80d1-162637b9dd34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnfz9" May 21 18:13:18.038441 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.035851 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4b6958b0-ec19-4342-80d1-162637b9dd34-sys-fs\") pod \"aws-ebs-csi-driver-node-mnfz9\" (UID: \"4b6958b0-ec19-4342-80d1-162637b9dd34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnfz9" May 21 18:13:18.038441 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.035897 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79474071-9b7b-4d06-b70e-c65abde6fc43-etc-kubernetes\") pod \"tuned-5wfjk\" (UID: \"79474071-9b7b-4d06-b70e-c65abde6fc43\") " pod="openshift-cluster-node-tuning-operator/tuned-5wfjk" May 21 18:13:18.038441 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.035935 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/79474071-9b7b-4d06-b70e-c65abde6fc43-sys\") pod \"tuned-5wfjk\" (UID: \"79474071-9b7b-4d06-b70e-c65abde6fc43\") " pod="openshift-cluster-node-tuning-operator/tuned-5wfjk" May 21 18:13:18.038441 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.036087 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d9537e64-5ba3-4910-998c-e9d3deb97929-env-overrides\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:18.038441 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.036072 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5ec61c29-892e-485c-b233-01e2eafa1ff4-konnectivity-ca\") pod \"konnectivity-agent-l82nt\" (UID: \"5ec61c29-892e-485c-b233-01e2eafa1ff4\") " pod="kube-system/konnectivity-agent-l82nt" May 21 18:13:18.038441 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.037609 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/79474071-9b7b-4d06-b70e-c65abde6fc43-run\") pod \"tuned-5wfjk\" (UID: \"79474071-9b7b-4d06-b70e-c65abde6fc43\") " pod="openshift-cluster-node-tuning-operator/tuned-5wfjk" May 21 18:13:18.038441 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.036103 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79474071-9b7b-4d06-b70e-c65abde6fc43-var-lib-kubelet\") pod \"tuned-5wfjk\" (UID: \"79474071-9b7b-4d06-b70e-c65abde6fc43\") " pod="openshift-cluster-node-tuning-operator/tuned-5wfjk" May 21 18:13:18.039154 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.038548 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d9537e64-5ba3-4910-998c-e9d3deb97929-ovn-node-metrics-cert\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:18.039154 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.038595 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/868c9a60-0d4e-4bda-9e1d-8c1087daa9e5-cni-binary-copy\") pod \"multus-additional-cni-plugins-jx9sz\" (UID: \"868c9a60-0d4e-4bda-9e1d-8c1087daa9e5\") " pod="openshift-multus/multus-additional-cni-plugins-jx9sz" May 21 18:13:18.042217 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.040112 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/79474071-9b7b-4d06-b70e-c65abde6fc43-etc-tuned\") pod \"tuned-5wfjk\" (UID: \"79474071-9b7b-4d06-b70e-c65abde6fc43\") " pod="openshift-cluster-node-tuning-operator/tuned-5wfjk" May 21 18:13:18.042217 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.040196 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d9537e64-5ba3-4910-998c-e9d3deb97929-etc-openvswitch\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:18.045631 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.044874 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj2jw\" (UniqueName: \"kubernetes.io/projected/868c9a60-0d4e-4bda-9e1d-8c1087daa9e5-kube-api-access-dj2jw\") pod \"multus-additional-cni-plugins-jx9sz\" (UID: \"868c9a60-0d4e-4bda-9e1d-8c1087daa9e5\") " pod="openshift-multus/multus-additional-cni-plugins-jx9sz" May 21 18:13:18.047049 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.046207 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ssdb\" (UniqueName: \"kubernetes.io/projected/806b4e1a-170a-44ac-b356-92e2c2337e02-kube-api-access-2ssdb\") pod \"node-resolver-6h54k\" (UID: \"806b4e1a-170a-44ac-b356-92e2c2337e02\") " pod="openshift-dns/node-resolver-6h54k" May 21 18:13:18.047049 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.046514 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjrd9\" (UniqueName: \"kubernetes.io/projected/4b6958b0-ec19-4342-80d1-162637b9dd34-kube-api-access-kjrd9\") pod \"aws-ebs-csi-driver-node-mnfz9\" (UID: \"4b6958b0-ec19-4342-80d1-162637b9dd34\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnfz9" May 21 18:13:18.047049 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:18.046705 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 18:13:18.047049 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:18.046731 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 18:13:18.047049 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:18.046744 2567 projected.go:194] Error preparing data for projected volume kube-api-access-f7q6m for pod openshift-network-diagnostics/network-check-target-qfkc7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 18:13:18.047049 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.046789 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7s5gb\" (UniqueName: \"kubernetes.io/projected/79474071-9b7b-4d06-b70e-c65abde6fc43-kube-api-access-7s5gb\") pod \"tuned-5wfjk\" (UID: \"79474071-9b7b-4d06-b70e-c65abde6fc43\") " pod="openshift-cluster-node-tuning-operator/tuned-5wfjk" May 21 18:13:18.047049 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:18.046826 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96d08281-69d3-4a00-ba5c-74771da205d3-kube-api-access-f7q6m podName:96d08281-69d3-4a00-ba5c-74771da205d3 nodeName:}" failed. No retries permitted until 2026-05-21 18:13:18.546799561 +0000 UTC m=+3.132285996 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-f7q6m" (UniqueName: "kubernetes.io/projected/96d08281-69d3-4a00-ba5c-74771da205d3-kube-api-access-f7q6m") pod "network-check-target-qfkc7" (UID: "96d08281-69d3-4a00-ba5c-74771da205d3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 18:13:18.047461 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.047186 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79474071-9b7b-4d06-b70e-c65abde6fc43-tmp\") pod \"tuned-5wfjk\" (UID: \"79474071-9b7b-4d06-b70e-c65abde6fc43\") " pod="openshift-cluster-node-tuning-operator/tuned-5wfjk" May 21 18:13:18.050960 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.050906 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5v66\" (UniqueName: \"kubernetes.io/projected/e3c0da04-85d7-4c03-8f44-42c8748c4218-kube-api-access-c5v66\") pod \"node-ca-fwkk2\" (UID: \"e3c0da04-85d7-4c03-8f44-42c8748c4218\") " pod="openshift-image-registry/node-ca-fwkk2" May 21 18:13:18.050960 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.050940 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g5dd\" (UniqueName: \"kubernetes.io/projected/80ec104c-46e1-4fb3-a8bc-f5664e798321-kube-api-access-9g5dd\") pod \"network-metrics-daemon-lk2c6\" (UID: \"80ec104c-46e1-4fb3-a8bc-f5664e798321\") " pod="openshift-multus/network-metrics-daemon-lk2c6" May 21 18:13:18.050960 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.050956 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whndp\" (UniqueName: \"kubernetes.io/projected/d9537e64-5ba3-4910-998c-e9d3deb97929-kube-api-access-whndp\") pod \"ovnkube-node-2n5jr\" (UID: \"d9537e64-5ba3-4910-998c-e9d3deb97929\") " pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:18.135640 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.135608 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-etc-kubernetes\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.135803 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.135647 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-multus-socket-dir-parent\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.135803 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.135678 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-cni-binary-copy\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.135803 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.135696 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-host-var-lib-cni-multus\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.135803 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.135699 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-etc-kubernetes\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.135803 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.135721 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7x4j7\" (UniqueName: \"kubernetes.io/projected/650efcfa-3258-4d4e-bb7f-4d26aa341842-kube-api-access-7x4j7\") pod \"iptables-alerter-xzwnx\" (UID: \"650efcfa-3258-4d4e-bb7f-4d26aa341842\") " pod="openshift-network-operator/iptables-alerter-xzwnx" May 21 18:13:18.135803 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.135771 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-host-var-lib-cni-multus\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.135803 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.135775 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-host-run-netns\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.136143 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.135809 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-host-run-netns\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.136143 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.135808 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-multus-socket-dir-parent\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.136143 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.135822 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-os-release\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.136143 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.135862 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ffbpj\" (UniqueName: \"kubernetes.io/projected/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-kube-api-access-ffbpj\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.136143 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.135881 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-os-release\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.136143 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.135896 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-host-var-lib-cni-bin\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.136143 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.135937 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-multus-cni-dir\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.136143 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.135966 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-cnibin\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.136143 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.135986 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-host-var-lib-cni-bin\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.136143 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.135991 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-host-var-lib-kubelet\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.136143 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.136017 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/650efcfa-3258-4d4e-bb7f-4d26aa341842-host-slash\") pod \"iptables-alerter-xzwnx\" (UID: \"650efcfa-3258-4d4e-bb7f-4d26aa341842\") " pod="openshift-network-operator/iptables-alerter-xzwnx" May 21 18:13:18.136143 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.136037 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-multus-cni-dir\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.136143 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.136043 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-system-cni-dir\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.136143 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.136067 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-multus-daemon-config\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.136143 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.136072 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/650efcfa-3258-4d4e-bb7f-4d26aa341842-host-slash\") pod \"iptables-alerter-xzwnx\" (UID: \"650efcfa-3258-4d4e-bb7f-4d26aa341842\") " pod="openshift-network-operator/iptables-alerter-xzwnx" May 21 18:13:18.136143 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.136074 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-host-var-lib-kubelet\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.136143 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.136046 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-cnibin\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.136143 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.136111 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-system-cni-dir\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.136866 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.136136 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-host-run-k8s-cni-cncf-io\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.136866 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.136152 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-multus-conf-dir\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.136866 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.136188 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-host-run-multus-certs\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.136866 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.136213 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-host-run-multus-certs\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.136866 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.136225 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-cni-binary-copy\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.136866 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.136236 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-host-run-k8s-cni-cncf-io\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.136866 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.136263 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-multus-conf-dir\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.136866 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.136273 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-hostroot\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.136866 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.136302 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/650efcfa-3258-4d4e-bb7f-4d26aa341842-iptables-alerter-script\") pod \"iptables-alerter-xzwnx\" (UID: \"650efcfa-3258-4d4e-bb7f-4d26aa341842\") " pod="openshift-network-operator/iptables-alerter-xzwnx" May 21 18:13:18.136866 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.136329 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-hostroot\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.136866 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.136533 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-multus-daemon-config\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.136866 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.136695 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/650efcfa-3258-4d4e-bb7f-4d26aa341842-iptables-alerter-script\") pod \"iptables-alerter-xzwnx\" (UID: \"650efcfa-3258-4d4e-bb7f-4d26aa341842\") " pod="openshift-network-operator/iptables-alerter-xzwnx" May 21 18:13:18.144678 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.144650 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffbpj\" (UniqueName: \"kubernetes.io/projected/151a7f52-0d11-42c8-a0d5-87d0d3cd7598-kube-api-access-ffbpj\") pod \"multus-zkz67\" (UID: \"151a7f52-0d11-42c8-a0d5-87d0d3cd7598\") " pod="openshift-multus/multus-zkz67" May 21 18:13:18.144780 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.144722 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x4j7\" (UniqueName: \"kubernetes.io/projected/650efcfa-3258-4d4e-bb7f-4d26aa341842-kube-api-access-7x4j7\") pod \"iptables-alerter-xzwnx\" (UID: \"650efcfa-3258-4d4e-bb7f-4d26aa341842\") " pod="openshift-network-operator/iptables-alerter-xzwnx" May 21 18:13:18.175426 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.175357 2567 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 18:13:18.221364 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.221331 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnfz9" May 21 18:13:18.231148 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.231121 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l82nt" May 21 18:13:18.239845 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.239825 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5wfjk" May 21 18:13:18.244166 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.244149 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6h54k" May 21 18:13:18.257668 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.257641 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fwkk2" May 21 18:13:18.264238 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.264218 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jx9sz" May 21 18:13:18.272005 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.271890 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:18.279476 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.279458 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zkz67" May 21 18:13:18.287000 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.286984 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xzwnx" May 21 18:13:18.538876 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.538798 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80ec104c-46e1-4fb3-a8bc-f5664e798321-metrics-certs\") pod \"network-metrics-daemon-lk2c6\" (UID: \"80ec104c-46e1-4fb3-a8bc-f5664e798321\") " pod="openshift-multus/network-metrics-daemon-lk2c6" May 21 18:13:18.539009 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:18.538980 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 18:13:18.539073 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:18.539058 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80ec104c-46e1-4fb3-a8bc-f5664e798321-metrics-certs podName:80ec104c-46e1-4fb3-a8bc-f5664e798321 nodeName:}" failed. No retries permitted until 2026-05-21 18:13:19.539038769 +0000 UTC m=+4.124525193 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/80ec104c-46e1-4fb3-a8bc-f5664e798321-metrics-certs") pod "network-metrics-daemon-lk2c6" (UID: "80ec104c-46e1-4fb3-a8bc-f5664e798321") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 18:13:18.639977 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.639940 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f7q6m\" (UniqueName: \"kubernetes.io/projected/96d08281-69d3-4a00-ba5c-74771da205d3-kube-api-access-f7q6m\") pod \"network-check-target-qfkc7\" (UID: \"96d08281-69d3-4a00-ba5c-74771da205d3\") " pod="openshift-network-diagnostics/network-check-target-qfkc7" May 21 18:13:18.640142 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:18.640122 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 18:13:18.640181 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:18.640148 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 18:13:18.640181 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:18.640159 2567 projected.go:194] Error preparing data for projected volume kube-api-access-f7q6m for pod openshift-network-diagnostics/network-check-target-qfkc7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 18:13:18.640273 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:18.640216 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96d08281-69d3-4a00-ba5c-74771da205d3-kube-api-access-f7q6m podName:96d08281-69d3-4a00-ba5c-74771da205d3 nodeName:}" failed. No retries permitted until 2026-05-21 18:13:19.640200541 +0000 UTC m=+4.225686970 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-f7q6m" (UniqueName: "kubernetes.io/projected/96d08281-69d3-4a00-ba5c-74771da205d3-kube-api-access-f7q6m") pod "network-check-target-qfkc7" (UID: "96d08281-69d3-4a00-ba5c-74771da205d3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 18:13:18.843869 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:18.843508 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod151a7f52_0d11_42c8_a0d5_87d0d3cd7598.slice/crio-da0e2fb0a63a76ab75555d95187212df0a89cb9f38163740211a2a7e26974195 WatchSource:0}: Error finding container da0e2fb0a63a76ab75555d95187212df0a89cb9f38163740211a2a7e26974195: Status 404 returned error can't find the container with id da0e2fb0a63a76ab75555d95187212df0a89cb9f38163740211a2a7e26974195 May 21 18:13:18.844043 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:18.844017 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod806b4e1a_170a_44ac_b356_92e2c2337e02.slice/crio-8ea8423d36395e8216ef396b4a5ca77006c011391b81f258f4cbbcafb2eddf02 WatchSource:0}: Error finding container 8ea8423d36395e8216ef396b4a5ca77006c011391b81f258f4cbbcafb2eddf02: Status 404 returned error can't find the container with id 8ea8423d36395e8216ef396b4a5ca77006c011391b81f258f4cbbcafb2eddf02 May 21 18:13:18.845272 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:18.845229 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod650efcfa_3258_4d4e_bb7f_4d26aa341842.slice/crio-48cedb31120cc9fadbd0726fa57eed586a9387065ab749b628764884fe7f9412 WatchSource:0}: Error finding container 48cedb31120cc9fadbd0726fa57eed586a9387065ab749b628764884fe7f9412: Status 404 returned error can't find the container with id 48cedb31120cc9fadbd0726fa57eed586a9387065ab749b628764884fe7f9412 May 21 18:13:18.846049 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:18.846011 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod868c9a60_0d4e_4bda_9e1d_8c1087daa9e5.slice/crio-4c0574013a8c6678a6034291bae9004241ef6406bd26f69267c4f5073380f6cd WatchSource:0}: Error finding container 4c0574013a8c6678a6034291bae9004241ef6406bd26f69267c4f5073380f6cd: Status 404 returned error can't find the container with id 4c0574013a8c6678a6034291bae9004241ef6406bd26f69267c4f5073380f6cd May 21 18:13:18.846834 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:18.846735 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b6958b0_ec19_4342_80d1_162637b9dd34.slice/crio-379fdcfddc69484416f28da628431ebe39b820ad248ef5c756d5798e8303405f WatchSource:0}: Error finding container 379fdcfddc69484416f28da628431ebe39b820ad248ef5c756d5798e8303405f: Status 404 returned error can't find the container with id 379fdcfddc69484416f28da628431ebe39b820ad248ef5c756d5798e8303405f May 21 18:13:18.848251 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:18.847639 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ec61c29_892e_485c_b233_01e2eafa1ff4.slice/crio-9af2a5b169d78254be27f481918a67ce4553c1ffbb9e0bfd9786ba61fcc9717c WatchSource:0}: Error finding container 9af2a5b169d78254be27f481918a67ce4553c1ffbb9e0bfd9786ba61fcc9717c: Status 404 returned error can't find the container with id 9af2a5b169d78254be27f481918a67ce4553c1ffbb9e0bfd9786ba61fcc9717c May 21 18:13:18.849414 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:18.849380 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79474071_9b7b_4d06_b70e_c65abde6fc43.slice/crio-4140a80cfc539dd2e03a900224f26ca8d8cd0c166ad5270a86753b14740d800a WatchSource:0}: Error finding container 4140a80cfc539dd2e03a900224f26ca8d8cd0c166ad5270a86753b14740d800a: Status 404 returned error can't find the container with id 4140a80cfc539dd2e03a900224f26ca8d8cd0c166ad5270a86753b14740d800a May 21 18:13:18.850956 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:18.850822 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3c0da04_85d7_4c03_8f44_42c8748c4218.slice/crio-be98cdb065457d9d86193b3665a280721ec0caf5374aef0574392e496f9f6574 WatchSource:0}: Error finding container be98cdb065457d9d86193b3665a280721ec0caf5374aef0574392e496f9f6574: Status 404 returned error can't find the container with id be98cdb065457d9d86193b3665a280721ec0caf5374aef0574392e496f9f6574 May 21 18:13:18.852558 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:18.852460 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9537e64_5ba3_4910_998c_e9d3deb97929.slice/crio-e64653208a9330b056aea20f9647d390ec796cc81711e4aa42108e2ddf12ee6f WatchSource:0}: Error finding container e64653208a9330b056aea20f9647d390ec796cc81711e4aa42108e2ddf12ee6f: Status 404 returned error can't find the container with id e64653208a9330b056aea20f9647d390ec796cc81711e4aa42108e2ddf12ee6f May 21 18:13:18.964344 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.964307 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 18:08:16 +0000 UTC" deadline="2028-02-19 02:47:43.192588918 +0000 UTC" May 21 18:13:18.964344 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.964341 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15320h34m24.228250796s" May 21 18:13:18.988521 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.988488 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnfz9" event={"ID":"4b6958b0-ec19-4342-80d1-162637b9dd34","Type":"ContainerStarted","Data":"379fdcfddc69484416f28da628431ebe39b820ad248ef5c756d5798e8303405f"} May 21 18:13:18.990462 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.990413 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jx9sz" event={"ID":"868c9a60-0d4e-4bda-9e1d-8c1087daa9e5","Type":"ContainerStarted","Data":"4c0574013a8c6678a6034291bae9004241ef6406bd26f69267c4f5073380f6cd"} May 21 18:13:18.991827 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.991798 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xzwnx" event={"ID":"650efcfa-3258-4d4e-bb7f-4d26aa341842","Type":"ContainerStarted","Data":"48cedb31120cc9fadbd0726fa57eed586a9387065ab749b628764884fe7f9412"} May 21 18:13:18.993285 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.993251 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zkz67" event={"ID":"151a7f52-0d11-42c8-a0d5-87d0d3cd7598","Type":"ContainerStarted","Data":"da0e2fb0a63a76ab75555d95187212df0a89cb9f38163740211a2a7e26974195"} May 21 18:13:18.995188 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.995157 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-59.ec2.internal" event={"ID":"865c2e3735c54eea4d9ac88d1c24d330","Type":"ContainerStarted","Data":"ff744f12992d6c05830af9d1fd0b827a594a0bf8b48036a2f479cf10349d9c30"} May 21 18:13:18.996173 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.996152 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" event={"ID":"d9537e64-5ba3-4910-998c-e9d3deb97929","Type":"ContainerStarted","Data":"e64653208a9330b056aea20f9647d390ec796cc81711e4aa42108e2ddf12ee6f"} May 21 18:13:18.997145 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.997120 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l82nt" event={"ID":"5ec61c29-892e-485c-b233-01e2eafa1ff4","Type":"ContainerStarted","Data":"9af2a5b169d78254be27f481918a67ce4553c1ffbb9e0bfd9786ba61fcc9717c"} May 21 18:13:18.998097 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.998074 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fwkk2" event={"ID":"e3c0da04-85d7-4c03-8f44-42c8748c4218","Type":"ContainerStarted","Data":"be98cdb065457d9d86193b3665a280721ec0caf5374aef0574392e496f9f6574"} May 21 18:13:18.999084 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.999065 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5wfjk" event={"ID":"79474071-9b7b-4d06-b70e-c65abde6fc43","Type":"ContainerStarted","Data":"4140a80cfc539dd2e03a900224f26ca8d8cd0c166ad5270a86753b14740d800a"} May 21 18:13:19.000006 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:18.999990 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6h54k" event={"ID":"806b4e1a-170a-44ac-b356-92e2c2337e02","Type":"ContainerStarted","Data":"8ea8423d36395e8216ef396b4a5ca77006c011391b81f258f4cbbcafb2eddf02"} May 21 18:13:19.008843 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:19.008807 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-59.ec2.internal" podStartSLOduration=2.008795835 podStartE2EDuration="2.008795835s" podCreationTimestamp="2026-05-21 18:13:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:13:19.00825902 +0000 UTC m=+3.593745456" watchObservedRunningTime="2026-05-21 18:13:19.008795835 +0000 UTC m=+3.594282271" May 21 18:13:19.546533 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:19.545865 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80ec104c-46e1-4fb3-a8bc-f5664e798321-metrics-certs\") pod \"network-metrics-daemon-lk2c6\" (UID: \"80ec104c-46e1-4fb3-a8bc-f5664e798321\") " pod="openshift-multus/network-metrics-daemon-lk2c6" May 21 18:13:19.546533 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:19.546049 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 18:13:19.546533 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:19.546114 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80ec104c-46e1-4fb3-a8bc-f5664e798321-metrics-certs podName:80ec104c-46e1-4fb3-a8bc-f5664e798321 nodeName:}" failed. No retries permitted until 2026-05-21 18:13:21.546096923 +0000 UTC m=+6.131583352 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/80ec104c-46e1-4fb3-a8bc-f5664e798321-metrics-certs") pod "network-metrics-daemon-lk2c6" (UID: "80ec104c-46e1-4fb3-a8bc-f5664e798321") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 18:13:19.647832 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:19.647192 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f7q6m\" (UniqueName: \"kubernetes.io/projected/96d08281-69d3-4a00-ba5c-74771da205d3-kube-api-access-f7q6m\") pod \"network-check-target-qfkc7\" (UID: \"96d08281-69d3-4a00-ba5c-74771da205d3\") " pod="openshift-network-diagnostics/network-check-target-qfkc7" May 21 18:13:19.647832 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:19.647379 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 18:13:19.647832 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:19.647398 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 18:13:19.647832 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:19.647411 2567 projected.go:194] Error preparing data for projected volume kube-api-access-f7q6m for pod openshift-network-diagnostics/network-check-target-qfkc7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 18:13:19.647832 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:19.647469 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96d08281-69d3-4a00-ba5c-74771da205d3-kube-api-access-f7q6m podName:96d08281-69d3-4a00-ba5c-74771da205d3 nodeName:}" failed. No retries permitted until 2026-05-21 18:13:21.647450156 +0000 UTC m=+6.232936594 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-f7q6m" (UniqueName: "kubernetes.io/projected/96d08281-69d3-4a00-ba5c-74771da205d3-kube-api-access-f7q6m") pod "network-check-target-qfkc7" (UID: "96d08281-69d3-4a00-ba5c-74771da205d3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 18:13:19.980089 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:19.980010 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfkc7" May 21 18:13:19.980515 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:19.980142 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfkc7" podUID="96d08281-69d3-4a00-ba5c-74771da205d3" May 21 18:13:19.980691 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:19.980672 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk2c6" May 21 18:13:19.980791 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:19.980772 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk2c6" podUID="80ec104c-46e1-4fb3-a8bc-f5664e798321" May 21 18:13:20.014673 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:20.014635 2567 generic.go:358] "Generic (PLEG): container finished" podID="c74b687aae66fdce85b9519c288ee8b1" containerID="14dc417a239fe5bec5b57cf8bf4cd31d4fee1e9789a061c97b7c52ceaa30ec76" exitCode=0 May 21 18:13:20.015557 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:20.015531 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal" event={"ID":"c74b687aae66fdce85b9519c288ee8b1","Type":"ContainerDied","Data":"14dc417a239fe5bec5b57cf8bf4cd31d4fee1e9789a061c97b7c52ceaa30ec76"} May 21 18:13:21.041370 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:21.041318 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal" event={"ID":"c74b687aae66fdce85b9519c288ee8b1","Type":"ContainerStarted","Data":"5be53f99e47e96c76813c35c3417a787ac7bca78ab79fdf38062145565000359"} May 21 18:13:21.566916 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:21.566249 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80ec104c-46e1-4fb3-a8bc-f5664e798321-metrics-certs\") pod \"network-metrics-daemon-lk2c6\" (UID: \"80ec104c-46e1-4fb3-a8bc-f5664e798321\") " pod="openshift-multus/network-metrics-daemon-lk2c6" May 21 18:13:21.566916 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:21.566444 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 18:13:21.566916 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:21.566518 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80ec104c-46e1-4fb3-a8bc-f5664e798321-metrics-certs podName:80ec104c-46e1-4fb3-a8bc-f5664e798321 nodeName:}" failed. No retries permitted until 2026-05-21 18:13:25.566498346 +0000 UTC m=+10.151984761 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/80ec104c-46e1-4fb3-a8bc-f5664e798321-metrics-certs") pod "network-metrics-daemon-lk2c6" (UID: "80ec104c-46e1-4fb3-a8bc-f5664e798321") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 18:13:21.667326 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:21.666648 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f7q6m\" (UniqueName: \"kubernetes.io/projected/96d08281-69d3-4a00-ba5c-74771da205d3-kube-api-access-f7q6m\") pod \"network-check-target-qfkc7\" (UID: \"96d08281-69d3-4a00-ba5c-74771da205d3\") " pod="openshift-network-diagnostics/network-check-target-qfkc7" May 21 18:13:21.667326 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:21.666888 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 18:13:21.667326 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:21.666909 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 18:13:21.667326 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:21.666921 2567 projected.go:194] Error preparing data for projected volume kube-api-access-f7q6m for pod openshift-network-diagnostics/network-check-target-qfkc7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 18:13:21.667326 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:21.666976 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96d08281-69d3-4a00-ba5c-74771da205d3-kube-api-access-f7q6m podName:96d08281-69d3-4a00-ba5c-74771da205d3 nodeName:}" failed. No retries permitted until 2026-05-21 18:13:25.666958773 +0000 UTC m=+10.252445201 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-f7q6m" (UniqueName: "kubernetes.io/projected/96d08281-69d3-4a00-ba5c-74771da205d3-kube-api-access-f7q6m") pod "network-check-target-qfkc7" (UID: "96d08281-69d3-4a00-ba5c-74771da205d3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 18:13:21.983446 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:21.983372 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfkc7" May 21 18:13:21.983446 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:21.983389 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk2c6" May 21 18:13:21.983674 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:21.983504 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfkc7" podUID="96d08281-69d3-4a00-ba5c-74771da205d3" May 21 18:13:21.983770 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:21.983739 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk2c6" podUID="80ec104c-46e1-4fb3-a8bc-f5664e798321" May 21 18:13:23.979797 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:23.979763 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfkc7" May 21 18:13:23.980250 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:23.979900 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfkc7" podUID="96d08281-69d3-4a00-ba5c-74771da205d3" May 21 18:13:23.980250 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:23.979997 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk2c6" May 21 18:13:23.980250 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:23.980118 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk2c6" podUID="80ec104c-46e1-4fb3-a8bc-f5664e798321" May 21 18:13:25.600219 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:25.600181 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80ec104c-46e1-4fb3-a8bc-f5664e798321-metrics-certs\") pod \"network-metrics-daemon-lk2c6\" (UID: \"80ec104c-46e1-4fb3-a8bc-f5664e798321\") " pod="openshift-multus/network-metrics-daemon-lk2c6" May 21 18:13:25.600710 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:25.600355 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 18:13:25.600710 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:25.600441 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80ec104c-46e1-4fb3-a8bc-f5664e798321-metrics-certs podName:80ec104c-46e1-4fb3-a8bc-f5664e798321 nodeName:}" failed. No retries permitted until 2026-05-21 18:13:33.600419849 +0000 UTC m=+18.185906266 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/80ec104c-46e1-4fb3-a8bc-f5664e798321-metrics-certs") pod "network-metrics-daemon-lk2c6" (UID: "80ec104c-46e1-4fb3-a8bc-f5664e798321") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 18:13:25.701161 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:25.701121 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f7q6m\" (UniqueName: \"kubernetes.io/projected/96d08281-69d3-4a00-ba5c-74771da205d3-kube-api-access-f7q6m\") pod \"network-check-target-qfkc7\" (UID: \"96d08281-69d3-4a00-ba5c-74771da205d3\") " pod="openshift-network-diagnostics/network-check-target-qfkc7" May 21 18:13:25.701323 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:25.701282 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 18:13:25.701323 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:25.701300 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 18:13:25.701323 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:25.701312 2567 projected.go:194] Error preparing data for projected volume kube-api-access-f7q6m for pod openshift-network-diagnostics/network-check-target-qfkc7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 18:13:25.701476 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:25.701373 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96d08281-69d3-4a00-ba5c-74771da205d3-kube-api-access-f7q6m podName:96d08281-69d3-4a00-ba5c-74771da205d3 nodeName:}" failed. No retries permitted until 2026-05-21 18:13:33.701355723 +0000 UTC m=+18.286842144 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-f7q6m" (UniqueName: "kubernetes.io/projected/96d08281-69d3-4a00-ba5c-74771da205d3-kube-api-access-f7q6m") pod "network-check-target-qfkc7" (UID: "96d08281-69d3-4a00-ba5c-74771da205d3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 18:13:25.980772 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:25.980699 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfkc7" May 21 18:13:25.981587 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:25.981541 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk2c6" May 21 18:13:25.981714 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:25.981661 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfkc7" podUID="96d08281-69d3-4a00-ba5c-74771da205d3" May 21 18:13:25.981773 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:25.981760 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk2c6" podUID="80ec104c-46e1-4fb3-a8bc-f5664e798321" May 21 18:13:27.979816 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:27.979777 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfkc7" May 21 18:13:27.980312 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:27.979836 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk2c6" May 21 18:13:27.980312 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:27.979958 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfkc7" podUID="96d08281-69d3-4a00-ba5c-74771da205d3" May 21 18:13:27.980312 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:27.980093 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk2c6" podUID="80ec104c-46e1-4fb3-a8bc-f5664e798321" May 21 18:13:29.979427 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:29.979390 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfkc7" May 21 18:13:29.979898 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:29.979516 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfkc7" podUID="96d08281-69d3-4a00-ba5c-74771da205d3" May 21 18:13:29.979898 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:29.979589 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk2c6" May 21 18:13:29.979898 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:29.979703 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk2c6" podUID="80ec104c-46e1-4fb3-a8bc-f5664e798321" May 21 18:13:31.979762 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:31.979672 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk2c6" May 21 18:13:31.979762 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:31.979698 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfkc7" May 21 18:13:31.980260 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:31.979833 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk2c6" podUID="80ec104c-46e1-4fb3-a8bc-f5664e798321" May 21 18:13:31.980260 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:31.979944 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfkc7" podUID="96d08281-69d3-4a00-ba5c-74771da205d3" May 21 18:13:33.661201 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:33.661149 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80ec104c-46e1-4fb3-a8bc-f5664e798321-metrics-certs\") pod \"network-metrics-daemon-lk2c6\" (UID: \"80ec104c-46e1-4fb3-a8bc-f5664e798321\") " pod="openshift-multus/network-metrics-daemon-lk2c6" May 21 18:13:33.661687 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:33.661304 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 18:13:33.661687 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:33.661369 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80ec104c-46e1-4fb3-a8bc-f5664e798321-metrics-certs podName:80ec104c-46e1-4fb3-a8bc-f5664e798321 nodeName:}" failed. No retries permitted until 2026-05-21 18:13:49.661354114 +0000 UTC m=+34.246840528 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/80ec104c-46e1-4fb3-a8bc-f5664e798321-metrics-certs") pod "network-metrics-daemon-lk2c6" (UID: "80ec104c-46e1-4fb3-a8bc-f5664e798321") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 18:13:33.761973 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:33.761938 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f7q6m\" (UniqueName: \"kubernetes.io/projected/96d08281-69d3-4a00-ba5c-74771da205d3-kube-api-access-f7q6m\") pod \"network-check-target-qfkc7\" (UID: \"96d08281-69d3-4a00-ba5c-74771da205d3\") " pod="openshift-network-diagnostics/network-check-target-qfkc7" May 21 18:13:33.762142 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:33.762093 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 18:13:33.762142 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:33.762113 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 18:13:33.762142 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:33.762127 2567 projected.go:194] Error preparing data for projected volume kube-api-access-f7q6m for pod openshift-network-diagnostics/network-check-target-qfkc7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 18:13:33.762269 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:33.762185 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96d08281-69d3-4a00-ba5c-74771da205d3-kube-api-access-f7q6m podName:96d08281-69d3-4a00-ba5c-74771da205d3 nodeName:}" failed. No retries permitted until 2026-05-21 18:13:49.762172248 +0000 UTC m=+34.347658661 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-f7q6m" (UniqueName: "kubernetes.io/projected/96d08281-69d3-4a00-ba5c-74771da205d3-kube-api-access-f7q6m") pod "network-check-target-qfkc7" (UID: "96d08281-69d3-4a00-ba5c-74771da205d3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 18:13:33.979384 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:33.979307 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfkc7" May 21 18:13:33.979527 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:33.979431 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfkc7" podUID="96d08281-69d3-4a00-ba5c-74771da205d3" May 21 18:13:33.979527 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:33.979469 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk2c6" May 21 18:13:33.979641 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:33.979526 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk2c6" podUID="80ec104c-46e1-4fb3-a8bc-f5664e798321" May 21 18:13:35.979713 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:35.979682 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk2c6" May 21 18:13:35.980043 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:35.979770 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk2c6" podUID="80ec104c-46e1-4fb3-a8bc-f5664e798321" May 21 18:13:35.980043 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:35.979861 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfkc7" May 21 18:13:35.980043 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:35.979973 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfkc7" podUID="96d08281-69d3-4a00-ba5c-74771da205d3" May 21 18:13:37.071350 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:37.071112 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l82nt" event={"ID":"5ec61c29-892e-485c-b233-01e2eafa1ff4","Type":"ContainerStarted","Data":"f04f28a3b48d4e115a27345a4c8d6025d36ac0d71892c64a1b5693d3c7e826f1"} May 21 18:13:37.072487 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:37.072461 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fwkk2" event={"ID":"e3c0da04-85d7-4c03-8f44-42c8748c4218","Type":"ContainerStarted","Data":"90390239e504e967f79e6d96eddd43f9484f12af281dcd8d62ab6357f07a5c5c"} May 21 18:13:37.073777 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:37.073751 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5wfjk" event={"ID":"79474071-9b7b-4d06-b70e-c65abde6fc43","Type":"ContainerStarted","Data":"a597ae5fe194ad28c301d02b7c113f0addfd0410126d4d6ad5a149fbf45c3aaf"} May 21 18:13:37.074896 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:37.074869 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6h54k" event={"ID":"806b4e1a-170a-44ac-b356-92e2c2337e02","Type":"ContainerStarted","Data":"189753b4dd65955ec29cc8c3bcfe2d1e5d47731eff65cad2c127ee2cc7bf0ec1"} May 21 18:13:37.076016 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:37.075985 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnfz9" event={"ID":"4b6958b0-ec19-4342-80d1-162637b9dd34","Type":"ContainerStarted","Data":"e519b3e330c95d8ea952c739432ffe7fcc1b9f50d2c9d41e77987bfd3dbbbb6c"} May 21 18:13:37.077198 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:37.077173 2567 generic.go:358] "Generic (PLEG): container finished" podID="868c9a60-0d4e-4bda-9e1d-8c1087daa9e5" containerID="9bd262839fdc44792c0c2a477c9fe478bf9d81aafed1e9ad097c809ff4624064" exitCode=0 May 21 18:13:37.077299 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:37.077234 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jx9sz" event={"ID":"868c9a60-0d4e-4bda-9e1d-8c1087daa9e5","Type":"ContainerDied","Data":"9bd262839fdc44792c0c2a477c9fe478bf9d81aafed1e9ad097c809ff4624064"} May 21 18:13:37.078377 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:37.078351 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zkz67" event={"ID":"151a7f52-0d11-42c8-a0d5-87d0d3cd7598","Type":"ContainerStarted","Data":"efc455595b482b0df46ea3f38c12f6cfe61198f203fad98c63ebb45f1b75508b"} May 21 18:13:37.080797 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:37.080780 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2n5jr_d9537e64-5ba3-4910-998c-e9d3deb97929/ovn-acl-logging/0.log" May 21 18:13:37.081074 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:37.081056 2567 generic.go:358] "Generic (PLEG): container finished" podID="d9537e64-5ba3-4910-998c-e9d3deb97929" containerID="25b732c149b6c31e1353d7d92c0ea28ccabaaa509f62f5a4bd4b1f4ff4da6bb1" exitCode=1 May 21 18:13:37.081169 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:37.081088 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" event={"ID":"d9537e64-5ba3-4910-998c-e9d3deb97929","Type":"ContainerStarted","Data":"de2dbdb3e83aaf2be005dcab8ec975bcd29709b8012f6b72b8f4ab395fe78e82"} May 21 18:13:37.081169 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:37.081108 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" event={"ID":"d9537e64-5ba3-4910-998c-e9d3deb97929","Type":"ContainerStarted","Data":"bb82a00658e76153741d9db243dd6acaae4ef4f04f800bffa4f9616e4008e84f"} May 21 18:13:37.081169 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:37.081122 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" event={"ID":"d9537e64-5ba3-4910-998c-e9d3deb97929","Type":"ContainerStarted","Data":"4a8ea5c27a58cdf20c15934eb60ce32e6b68c2e674bfc1273597d06db30164f6"} May 21 18:13:37.081169 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:37.081134 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" event={"ID":"d9537e64-5ba3-4910-998c-e9d3deb97929","Type":"ContainerStarted","Data":"1db4219224ee90ff8cb37767b174a66664ffd120dce37f25e39eea000567dad0"} May 21 18:13:37.081169 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:37.081145 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" event={"ID":"d9537e64-5ba3-4910-998c-e9d3deb97929","Type":"ContainerDied","Data":"25b732c149b6c31e1353d7d92c0ea28ccabaaa509f62f5a4bd4b1f4ff4da6bb1"} May 21 18:13:37.081169 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:37.081158 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" event={"ID":"d9537e64-5ba3-4910-998c-e9d3deb97929","Type":"ContainerStarted","Data":"c05b5919b4eea3862c74a2b659ca778624cfc06e7195a626d63cb875af1ed1f4"} May 21 18:13:37.097203 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:37.097166 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal" podStartSLOduration=20.097138323 podStartE2EDuration="20.097138323s" podCreationTimestamp="2026-05-21 18:13:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:13:21.084681473 +0000 UTC m=+5.670167908" watchObservedRunningTime="2026-05-21 18:13:37.097138323 +0000 UTC m=+21.682624741" May 21 18:13:37.097665 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:37.097638 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-l82nt" podStartSLOduration=3.930431803 podStartE2EDuration="21.09763035s" podCreationTimestamp="2026-05-21 18:13:16 +0000 UTC" firstStartedPulling="2026-05-21 18:13:18.849424009 +0000 UTC m=+3.434910427" lastFinishedPulling="2026-05-21 18:13:36.016622551 +0000 UTC m=+20.602108974" observedRunningTime="2026-05-21 18:13:37.09723107 +0000 UTC m=+21.682717504" watchObservedRunningTime="2026-05-21 18:13:37.09763035 +0000 UTC m=+21.683116785" May 21 18:13:37.113875 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:37.113835 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5wfjk" podStartSLOduration=3.948353341 podStartE2EDuration="21.113817621s" podCreationTimestamp="2026-05-21 18:13:16 +0000 UTC" firstStartedPulling="2026-05-21 18:13:18.85115579 +0000 UTC m=+3.436642213" lastFinishedPulling="2026-05-21 18:13:36.016620066 +0000 UTC m=+20.602106493" observedRunningTime="2026-05-21 18:13:37.113634419 +0000 UTC m=+21.699120854" watchObservedRunningTime="2026-05-21 18:13:37.113817621 +0000 UTC m=+21.699304058" May 21 18:13:37.164162 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:37.164115 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-zkz67" podStartSLOduration=3.934739089 podStartE2EDuration="21.164102244s" podCreationTimestamp="2026-05-21 18:13:16 +0000 UTC" firstStartedPulling="2026-05-21 18:13:18.845242028 +0000 UTC m=+3.430728447" lastFinishedPulling="2026-05-21 18:13:36.074605177 +0000 UTC m=+20.660091602" observedRunningTime="2026-05-21 18:13:37.163881083 +0000 UTC m=+21.749367531" watchObservedRunningTime="2026-05-21 18:13:37.164102244 +0000 UTC m=+21.749588678" May 21 18:13:37.180141 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:37.180098 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-6h54k" podStartSLOduration=4.003490002 podStartE2EDuration="21.180087521s" podCreationTimestamp="2026-05-21 18:13:16 +0000 UTC" firstStartedPulling="2026-05-21 18:13:18.846213998 +0000 UTC m=+3.431700416" lastFinishedPulling="2026-05-21 18:13:36.022811518 +0000 UTC m=+20.608297935" observedRunningTime="2026-05-21 18:13:37.179934004 +0000 UTC m=+21.765420441" watchObservedRunningTime="2026-05-21 18:13:37.180087521 +0000 UTC m=+21.765573955" May 21 18:13:37.193773 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:37.193730 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fwkk2" podStartSLOduration=4.032566093 podStartE2EDuration="21.193718834s" podCreationTimestamp="2026-05-21 18:13:16 +0000 UTC" firstStartedPulling="2026-05-21 18:13:18.855447728 +0000 UTC m=+3.440934141" lastFinishedPulling="2026-05-21 18:13:36.016600468 +0000 UTC m=+20.602086882" observedRunningTime="2026-05-21 18:13:37.193290447 +0000 UTC m=+21.778776881" watchObservedRunningTime="2026-05-21 18:13:37.193718834 +0000 UTC m=+21.779205267" May 21 18:13:37.366711 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:37.366688 2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 21 18:13:37.979037 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:37.979005 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfkc7" May 21 18:13:37.979272 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:37.979008 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk2c6" May 21 18:13:37.979272 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:37.979107 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfkc7" podUID="96d08281-69d3-4a00-ba5c-74771da205d3" May 21 18:13:37.979272 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:37.979210 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk2c6" podUID="80ec104c-46e1-4fb3-a8bc-f5664e798321" May 21 18:13:37.998657 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:37.998539 2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T18:13:37.366708061Z","UUID":"09304a89-53b4-46b6-b9d3-cf21d787cdc6","Handler":null,"Name":"","Endpoint":""} May 21 18:13:38.000264 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:38.000224 2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 21 18:13:38.000390 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:38.000274 2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 21 18:13:38.084703 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:38.084665 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnfz9" event={"ID":"4b6958b0-ec19-4342-80d1-162637b9dd34","Type":"ContainerStarted","Data":"719bf8b4f3c13c8512c5dd943be8848704b564986075d94e5e351b569da032ab"} May 21 18:13:38.086391 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:38.086256 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xzwnx" event={"ID":"650efcfa-3258-4d4e-bb7f-4d26aa341842","Type":"ContainerStarted","Data":"021e95ae47dd3e1bb95a53d6fdc859c41a4797805b9026aa588216040f56df79"} May 21 18:13:38.101301 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:38.101254 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xzwnx" podStartSLOduration=4.931929418 podStartE2EDuration="22.101235543s" podCreationTimestamp="2026-05-21 18:13:16 +0000 UTC" firstStartedPulling="2026-05-21 18:13:18.847506278 +0000 UTC m=+3.432992691" lastFinishedPulling="2026-05-21 18:13:36.016812395 +0000 UTC m=+20.602298816" observedRunningTime="2026-05-21 18:13:38.101084121 +0000 UTC m=+22.686570555" watchObservedRunningTime="2026-05-21 18:13:38.101235543 +0000 UTC m=+22.686721980" May 21 18:13:39.090349 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:39.090250 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnfz9" event={"ID":"4b6958b0-ec19-4342-80d1-162637b9dd34","Type":"ContainerStarted","Data":"610a7b284510dfd83846151a1c700db0334ee290974c419fc2af402059664aea"} May 21 18:13:39.093177 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:39.093153 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2n5jr_d9537e64-5ba3-4910-998c-e9d3deb97929/ovn-acl-logging/0.log" May 21 18:13:39.093952 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:39.093537 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" event={"ID":"d9537e64-5ba3-4910-998c-e9d3deb97929","Type":"ContainerStarted","Data":"f16b3a881fdc3303e235730fe7151b70b8ff172780fbf5401bcd39cc9383baa4"} May 21 18:13:39.108213 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:39.108166 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnfz9" podStartSLOduration=3.712625747 podStartE2EDuration="23.108153766s" podCreationTimestamp="2026-05-21 18:13:16 +0000 UTC" firstStartedPulling="2026-05-21 18:13:18.849223302 +0000 UTC m=+3.434709726" lastFinishedPulling="2026-05-21 18:13:38.244751323 +0000 UTC m=+22.830237745" observedRunningTime="2026-05-21 18:13:39.107008707 +0000 UTC m=+23.692495141" watchObservedRunningTime="2026-05-21 18:13:39.108153766 +0000 UTC m=+23.693640201" May 21 18:13:39.982541 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:39.980067 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfkc7" May 21 18:13:39.982541 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:39.980096 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk2c6" May 21 18:13:39.982541 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:39.980283 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfkc7" podUID="96d08281-69d3-4a00-ba5c-74771da205d3" May 21 18:13:39.982541 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:39.980436 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk2c6" podUID="80ec104c-46e1-4fb3-a8bc-f5664e798321" May 21 18:13:40.421396 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:40.421314 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-l82nt" May 21 18:13:40.421895 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:40.421878 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-l82nt" May 21 18:13:41.978956 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:41.978921 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk2c6" May 21 18:13:41.978956 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:41.978958 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfkc7" May 21 18:13:41.979569 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:41.979037 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk2c6" podUID="80ec104c-46e1-4fb3-a8bc-f5664e798321" May 21 18:13:41.979569 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:41.979107 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfkc7" podUID="96d08281-69d3-4a00-ba5c-74771da205d3" May 21 18:13:42.103406 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:42.103096 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2n5jr_d9537e64-5ba3-4910-998c-e9d3deb97929/ovn-acl-logging/0.log" May 21 18:13:42.103797 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:42.103593 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" event={"ID":"d9537e64-5ba3-4910-998c-e9d3deb97929","Type":"ContainerStarted","Data":"dbd52752afad9b6c2a53a9b0a94f427bd9ad347c187121cc4a6bd9d7a765e18a"} May 21 18:13:42.104246 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:42.103907 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:42.104246 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:42.103934 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:42.104246 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:42.104082 2567 scope.go:117] "RemoveContainer" containerID="25b732c149b6c31e1353d7d92c0ea28ccabaaa509f62f5a4bd4b1f4ff4da6bb1" May 21 18:13:42.120302 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:42.120182 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:42.693144 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:42.693064 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-l82nt" May 21 18:13:42.693309 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:42.693191 2567 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 21 18:13:42.693617 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:42.693599 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-l82nt" May 21 18:13:43.107952 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:43.107927 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2n5jr_d9537e64-5ba3-4910-998c-e9d3deb97929/ovn-acl-logging/0.log" May 21 18:13:43.108377 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:43.108221 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" event={"ID":"d9537e64-5ba3-4910-998c-e9d3deb97929","Type":"ContainerStarted","Data":"f2c5cc31b8f4c52b7748151f73310b2d006ec83ae42f184555dd5917264f48b9"} May 21 18:13:43.108488 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:43.108463 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:43.109833 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:43.109811 2567 generic.go:358] "Generic (PLEG): container finished" podID="868c9a60-0d4e-4bda-9e1d-8c1087daa9e5" containerID="cdd484899d87ec25dd3726cc01ebcedd8d0c2778f6ccf050cf88816df84bb7ee" exitCode=0 May 21 18:13:43.109949 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:43.109892 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jx9sz" event={"ID":"868c9a60-0d4e-4bda-9e1d-8c1087daa9e5","Type":"ContainerDied","Data":"cdd484899d87ec25dd3726cc01ebcedd8d0c2778f6ccf050cf88816df84bb7ee"} May 21 18:13:43.124126 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:43.124099 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:13:43.133272 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:43.133237 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" podStartSLOduration=9.904183299 podStartE2EDuration="27.13322559s" podCreationTimestamp="2026-05-21 18:13:16 +0000 UTC" firstStartedPulling="2026-05-21 18:13:18.854784318 +0000 UTC m=+3.440270731" lastFinishedPulling="2026-05-21 18:13:36.083826592 +0000 UTC m=+20.669313022" observedRunningTime="2026-05-21 18:13:43.131675023 +0000 UTC m=+27.717161458" watchObservedRunningTime="2026-05-21 18:13:43.13322559 +0000 UTC m=+27.718712024" May 21 18:13:43.978858 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:43.978832 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfkc7" May 21 18:13:43.978990 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:43.978832 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk2c6" May 21 18:13:43.978990 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:43.978936 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfkc7" podUID="96d08281-69d3-4a00-ba5c-74771da205d3" May 21 18:13:43.979106 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:43.979005 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk2c6" podUID="80ec104c-46e1-4fb3-a8bc-f5664e798321" May 21 18:13:44.000884 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:44.000823 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lk2c6"] May 21 18:13:44.003972 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:44.003933 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qfkc7"] May 21 18:13:44.113796 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:44.113563 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jx9sz" event={"ID":"868c9a60-0d4e-4bda-9e1d-8c1087daa9e5","Type":"ContainerStarted","Data":"a667f615a4ee0aef81e2aa904a66bb4c74efd29126d3d414ec298edc20990816"} May 21 18:13:44.114077 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:44.113660 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk2c6" May 21 18:13:44.114077 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:44.113686 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfkc7" May 21 18:13:44.114193 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:44.114170 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk2c6" podUID="80ec104c-46e1-4fb3-a8bc-f5664e798321" May 21 18:13:44.114259 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:44.114244 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfkc7" podUID="96d08281-69d3-4a00-ba5c-74771da205d3" May 21 18:13:45.116924 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:45.116891 2567 generic.go:358] "Generic (PLEG): container finished" podID="868c9a60-0d4e-4bda-9e1d-8c1087daa9e5" containerID="a667f615a4ee0aef81e2aa904a66bb4c74efd29126d3d414ec298edc20990816" exitCode=0 May 21 18:13:45.117290 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:45.116978 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jx9sz" event={"ID":"868c9a60-0d4e-4bda-9e1d-8c1087daa9e5","Type":"ContainerDied","Data":"a667f615a4ee0aef81e2aa904a66bb4c74efd29126d3d414ec298edc20990816"} May 21 18:13:45.980382 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:45.980353 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfkc7" May 21 18:13:45.980530 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:45.980422 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfkc7" podUID="96d08281-69d3-4a00-ba5c-74771da205d3" May 21 18:13:45.980530 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:45.980512 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk2c6" May 21 18:13:45.980661 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:45.980639 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk2c6" podUID="80ec104c-46e1-4fb3-a8bc-f5664e798321" May 21 18:13:46.121081 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:46.120994 2567 generic.go:358] "Generic (PLEG): container finished" podID="868c9a60-0d4e-4bda-9e1d-8c1087daa9e5" containerID="f9c44dc38c2388212df7944384b9f8f82297a0cf2c176c928e5deb0aa29de394" exitCode=0 May 21 18:13:46.121081 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:46.121065 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jx9sz" event={"ID":"868c9a60-0d4e-4bda-9e1d-8c1087daa9e5","Type":"ContainerDied","Data":"f9c44dc38c2388212df7944384b9f8f82297a0cf2c176c928e5deb0aa29de394"} May 21 18:13:47.979629 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:47.979590 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfkc7" May 21 18:13:47.980144 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:47.979594 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk2c6" May 21 18:13:47.980144 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:47.979735 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qfkc7" podUID="96d08281-69d3-4a00-ba5c-74771da205d3" May 21 18:13:47.980144 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:47.979794 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk2c6" podUID="80ec104c-46e1-4fb3-a8bc-f5664e798321" May 21 18:13:49.225485 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.225449 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeReady" May 21 18:13:49.226130 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.225612 2567 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 21 18:13:49.258056 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.258024 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-655b874888-tngrh"] May 21 18:13:49.279665 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.279634 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-x42gp"] May 21 18:13:49.297474 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.297445 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jmg7k"] May 21 18:13:49.297614 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.297495 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-655b874888-tngrh" May 21 18:13:49.297675 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.297643 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x42gp" May 21 18:13:49.300132 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.300113 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 21 18:13:49.300253 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.300134 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 21 18:13:49.300253 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.300177 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-sjddb\"" May 21 18:13:49.300253 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.300120 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 21 18:13:49.300460 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.300447 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8zgcw\"" May 21 18:13:49.300587 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.300556 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 21 18:13:49.301156 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.301140 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 21 18:13:49.304403 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.304384 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 21 18:13:49.319474 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.319456 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-655b874888-tngrh"] May 21 18:13:49.319474 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.319477 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x42gp"] May 21 18:13:49.319601 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.319487 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jmg7k"] May 21 18:13:49.319601 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.319562 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jmg7k" May 21 18:13:49.321602 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.321585 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 21 18:13:49.321693 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.321618 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xmgqj\"" May 21 18:13:49.321693 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.321647 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 21 18:13:49.321858 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.321845 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 21 18:13:49.372871 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.372850 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a748fb72-614d-4d85-aba5-8a243e2cd7bc-bound-sa-token\") pod \"image-registry-655b874888-tngrh\" (UID: \"a748fb72-614d-4d85-aba5-8a243e2cd7bc\") " pod="openshift-image-registry/image-registry-655b874888-tngrh" May 21 18:13:49.372871 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.372878 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a748fb72-614d-4d85-aba5-8a243e2cd7bc-trusted-ca\") pod \"image-registry-655b874888-tngrh\" (UID: \"a748fb72-614d-4d85-aba5-8a243e2cd7bc\") " pod="openshift-image-registry/image-registry-655b874888-tngrh" May 21 18:13:49.373044 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.372898 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a748fb72-614d-4d85-aba5-8a243e2cd7bc-registry-certificates\") pod \"image-registry-655b874888-tngrh\" (UID: \"a748fb72-614d-4d85-aba5-8a243e2cd7bc\") " pod="openshift-image-registry/image-registry-655b874888-tngrh" May 21 18:13:49.373044 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.372916 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5f9e615-faab-4e8d-aff3-b1fb8007d012-tmp-dir\") pod \"dns-default-x42gp\" (UID: \"e5f9e615-faab-4e8d-aff3-b1fb8007d012\") " pod="openshift-dns/dns-default-x42gp" May 21 18:13:49.373044 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.372988 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a748fb72-614d-4d85-aba5-8a243e2cd7bc-ca-trust-extracted\") pod \"image-registry-655b874888-tngrh\" (UID: \"a748fb72-614d-4d85-aba5-8a243e2cd7bc\") " pod="openshift-image-registry/image-registry-655b874888-tngrh" May 21 18:13:49.373044 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.373023 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a748fb72-614d-4d85-aba5-8a243e2cd7bc-registry-tls\") pod \"image-registry-655b874888-tngrh\" (UID: \"a748fb72-614d-4d85-aba5-8a243e2cd7bc\") " pod="openshift-image-registry/image-registry-655b874888-tngrh" May 21 18:13:49.373044 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.373044 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e5f9e615-faab-4e8d-aff3-b1fb8007d012-config-volume\") pod \"dns-default-x42gp\" (UID: \"e5f9e615-faab-4e8d-aff3-b1fb8007d012\") " pod="openshift-dns/dns-default-x42gp" May 21 18:13:49.373269 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.373062 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvd94\" (UniqueName: \"kubernetes.io/projected/a748fb72-614d-4d85-aba5-8a243e2cd7bc-kube-api-access-nvd94\") pod \"image-registry-655b874888-tngrh\" (UID: \"a748fb72-614d-4d85-aba5-8a243e2cd7bc\") " pod="openshift-image-registry/image-registry-655b874888-tngrh" May 21 18:13:49.373269 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.373092 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5f9e615-faab-4e8d-aff3-b1fb8007d012-metrics-tls\") pod \"dns-default-x42gp\" (UID: \"e5f9e615-faab-4e8d-aff3-b1fb8007d012\") " pod="openshift-dns/dns-default-x42gp" May 21 18:13:49.373269 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.373166 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a748fb72-614d-4d85-aba5-8a243e2cd7bc-image-registry-private-configuration\") pod \"image-registry-655b874888-tngrh\" (UID: \"a748fb72-614d-4d85-aba5-8a243e2cd7bc\") " pod="openshift-image-registry/image-registry-655b874888-tngrh" May 21 18:13:49.373269 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.373214 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a748fb72-614d-4d85-aba5-8a243e2cd7bc-installation-pull-secrets\") pod \"image-registry-655b874888-tngrh\" (UID: \"a748fb72-614d-4d85-aba5-8a243e2cd7bc\") " pod="openshift-image-registry/image-registry-655b874888-tngrh" May 21 18:13:49.373269 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.373250 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcrpb\" (UniqueName: \"kubernetes.io/projected/e5f9e615-faab-4e8d-aff3-b1fb8007d012-kube-api-access-bcrpb\") pod \"dns-default-x42gp\" (UID: \"e5f9e615-faab-4e8d-aff3-b1fb8007d012\") " pod="openshift-dns/dns-default-x42gp" May 21 18:13:49.474269 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.474237 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a748fb72-614d-4d85-aba5-8a243e2cd7bc-image-registry-private-configuration\") pod \"image-registry-655b874888-tngrh\" (UID: \"a748fb72-614d-4d85-aba5-8a243e2cd7bc\") " pod="openshift-image-registry/image-registry-655b874888-tngrh" May 21 18:13:49.474453 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.474283 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a748fb72-614d-4d85-aba5-8a243e2cd7bc-installation-pull-secrets\") pod \"image-registry-655b874888-tngrh\" (UID: \"a748fb72-614d-4d85-aba5-8a243e2cd7bc\") " pod="openshift-image-registry/image-registry-655b874888-tngrh" May 21 18:13:49.474518 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.474472 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bcrpb\" (UniqueName: \"kubernetes.io/projected/e5f9e615-faab-4e8d-aff3-b1fb8007d012-kube-api-access-bcrpb\") pod \"dns-default-x42gp\" (UID: \"e5f9e615-faab-4e8d-aff3-b1fb8007d012\") " pod="openshift-dns/dns-default-x42gp" May 21 18:13:49.474568 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.474537 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8-cert\") pod \"ingress-canary-jmg7k\" (UID: \"1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8\") " pod="openshift-ingress-canary/ingress-canary-jmg7k" May 21 18:13:49.474655 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.474593 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a748fb72-614d-4d85-aba5-8a243e2cd7bc-bound-sa-token\") pod \"image-registry-655b874888-tngrh\" (UID: \"a748fb72-614d-4d85-aba5-8a243e2cd7bc\") " pod="openshift-image-registry/image-registry-655b874888-tngrh" May 21 18:13:49.474655 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.474623 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a748fb72-614d-4d85-aba5-8a243e2cd7bc-trusted-ca\") pod \"image-registry-655b874888-tngrh\" (UID: \"a748fb72-614d-4d85-aba5-8a243e2cd7bc\") " pod="openshift-image-registry/image-registry-655b874888-tngrh" May 21 18:13:49.474742 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.474681 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a748fb72-614d-4d85-aba5-8a243e2cd7bc-registry-certificates\") pod \"image-registry-655b874888-tngrh\" (UID: \"a748fb72-614d-4d85-aba5-8a243e2cd7bc\") " pod="openshift-image-registry/image-registry-655b874888-tngrh" May 21 18:13:49.474742 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.474736 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5f9e615-faab-4e8d-aff3-b1fb8007d012-tmp-dir\") pod \"dns-default-x42gp\" (UID: \"e5f9e615-faab-4e8d-aff3-b1fb8007d012\") " pod="openshift-dns/dns-default-x42gp" May 21 18:13:49.474819 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.474777 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a748fb72-614d-4d85-aba5-8a243e2cd7bc-ca-trust-extracted\") pod \"image-registry-655b874888-tngrh\" (UID: \"a748fb72-614d-4d85-aba5-8a243e2cd7bc\") " pod="openshift-image-registry/image-registry-655b874888-tngrh" May 21 18:13:49.474819 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.474810 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a748fb72-614d-4d85-aba5-8a243e2cd7bc-registry-tls\") pod \"image-registry-655b874888-tngrh\" (UID: \"a748fb72-614d-4d85-aba5-8a243e2cd7bc\") " pod="openshift-image-registry/image-registry-655b874888-tngrh" May 21 18:13:49.474903 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.474844 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqxsx\" (UniqueName: \"kubernetes.io/projected/1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8-kube-api-access-jqxsx\") pod \"ingress-canary-jmg7k\" (UID: \"1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8\") " pod="openshift-ingress-canary/ingress-canary-jmg7k" May 21 18:13:49.474903 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.474874 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e5f9e615-faab-4e8d-aff3-b1fb8007d012-config-volume\") pod \"dns-default-x42gp\" (UID: \"e5f9e615-faab-4e8d-aff3-b1fb8007d012\") " pod="openshift-dns/dns-default-x42gp" May 21 18:13:49.474993 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.474903 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nvd94\" (UniqueName: \"kubernetes.io/projected/a748fb72-614d-4d85-aba5-8a243e2cd7bc-kube-api-access-nvd94\") pod \"image-registry-655b874888-tngrh\" (UID: \"a748fb72-614d-4d85-aba5-8a243e2cd7bc\") " pod="openshift-image-registry/image-registry-655b874888-tngrh" May 21 18:13:49.474993 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.474950 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5f9e615-faab-4e8d-aff3-b1fb8007d012-metrics-tls\") pod \"dns-default-x42gp\" (UID: \"e5f9e615-faab-4e8d-aff3-b1fb8007d012\") " pod="openshift-dns/dns-default-x42gp" May 21 18:13:49.475086 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:49.475070 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 18:13:49.475134 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:49.475100 2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 18:13:49.475134 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:49.475115 2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-655b874888-tngrh: secret "image-registry-tls" not found May 21 18:13:49.475134 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:49.475133 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5f9e615-faab-4e8d-aff3-b1fb8007d012-metrics-tls podName:e5f9e615-faab-4e8d-aff3-b1fb8007d012 nodeName:}" failed. No retries permitted until 2026-05-21 18:13:49.975115793 +0000 UTC m=+34.560602219 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5f9e615-faab-4e8d-aff3-b1fb8007d012-metrics-tls") pod "dns-default-x42gp" (UID: "e5f9e615-faab-4e8d-aff3-b1fb8007d012") : secret "dns-default-metrics-tls" not found May 21 18:13:49.475276 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.475131 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a748fb72-614d-4d85-aba5-8a243e2cd7bc-ca-trust-extracted\") pod \"image-registry-655b874888-tngrh\" (UID: \"a748fb72-614d-4d85-aba5-8a243e2cd7bc\") " pod="openshift-image-registry/image-registry-655b874888-tngrh" May 21 18:13:49.475276 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:49.475164 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a748fb72-614d-4d85-aba5-8a243e2cd7bc-registry-tls podName:a748fb72-614d-4d85-aba5-8a243e2cd7bc nodeName:}" failed. No retries permitted until 2026-05-21 18:13:49.975145761 +0000 UTC m=+34.560632194 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a748fb72-614d-4d85-aba5-8a243e2cd7bc-registry-tls") pod "image-registry-655b874888-tngrh" (UID: "a748fb72-614d-4d85-aba5-8a243e2cd7bc") : secret "image-registry-tls" not found May 21 18:13:49.475276 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.475190 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5f9e615-faab-4e8d-aff3-b1fb8007d012-tmp-dir\") pod \"dns-default-x42gp\" (UID: \"e5f9e615-faab-4e8d-aff3-b1fb8007d012\") " pod="openshift-dns/dns-default-x42gp" May 21 18:13:49.475702 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.475623 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e5f9e615-faab-4e8d-aff3-b1fb8007d012-config-volume\") pod \"dns-default-x42gp\" (UID: \"e5f9e615-faab-4e8d-aff3-b1fb8007d012\") " pod="openshift-dns/dns-default-x42gp" May 21 18:13:49.475702 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.475661 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a748fb72-614d-4d85-aba5-8a243e2cd7bc-trusted-ca\") pod \"image-registry-655b874888-tngrh\" (UID: \"a748fb72-614d-4d85-aba5-8a243e2cd7bc\") " pod="openshift-image-registry/image-registry-655b874888-tngrh" May 21 18:13:49.475845 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.475825 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a748fb72-614d-4d85-aba5-8a243e2cd7bc-registry-certificates\") pod \"image-registry-655b874888-tngrh\" (UID: \"a748fb72-614d-4d85-aba5-8a243e2cd7bc\") " pod="openshift-image-registry/image-registry-655b874888-tngrh" May 21 18:13:49.478821 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.478799 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a748fb72-614d-4d85-aba5-8a243e2cd7bc-image-registry-private-configuration\") pod \"image-registry-655b874888-tngrh\" (UID: \"a748fb72-614d-4d85-aba5-8a243e2cd7bc\") " pod="openshift-image-registry/image-registry-655b874888-tngrh" May 21 18:13:49.479086 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.479061 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a748fb72-614d-4d85-aba5-8a243e2cd7bc-installation-pull-secrets\") pod \"image-registry-655b874888-tngrh\" (UID: \"a748fb72-614d-4d85-aba5-8a243e2cd7bc\") " pod="openshift-image-registry/image-registry-655b874888-tngrh" May 21 18:13:49.483586 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.483552 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcrpb\" (UniqueName: \"kubernetes.io/projected/e5f9e615-faab-4e8d-aff3-b1fb8007d012-kube-api-access-bcrpb\") pod \"dns-default-x42gp\" (UID: \"e5f9e615-faab-4e8d-aff3-b1fb8007d012\") " pod="openshift-dns/dns-default-x42gp" May 21 18:13:49.483894 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.483874 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a748fb72-614d-4d85-aba5-8a243e2cd7bc-bound-sa-token\") pod \"image-registry-655b874888-tngrh\" (UID: \"a748fb72-614d-4d85-aba5-8a243e2cd7bc\") " pod="openshift-image-registry/image-registry-655b874888-tngrh" May 21 18:13:49.484361 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.484344 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvd94\" (UniqueName: \"kubernetes.io/projected/a748fb72-614d-4d85-aba5-8a243e2cd7bc-kube-api-access-nvd94\") pod \"image-registry-655b874888-tngrh\" (UID: \"a748fb72-614d-4d85-aba5-8a243e2cd7bc\") " pod="openshift-image-registry/image-registry-655b874888-tngrh" May 21 18:13:49.575470 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.575434 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8-cert\") pod \"ingress-canary-jmg7k\" (UID: \"1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8\") " pod="openshift-ingress-canary/ingress-canary-jmg7k" May 21 18:13:49.575664 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.575612 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jqxsx\" (UniqueName: \"kubernetes.io/projected/1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8-kube-api-access-jqxsx\") pod \"ingress-canary-jmg7k\" (UID: \"1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8\") " pod="openshift-ingress-canary/ingress-canary-jmg7k" May 21 18:13:49.575730 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:49.575612 2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 18:13:49.575778 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:49.575746 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8-cert podName:1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8 nodeName:}" failed. No retries permitted until 2026-05-21 18:13:50.075732058 +0000 UTC m=+34.661218475 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8-cert") pod "ingress-canary-jmg7k" (UID: "1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8") : secret "canary-serving-cert" not found May 21 18:13:49.584249 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.584224 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqxsx\" (UniqueName: \"kubernetes.io/projected/1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8-kube-api-access-jqxsx\") pod \"ingress-canary-jmg7k\" (UID: \"1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8\") " pod="openshift-ingress-canary/ingress-canary-jmg7k" May 21 18:13:49.676824 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.676787 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80ec104c-46e1-4fb3-a8bc-f5664e798321-metrics-certs\") pod \"network-metrics-daemon-lk2c6\" (UID: \"80ec104c-46e1-4fb3-a8bc-f5664e798321\") " pod="openshift-multus/network-metrics-daemon-lk2c6" May 21 18:13:49.676969 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:49.676947 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 18:13:49.677022 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:49.677011 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80ec104c-46e1-4fb3-a8bc-f5664e798321-metrics-certs podName:80ec104c-46e1-4fb3-a8bc-f5664e798321 nodeName:}" failed. No retries permitted until 2026-05-21 18:14:21.676998132 +0000 UTC m=+66.262484546 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/80ec104c-46e1-4fb3-a8bc-f5664e798321-metrics-certs") pod "network-metrics-daemon-lk2c6" (UID: "80ec104c-46e1-4fb3-a8bc-f5664e798321") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 18:13:49.777451 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.777363 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f7q6m\" (UniqueName: \"kubernetes.io/projected/96d08281-69d3-4a00-ba5c-74771da205d3-kube-api-access-f7q6m\") pod \"network-check-target-qfkc7\" (UID: \"96d08281-69d3-4a00-ba5c-74771da205d3\") " pod="openshift-network-diagnostics/network-check-target-qfkc7" May 21 18:13:49.777616 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:49.777545 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 18:13:49.777616 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:49.777565 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 18:13:49.777616 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:49.777587 2567 projected.go:194] Error preparing data for projected volume kube-api-access-f7q6m for pod openshift-network-diagnostics/network-check-target-qfkc7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 18:13:49.777748 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:49.777639 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96d08281-69d3-4a00-ba5c-74771da205d3-kube-api-access-f7q6m podName:96d08281-69d3-4a00-ba5c-74771da205d3 nodeName:}" failed. No retries permitted until 2026-05-21 18:14:21.777623164 +0000 UTC m=+66.363109581 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-f7q6m" (UniqueName: "kubernetes.io/projected/96d08281-69d3-4a00-ba5c-74771da205d3-kube-api-access-f7q6m") pod "network-check-target-qfkc7" (UID: "96d08281-69d3-4a00-ba5c-74771da205d3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 18:13:49.978871 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.978832 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a748fb72-614d-4d85-aba5-8a243e2cd7bc-registry-tls\") pod \"image-registry-655b874888-tngrh\" (UID: \"a748fb72-614d-4d85-aba5-8a243e2cd7bc\") " pod="openshift-image-registry/image-registry-655b874888-tngrh" May 21 18:13:49.979054 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.978888 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5f9e615-faab-4e8d-aff3-b1fb8007d012-metrics-tls\") pod \"dns-default-x42gp\" (UID: \"e5f9e615-faab-4e8d-aff3-b1fb8007d012\") " pod="openshift-dns/dns-default-x42gp" May 21 18:13:49.979054 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.979013 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfkc7" May 21 18:13:49.979054 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:49.979017 2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 18:13:49.979054 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:49.979038 2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-655b874888-tngrh: secret "image-registry-tls" not found May 21 18:13:49.979252 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:49.979100 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a748fb72-614d-4d85-aba5-8a243e2cd7bc-registry-tls podName:a748fb72-614d-4d85-aba5-8a243e2cd7bc nodeName:}" failed. No retries permitted until 2026-05-21 18:13:50.979077605 +0000 UTC m=+35.564564035 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a748fb72-614d-4d85-aba5-8a243e2cd7bc-registry-tls") pod "image-registry-655b874888-tngrh" (UID: "a748fb72-614d-4d85-aba5-8a243e2cd7bc") : secret "image-registry-tls" not found May 21 18:13:49.979252 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.979127 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk2c6" May 21 18:13:49.979252 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:49.979197 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 18:13:49.979387 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:49.979254 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5f9e615-faab-4e8d-aff3-b1fb8007d012-metrics-tls podName:e5f9e615-faab-4e8d-aff3-b1fb8007d012 nodeName:}" failed. No retries permitted until 2026-05-21 18:13:50.979237843 +0000 UTC m=+35.564724271 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5f9e615-faab-4e8d-aff3-b1fb8007d012-metrics-tls") pod "dns-default-x42gp" (UID: "e5f9e615-faab-4e8d-aff3-b1fb8007d012") : secret "dns-default-metrics-tls" not found May 21 18:13:49.981634 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.981613 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 18:13:49.981762 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.981679 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2tccs\"" May 21 18:13:49.981957 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.981940 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 18:13:49.982053 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.981955 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-w9qjh\"" May 21 18:13:49.982243 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:49.982226 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 18:13:50.079730 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:50.079643 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8-cert\") pod \"ingress-canary-jmg7k\" (UID: \"1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8\") " pod="openshift-ingress-canary/ingress-canary-jmg7k" May 21 18:13:50.079885 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:50.079817 2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 18:13:50.079885 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:50.079884 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8-cert podName:1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8 nodeName:}" failed. No retries permitted until 2026-05-21 18:13:51.079867081 +0000 UTC m=+35.665353507 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8-cert") pod "ingress-canary-jmg7k" (UID: "1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8") : secret "canary-serving-cert" not found May 21 18:13:50.987256 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:50.987217 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a748fb72-614d-4d85-aba5-8a243e2cd7bc-registry-tls\") pod \"image-registry-655b874888-tngrh\" (UID: \"a748fb72-614d-4d85-aba5-8a243e2cd7bc\") " pod="openshift-image-registry/image-registry-655b874888-tngrh" May 21 18:13:50.987866 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:50.987274 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5f9e615-faab-4e8d-aff3-b1fb8007d012-metrics-tls\") pod \"dns-default-x42gp\" (UID: \"e5f9e615-faab-4e8d-aff3-b1fb8007d012\") " pod="openshift-dns/dns-default-x42gp" May 21 18:13:50.987866 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:50.987374 2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 18:13:50.987866 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:50.987398 2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-655b874888-tngrh: secret "image-registry-tls" not found May 21 18:13:50.987866 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:50.987417 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 18:13:50.987866 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:50.987463 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a748fb72-614d-4d85-aba5-8a243e2cd7bc-registry-tls podName:a748fb72-614d-4d85-aba5-8a243e2cd7bc nodeName:}" failed. No retries permitted until 2026-05-21 18:13:52.987443277 +0000 UTC m=+37.572929690 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a748fb72-614d-4d85-aba5-8a243e2cd7bc-registry-tls") pod "image-registry-655b874888-tngrh" (UID: "a748fb72-614d-4d85-aba5-8a243e2cd7bc") : secret "image-registry-tls" not found May 21 18:13:50.987866 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:50.987481 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5f9e615-faab-4e8d-aff3-b1fb8007d012-metrics-tls podName:e5f9e615-faab-4e8d-aff3-b1fb8007d012 nodeName:}" failed. No retries permitted until 2026-05-21 18:13:52.98747252 +0000 UTC m=+37.572958933 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5f9e615-faab-4e8d-aff3-b1fb8007d012-metrics-tls") pod "dns-default-x42gp" (UID: "e5f9e615-faab-4e8d-aff3-b1fb8007d012") : secret "dns-default-metrics-tls" not found May 21 18:13:51.088591 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:51.088539 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8-cert\") pod \"ingress-canary-jmg7k\" (UID: \"1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8\") " pod="openshift-ingress-canary/ingress-canary-jmg7k" May 21 18:13:51.088768 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:51.088682 2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 18:13:51.088768 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:51.088758 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8-cert podName:1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8 nodeName:}" failed. No retries permitted until 2026-05-21 18:13:53.088739275 +0000 UTC m=+37.674225702 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8-cert") pod "ingress-canary-jmg7k" (UID: "1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8") : secret "canary-serving-cert" not found May 21 18:13:51.411357 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:51.411282 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-99nkl"] May 21 18:13:51.443792 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:51.443767 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-99nkl"] May 21 18:13:51.443938 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:51.443875 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-99nkl" May 21 18:13:51.446246 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:51.446218 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 21 18:13:51.593776 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:51.593746 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3f3c9bbc-1112-4856-9a53-6a1e76ca54e0-kubelet-config\") pod \"global-pull-secret-syncer-99nkl\" (UID: \"3f3c9bbc-1112-4856-9a53-6a1e76ca54e0\") " pod="kube-system/global-pull-secret-syncer-99nkl" May 21 18:13:51.593922 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:51.593805 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f3c9bbc-1112-4856-9a53-6a1e76ca54e0-original-pull-secret\") pod \"global-pull-secret-syncer-99nkl\" (UID: \"3f3c9bbc-1112-4856-9a53-6a1e76ca54e0\") " pod="kube-system/global-pull-secret-syncer-99nkl" May 21 18:13:51.593922 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:51.593830 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3f3c9bbc-1112-4856-9a53-6a1e76ca54e0-dbus\") pod \"global-pull-secret-syncer-99nkl\" (UID: \"3f3c9bbc-1112-4856-9a53-6a1e76ca54e0\") " pod="kube-system/global-pull-secret-syncer-99nkl" May 21 18:13:51.694801 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:51.694740 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f3c9bbc-1112-4856-9a53-6a1e76ca54e0-original-pull-secret\") pod \"global-pull-secret-syncer-99nkl\" (UID: \"3f3c9bbc-1112-4856-9a53-6a1e76ca54e0\") " pod="kube-system/global-pull-secret-syncer-99nkl" May 21 18:13:51.694801 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:51.694775 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3f3c9bbc-1112-4856-9a53-6a1e76ca54e0-dbus\") pod \"global-pull-secret-syncer-99nkl\" (UID: \"3f3c9bbc-1112-4856-9a53-6a1e76ca54e0\") " pod="kube-system/global-pull-secret-syncer-99nkl" May 21 18:13:51.694941 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:51.694869 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3f3c9bbc-1112-4856-9a53-6a1e76ca54e0-kubelet-config\") pod \"global-pull-secret-syncer-99nkl\" (UID: \"3f3c9bbc-1112-4856-9a53-6a1e76ca54e0\") " pod="kube-system/global-pull-secret-syncer-99nkl" May 21 18:13:51.694974 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:51.694950 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3f3c9bbc-1112-4856-9a53-6a1e76ca54e0-kubelet-config\") pod \"global-pull-secret-syncer-99nkl\" (UID: \"3f3c9bbc-1112-4856-9a53-6a1e76ca54e0\") " pod="kube-system/global-pull-secret-syncer-99nkl" May 21 18:13:51.695021 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:51.695004 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3f3c9bbc-1112-4856-9a53-6a1e76ca54e0-dbus\") pod \"global-pull-secret-syncer-99nkl\" (UID: \"3f3c9bbc-1112-4856-9a53-6a1e76ca54e0\") " pod="kube-system/global-pull-secret-syncer-99nkl" May 21 18:13:51.696967 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:51.696950 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f3c9bbc-1112-4856-9a53-6a1e76ca54e0-original-pull-secret\") pod \"global-pull-secret-syncer-99nkl\" (UID: \"3f3c9bbc-1112-4856-9a53-6a1e76ca54e0\") " pod="kube-system/global-pull-secret-syncer-99nkl" May 21 18:13:51.752469 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:51.752442 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-99nkl" May 21 18:13:51.969706 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:51.969668 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-99nkl"] May 21 18:13:51.974771 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:13:51.974747 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f3c9bbc_1112_4856_9a53_6a1e76ca54e0.slice/crio-7a5fbbf6b78200829ebdee5ceaaba31e00a7fe675938f3fc5fc0b160e7c0b1bb WatchSource:0}: Error finding container 7a5fbbf6b78200829ebdee5ceaaba31e00a7fe675938f3fc5fc0b160e7c0b1bb: Status 404 returned error can't find the container with id 7a5fbbf6b78200829ebdee5ceaaba31e00a7fe675938f3fc5fc0b160e7c0b1bb May 21 18:13:52.134595 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:52.134553 2567 generic.go:358] "Generic (PLEG): container finished" podID="868c9a60-0d4e-4bda-9e1d-8c1087daa9e5" containerID="f75e6e67bf7f551c9d308ddfe816413661941f46b101c1b9287208dc8da6c65f" exitCode=0 May 21 18:13:52.135030 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:52.134621 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jx9sz" event={"ID":"868c9a60-0d4e-4bda-9e1d-8c1087daa9e5","Type":"ContainerDied","Data":"f75e6e67bf7f551c9d308ddfe816413661941f46b101c1b9287208dc8da6c65f"} May 21 18:13:52.135677 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:52.135657 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-99nkl" event={"ID":"3f3c9bbc-1112-4856-9a53-6a1e76ca54e0","Type":"ContainerStarted","Data":"7a5fbbf6b78200829ebdee5ceaaba31e00a7fe675938f3fc5fc0b160e7c0b1bb"} May 21 18:13:53.007813 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:53.007773 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5f9e615-faab-4e8d-aff3-b1fb8007d012-metrics-tls\") pod \"dns-default-x42gp\" (UID: \"e5f9e615-faab-4e8d-aff3-b1fb8007d012\") " pod="openshift-dns/dns-default-x42gp" May 21 18:13:53.008014 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:53.007917 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a748fb72-614d-4d85-aba5-8a243e2cd7bc-registry-tls\") pod \"image-registry-655b874888-tngrh\" (UID: \"a748fb72-614d-4d85-aba5-8a243e2cd7bc\") " pod="openshift-image-registry/image-registry-655b874888-tngrh" May 21 18:13:53.008014 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:53.007945 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 18:13:53.008123 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:53.008026 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5f9e615-faab-4e8d-aff3-b1fb8007d012-metrics-tls podName:e5f9e615-faab-4e8d-aff3-b1fb8007d012 nodeName:}" failed. No retries permitted until 2026-05-21 18:13:57.008006267 +0000 UTC m=+41.593492684 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5f9e615-faab-4e8d-aff3-b1fb8007d012-metrics-tls") pod "dns-default-x42gp" (UID: "e5f9e615-faab-4e8d-aff3-b1fb8007d012") : secret "dns-default-metrics-tls" not found May 21 18:13:53.008123 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:53.008029 2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 18:13:53.008123 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:53.008041 2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-655b874888-tngrh: secret "image-registry-tls" not found May 21 18:13:53.008123 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:53.008085 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a748fb72-614d-4d85-aba5-8a243e2cd7bc-registry-tls podName:a748fb72-614d-4d85-aba5-8a243e2cd7bc nodeName:}" failed. No retries permitted until 2026-05-21 18:13:57.008069951 +0000 UTC m=+41.593556368 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a748fb72-614d-4d85-aba5-8a243e2cd7bc-registry-tls") pod "image-registry-655b874888-tngrh" (UID: "a748fb72-614d-4d85-aba5-8a243e2cd7bc") : secret "image-registry-tls" not found May 21 18:13:53.108864 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:53.108831 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8-cert\") pod \"ingress-canary-jmg7k\" (UID: \"1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8\") " pod="openshift-ingress-canary/ingress-canary-jmg7k" May 21 18:13:53.109041 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:53.108982 2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 18:13:53.109108 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:53.109049 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8-cert podName:1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8 nodeName:}" failed. No retries permitted until 2026-05-21 18:13:57.109033861 +0000 UTC m=+41.694520279 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8-cert") pod "ingress-canary-jmg7k" (UID: "1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8") : secret "canary-serving-cert" not found May 21 18:13:53.140671 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:53.140628 2567 generic.go:358] "Generic (PLEG): container finished" podID="868c9a60-0d4e-4bda-9e1d-8c1087daa9e5" containerID="7d56b81c6ecb3a0a2b17bf7e0ee6ac1f00ffea9765eb2c5e6b76354834c0d221" exitCode=0 May 21 18:13:53.140671 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:53.140669 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jx9sz" event={"ID":"868c9a60-0d4e-4bda-9e1d-8c1087daa9e5","Type":"ContainerDied","Data":"7d56b81c6ecb3a0a2b17bf7e0ee6ac1f00ffea9765eb2c5e6b76354834c0d221"} May 21 18:13:54.145310 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:54.145128 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jx9sz" event={"ID":"868c9a60-0d4e-4bda-9e1d-8c1087daa9e5","Type":"ContainerStarted","Data":"7c9e7f1d25cd340c53751fa0e34c363d9b47ad34c17e52f04b29a86f6a7d86d4"} May 21 18:13:54.167108 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:54.167064 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jx9sz" podStartSLOduration=5.198877113 podStartE2EDuration="38.167049538s" podCreationTimestamp="2026-05-21 18:13:16 +0000 UTC" firstStartedPulling="2026-05-21 18:13:18.848450296 +0000 UTC m=+3.433936709" lastFinishedPulling="2026-05-21 18:13:51.816622719 +0000 UTC m=+36.402109134" observedRunningTime="2026-05-21 18:13:54.166335719 +0000 UTC m=+38.751822154" watchObservedRunningTime="2026-05-21 18:13:54.167049538 +0000 UTC m=+38.752535969" May 21 18:13:56.150325 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:56.150244 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-99nkl" event={"ID":"3f3c9bbc-1112-4856-9a53-6a1e76ca54e0","Type":"ContainerStarted","Data":"a118bd4d59d1abebe5da048f3daab068059f5439adad1f08c959fd67233c4f34"} May 21 18:13:56.163501 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:56.163458 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-99nkl" podStartSLOduration=1.291248228 podStartE2EDuration="5.163444903s" podCreationTimestamp="2026-05-21 18:13:51 +0000 UTC" firstStartedPulling="2026-05-21 18:13:51.976305996 +0000 UTC m=+36.561792409" lastFinishedPulling="2026-05-21 18:13:55.848502655 +0000 UTC m=+40.433989084" observedRunningTime="2026-05-21 18:13:56.163070082 +0000 UTC m=+40.748556519" watchObservedRunningTime="2026-05-21 18:13:56.163444903 +0000 UTC m=+40.748931338" May 21 18:13:57.040074 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:57.040032 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a748fb72-614d-4d85-aba5-8a243e2cd7bc-registry-tls\") pod \"image-registry-655b874888-tngrh\" (UID: \"a748fb72-614d-4d85-aba5-8a243e2cd7bc\") " pod="openshift-image-registry/image-registry-655b874888-tngrh" May 21 18:13:57.040254 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:57.040093 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5f9e615-faab-4e8d-aff3-b1fb8007d012-metrics-tls\") pod \"dns-default-x42gp\" (UID: \"e5f9e615-faab-4e8d-aff3-b1fb8007d012\") " pod="openshift-dns/dns-default-x42gp" May 21 18:13:57.040254 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:57.040187 2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 18:13:57.040254 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:57.040200 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 18:13:57.040254 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:57.040207 2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-655b874888-tngrh: secret "image-registry-tls" not found May 21 18:13:57.040254 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:57.040253 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5f9e615-faab-4e8d-aff3-b1fb8007d012-metrics-tls podName:e5f9e615-faab-4e8d-aff3-b1fb8007d012 nodeName:}" failed. No retries permitted until 2026-05-21 18:14:05.040239513 +0000 UTC m=+49.625725927 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5f9e615-faab-4e8d-aff3-b1fb8007d012-metrics-tls") pod "dns-default-x42gp" (UID: "e5f9e615-faab-4e8d-aff3-b1fb8007d012") : secret "dns-default-metrics-tls" not found May 21 18:13:57.040418 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:57.040266 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a748fb72-614d-4d85-aba5-8a243e2cd7bc-registry-tls podName:a748fb72-614d-4d85-aba5-8a243e2cd7bc nodeName:}" failed. No retries permitted until 2026-05-21 18:14:05.040259112 +0000 UTC m=+49.625745525 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a748fb72-614d-4d85-aba5-8a243e2cd7bc-registry-tls") pod "image-registry-655b874888-tngrh" (UID: "a748fb72-614d-4d85-aba5-8a243e2cd7bc") : secret "image-registry-tls" not found May 21 18:13:57.143244 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:13:57.140968 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8-cert\") pod \"ingress-canary-jmg7k\" (UID: \"1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8\") " pod="openshift-ingress-canary/ingress-canary-jmg7k" May 21 18:13:57.143244 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:57.141143 2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 18:13:57.143244 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:13:57.141254 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8-cert podName:1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8 nodeName:}" failed. No retries permitted until 2026-05-21 18:14:05.141232285 +0000 UTC m=+49.726718725 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8-cert") pod "ingress-canary-jmg7k" (UID: "1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8") : secret "canary-serving-cert" not found May 21 18:14:05.097793 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:14:05.097755 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5f9e615-faab-4e8d-aff3-b1fb8007d012-metrics-tls\") pod \"dns-default-x42gp\" (UID: \"e5f9e615-faab-4e8d-aff3-b1fb8007d012\") " pod="openshift-dns/dns-default-x42gp" May 21 18:14:05.098276 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:14:05.097855 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a748fb72-614d-4d85-aba5-8a243e2cd7bc-registry-tls\") pod \"image-registry-655b874888-tngrh\" (UID: \"a748fb72-614d-4d85-aba5-8a243e2cd7bc\") " pod="openshift-image-registry/image-registry-655b874888-tngrh" May 21 18:14:05.098331 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:14:05.098273 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 18:14:05.098386 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:14:05.098367 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5f9e615-faab-4e8d-aff3-b1fb8007d012-metrics-tls podName:e5f9e615-faab-4e8d-aff3-b1fb8007d012 nodeName:}" failed. No retries permitted until 2026-05-21 18:14:21.098341756 +0000 UTC m=+65.683828173 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5f9e615-faab-4e8d-aff3-b1fb8007d012-metrics-tls") pod "dns-default-x42gp" (UID: "e5f9e615-faab-4e8d-aff3-b1fb8007d012") : secret "dns-default-metrics-tls" not found May 21 18:14:05.098607 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:14:05.098520 2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 18:14:05.098607 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:14:05.098602 2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-655b874888-tngrh: secret "image-registry-tls" not found May 21 18:14:05.098912 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:14:05.098899 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a748fb72-614d-4d85-aba5-8a243e2cd7bc-registry-tls podName:a748fb72-614d-4d85-aba5-8a243e2cd7bc nodeName:}" failed. No retries permitted until 2026-05-21 18:14:21.098879393 +0000 UTC m=+65.684365823 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a748fb72-614d-4d85-aba5-8a243e2cd7bc-registry-tls") pod "image-registry-655b874888-tngrh" (UID: "a748fb72-614d-4d85-aba5-8a243e2cd7bc") : secret "image-registry-tls" not found May 21 18:14:05.199591 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:14:05.199536 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8-cert\") pod \"ingress-canary-jmg7k\" (UID: \"1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8\") " pod="openshift-ingress-canary/ingress-canary-jmg7k" May 21 18:14:05.199766 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:14:05.199687 2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 18:14:05.199766 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:14:05.199745 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8-cert podName:1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8 nodeName:}" failed. No retries permitted until 2026-05-21 18:14:21.199730997 +0000 UTC m=+65.785217411 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8-cert") pod "ingress-canary-jmg7k" (UID: "1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8") : secret "canary-serving-cert" not found May 21 18:14:15.127766 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:14:15.127737 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2n5jr" May 21 18:14:21.109204 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:14:21.109107 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a748fb72-614d-4d85-aba5-8a243e2cd7bc-registry-tls\") pod \"image-registry-655b874888-tngrh\" (UID: \"a748fb72-614d-4d85-aba5-8a243e2cd7bc\") " pod="openshift-image-registry/image-registry-655b874888-tngrh" May 21 18:14:21.109204 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:14:21.109160 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5f9e615-faab-4e8d-aff3-b1fb8007d012-metrics-tls\") pod \"dns-default-x42gp\" (UID: \"e5f9e615-faab-4e8d-aff3-b1fb8007d012\") " pod="openshift-dns/dns-default-x42gp" May 21 18:14:21.109625 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:14:21.109260 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 18:14:21.109625 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:14:21.109264 2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 18:14:21.109625 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:14:21.109282 2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-655b874888-tngrh: secret "image-registry-tls" not found May 21 18:14:21.109625 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:14:21.109321 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5f9e615-faab-4e8d-aff3-b1fb8007d012-metrics-tls podName:e5f9e615-faab-4e8d-aff3-b1fb8007d012 nodeName:}" failed. No retries permitted until 2026-05-21 18:14:53.109307242 +0000 UTC m=+97.694793656 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5f9e615-faab-4e8d-aff3-b1fb8007d012-metrics-tls") pod "dns-default-x42gp" (UID: "e5f9e615-faab-4e8d-aff3-b1fb8007d012") : secret "dns-default-metrics-tls" not found May 21 18:14:21.109625 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:14:21.109334 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a748fb72-614d-4d85-aba5-8a243e2cd7bc-registry-tls podName:a748fb72-614d-4d85-aba5-8a243e2cd7bc nodeName:}" failed. No retries permitted until 2026-05-21 18:14:53.109328064 +0000 UTC m=+97.694814477 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a748fb72-614d-4d85-aba5-8a243e2cd7bc-registry-tls") pod "image-registry-655b874888-tngrh" (UID: "a748fb72-614d-4d85-aba5-8a243e2cd7bc") : secret "image-registry-tls" not found May 21 18:14:21.210133 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:14:21.210101 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8-cert\") pod \"ingress-canary-jmg7k\" (UID: \"1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8\") " pod="openshift-ingress-canary/ingress-canary-jmg7k" May 21 18:14:21.210298 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:14:21.210229 2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 18:14:21.210298 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:14:21.210279 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8-cert podName:1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8 nodeName:}" failed. No retries permitted until 2026-05-21 18:14:53.210265794 +0000 UTC m=+97.795752208 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8-cert") pod "ingress-canary-jmg7k" (UID: "1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8") : secret "canary-serving-cert" not found May 21 18:14:21.713988 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:14:21.713952 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80ec104c-46e1-4fb3-a8bc-f5664e798321-metrics-certs\") pod \"network-metrics-daemon-lk2c6\" (UID: \"80ec104c-46e1-4fb3-a8bc-f5664e798321\") " pod="openshift-multus/network-metrics-daemon-lk2c6" May 21 18:14:21.716819 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:14:21.716800 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 18:14:21.724687 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:14:21.724668 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 18:14:21.724751 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:14:21.724724 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80ec104c-46e1-4fb3-a8bc-f5664e798321-metrics-certs podName:80ec104c-46e1-4fb3-a8bc-f5664e798321 nodeName:}" failed. No retries permitted until 2026-05-21 18:15:25.724707297 +0000 UTC m=+130.310193711 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/80ec104c-46e1-4fb3-a8bc-f5664e798321-metrics-certs") pod "network-metrics-daemon-lk2c6" (UID: "80ec104c-46e1-4fb3-a8bc-f5664e798321") : secret "metrics-daemon-secret" not found May 21 18:14:21.815097 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:14:21.815062 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f7q6m\" (UniqueName: \"kubernetes.io/projected/96d08281-69d3-4a00-ba5c-74771da205d3-kube-api-access-f7q6m\") pod \"network-check-target-qfkc7\" (UID: \"96d08281-69d3-4a00-ba5c-74771da205d3\") " pod="openshift-network-diagnostics/network-check-target-qfkc7" May 21 18:14:21.818012 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:14:21.817992 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 18:14:21.827632 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:14:21.827614 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 18:14:21.840148 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:14:21.840129 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7q6m\" (UniqueName: \"kubernetes.io/projected/96d08281-69d3-4a00-ba5c-74771da205d3-kube-api-access-f7q6m\") pod \"network-check-target-qfkc7\" (UID: \"96d08281-69d3-4a00-ba5c-74771da205d3\") " pod="openshift-network-diagnostics/network-check-target-qfkc7" May 21 18:14:22.093004 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:14:22.092965 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-w9qjh\"" May 21 18:14:22.101188 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:14:22.101166 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qfkc7" May 21 18:14:22.238748 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:14:22.238715 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qfkc7"] May 21 18:14:22.241611 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:14:22.241553 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96d08281_69d3_4a00_ba5c_74771da205d3.slice/crio-8a089d9ebe0db45b06cbd07955a5a2956638ca53d6eced9c3d0f4f3cbec192fc WatchSource:0}: Error finding container 8a089d9ebe0db45b06cbd07955a5a2956638ca53d6eced9c3d0f4f3cbec192fc: Status 404 returned error can't find the container with id 8a089d9ebe0db45b06cbd07955a5a2956638ca53d6eced9c3d0f4f3cbec192fc May 21 18:14:23.200460 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:14:23.200420 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qfkc7" event={"ID":"96d08281-69d3-4a00-ba5c-74771da205d3","Type":"ContainerStarted","Data":"8a089d9ebe0db45b06cbd07955a5a2956638ca53d6eced9c3d0f4f3cbec192fc"} May 21 18:14:24.274762 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:14:24.274717 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f67cb9449-j96rz"] May 21 18:14:24.284834 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:14:24.284804 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f67cb9449-j96rz" May 21 18:14:24.287166 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:14:24.287114 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f67cb9449-j96rz"] May 21 18:14:24.287297 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:14:24.287226 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" May 21 18:14:24.287358 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:14:24.287226 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" May 21 18:14:24.288145 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:14:24.288117 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" May 21 18:14:24.288244 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:14:24.288147 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" May 21 18:14:24.335629 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:14:24.335592 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ac952ed0-75f8-4de0-a25d-ff42bd81ebbd-klusterlet-config\") pod \"klusterlet-addon-workmgr-5f67cb9449-j96rz\" (UID: \"ac952ed0-75f8-4de0-a25d-ff42bd81ebbd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f67cb9449-j96rz" May 21 18:14:24.335783 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:14:24.335683 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac952ed0-75f8-4de0-a25d-ff42bd81ebbd-tmp\") pod \"klusterlet-addon-workmgr-5f67cb9449-j96rz\" (UID: \"ac952ed0-75f8-4de0-a25d-ff42bd81ebbd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f67cb9449-j96rz" May 21 18:14:24.335843 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:14:24.335780 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l6tp\" (UniqueName: \"kubernetes.io/projected/ac952ed0-75f8-4de0-a25d-ff42bd81ebbd-kube-api-access-4l6tp\") pod \"klusterlet-addon-workmgr-5f67cb9449-j96rz\" (UID: \"ac952ed0-75f8-4de0-a25d-ff42bd81ebbd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f67cb9449-j96rz" May 21 18:14:24.436618 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:14:24.436560 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4l6tp\" (UniqueName: \"kubernetes.io/projected/ac952ed0-75f8-4de0-a25d-ff42bd81ebbd-kube-api-access-4l6tp\") pod \"klusterlet-addon-workmgr-5f67cb9449-j96rz\" (UID: \"ac952ed0-75f8-4de0-a25d-ff42bd81ebbd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f67cb9449-j96rz" May 21 18:14:24.436805 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:14:24.436635 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ac952ed0-75f8-4de0-a25d-ff42bd81ebbd-klusterlet-config\") pod \"klusterlet-addon-workmgr-5f67cb9449-j96rz\" (UID: \"ac952ed0-75f8-4de0-a25d-ff42bd81ebbd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f67cb9449-j96rz" May 21 18:14:24.436805 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:14:24.436688 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac952ed0-75f8-4de0-a25d-ff42bd81ebbd-tmp\") pod \"klusterlet-addon-workmgr-5f67cb9449-j96rz\" (UID: \"ac952ed0-75f8-4de0-a25d-ff42bd81ebbd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f67cb9449-j96rz" May 21 18:14:24.437118 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:14:24.437088 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac952ed0-75f8-4de0-a25d-ff42bd81ebbd-tmp\") pod \"klusterlet-addon-workmgr-5f67cb9449-j96rz\" (UID: \"ac952ed0-75f8-4de0-a25d-ff42bd81ebbd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f67cb9449-j96rz" May 21 18:14:24.439825 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:14:24.439802 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ac952ed0-75f8-4de0-a25d-ff42bd81ebbd-klusterlet-config\") pod \"klusterlet-addon-workmgr-5f67cb9449-j96rz\" (UID: \"ac952ed0-75f8-4de0-a25d-ff42bd81ebbd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f67cb9449-j96rz" May 21 18:14:24.445383 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:14:24.445341 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l6tp\" (UniqueName: \"kubernetes.io/projected/ac952ed0-75f8-4de0-a25d-ff42bd81ebbd-kube-api-access-4l6tp\") pod \"klusterlet-addon-workmgr-5f67cb9449-j96rz\" (UID: \"ac952ed0-75f8-4de0-a25d-ff42bd81ebbd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f67cb9449-j96rz" May 21 18:14:24.597618 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:14:24.597528 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f67cb9449-j96rz" May 21 18:14:25.140030 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:14:25.139974 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f67cb9449-j96rz"] May 21 18:14:25.144651 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:14:25.144624 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac952ed0_75f8_4de0_a25d_ff42bd81ebbd.slice/crio-00c33ae3e20966c690fbdedb6243362eb3aba5fc0fc3308964196e5914733f0b WatchSource:0}: Error finding container 00c33ae3e20966c690fbdedb6243362eb3aba5fc0fc3308964196e5914733f0b: Status 404 returned error can't find the container with id 00c33ae3e20966c690fbdedb6243362eb3aba5fc0fc3308964196e5914733f0b May 21 18:14:25.205887 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:14:25.205851 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f67cb9449-j96rz" event={"ID":"ac952ed0-75f8-4de0-a25d-ff42bd81ebbd","Type":"ContainerStarted","Data":"00c33ae3e20966c690fbdedb6243362eb3aba5fc0fc3308964196e5914733f0b"} May 21 18:14:26.209640 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:14:26.209483 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qfkc7" event={"ID":"96d08281-69d3-4a00-ba5c-74771da205d3","Type":"ContainerStarted","Data":"36c8985731f0a21a38c89824064d0a91805601fef2307a27587f69ac80309472"} May 21 18:14:26.210188 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:14:26.209717 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qfkc7" May 21 18:14:26.224474 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:14:26.224412 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qfkc7" podStartSLOduration=67.081493468 podStartE2EDuration="1m10.224396215s" podCreationTimestamp="2026-05-21 18:13:16 +0000 UTC" firstStartedPulling="2026-05-21 18:14:22.243385596 +0000 UTC m=+66.828872013" lastFinishedPulling="2026-05-21 18:14:25.386288333 +0000 UTC m=+69.971774760" observedRunningTime="2026-05-21 18:14:26.223623937 +0000 UTC m=+70.809110367" watchObservedRunningTime="2026-05-21 18:14:26.224396215 +0000 UTC m=+70.809882653" May 21 18:14:29.216663 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:14:29.216630 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f67cb9449-j96rz" event={"ID":"ac952ed0-75f8-4de0-a25d-ff42bd81ebbd","Type":"ContainerStarted","Data":"ffe8b8e0b502e3245ab3a2a9ceec990c019c6fff914541d3a8d4c81007e657e2"} May 21 18:14:29.217089 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:14:29.216861 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f67cb9449-j96rz" May 21 18:14:29.218185 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:14:29.218155 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f67cb9449-j96rz" podUID="ac952ed0-75f8-4de0-a25d-ff42bd81ebbd" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.9:8000/readyz\": dial tcp 10.132.0.9:8000: connect: connection refused" May 21 18:14:29.231598 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:14:29.231524 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f67cb9449-j96rz" podStartSLOduration=1.232517715 podStartE2EDuration="5.231504326s" podCreationTimestamp="2026-05-21 18:14:24 +0000 UTC" firstStartedPulling="2026-05-21 18:14:25.146298981 +0000 UTC m=+69.731785398" lastFinishedPulling="2026-05-21 18:14:29.145285595 +0000 UTC m=+73.730772009" observedRunningTime="2026-05-21 18:14:29.231007914 +0000 UTC m=+73.816494350" watchObservedRunningTime="2026-05-21 18:14:29.231504326 +0000 UTC m=+73.816990770" May 21 18:14:30.219958 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:14:30.219925 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f67cb9449-j96rz" May 21 18:14:53.155083 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:14:53.155032 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a748fb72-614d-4d85-aba5-8a243e2cd7bc-registry-tls\") pod \"image-registry-655b874888-tngrh\" (UID: \"a748fb72-614d-4d85-aba5-8a243e2cd7bc\") " pod="openshift-image-registry/image-registry-655b874888-tngrh" May 21 18:14:53.155551 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:14:53.155100 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5f9e615-faab-4e8d-aff3-b1fb8007d012-metrics-tls\") pod \"dns-default-x42gp\" (UID: \"e5f9e615-faab-4e8d-aff3-b1fb8007d012\") " pod="openshift-dns/dns-default-x42gp" May 21 18:14:53.155551 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:14:53.155180 2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 18:14:53.155551 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:14:53.155202 2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-655b874888-tngrh: secret "image-registry-tls" not found May 21 18:14:53.155551 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:14:53.155206 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 18:14:53.155551 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:14:53.155260 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a748fb72-614d-4d85-aba5-8a243e2cd7bc-registry-tls podName:a748fb72-614d-4d85-aba5-8a243e2cd7bc nodeName:}" failed. No retries permitted until 2026-05-21 18:15:57.155243491 +0000 UTC m=+161.740729905 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a748fb72-614d-4d85-aba5-8a243e2cd7bc-registry-tls") pod "image-registry-655b874888-tngrh" (UID: "a748fb72-614d-4d85-aba5-8a243e2cd7bc") : secret "image-registry-tls" not found May 21 18:14:53.155551 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:14:53.155274 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5f9e615-faab-4e8d-aff3-b1fb8007d012-metrics-tls podName:e5f9e615-faab-4e8d-aff3-b1fb8007d012 nodeName:}" failed. No retries permitted until 2026-05-21 18:15:57.155266895 +0000 UTC m=+161.740753308 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5f9e615-faab-4e8d-aff3-b1fb8007d012-metrics-tls") pod "dns-default-x42gp" (UID: "e5f9e615-faab-4e8d-aff3-b1fb8007d012") : secret "dns-default-metrics-tls" not found May 21 18:14:53.256252 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:14:53.256210 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8-cert\") pod \"ingress-canary-jmg7k\" (UID: \"1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8\") " pod="openshift-ingress-canary/ingress-canary-jmg7k" May 21 18:14:53.256424 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:14:53.256345 2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 18:14:53.256424 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:14:53.256401 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8-cert podName:1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8 nodeName:}" failed. No retries permitted until 2026-05-21 18:15:57.256387067 +0000 UTC m=+161.841873481 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8-cert") pod "ingress-canary-jmg7k" (UID: "1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8") : secret "canary-serving-cert" not found May 21 18:14:57.213825 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:14:57.213795 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qfkc7" May 21 18:15:25.796552 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:25.796516 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80ec104c-46e1-4fb3-a8bc-f5664e798321-metrics-certs\") pod \"network-metrics-daemon-lk2c6\" (UID: \"80ec104c-46e1-4fb3-a8bc-f5664e798321\") " pod="openshift-multus/network-metrics-daemon-lk2c6" May 21 18:15:25.796975 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:15:25.796677 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 18:15:25.796975 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:15:25.796758 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80ec104c-46e1-4fb3-a8bc-f5664e798321-metrics-certs podName:80ec104c-46e1-4fb3-a8bc-f5664e798321 nodeName:}" failed. No retries permitted until 2026-05-21 18:17:27.796740719 +0000 UTC m=+252.382227133 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/80ec104c-46e1-4fb3-a8bc-f5664e798321-metrics-certs") pod "network-metrics-daemon-lk2c6" (UID: "80ec104c-46e1-4fb3-a8bc-f5664e798321") : secret "metrics-daemon-secret" not found May 21 18:15:28.135803 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:28.135748 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-jxqn7"] May 21 18:15:28.138197 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:28.138171 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-j7vs8"] May 21 18:15:28.138336 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:28.138316 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-jxqn7" May 21 18:15:28.140196 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:28.140175 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-j7vs8" May 21 18:15:28.144262 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:28.144242 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" May 21 18:15:28.144346 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:28.144300 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" May 21 18:15:28.145067 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:28.144689 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" May 21 18:15:28.145067 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:28.144738 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" May 21 18:15:28.145067 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:28.144818 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-5zv2m\"" May 21 18:15:28.145235 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:28.145163 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-jvjsw\"" May 21 18:15:28.150717 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:28.150648 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-jxqn7"] May 21 18:15:28.180568 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:28.180540 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-j7vs8"] May 21 18:15:28.215289 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:28.215260 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xjk8\" (UniqueName: \"kubernetes.io/projected/89456e3c-5471-41e7-bb65-6717938c4f98-kube-api-access-6xjk8\") pod \"network-check-source-7f44b6dd87-j7vs8\" (UID: \"89456e3c-5471-41e7-bb65-6717938c4f98\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-j7vs8" May 21 18:15:28.215503 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:28.215304 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/19902950-4f77-4026-98b8-09db0bc05a05-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-jxqn7\" (UID: \"19902950-4f77-4026-98b8-09db0bc05a05\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-jxqn7" May 21 18:15:28.215503 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:28.215325 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/19902950-4f77-4026-98b8-09db0bc05a05-config\") pod \"kube-storage-version-migrator-operator-565644f49-jxqn7\" (UID: \"19902950-4f77-4026-98b8-09db0bc05a05\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-jxqn7" May 21 18:15:28.215503 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:28.215342 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knqz6\" (UniqueName: \"kubernetes.io/projected/19902950-4f77-4026-98b8-09db0bc05a05-kube-api-access-knqz6\") pod \"kube-storage-version-migrator-operator-565644f49-jxqn7\" (UID: \"19902950-4f77-4026-98b8-09db0bc05a05\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-jxqn7" May 21 18:15:28.315964 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:28.315930 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6xjk8\" (UniqueName: \"kubernetes.io/projected/89456e3c-5471-41e7-bb65-6717938c4f98-kube-api-access-6xjk8\") pod \"network-check-source-7f44b6dd87-j7vs8\" (UID: \"89456e3c-5471-41e7-bb65-6717938c4f98\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-j7vs8" May 21 18:15:28.316117 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:28.315992 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/19902950-4f77-4026-98b8-09db0bc05a05-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-jxqn7\" (UID: \"19902950-4f77-4026-98b8-09db0bc05a05\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-jxqn7" May 21 18:15:28.316117 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:28.316020 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/19902950-4f77-4026-98b8-09db0bc05a05-config\") pod \"kube-storage-version-migrator-operator-565644f49-jxqn7\" (UID: \"19902950-4f77-4026-98b8-09db0bc05a05\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-jxqn7" May 21 18:15:28.316117 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:28.316049 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-knqz6\" (UniqueName: \"kubernetes.io/projected/19902950-4f77-4026-98b8-09db0bc05a05-kube-api-access-knqz6\") pod \"kube-storage-version-migrator-operator-565644f49-jxqn7\" (UID: \"19902950-4f77-4026-98b8-09db0bc05a05\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-jxqn7" May 21 18:15:28.316545 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:28.316516 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/19902950-4f77-4026-98b8-09db0bc05a05-config\") pod \"kube-storage-version-migrator-operator-565644f49-jxqn7\" (UID: \"19902950-4f77-4026-98b8-09db0bc05a05\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-jxqn7" May 21 18:15:28.318210 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:28.318192 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/19902950-4f77-4026-98b8-09db0bc05a05-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-jxqn7\" (UID: \"19902950-4f77-4026-98b8-09db0bc05a05\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-jxqn7" May 21 18:15:28.337223 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:28.337201 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knqz6\" (UniqueName: \"kubernetes.io/projected/19902950-4f77-4026-98b8-09db0bc05a05-kube-api-access-knqz6\") pod \"kube-storage-version-migrator-operator-565644f49-jxqn7\" (UID: \"19902950-4f77-4026-98b8-09db0bc05a05\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-jxqn7" May 21 18:15:28.344452 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:28.344427 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xjk8\" (UniqueName: \"kubernetes.io/projected/89456e3c-5471-41e7-bb65-6717938c4f98-kube-api-access-6xjk8\") pod \"network-check-source-7f44b6dd87-j7vs8\" (UID: \"89456e3c-5471-41e7-bb65-6717938c4f98\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-j7vs8" May 21 18:15:28.448007 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:28.447921 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-jxqn7" May 21 18:15:28.453641 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:28.453622 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-j7vs8" May 21 18:15:28.577402 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:28.577372 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-jxqn7"] May 21 18:15:28.581168 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:15:28.581140 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19902950_4f77_4026_98b8_09db0bc05a05.slice/crio-72a5021412ec756be9263ac39e38a48aeecc49a4301dfd4fa4552472a1c4e695 WatchSource:0}: Error finding container 72a5021412ec756be9263ac39e38a48aeecc49a4301dfd4fa4552472a1c4e695: Status 404 returned error can't find the container with id 72a5021412ec756be9263ac39e38a48aeecc49a4301dfd4fa4552472a1c4e695 May 21 18:15:28.594227 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:28.594203 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-j7vs8"] May 21 18:15:28.597094 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:15:28.597062 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89456e3c_5471_41e7_bb65_6717938c4f98.slice/crio-24a7b5557864c876fc4950c49a4f6ed88c625d6bb67eb7c1116cbd1ab773f011 WatchSource:0}: Error finding container 24a7b5557864c876fc4950c49a4f6ed88c625d6bb67eb7c1116cbd1ab773f011: Status 404 returned error can't find the container with id 24a7b5557864c876fc4950c49a4f6ed88c625d6bb67eb7c1116cbd1ab773f011 May 21 18:15:29.329440 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:29.329395 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-jxqn7" event={"ID":"19902950-4f77-4026-98b8-09db0bc05a05","Type":"ContainerStarted","Data":"72a5021412ec756be9263ac39e38a48aeecc49a4301dfd4fa4552472a1c4e695"} May 21 18:15:29.331093 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:29.331028 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-j7vs8" event={"ID":"89456e3c-5471-41e7-bb65-6717938c4f98","Type":"ContainerStarted","Data":"a93ce2b80219d80eeea6f30524ce2e42f417b4aaf6996a7bb1db6ac2ac697027"} May 21 18:15:29.331093 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:29.331063 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-j7vs8" event={"ID":"89456e3c-5471-41e7-bb65-6717938c4f98","Type":"ContainerStarted","Data":"24a7b5557864c876fc4950c49a4f6ed88c625d6bb67eb7c1116cbd1ab773f011"} May 21 18:15:29.364921 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:29.364868 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-j7vs8" podStartSLOduration=1.364849771 podStartE2EDuration="1.364849771s" podCreationTimestamp="2026-05-21 18:15:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:15:29.363778665 +0000 UTC m=+133.949265102" watchObservedRunningTime="2026-05-21 18:15:29.364849771 +0000 UTC m=+133.950336209" May 21 18:15:31.337128 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:31.337088 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-jxqn7" event={"ID":"19902950-4f77-4026-98b8-09db0bc05a05","Type":"ContainerStarted","Data":"4cf03090c24b123a138bc1ac972a5c011332137a0931ad23be416511c3c223c8"} May 21 18:15:31.355754 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:31.355707 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-jxqn7" podStartSLOduration=1.165262817 podStartE2EDuration="3.355693112s" podCreationTimestamp="2026-05-21 18:15:28 +0000 UTC" firstStartedPulling="2026-05-21 18:15:28.582935029 +0000 UTC m=+133.168421443" lastFinishedPulling="2026-05-21 18:15:30.773365308 +0000 UTC m=+135.358851738" observedRunningTime="2026-05-21 18:15:31.354849036 +0000 UTC m=+135.940335473" watchObservedRunningTime="2026-05-21 18:15:31.355693112 +0000 UTC m=+135.941179588" May 21 18:15:31.922278 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:31.922236 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-sv552"] May 21 18:15:31.924720 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:31.924703 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-sv552" May 21 18:15:31.927498 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:31.927476 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-ww2th\"" May 21 18:15:31.927633 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:31.927501 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" May 21 18:15:31.927633 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:31.927526 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" May 21 18:15:31.936126 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:31.936106 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-sv552"] May 21 18:15:31.946514 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:31.943867 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9pdb\" (UniqueName: \"kubernetes.io/projected/d8dc7a52-a103-4b9c-90e7-a7ff58a9a58a-kube-api-access-j9pdb\") pod \"migrator-b985f5d89-sv552\" (UID: \"d8dc7a52-a103-4b9c-90e7-a7ff58a9a58a\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-sv552" May 21 18:15:32.044647 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:32.044615 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j9pdb\" (UniqueName: \"kubernetes.io/projected/d8dc7a52-a103-4b9c-90e7-a7ff58a9a58a-kube-api-access-j9pdb\") pod \"migrator-b985f5d89-sv552\" (UID: \"d8dc7a52-a103-4b9c-90e7-a7ff58a9a58a\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-sv552" May 21 18:15:32.055639 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:32.055609 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9pdb\" (UniqueName: \"kubernetes.io/projected/d8dc7a52-a103-4b9c-90e7-a7ff58a9a58a-kube-api-access-j9pdb\") pod \"migrator-b985f5d89-sv552\" (UID: \"d8dc7a52-a103-4b9c-90e7-a7ff58a9a58a\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-sv552" May 21 18:15:32.233332 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:32.233294 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-sv552" May 21 18:15:32.350444 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:32.350411 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-sv552"] May 21 18:15:32.353397 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:15:32.353367 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8dc7a52_a103_4b9c_90e7_a7ff58a9a58a.slice/crio-f159eff358eb3550863e19ed9b9f223c6a376fd8a3abb8fa2aae3f4760a95351 WatchSource:0}: Error finding container f159eff358eb3550863e19ed9b9f223c6a376fd8a3abb8fa2aae3f4760a95351: Status 404 returned error can't find the container with id f159eff358eb3550863e19ed9b9f223c6a376fd8a3abb8fa2aae3f4760a95351 May 21 18:15:33.345120 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:33.345059 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-sv552" event={"ID":"d8dc7a52-a103-4b9c-90e7-a7ff58a9a58a","Type":"ContainerStarted","Data":"f159eff358eb3550863e19ed9b9f223c6a376fd8a3abb8fa2aae3f4760a95351"} May 21 18:15:34.348904 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:34.348866 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-sv552" event={"ID":"d8dc7a52-a103-4b9c-90e7-a7ff58a9a58a","Type":"ContainerStarted","Data":"6394807b22c35b68e469df39d60ce37f89a60b93029753aa8c3949d319b1f86e"} May 21 18:15:34.349289 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:34.348925 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-sv552" event={"ID":"d8dc7a52-a103-4b9c-90e7-a7ff58a9a58a","Type":"ContainerStarted","Data":"b4a331aefb4fdaffc3b2ad7338e3c36624a2cf65b980bc65112a70a3fe47905f"} May 21 18:15:34.363834 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:34.363788 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-sv552" podStartSLOduration=2.091863993 podStartE2EDuration="3.363772968s" podCreationTimestamp="2026-05-21 18:15:31 +0000 UTC" firstStartedPulling="2026-05-21 18:15:32.355427699 +0000 UTC m=+136.940914113" lastFinishedPulling="2026-05-21 18:15:33.627336675 +0000 UTC m=+138.212823088" observedRunningTime="2026-05-21 18:15:34.362667243 +0000 UTC m=+138.948153678" watchObservedRunningTime="2026-05-21 18:15:34.363772968 +0000 UTC m=+138.949259467" May 21 18:15:34.981918 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:34.981891 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6h54k_806b4e1a-170a-44ac-b356-92e2c2337e02/dns-node-resolver/0.log" May 21 18:15:35.907328 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:35.907299 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-2sk99"] May 21 18:15:35.909417 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:35.909400 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-2sk99" May 21 18:15:35.911922 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:35.911891 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" May 21 18:15:35.912064 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:35.911945 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" May 21 18:15:35.912064 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:35.912039 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" May 21 18:15:35.913038 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:35.913023 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-n6shg\"" May 21 18:15:35.913097 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:35.913041 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" May 21 18:15:35.920537 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:35.920514 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-2sk99"] May 21 18:15:35.976261 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:35.976216 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e094f7db-009f-4e0f-9744-05629f8fca6d-signing-cabundle\") pod \"service-ca-67d667c7d-2sk99\" (UID: \"e094f7db-009f-4e0f-9744-05629f8fca6d\") " pod="openshift-service-ca/service-ca-67d667c7d-2sk99" May 21 18:15:35.976261 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:35.976259 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnnqp\" (UniqueName: \"kubernetes.io/projected/e094f7db-009f-4e0f-9744-05629f8fca6d-kube-api-access-vnnqp\") pod \"service-ca-67d667c7d-2sk99\" (UID: \"e094f7db-009f-4e0f-9744-05629f8fca6d\") " pod="openshift-service-ca/service-ca-67d667c7d-2sk99" May 21 18:15:35.976480 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:35.976338 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e094f7db-009f-4e0f-9744-05629f8fca6d-signing-key\") pod \"service-ca-67d667c7d-2sk99\" (UID: \"e094f7db-009f-4e0f-9744-05629f8fca6d\") " pod="openshift-service-ca/service-ca-67d667c7d-2sk99" May 21 18:15:36.076777 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:36.076736 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e094f7db-009f-4e0f-9744-05629f8fca6d-signing-key\") pod \"service-ca-67d667c7d-2sk99\" (UID: \"e094f7db-009f-4e0f-9744-05629f8fca6d\") " pod="openshift-service-ca/service-ca-67d667c7d-2sk99" May 21 18:15:36.076946 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:36.076807 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e094f7db-009f-4e0f-9744-05629f8fca6d-signing-cabundle\") pod \"service-ca-67d667c7d-2sk99\" (UID: \"e094f7db-009f-4e0f-9744-05629f8fca6d\") " pod="openshift-service-ca/service-ca-67d667c7d-2sk99" May 21 18:15:36.076946 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:36.076828 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vnnqp\" (UniqueName: \"kubernetes.io/projected/e094f7db-009f-4e0f-9744-05629f8fca6d-kube-api-access-vnnqp\") pod \"service-ca-67d667c7d-2sk99\" (UID: \"e094f7db-009f-4e0f-9744-05629f8fca6d\") " pod="openshift-service-ca/service-ca-67d667c7d-2sk99" May 21 18:15:36.077656 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:36.077632 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e094f7db-009f-4e0f-9744-05629f8fca6d-signing-cabundle\") pod \"service-ca-67d667c7d-2sk99\" (UID: \"e094f7db-009f-4e0f-9744-05629f8fca6d\") " pod="openshift-service-ca/service-ca-67d667c7d-2sk99" May 21 18:15:36.079278 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:36.079259 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e094f7db-009f-4e0f-9744-05629f8fca6d-signing-key\") pod \"service-ca-67d667c7d-2sk99\" (UID: \"e094f7db-009f-4e0f-9744-05629f8fca6d\") " pod="openshift-service-ca/service-ca-67d667c7d-2sk99" May 21 18:15:36.085464 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:36.085432 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnnqp\" (UniqueName: \"kubernetes.io/projected/e094f7db-009f-4e0f-9744-05629f8fca6d-kube-api-access-vnnqp\") pod \"service-ca-67d667c7d-2sk99\" (UID: \"e094f7db-009f-4e0f-9744-05629f8fca6d\") " pod="openshift-service-ca/service-ca-67d667c7d-2sk99" May 21 18:15:36.182632 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:36.182528 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fwkk2_e3c0da04-85d7-4c03-8f44-42c8748c4218/node-ca/0.log" May 21 18:15:36.218980 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:36.218952 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-2sk99" May 21 18:15:36.348365 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:36.348331 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-2sk99"] May 21 18:15:36.351512 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:15:36.351474 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode094f7db_009f_4e0f_9744_05629f8fca6d.slice/crio-fee45cdf7b9c4026e3cc866a89f1f678edfee5d3140834c26a78e42ac0210dc7 WatchSource:0}: Error finding container fee45cdf7b9c4026e3cc866a89f1f678edfee5d3140834c26a78e42ac0210dc7: Status 404 returned error can't find the container with id fee45cdf7b9c4026e3cc866a89f1f678edfee5d3140834c26a78e42ac0210dc7 May 21 18:15:37.357425 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:37.357386 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-2sk99" event={"ID":"e094f7db-009f-4e0f-9744-05629f8fca6d","Type":"ContainerStarted","Data":"fee45cdf7b9c4026e3cc866a89f1f678edfee5d3140834c26a78e42ac0210dc7"} May 21 18:15:37.384453 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:37.384418 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-sv552_d8dc7a52-a103-4b9c-90e7-a7ff58a9a58a/migrator/0.log" May 21 18:15:37.590011 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:37.589977 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-sv552_d8dc7a52-a103-4b9c-90e7-a7ff58a9a58a/graceful-termination/0.log" May 21 18:15:37.788235 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:37.788196 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-jxqn7_19902950-4f77-4026-98b8-09db0bc05a05/kube-storage-version-migrator-operator/0.log" May 21 18:15:38.363991 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:38.363956 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-2sk99" event={"ID":"e094f7db-009f-4e0f-9744-05629f8fca6d","Type":"ContainerStarted","Data":"755fa2f7d22a84400accfb98b0b4f4cd46ab650748e2ca3663a75d37ca7b01ad"} May 21 18:15:38.379591 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:38.379530 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-2sk99" podStartSLOduration=1.554212348 podStartE2EDuration="3.379507602s" podCreationTimestamp="2026-05-21 18:15:35 +0000 UTC" firstStartedPulling="2026-05-21 18:15:36.353327722 +0000 UTC m=+140.938814135" lastFinishedPulling="2026-05-21 18:15:38.178622975 +0000 UTC m=+142.764109389" observedRunningTime="2026-05-21 18:15:38.378025595 +0000 UTC m=+142.963512031" watchObservedRunningTime="2026-05-21 18:15:38.379507602 +0000 UTC m=+142.964994041" May 21 18:15:52.308015 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:15:52.307967 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-655b874888-tngrh" podUID="a748fb72-614d-4d85-aba5-8a243e2cd7bc" May 21 18:15:52.312086 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:15:52.312052 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-x42gp" podUID="e5f9e615-faab-4e8d-aff3-b1fb8007d012" May 21 18:15:52.327282 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:15:52.327248 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-jmg7k" podUID="1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8" May 21 18:15:52.396461 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:52.396433 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x42gp" May 21 18:15:52.396618 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:52.396433 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-655b874888-tngrh" May 21 18:15:52.997058 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:15:52.997007 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-lk2c6" podUID="80ec104c-46e1-4fb3-a8bc-f5664e798321" May 21 18:15:55.351059 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:55.351025 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hvk4x"] May 21 18:15:55.353360 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:55.353338 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hvk4x" May 21 18:15:55.356022 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:55.355998 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 21 18:15:55.356022 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:55.356019 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 21 18:15:55.356229 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:55.356206 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 21 18:15:55.357158 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:55.357141 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mhnx6\"" May 21 18:15:55.357272 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:55.357236 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 21 18:15:55.370005 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:55.369983 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hvk4x"] May 21 18:15:55.435544 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:55.435510 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqlxk\" (UniqueName: \"kubernetes.io/projected/a34d53fe-0e5b-4781-ae13-d702722fd7d1-kube-api-access-cqlxk\") pod \"insights-runtime-extractor-hvk4x\" (UID: \"a34d53fe-0e5b-4781-ae13-d702722fd7d1\") " pod="openshift-insights/insights-runtime-extractor-hvk4x" May 21 18:15:55.435729 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:55.435548 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a34d53fe-0e5b-4781-ae13-d702722fd7d1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hvk4x\" (UID: \"a34d53fe-0e5b-4781-ae13-d702722fd7d1\") " pod="openshift-insights/insights-runtime-extractor-hvk4x" May 21 18:15:55.435729 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:55.435592 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a34d53fe-0e5b-4781-ae13-d702722fd7d1-data-volume\") pod \"insights-runtime-extractor-hvk4x\" (UID: \"a34d53fe-0e5b-4781-ae13-d702722fd7d1\") " pod="openshift-insights/insights-runtime-extractor-hvk4x" May 21 18:15:55.435846 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:55.435770 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a34d53fe-0e5b-4781-ae13-d702722fd7d1-crio-socket\") pod \"insights-runtime-extractor-hvk4x\" (UID: \"a34d53fe-0e5b-4781-ae13-d702722fd7d1\") " pod="openshift-insights/insights-runtime-extractor-hvk4x" May 21 18:15:55.435846 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:55.435811 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a34d53fe-0e5b-4781-ae13-d702722fd7d1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hvk4x\" (UID: \"a34d53fe-0e5b-4781-ae13-d702722fd7d1\") " pod="openshift-insights/insights-runtime-extractor-hvk4x" May 21 18:15:55.536181 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:55.536153 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a34d53fe-0e5b-4781-ae13-d702722fd7d1-crio-socket\") pod \"insights-runtime-extractor-hvk4x\" (UID: \"a34d53fe-0e5b-4781-ae13-d702722fd7d1\") " pod="openshift-insights/insights-runtime-extractor-hvk4x" May 21 18:15:55.536350 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:55.536189 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a34d53fe-0e5b-4781-ae13-d702722fd7d1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hvk4x\" (UID: \"a34d53fe-0e5b-4781-ae13-d702722fd7d1\") " pod="openshift-insights/insights-runtime-extractor-hvk4x" May 21 18:15:55.536350 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:55.536212 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cqlxk\" (UniqueName: \"kubernetes.io/projected/a34d53fe-0e5b-4781-ae13-d702722fd7d1-kube-api-access-cqlxk\") pod \"insights-runtime-extractor-hvk4x\" (UID: \"a34d53fe-0e5b-4781-ae13-d702722fd7d1\") " pod="openshift-insights/insights-runtime-extractor-hvk4x" May 21 18:15:55.536350 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:55.536229 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a34d53fe-0e5b-4781-ae13-d702722fd7d1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hvk4x\" (UID: \"a34d53fe-0e5b-4781-ae13-d702722fd7d1\") " pod="openshift-insights/insights-runtime-extractor-hvk4x" May 21 18:15:55.536350 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:55.536254 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a34d53fe-0e5b-4781-ae13-d702722fd7d1-data-volume\") pod \"insights-runtime-extractor-hvk4x\" (UID: \"a34d53fe-0e5b-4781-ae13-d702722fd7d1\") " pod="openshift-insights/insights-runtime-extractor-hvk4x" May 21 18:15:55.536350 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:55.536297 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a34d53fe-0e5b-4781-ae13-d702722fd7d1-crio-socket\") pod \"insights-runtime-extractor-hvk4x\" (UID: \"a34d53fe-0e5b-4781-ae13-d702722fd7d1\") " pod="openshift-insights/insights-runtime-extractor-hvk4x" May 21 18:15:55.536718 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:55.536698 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a34d53fe-0e5b-4781-ae13-d702722fd7d1-data-volume\") pod \"insights-runtime-extractor-hvk4x\" (UID: \"a34d53fe-0e5b-4781-ae13-d702722fd7d1\") " pod="openshift-insights/insights-runtime-extractor-hvk4x" May 21 18:15:55.536913 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:55.536899 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a34d53fe-0e5b-4781-ae13-d702722fd7d1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hvk4x\" (UID: \"a34d53fe-0e5b-4781-ae13-d702722fd7d1\") " pod="openshift-insights/insights-runtime-extractor-hvk4x" May 21 18:15:55.538664 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:55.538641 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a34d53fe-0e5b-4781-ae13-d702722fd7d1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hvk4x\" (UID: \"a34d53fe-0e5b-4781-ae13-d702722fd7d1\") " pod="openshift-insights/insights-runtime-extractor-hvk4x" May 21 18:15:55.544061 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:55.544037 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqlxk\" (UniqueName: \"kubernetes.io/projected/a34d53fe-0e5b-4781-ae13-d702722fd7d1-kube-api-access-cqlxk\") pod \"insights-runtime-extractor-hvk4x\" (UID: \"a34d53fe-0e5b-4781-ae13-d702722fd7d1\") " pod="openshift-insights/insights-runtime-extractor-hvk4x" May 21 18:15:55.662674 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:55.662608 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hvk4x" May 21 18:15:55.786395 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:55.786361 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hvk4x"] May 21 18:15:55.789476 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:15:55.789444 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda34d53fe_0e5b_4781_ae13_d702722fd7d1.slice/crio-bedea42c21aef2139ebb2d00e1b2b777c2c00ccc8b66841d2bd3df75bfdd0a7e WatchSource:0}: Error finding container bedea42c21aef2139ebb2d00e1b2b777c2c00ccc8b66841d2bd3df75bfdd0a7e: Status 404 returned error can't find the container with id bedea42c21aef2139ebb2d00e1b2b777c2c00ccc8b66841d2bd3df75bfdd0a7e May 21 18:15:56.407675 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:56.407569 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hvk4x" event={"ID":"a34d53fe-0e5b-4781-ae13-d702722fd7d1","Type":"ContainerStarted","Data":"f1ef126f2bd922de79f236d960950fc69da53b0f0aa0d166971d60616a78bf03"} May 21 18:15:56.407675 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:56.407626 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hvk4x" event={"ID":"a34d53fe-0e5b-4781-ae13-d702722fd7d1","Type":"ContainerStarted","Data":"bedea42c21aef2139ebb2d00e1b2b777c2c00ccc8b66841d2bd3df75bfdd0a7e"} May 21 18:15:57.249441 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:57.249394 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a748fb72-614d-4d85-aba5-8a243e2cd7bc-registry-tls\") pod \"image-registry-655b874888-tngrh\" (UID: \"a748fb72-614d-4d85-aba5-8a243e2cd7bc\") " pod="openshift-image-registry/image-registry-655b874888-tngrh" May 21 18:15:57.249653 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:57.249460 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5f9e615-faab-4e8d-aff3-b1fb8007d012-metrics-tls\") pod \"dns-default-x42gp\" (UID: \"e5f9e615-faab-4e8d-aff3-b1fb8007d012\") " pod="openshift-dns/dns-default-x42gp" May 21 18:15:57.251903 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:57.251878 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5f9e615-faab-4e8d-aff3-b1fb8007d012-metrics-tls\") pod \"dns-default-x42gp\" (UID: \"e5f9e615-faab-4e8d-aff3-b1fb8007d012\") " pod="openshift-dns/dns-default-x42gp" May 21 18:15:57.252159 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:57.252132 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a748fb72-614d-4d85-aba5-8a243e2cd7bc-registry-tls\") pod \"image-registry-655b874888-tngrh\" (UID: \"a748fb72-614d-4d85-aba5-8a243e2cd7bc\") " pod="openshift-image-registry/image-registry-655b874888-tngrh" May 21 18:15:57.350877 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:57.350826 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8-cert\") pod \"ingress-canary-jmg7k\" (UID: \"1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8\") " pod="openshift-ingress-canary/ingress-canary-jmg7k" May 21 18:15:57.353132 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:57.353109 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8-cert\") pod \"ingress-canary-jmg7k\" (UID: \"1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8\") " pod="openshift-ingress-canary/ingress-canary-jmg7k" May 21 18:15:57.411694 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:57.411660 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hvk4x" event={"ID":"a34d53fe-0e5b-4781-ae13-d702722fd7d1","Type":"ContainerStarted","Data":"4d1f54d43c51c9a0f9645046079d7a4789262ff36bb4adeb6907d2d5e620d7eb"} May 21 18:15:57.500442 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:57.500359 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8zgcw\"" May 21 18:15:57.500442 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:57.500359 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-sjddb\"" May 21 18:15:57.507331 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:57.507303 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x42gp" May 21 18:15:57.507331 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:57.507323 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-655b874888-tngrh" May 21 18:15:57.674392 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:57.674363 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-655b874888-tngrh"] May 21 18:15:57.678119 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:15:57.678091 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda748fb72_614d_4d85_aba5_8a243e2cd7bc.slice/crio-39473c9108ada28ef2ac4b11e08070eb6954022345e8e30011a428606fc147d6 WatchSource:0}: Error finding container 39473c9108ada28ef2ac4b11e08070eb6954022345e8e30011a428606fc147d6: Status 404 returned error can't find the container with id 39473c9108ada28ef2ac4b11e08070eb6954022345e8e30011a428606fc147d6 May 21 18:15:57.688382 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:57.688356 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x42gp"] May 21 18:15:57.691677 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:15:57.691650 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5f9e615_faab_4e8d_aff3_b1fb8007d012.slice/crio-5388e300f8e820fecdc69a8534bf78a519f33b24b2153df9d742ebd3061610c5 WatchSource:0}: Error finding container 5388e300f8e820fecdc69a8534bf78a519f33b24b2153df9d742ebd3061610c5: Status 404 returned error can't find the container with id 5388e300f8e820fecdc69a8534bf78a519f33b24b2153df9d742ebd3061610c5 May 21 18:15:58.415529 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:58.415497 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x42gp" event={"ID":"e5f9e615-faab-4e8d-aff3-b1fb8007d012","Type":"ContainerStarted","Data":"5388e300f8e820fecdc69a8534bf78a519f33b24b2153df9d742ebd3061610c5"} May 21 18:15:58.416859 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:58.416831 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-655b874888-tngrh" event={"ID":"a748fb72-614d-4d85-aba5-8a243e2cd7bc","Type":"ContainerStarted","Data":"8b6bb5cdbf28489deb2c68ca12618d27e2927386c22bddf883ad6454127d1cf2"} May 21 18:15:58.416987 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:58.416867 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-655b874888-tngrh" event={"ID":"a748fb72-614d-4d85-aba5-8a243e2cd7bc","Type":"ContainerStarted","Data":"39473c9108ada28ef2ac4b11e08070eb6954022345e8e30011a428606fc147d6"} May 21 18:15:58.416987 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:58.416955 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-655b874888-tngrh" May 21 18:15:58.418673 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:58.418649 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hvk4x" event={"ID":"a34d53fe-0e5b-4781-ae13-d702722fd7d1","Type":"ContainerStarted","Data":"4522afea688eb96eb60e57797b4b01739a5915b11656fe2cf87a4f9b958de1ac"} May 21 18:15:58.436369 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:58.436331 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-655b874888-tngrh" podStartSLOduration=162.436322134 podStartE2EDuration="2m42.436322134s" podCreationTimestamp="2026-05-21 18:13:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:15:58.435309901 +0000 UTC m=+163.020796381" watchObservedRunningTime="2026-05-21 18:15:58.436322134 +0000 UTC m=+163.021808569" May 21 18:15:58.451414 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:15:58.451378 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hvk4x" podStartSLOduration=0.967498615 podStartE2EDuration="3.451369413s" podCreationTimestamp="2026-05-21 18:15:55 +0000 UTC" firstStartedPulling="2026-05-21 18:15:55.836616326 +0000 UTC m=+160.422102741" lastFinishedPulling="2026-05-21 18:15:58.320487125 +0000 UTC m=+162.905973539" observedRunningTime="2026-05-21 18:15:58.450304418 +0000 UTC m=+163.035790868" watchObservedRunningTime="2026-05-21 18:15:58.451369413 +0000 UTC m=+163.036855849" May 21 18:16:00.425463 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:00.425420 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x42gp" event={"ID":"e5f9e615-faab-4e8d-aff3-b1fb8007d012","Type":"ContainerStarted","Data":"6c437d3de264c96a7c382909f15498ef4ad6e55dd0d1eeb37050bdd17e8ce82e"} May 21 18:16:00.425463 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:00.425458 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x42gp" event={"ID":"e5f9e615-faab-4e8d-aff3-b1fb8007d012","Type":"ContainerStarted","Data":"b492fff6c8407b7beaa13523c3fb3104e6951889203a845a8a3844e89806b045"} May 21 18:16:00.425936 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:00.425609 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-x42gp" May 21 18:16:05.980977 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:05.980939 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jmg7k" May 21 18:16:05.981423 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:05.981166 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk2c6" May 21 18:16:05.983526 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:05.983507 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xmgqj\"" May 21 18:16:05.991688 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:05.991668 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jmg7k" May 21 18:16:06.112862 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:06.112807 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-x42gp" podStartSLOduration=135.445438582 podStartE2EDuration="2m17.112791742s" podCreationTimestamp="2026-05-21 18:13:49 +0000 UTC" firstStartedPulling="2026-05-21 18:15:57.693670106 +0000 UTC m=+162.279156525" lastFinishedPulling="2026-05-21 18:15:59.361023272 +0000 UTC m=+163.946509685" observedRunningTime="2026-05-21 18:16:00.439981254 +0000 UTC m=+165.025467702" watchObservedRunningTime="2026-05-21 18:16:06.112791742 +0000 UTC m=+170.698278181" May 21 18:16:06.113465 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:06.113448 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jmg7k"] May 21 18:16:06.117028 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:16:06.117002 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a74d1a0_0bba_4463_8e3f_e9aa3157eaf8.slice/crio-fafcb3d4b7e60651ec74004b4f6e8f0ace288ceae678d0a80679b56ec64460fc WatchSource:0}: Error finding container fafcb3d4b7e60651ec74004b4f6e8f0ace288ceae678d0a80679b56ec64460fc: Status 404 returned error can't find the container with id fafcb3d4b7e60651ec74004b4f6e8f0ace288ceae678d0a80679b56ec64460fc May 21 18:16:06.443367 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:06.443280 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jmg7k" event={"ID":"1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8","Type":"ContainerStarted","Data":"fafcb3d4b7e60651ec74004b4f6e8f0ace288ceae678d0a80679b56ec64460fc"} May 21 18:16:08.449497 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:08.449409 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jmg7k" event={"ID":"1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8","Type":"ContainerStarted","Data":"d8f01cbd51c36df6c43992bae20ced436e1aa2f53cfaad3ac52333ffae402d19"} May 21 18:16:08.463902 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:08.463855 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jmg7k" podStartSLOduration=137.56459113 podStartE2EDuration="2m19.463842537s" podCreationTimestamp="2026-05-21 18:13:49 +0000 UTC" firstStartedPulling="2026-05-21 18:16:06.118926394 +0000 UTC m=+170.704412809" lastFinishedPulling="2026-05-21 18:16:08.018177803 +0000 UTC m=+172.603664216" observedRunningTime="2026-05-21 18:16:08.463142878 +0000 UTC m=+173.048629313" watchObservedRunningTime="2026-05-21 18:16:08.463842537 +0000 UTC m=+173.049328974" May 21 18:16:10.317285 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.317248 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-4mn82"] May 21 18:16:10.320012 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.319992 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-4mn82" May 21 18:16:10.323083 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.323054 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" May 21 18:16:10.323400 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.323375 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" May 21 18:16:10.323400 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.323393 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-pdqss\"" May 21 18:16:10.323969 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.323949 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 21 18:16:10.324066 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.324009 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 21 18:16:10.324133 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.324118 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 21 18:16:10.333089 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.333067 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-4mn82"] May 21 18:16:10.348082 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.348060 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kf6bz"] May 21 18:16:10.350756 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.350737 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kf6bz" May 21 18:16:10.353187 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.353163 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 21 18:16:10.353289 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.353214 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 21 18:16:10.353371 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.353354 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vpjw5\"" May 21 18:16:10.353485 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.353468 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 21 18:16:10.430226 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.430201 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-x42gp" May 21 18:16:10.451847 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.451821 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1da06ee6-5895-4f97-8d35-8967b0bc81e8-sys\") pod \"node-exporter-kf6bz\" (UID: \"1da06ee6-5895-4f97-8d35-8967b0bc81e8\") " pod="openshift-monitoring/node-exporter-kf6bz" May 21 18:16:10.452006 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.451860 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c1362ee-6e5b-42e5-b041-4c5d9cb57692-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-4mn82\" (UID: \"8c1362ee-6e5b-42e5-b041-4c5d9cb57692\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-4mn82" May 21 18:16:10.452006 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.451907 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1da06ee6-5895-4f97-8d35-8967b0bc81e8-node-exporter-textfile\") pod \"node-exporter-kf6bz\" (UID: \"1da06ee6-5895-4f97-8d35-8967b0bc81e8\") " pod="openshift-monitoring/node-exporter-kf6bz" May 21 18:16:10.452006 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.451964 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1da06ee6-5895-4f97-8d35-8967b0bc81e8-root\") pod \"node-exporter-kf6bz\" (UID: \"1da06ee6-5895-4f97-8d35-8967b0bc81e8\") " pod="openshift-monitoring/node-exporter-kf6bz" May 21 18:16:10.452006 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.451987 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1da06ee6-5895-4f97-8d35-8967b0bc81e8-node-exporter-wtmp\") pod \"node-exporter-kf6bz\" (UID: \"1da06ee6-5895-4f97-8d35-8967b0bc81e8\") " pod="openshift-monitoring/node-exporter-kf6bz" May 21 18:16:10.452191 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.452031 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c1362ee-6e5b-42e5-b041-4c5d9cb57692-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-4mn82\" (UID: \"8c1362ee-6e5b-42e5-b041-4c5d9cb57692\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-4mn82" May 21 18:16:10.452191 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.452071 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29lwk\" (UniqueName: \"kubernetes.io/projected/8c1362ee-6e5b-42e5-b041-4c5d9cb57692-kube-api-access-29lwk\") pod \"openshift-state-metrics-9c959559f-4mn82\" (UID: \"8c1362ee-6e5b-42e5-b041-4c5d9cb57692\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-4mn82" May 21 18:16:10.452191 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.452137 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cx42\" (UniqueName: \"kubernetes.io/projected/1da06ee6-5895-4f97-8d35-8967b0bc81e8-kube-api-access-2cx42\") pod \"node-exporter-kf6bz\" (UID: \"1da06ee6-5895-4f97-8d35-8967b0bc81e8\") " pod="openshift-monitoring/node-exporter-kf6bz" May 21 18:16:10.452191 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.452176 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1da06ee6-5895-4f97-8d35-8967b0bc81e8-metrics-client-ca\") pod \"node-exporter-kf6bz\" (UID: \"1da06ee6-5895-4f97-8d35-8967b0bc81e8\") " pod="openshift-monitoring/node-exporter-kf6bz" May 21 18:16:10.452352 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.452202 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1da06ee6-5895-4f97-8d35-8967b0bc81e8-node-exporter-tls\") pod \"node-exporter-kf6bz\" (UID: \"1da06ee6-5895-4f97-8d35-8967b0bc81e8\") " pod="openshift-monitoring/node-exporter-kf6bz" May 21 18:16:10.452352 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.452251 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1da06ee6-5895-4f97-8d35-8967b0bc81e8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kf6bz\" (UID: \"1da06ee6-5895-4f97-8d35-8967b0bc81e8\") " pod="openshift-monitoring/node-exporter-kf6bz" May 21 18:16:10.452352 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.452276 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1da06ee6-5895-4f97-8d35-8967b0bc81e8-node-exporter-accelerators-collector-config\") pod \"node-exporter-kf6bz\" (UID: \"1da06ee6-5895-4f97-8d35-8967b0bc81e8\") " pod="openshift-monitoring/node-exporter-kf6bz" May 21 18:16:10.452352 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.452306 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8c1362ee-6e5b-42e5-b041-4c5d9cb57692-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-4mn82\" (UID: \"8c1362ee-6e5b-42e5-b041-4c5d9cb57692\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-4mn82" May 21 18:16:10.553221 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.553181 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c1362ee-6e5b-42e5-b041-4c5d9cb57692-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-4mn82\" (UID: \"8c1362ee-6e5b-42e5-b041-4c5d9cb57692\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-4mn82" May 21 18:16:10.553384 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.553237 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1da06ee6-5895-4f97-8d35-8967b0bc81e8-node-exporter-textfile\") pod \"node-exporter-kf6bz\" (UID: \"1da06ee6-5895-4f97-8d35-8967b0bc81e8\") " pod="openshift-monitoring/node-exporter-kf6bz" May 21 18:16:10.553384 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.553271 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1da06ee6-5895-4f97-8d35-8967b0bc81e8-root\") pod \"node-exporter-kf6bz\" (UID: \"1da06ee6-5895-4f97-8d35-8967b0bc81e8\") " pod="openshift-monitoring/node-exporter-kf6bz" May 21 18:16:10.553384 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.553292 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1da06ee6-5895-4f97-8d35-8967b0bc81e8-node-exporter-wtmp\") pod \"node-exporter-kf6bz\" (UID: \"1da06ee6-5895-4f97-8d35-8967b0bc81e8\") " pod="openshift-monitoring/node-exporter-kf6bz" May 21 18:16:10.553384 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.553331 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c1362ee-6e5b-42e5-b041-4c5d9cb57692-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-4mn82\" (UID: \"8c1362ee-6e5b-42e5-b041-4c5d9cb57692\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-4mn82" May 21 18:16:10.553384 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.553369 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-29lwk\" (UniqueName: \"kubernetes.io/projected/8c1362ee-6e5b-42e5-b041-4c5d9cb57692-kube-api-access-29lwk\") pod \"openshift-state-metrics-9c959559f-4mn82\" (UID: \"8c1362ee-6e5b-42e5-b041-4c5d9cb57692\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-4mn82" May 21 18:16:10.553677 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.553385 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1da06ee6-5895-4f97-8d35-8967b0bc81e8-root\") pod \"node-exporter-kf6bz\" (UID: \"1da06ee6-5895-4f97-8d35-8967b0bc81e8\") " pod="openshift-monitoring/node-exporter-kf6bz" May 21 18:16:10.553677 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.553401 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2cx42\" (UniqueName: \"kubernetes.io/projected/1da06ee6-5895-4f97-8d35-8967b0bc81e8-kube-api-access-2cx42\") pod \"node-exporter-kf6bz\" (UID: \"1da06ee6-5895-4f97-8d35-8967b0bc81e8\") " pod="openshift-monitoring/node-exporter-kf6bz" May 21 18:16:10.553677 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.553458 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1da06ee6-5895-4f97-8d35-8967b0bc81e8-node-exporter-wtmp\") pod \"node-exporter-kf6bz\" (UID: \"1da06ee6-5895-4f97-8d35-8967b0bc81e8\") " pod="openshift-monitoring/node-exporter-kf6bz" May 21 18:16:10.553994 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.553676 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1da06ee6-5895-4f97-8d35-8967b0bc81e8-metrics-client-ca\") pod \"node-exporter-kf6bz\" (UID: \"1da06ee6-5895-4f97-8d35-8967b0bc81e8\") " pod="openshift-monitoring/node-exporter-kf6bz" May 21 18:16:10.553994 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.553705 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1da06ee6-5895-4f97-8d35-8967b0bc81e8-node-exporter-textfile\") pod \"node-exporter-kf6bz\" (UID: \"1da06ee6-5895-4f97-8d35-8967b0bc81e8\") " pod="openshift-monitoring/node-exporter-kf6bz" May 21 18:16:10.553994 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.553710 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1da06ee6-5895-4f97-8d35-8967b0bc81e8-node-exporter-tls\") pod \"node-exporter-kf6bz\" (UID: \"1da06ee6-5895-4f97-8d35-8967b0bc81e8\") " pod="openshift-monitoring/node-exporter-kf6bz" May 21 18:16:10.554146 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.554061 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c1362ee-6e5b-42e5-b041-4c5d9cb57692-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-4mn82\" (UID: \"8c1362ee-6e5b-42e5-b041-4c5d9cb57692\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-4mn82" May 21 18:16:10.554270 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.553771 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1da06ee6-5895-4f97-8d35-8967b0bc81e8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kf6bz\" (UID: \"1da06ee6-5895-4f97-8d35-8967b0bc81e8\") " pod="openshift-monitoring/node-exporter-kf6bz" May 21 18:16:10.554343 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.554292 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1da06ee6-5895-4f97-8d35-8967b0bc81e8-node-exporter-accelerators-collector-config\") pod \"node-exporter-kf6bz\" (UID: \"1da06ee6-5895-4f97-8d35-8967b0bc81e8\") " pod="openshift-monitoring/node-exporter-kf6bz" May 21 18:16:10.554343 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.554321 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1da06ee6-5895-4f97-8d35-8967b0bc81e8-metrics-client-ca\") pod \"node-exporter-kf6bz\" (UID: \"1da06ee6-5895-4f97-8d35-8967b0bc81e8\") " pod="openshift-monitoring/node-exporter-kf6bz" May 21 18:16:10.554343 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.554331 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8c1362ee-6e5b-42e5-b041-4c5d9cb57692-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-4mn82\" (UID: \"8c1362ee-6e5b-42e5-b041-4c5d9cb57692\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-4mn82" May 21 18:16:10.554496 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.554445 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1da06ee6-5895-4f97-8d35-8967b0bc81e8-sys\") pod \"node-exporter-kf6bz\" (UID: \"1da06ee6-5895-4f97-8d35-8967b0bc81e8\") " pod="openshift-monitoring/node-exporter-kf6bz" May 21 18:16:10.554570 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.554521 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1da06ee6-5895-4f97-8d35-8967b0bc81e8-sys\") pod \"node-exporter-kf6bz\" (UID: \"1da06ee6-5895-4f97-8d35-8967b0bc81e8\") " pod="openshift-monitoring/node-exporter-kf6bz" May 21 18:16:10.554955 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.554907 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1da06ee6-5895-4f97-8d35-8967b0bc81e8-node-exporter-accelerators-collector-config\") pod \"node-exporter-kf6bz\" (UID: \"1da06ee6-5895-4f97-8d35-8967b0bc81e8\") " pod="openshift-monitoring/node-exporter-kf6bz" May 21 18:16:10.556090 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.556060 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1da06ee6-5895-4f97-8d35-8967b0bc81e8-node-exporter-tls\") pod \"node-exporter-kf6bz\" (UID: \"1da06ee6-5895-4f97-8d35-8967b0bc81e8\") " pod="openshift-monitoring/node-exporter-kf6bz" May 21 18:16:10.556314 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.556285 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1da06ee6-5895-4f97-8d35-8967b0bc81e8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kf6bz\" (UID: \"1da06ee6-5895-4f97-8d35-8967b0bc81e8\") " pod="openshift-monitoring/node-exporter-kf6bz" May 21 18:16:10.556398 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.556294 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c1362ee-6e5b-42e5-b041-4c5d9cb57692-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-4mn82\" (UID: \"8c1362ee-6e5b-42e5-b041-4c5d9cb57692\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-4mn82" May 21 18:16:10.556487 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.556469 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8c1362ee-6e5b-42e5-b041-4c5d9cb57692-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-4mn82\" (UID: \"8c1362ee-6e5b-42e5-b041-4c5d9cb57692\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-4mn82" May 21 18:16:10.560942 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.560922 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29lwk\" (UniqueName: \"kubernetes.io/projected/8c1362ee-6e5b-42e5-b041-4c5d9cb57692-kube-api-access-29lwk\") pod \"openshift-state-metrics-9c959559f-4mn82\" (UID: \"8c1362ee-6e5b-42e5-b041-4c5d9cb57692\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-4mn82" May 21 18:16:10.561002 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.560957 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cx42\" (UniqueName: \"kubernetes.io/projected/1da06ee6-5895-4f97-8d35-8967b0bc81e8-kube-api-access-2cx42\") pod \"node-exporter-kf6bz\" (UID: \"1da06ee6-5895-4f97-8d35-8967b0bc81e8\") " pod="openshift-monitoring/node-exporter-kf6bz" May 21 18:16:10.631464 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.631366 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-4mn82" May 21 18:16:10.660498 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.660398 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kf6bz" May 21 18:16:10.672150 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:16:10.672119 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1da06ee6_5895_4f97_8d35_8967b0bc81e8.slice/crio-4ca329c244ea1dd71739c1548e100f7c2c4e6ed0c215831c79a8cb11dec43b0a WatchSource:0}: Error finding container 4ca329c244ea1dd71739c1548e100f7c2c4e6ed0c215831c79a8cb11dec43b0a: Status 404 returned error can't find the container with id 4ca329c244ea1dd71739c1548e100f7c2c4e6ed0c215831c79a8cb11dec43b0a May 21 18:16:10.758531 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:10.758503 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-4mn82"] May 21 18:16:10.760832 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:16:10.760803 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c1362ee_6e5b_42e5_b041_4c5d9cb57692.slice/crio-19c9d705fe842d2087a34df796a0d72e158d7dff800383b0e353985682bfdb8d WatchSource:0}: Error finding container 19c9d705fe842d2087a34df796a0d72e158d7dff800383b0e353985682bfdb8d: Status 404 returned error can't find the container with id 19c9d705fe842d2087a34df796a0d72e158d7dff800383b0e353985682bfdb8d May 21 18:16:11.398824 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.398787 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 18:16:11.402381 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.402357 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 21 18:16:11.404882 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.404848 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 21 18:16:11.405006 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.404908 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 21 18:16:11.405066 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.404849 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 21 18:16:11.405066 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.404849 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 21 18:16:11.405172 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.405134 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 21 18:16:11.405225 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.405201 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 21 18:16:11.405274 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.405253 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-l4qk4\"" May 21 18:16:11.405324 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.405287 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 21 18:16:11.405535 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.405383 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 21 18:16:11.405535 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.405423 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 21 18:16:11.415172 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.415139 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 18:16:11.458187 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.458143 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kf6bz" event={"ID":"1da06ee6-5895-4f97-8d35-8967b0bc81e8","Type":"ContainerStarted","Data":"4ca329c244ea1dd71739c1548e100f7c2c4e6ed0c215831c79a8cb11dec43b0a"} May 21 18:16:11.460099 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.460069 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-4mn82" event={"ID":"8c1362ee-6e5b-42e5-b041-4c5d9cb57692","Type":"ContainerStarted","Data":"36c9fa2f3b1dc85fb3e64c548865c3536bd27d0b4eadd712c1c234113a2b9e43"} May 21 18:16:11.460229 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.460105 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-4mn82" event={"ID":"8c1362ee-6e5b-42e5-b041-4c5d9cb57692","Type":"ContainerStarted","Data":"3df592fec056b12b3b983183d3b307d21000464ba74c6bc4569b2a98cca3e2f8"} May 21 18:16:11.460229 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.460120 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-4mn82" event={"ID":"8c1362ee-6e5b-42e5-b041-4c5d9cb57692","Type":"ContainerStarted","Data":"19c9d705fe842d2087a34df796a0d72e158d7dff800383b0e353985682bfdb8d"} May 21 18:16:11.563410 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.563374 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/032b4d76-9eca-4876-9cb8-bd8de236ba18-config-volume\") pod \"alertmanager-main-0\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:16:11.563522 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.563411 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/032b4d76-9eca-4876-9cb8-bd8de236ba18-web-config\") pod \"alertmanager-main-0\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:16:11.563522 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.563475 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5f6bz\" (UniqueName: \"kubernetes.io/projected/032b4d76-9eca-4876-9cb8-bd8de236ba18-kube-api-access-5f6bz\") pod \"alertmanager-main-0\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:16:11.563522 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.563496 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/032b4d76-9eca-4876-9cb8-bd8de236ba18-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:16:11.563710 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.563521 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/032b4d76-9eca-4876-9cb8-bd8de236ba18-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:16:11.563710 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.563562 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/032b4d76-9eca-4876-9cb8-bd8de236ba18-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:16:11.563710 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.563609 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/032b4d76-9eca-4876-9cb8-bd8de236ba18-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:16:11.563710 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.563645 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/032b4d76-9eca-4876-9cb8-bd8de236ba18-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:16:11.563710 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.563672 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/032b4d76-9eca-4876-9cb8-bd8de236ba18-config-out\") pod \"alertmanager-main-0\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:16:11.563710 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.563694 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/032b4d76-9eca-4876-9cb8-bd8de236ba18-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:16:11.563710 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.563711 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/032b4d76-9eca-4876-9cb8-bd8de236ba18-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:16:11.564042 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.563733 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/032b4d76-9eca-4876-9cb8-bd8de236ba18-tls-assets\") pod \"alertmanager-main-0\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:16:11.564042 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.563809 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/032b4d76-9eca-4876-9cb8-bd8de236ba18-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:16:11.664745 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.664660 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/032b4d76-9eca-4876-9cb8-bd8de236ba18-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:16:11.664745 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.664711 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/032b4d76-9eca-4876-9cb8-bd8de236ba18-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:16:11.664959 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.664749 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/032b4d76-9eca-4876-9cb8-bd8de236ba18-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:16:11.664959 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.664786 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/032b4d76-9eca-4876-9cb8-bd8de236ba18-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:16:11.664959 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.664827 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/032b4d76-9eca-4876-9cb8-bd8de236ba18-config-out\") pod \"alertmanager-main-0\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:16:11.664959 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.664865 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/032b4d76-9eca-4876-9cb8-bd8de236ba18-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:16:11.664959 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.664892 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/032b4d76-9eca-4876-9cb8-bd8de236ba18-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:16:11.664959 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.664928 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/032b4d76-9eca-4876-9cb8-bd8de236ba18-tls-assets\") pod \"alertmanager-main-0\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:16:11.664959 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.664951 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/032b4d76-9eca-4876-9cb8-bd8de236ba18-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:16:11.665297 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.664980 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/032b4d76-9eca-4876-9cb8-bd8de236ba18-config-volume\") pod \"alertmanager-main-0\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:16:11.665297 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.665009 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/032b4d76-9eca-4876-9cb8-bd8de236ba18-web-config\") pod \"alertmanager-main-0\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:16:11.666145 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.666114 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5f6bz\" (UniqueName: \"kubernetes.io/projected/032b4d76-9eca-4876-9cb8-bd8de236ba18-kube-api-access-5f6bz\") pod \"alertmanager-main-0\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:16:11.666256 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.666162 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/032b4d76-9eca-4876-9cb8-bd8de236ba18-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:16:11.666321 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.666243 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/032b4d76-9eca-4876-9cb8-bd8de236ba18-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:16:11.667311 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.666805 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/032b4d76-9eca-4876-9cb8-bd8de236ba18-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:16:11.668162 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.668113 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/032b4d76-9eca-4876-9cb8-bd8de236ba18-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:16:11.669799 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.669768 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/032b4d76-9eca-4876-9cb8-bd8de236ba18-config-out\") pod \"alertmanager-main-0\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:16:11.670458 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.670370 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/032b4d76-9eca-4876-9cb8-bd8de236ba18-tls-assets\") pod \"alertmanager-main-0\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:16:11.670458 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.670382 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/032b4d76-9eca-4876-9cb8-bd8de236ba18-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:16:11.670641 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.670504 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/032b4d76-9eca-4876-9cb8-bd8de236ba18-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:16:11.670856 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.670809 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/032b4d76-9eca-4876-9cb8-bd8de236ba18-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:16:11.671098 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.671082 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/032b4d76-9eca-4876-9cb8-bd8de236ba18-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:16:11.671957 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.671915 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/032b4d76-9eca-4876-9cb8-bd8de236ba18-web-config\") pod \"alertmanager-main-0\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:16:11.672042 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.671986 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/032b4d76-9eca-4876-9cb8-bd8de236ba18-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:16:11.672482 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.672457 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/032b4d76-9eca-4876-9cb8-bd8de236ba18-config-volume\") pod \"alertmanager-main-0\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:16:11.675785 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.675761 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5f6bz\" (UniqueName: \"kubernetes.io/projected/032b4d76-9eca-4876-9cb8-bd8de236ba18-kube-api-access-5f6bz\") pod \"alertmanager-main-0\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:16:11.713841 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.713809 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 21 18:16:11.860961 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:11.860929 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 18:16:11.993913 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:16:11.993882 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod032b4d76_9eca_4876_9cb8_bd8de236ba18.slice/crio-1766b6a4180185e2d58625331878bd6c6115bde2b4f11a8b65dbdc7c4655d5bb WatchSource:0}: Error finding container 1766b6a4180185e2d58625331878bd6c6115bde2b4f11a8b65dbdc7c4655d5bb: Status 404 returned error can't find the container with id 1766b6a4180185e2d58625331878bd6c6115bde2b4f11a8b65dbdc7c4655d5bb May 21 18:16:12.398591 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:12.398491 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5dbdf6b59f-9fslv"] May 21 18:16:12.401013 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:12.400998 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5dbdf6b59f-9fslv" May 21 18:16:12.403749 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:12.403714 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" May 21 18:16:12.403749 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:12.403714 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" May 21 18:16:12.403921 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:12.403745 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" May 21 18:16:12.403921 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:12.403776 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-6dpfw\"" May 21 18:16:12.403921 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:12.403797 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-66e5pagopn6d1\"" May 21 18:16:12.403921 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:12.403841 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" May 21 18:16:12.404100 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:12.404088 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" May 21 18:16:12.414369 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:12.414344 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5dbdf6b59f-9fslv"] May 21 18:16:12.464100 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:12.464061 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-4mn82" event={"ID":"8c1362ee-6e5b-42e5-b041-4c5d9cb57692","Type":"ContainerStarted","Data":"c2e886e92fbdf4fd10d4da2f17ccd88d8df11487fc064e647403a766159303e0"} May 21 18:16:12.465426 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:12.465401 2567 generic.go:358] "Generic (PLEG): container finished" podID="1da06ee6-5895-4f97-8d35-8967b0bc81e8" containerID="22d068e2745c91d7a40d62330b873b06ccac9598728954d3ecb2467d68b4ff48" exitCode=0 May 21 18:16:12.465538 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:12.465468 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kf6bz" event={"ID":"1da06ee6-5895-4f97-8d35-8967b0bc81e8","Type":"ContainerDied","Data":"22d068e2745c91d7a40d62330b873b06ccac9598728954d3ecb2467d68b4ff48"} May 21 18:16:12.466489 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:12.466465 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"032b4d76-9eca-4876-9cb8-bd8de236ba18","Type":"ContainerStarted","Data":"1766b6a4180185e2d58625331878bd6c6115bde2b4f11a8b65dbdc7c4655d5bb"} May 21 18:16:12.481413 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:12.481372 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-4mn82" podStartSLOduration=1.333171425 podStartE2EDuration="2.481354339s" podCreationTimestamp="2026-05-21 18:16:10 +0000 UTC" firstStartedPulling="2026-05-21 18:16:10.873149597 +0000 UTC m=+175.458636011" lastFinishedPulling="2026-05-21 18:16:12.02133251 +0000 UTC m=+176.606818925" observedRunningTime="2026-05-21 18:16:12.48049899 +0000 UTC m=+177.065985428" watchObservedRunningTime="2026-05-21 18:16:12.481354339 +0000 UTC m=+177.066840775" May 21 18:16:12.574359 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:12.574327 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e275137-ae27-4f57-a114-6265e167583c-metrics-client-ca\") pod \"thanos-querier-5dbdf6b59f-9fslv\" (UID: \"5e275137-ae27-4f57-a114-6265e167583c\") " pod="openshift-monitoring/thanos-querier-5dbdf6b59f-9fslv" May 21 18:16:12.574471 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:12.574401 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5e275137-ae27-4f57-a114-6265e167583c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5dbdf6b59f-9fslv\" (UID: \"5e275137-ae27-4f57-a114-6265e167583c\") " pod="openshift-monitoring/thanos-querier-5dbdf6b59f-9fslv" May 21 18:16:12.574471 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:12.574444 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5e275137-ae27-4f57-a114-6265e167583c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5dbdf6b59f-9fslv\" (UID: \"5e275137-ae27-4f57-a114-6265e167583c\") " pod="openshift-monitoring/thanos-querier-5dbdf6b59f-9fslv" May 21 18:16:12.574555 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:12.574513 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5e275137-ae27-4f57-a114-6265e167583c-secret-grpc-tls\") pod \"thanos-querier-5dbdf6b59f-9fslv\" (UID: \"5e275137-ae27-4f57-a114-6265e167583c\") " pod="openshift-monitoring/thanos-querier-5dbdf6b59f-9fslv" May 21 18:16:12.574630 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:12.574558 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5e275137-ae27-4f57-a114-6265e167583c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5dbdf6b59f-9fslv\" (UID: \"5e275137-ae27-4f57-a114-6265e167583c\") " pod="openshift-monitoring/thanos-querier-5dbdf6b59f-9fslv" May 21 18:16:12.574630 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:12.574611 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5e275137-ae27-4f57-a114-6265e167583c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5dbdf6b59f-9fslv\" (UID: \"5e275137-ae27-4f57-a114-6265e167583c\") " pod="openshift-monitoring/thanos-querier-5dbdf6b59f-9fslv" May 21 18:16:12.574701 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:12.574656 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5e275137-ae27-4f57-a114-6265e167583c-secret-thanos-querier-tls\") pod \"thanos-querier-5dbdf6b59f-9fslv\" (UID: \"5e275137-ae27-4f57-a114-6265e167583c\") " pod="openshift-monitoring/thanos-querier-5dbdf6b59f-9fslv" May 21 18:16:12.575068 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:12.574800 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pxtk\" (UniqueName: \"kubernetes.io/projected/5e275137-ae27-4f57-a114-6265e167583c-kube-api-access-7pxtk\") pod \"thanos-querier-5dbdf6b59f-9fslv\" (UID: \"5e275137-ae27-4f57-a114-6265e167583c\") " pod="openshift-monitoring/thanos-querier-5dbdf6b59f-9fslv" May 21 18:16:12.676183 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:12.676082 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5e275137-ae27-4f57-a114-6265e167583c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5dbdf6b59f-9fslv\" (UID: \"5e275137-ae27-4f57-a114-6265e167583c\") " pod="openshift-monitoring/thanos-querier-5dbdf6b59f-9fslv" May 21 18:16:12.676183 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:12.676136 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5e275137-ae27-4f57-a114-6265e167583c-secret-grpc-tls\") pod \"thanos-querier-5dbdf6b59f-9fslv\" (UID: \"5e275137-ae27-4f57-a114-6265e167583c\") " pod="openshift-monitoring/thanos-querier-5dbdf6b59f-9fslv" May 21 18:16:12.676183 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:12.676165 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5e275137-ae27-4f57-a114-6265e167583c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5dbdf6b59f-9fslv\" (UID: \"5e275137-ae27-4f57-a114-6265e167583c\") " pod="openshift-monitoring/thanos-querier-5dbdf6b59f-9fslv" May 21 18:16:12.676556 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:12.676196 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5e275137-ae27-4f57-a114-6265e167583c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5dbdf6b59f-9fslv\" (UID: \"5e275137-ae27-4f57-a114-6265e167583c\") " pod="openshift-monitoring/thanos-querier-5dbdf6b59f-9fslv" May 21 18:16:12.676556 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:12.676230 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5e275137-ae27-4f57-a114-6265e167583c-secret-thanos-querier-tls\") pod \"thanos-querier-5dbdf6b59f-9fslv\" (UID: \"5e275137-ae27-4f57-a114-6265e167583c\") " pod="openshift-monitoring/thanos-querier-5dbdf6b59f-9fslv" May 21 18:16:12.676556 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:12.676287 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7pxtk\" (UniqueName: \"kubernetes.io/projected/5e275137-ae27-4f57-a114-6265e167583c-kube-api-access-7pxtk\") pod \"thanos-querier-5dbdf6b59f-9fslv\" (UID: \"5e275137-ae27-4f57-a114-6265e167583c\") " pod="openshift-monitoring/thanos-querier-5dbdf6b59f-9fslv" May 21 18:16:12.676556 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:12.676357 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e275137-ae27-4f57-a114-6265e167583c-metrics-client-ca\") pod \"thanos-querier-5dbdf6b59f-9fslv\" (UID: \"5e275137-ae27-4f57-a114-6265e167583c\") " pod="openshift-monitoring/thanos-querier-5dbdf6b59f-9fslv" May 21 18:16:12.676556 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:12.676393 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5e275137-ae27-4f57-a114-6265e167583c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5dbdf6b59f-9fslv\" (UID: \"5e275137-ae27-4f57-a114-6265e167583c\") " pod="openshift-monitoring/thanos-querier-5dbdf6b59f-9fslv" May 21 18:16:12.677418 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:12.677383 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e275137-ae27-4f57-a114-6265e167583c-metrics-client-ca\") pod \"thanos-querier-5dbdf6b59f-9fslv\" (UID: \"5e275137-ae27-4f57-a114-6265e167583c\") " pod="openshift-monitoring/thanos-querier-5dbdf6b59f-9fslv" May 21 18:16:12.679124 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:12.679066 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5e275137-ae27-4f57-a114-6265e167583c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5dbdf6b59f-9fslv\" (UID: \"5e275137-ae27-4f57-a114-6265e167583c\") " pod="openshift-monitoring/thanos-querier-5dbdf6b59f-9fslv" May 21 18:16:12.679226 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:12.679126 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5e275137-ae27-4f57-a114-6265e167583c-secret-grpc-tls\") pod \"thanos-querier-5dbdf6b59f-9fslv\" (UID: \"5e275137-ae27-4f57-a114-6265e167583c\") " pod="openshift-monitoring/thanos-querier-5dbdf6b59f-9fslv" May 21 18:16:12.679708 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:12.679683 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5e275137-ae27-4f57-a114-6265e167583c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5dbdf6b59f-9fslv\" (UID: \"5e275137-ae27-4f57-a114-6265e167583c\") " pod="openshift-monitoring/thanos-querier-5dbdf6b59f-9fslv" May 21 18:16:12.679898 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:12.679874 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5e275137-ae27-4f57-a114-6265e167583c-secret-thanos-querier-tls\") pod \"thanos-querier-5dbdf6b59f-9fslv\" (UID: \"5e275137-ae27-4f57-a114-6265e167583c\") " pod="openshift-monitoring/thanos-querier-5dbdf6b59f-9fslv" May 21 18:16:12.679959 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:12.679936 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5e275137-ae27-4f57-a114-6265e167583c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5dbdf6b59f-9fslv\" (UID: \"5e275137-ae27-4f57-a114-6265e167583c\") " pod="openshift-monitoring/thanos-querier-5dbdf6b59f-9fslv" May 21 18:16:12.680465 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:12.680436 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5e275137-ae27-4f57-a114-6265e167583c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5dbdf6b59f-9fslv\" (UID: \"5e275137-ae27-4f57-a114-6265e167583c\") " pod="openshift-monitoring/thanos-querier-5dbdf6b59f-9fslv" May 21 18:16:12.683921 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:12.683900 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pxtk\" (UniqueName: \"kubernetes.io/projected/5e275137-ae27-4f57-a114-6265e167583c-kube-api-access-7pxtk\") pod \"thanos-querier-5dbdf6b59f-9fslv\" (UID: \"5e275137-ae27-4f57-a114-6265e167583c\") " pod="openshift-monitoring/thanos-querier-5dbdf6b59f-9fslv" May 21 18:16:12.710491 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:12.710466 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5dbdf6b59f-9fslv" May 21 18:16:12.840115 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:12.840075 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5dbdf6b59f-9fslv"] May 21 18:16:12.844863 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:16:12.844831 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e275137_ae27_4f57_a114_6265e167583c.slice/crio-06786ed48a83a9d2d0edf625890d85a5c1c80c198d1fdf756b8a9039fe6454c3 WatchSource:0}: Error finding container 06786ed48a83a9d2d0edf625890d85a5c1c80c198d1fdf756b8a9039fe6454c3: Status 404 returned error can't find the container with id 06786ed48a83a9d2d0edf625890d85a5c1c80c198d1fdf756b8a9039fe6454c3 May 21 18:16:13.472273 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:13.472236 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kf6bz" event={"ID":"1da06ee6-5895-4f97-8d35-8967b0bc81e8","Type":"ContainerStarted","Data":"44464789ca6efd305226f076d9359454a3d1310394ded79249baf5edbb83eeaf"} May 21 18:16:13.472752 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:13.472288 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kf6bz" event={"ID":"1da06ee6-5895-4f97-8d35-8967b0bc81e8","Type":"ContainerStarted","Data":"c557d97299b8aecb10f647e05aa0b507b2230bf08c633af17d7ce35b2c82c2ba"} May 21 18:16:13.473803 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:13.473766 2567 generic.go:358] "Generic (PLEG): container finished" podID="032b4d76-9eca-4876-9cb8-bd8de236ba18" containerID="f584c3cd077e859726f292fa494ddc7b20b490719cd4e0cbc93be77c58fcf898" exitCode=0 May 21 18:16:13.473919 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:13.473860 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"032b4d76-9eca-4876-9cb8-bd8de236ba18","Type":"ContainerDied","Data":"f584c3cd077e859726f292fa494ddc7b20b490719cd4e0cbc93be77c58fcf898"} May 21 18:16:13.475643 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:13.475538 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dbdf6b59f-9fslv" event={"ID":"5e275137-ae27-4f57-a114-6265e167583c","Type":"ContainerStarted","Data":"06786ed48a83a9d2d0edf625890d85a5c1c80c198d1fdf756b8a9039fe6454c3"} May 21 18:16:13.491317 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:13.491267 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kf6bz" podStartSLOduration=2.631399137 podStartE2EDuration="3.491252835s" podCreationTimestamp="2026-05-21 18:16:10 +0000 UTC" firstStartedPulling="2026-05-21 18:16:10.674453024 +0000 UTC m=+175.259939444" lastFinishedPulling="2026-05-21 18:16:11.534306714 +0000 UTC m=+176.119793142" observedRunningTime="2026-05-21 18:16:13.490141934 +0000 UTC m=+178.075628383" watchObservedRunningTime="2026-05-21 18:16:13.491252835 +0000 UTC m=+178.076739271" May 21 18:16:14.734987 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:14.734651 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-54876f9cd5-rz5ws"] May 21 18:16:14.738266 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:14.738227 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-54876f9cd5-rz5ws" May 21 18:16:14.740862 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:14.740771 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-sjwks\"" May 21 18:16:14.740862 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:14.740773 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" May 21 18:16:14.741068 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:14.740856 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" May 21 18:16:14.741068 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:14.740884 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" May 21 18:16:14.741715 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:14.741696 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 21 18:16:14.741715 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:14.741701 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-fqdcs10bmjjna\"" May 21 18:16:14.747878 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:14.747854 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-54876f9cd5-rz5ws"] May 21 18:16:14.898366 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:14.898331 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8ab70191-1066-4234-b458-d6faee0da7da-secret-metrics-server-tls\") pod \"metrics-server-54876f9cd5-rz5ws\" (UID: \"8ab70191-1066-4234-b458-d6faee0da7da\") " pod="openshift-monitoring/metrics-server-54876f9cd5-rz5ws" May 21 18:16:14.898366 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:14.898370 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8ab70191-1066-4234-b458-d6faee0da7da-client-ca-bundle\") pod \"metrics-server-54876f9cd5-rz5ws\" (UID: \"8ab70191-1066-4234-b458-d6faee0da7da\") " pod="openshift-monitoring/metrics-server-54876f9cd5-rz5ws" May 21 18:16:14.898646 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:14.898466 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwv8w\" (UniqueName: \"kubernetes.io/projected/8ab70191-1066-4234-b458-d6faee0da7da-kube-api-access-wwv8w\") pod \"metrics-server-54876f9cd5-rz5ws\" (UID: \"8ab70191-1066-4234-b458-d6faee0da7da\") " pod="openshift-monitoring/metrics-server-54876f9cd5-rz5ws" May 21 18:16:14.898646 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:14.898506 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8ab70191-1066-4234-b458-d6faee0da7da-metrics-server-audit-profiles\") pod \"metrics-server-54876f9cd5-rz5ws\" (UID: \"8ab70191-1066-4234-b458-d6faee0da7da\") " pod="openshift-monitoring/metrics-server-54876f9cd5-rz5ws" May 21 18:16:14.898646 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:14.898561 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ab70191-1066-4234-b458-d6faee0da7da-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-54876f9cd5-rz5ws\" (UID: \"8ab70191-1066-4234-b458-d6faee0da7da\") " pod="openshift-monitoring/metrics-server-54876f9cd5-rz5ws" May 21 18:16:14.898800 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:14.898679 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8ab70191-1066-4234-b458-d6faee0da7da-secret-metrics-server-client-certs\") pod \"metrics-server-54876f9cd5-rz5ws\" (UID: \"8ab70191-1066-4234-b458-d6faee0da7da\") " pod="openshift-monitoring/metrics-server-54876f9cd5-rz5ws" May 21 18:16:14.898800 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:14.898717 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8ab70191-1066-4234-b458-d6faee0da7da-audit-log\") pod \"metrics-server-54876f9cd5-rz5ws\" (UID: \"8ab70191-1066-4234-b458-d6faee0da7da\") " pod="openshift-monitoring/metrics-server-54876f9cd5-rz5ws" May 21 18:16:14.999696 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:14.999672 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8ab70191-1066-4234-b458-d6faee0da7da-secret-metrics-server-client-certs\") pod \"metrics-server-54876f9cd5-rz5ws\" (UID: \"8ab70191-1066-4234-b458-d6faee0da7da\") " pod="openshift-monitoring/metrics-server-54876f9cd5-rz5ws" May 21 18:16:14.999797 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:14.999719 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8ab70191-1066-4234-b458-d6faee0da7da-audit-log\") pod \"metrics-server-54876f9cd5-rz5ws\" (UID: \"8ab70191-1066-4234-b458-d6faee0da7da\") " pod="openshift-monitoring/metrics-server-54876f9cd5-rz5ws" May 21 18:16:14.999797 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:14.999755 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8ab70191-1066-4234-b458-d6faee0da7da-secret-metrics-server-tls\") pod \"metrics-server-54876f9cd5-rz5ws\" (UID: \"8ab70191-1066-4234-b458-d6faee0da7da\") " pod="openshift-monitoring/metrics-server-54876f9cd5-rz5ws" May 21 18:16:14.999797 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:14.999779 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8ab70191-1066-4234-b458-d6faee0da7da-client-ca-bundle\") pod \"metrics-server-54876f9cd5-rz5ws\" (UID: \"8ab70191-1066-4234-b458-d6faee0da7da\") " pod="openshift-monitoring/metrics-server-54876f9cd5-rz5ws" May 21 18:16:14.999939 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:14.999851 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wwv8w\" (UniqueName: \"kubernetes.io/projected/8ab70191-1066-4234-b458-d6faee0da7da-kube-api-access-wwv8w\") pod \"metrics-server-54876f9cd5-rz5ws\" (UID: \"8ab70191-1066-4234-b458-d6faee0da7da\") " pod="openshift-monitoring/metrics-server-54876f9cd5-rz5ws" May 21 18:16:14.999939 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:14.999885 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8ab70191-1066-4234-b458-d6faee0da7da-metrics-server-audit-profiles\") pod \"metrics-server-54876f9cd5-rz5ws\" (UID: \"8ab70191-1066-4234-b458-d6faee0da7da\") " pod="openshift-monitoring/metrics-server-54876f9cd5-rz5ws" May 21 18:16:14.999939 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:14.999925 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ab70191-1066-4234-b458-d6faee0da7da-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-54876f9cd5-rz5ws\" (UID: \"8ab70191-1066-4234-b458-d6faee0da7da\") " pod="openshift-monitoring/metrics-server-54876f9cd5-rz5ws" May 21 18:16:15.000224 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:15.000185 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8ab70191-1066-4234-b458-d6faee0da7da-audit-log\") pod \"metrics-server-54876f9cd5-rz5ws\" (UID: \"8ab70191-1066-4234-b458-d6faee0da7da\") " pod="openshift-monitoring/metrics-server-54876f9cd5-rz5ws" May 21 18:16:15.000621 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:15.000600 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ab70191-1066-4234-b458-d6faee0da7da-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-54876f9cd5-rz5ws\" (UID: \"8ab70191-1066-4234-b458-d6faee0da7da\") " pod="openshift-monitoring/metrics-server-54876f9cd5-rz5ws" May 21 18:16:15.001021 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:15.000998 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8ab70191-1066-4234-b458-d6faee0da7da-metrics-server-audit-profiles\") pod \"metrics-server-54876f9cd5-rz5ws\" (UID: \"8ab70191-1066-4234-b458-d6faee0da7da\") " pod="openshift-monitoring/metrics-server-54876f9cd5-rz5ws" May 21 18:16:15.002414 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:15.002385 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8ab70191-1066-4234-b458-d6faee0da7da-client-ca-bundle\") pod \"metrics-server-54876f9cd5-rz5ws\" (UID: \"8ab70191-1066-4234-b458-d6faee0da7da\") " pod="openshift-monitoring/metrics-server-54876f9cd5-rz5ws" May 21 18:16:15.002697 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:15.002681 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8ab70191-1066-4234-b458-d6faee0da7da-secret-metrics-server-client-certs\") pod \"metrics-server-54876f9cd5-rz5ws\" (UID: \"8ab70191-1066-4234-b458-d6faee0da7da\") " pod="openshift-monitoring/metrics-server-54876f9cd5-rz5ws" May 21 18:16:15.002751 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:15.002701 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8ab70191-1066-4234-b458-d6faee0da7da-secret-metrics-server-tls\") pod \"metrics-server-54876f9cd5-rz5ws\" (UID: \"8ab70191-1066-4234-b458-d6faee0da7da\") " pod="openshift-monitoring/metrics-server-54876f9cd5-rz5ws" May 21 18:16:15.007373 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:15.007352 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwv8w\" (UniqueName: \"kubernetes.io/projected/8ab70191-1066-4234-b458-d6faee0da7da-kube-api-access-wwv8w\") pod \"metrics-server-54876f9cd5-rz5ws\" (UID: \"8ab70191-1066-4234-b458-d6faee0da7da\") " pod="openshift-monitoring/metrics-server-54876f9cd5-rz5ws" May 21 18:16:15.049374 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:15.049339 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-54876f9cd5-rz5ws" May 21 18:16:15.200999 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:15.200974 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-54876f9cd5-rz5ws"] May 21 18:16:15.484078 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:15.484042 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dbdf6b59f-9fslv" event={"ID":"5e275137-ae27-4f57-a114-6265e167583c","Type":"ContainerStarted","Data":"c1a528b15c0f1e48718c9ae79ed54bf4f9b7568f12591131561a5eb0fd020463"} May 21 18:16:15.484237 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:15.484084 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dbdf6b59f-9fslv" event={"ID":"5e275137-ae27-4f57-a114-6265e167583c","Type":"ContainerStarted","Data":"32f8556df40d8b74ae8c577ddcd8686c0b7aef7b5336157d2002fee6fafb02e1"} May 21 18:16:15.484237 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:15.484096 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dbdf6b59f-9fslv" event={"ID":"5e275137-ae27-4f57-a114-6265e167583c","Type":"ContainerStarted","Data":"dc2935e9f67deb69e4d0775172e9f29b8a2a139eb8854236efd7455bae1debb6"} May 21 18:16:15.517258 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:16:15.517220 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ab70191_1066_4234_b458_d6faee0da7da.slice/crio-e3383802f5e90beb65f26a1d98eb6888b876a5379cd05ca828f60cf02a5f5b0b WatchSource:0}: Error finding container e3383802f5e90beb65f26a1d98eb6888b876a5379cd05ca828f60cf02a5f5b0b: Status 404 returned error can't find the container with id e3383802f5e90beb65f26a1d98eb6888b876a5379cd05ca828f60cf02a5f5b0b May 21 18:16:16.491303 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.491252 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"032b4d76-9eca-4876-9cb8-bd8de236ba18","Type":"ContainerStarted","Data":"acb3056ed35a3835af2d07a062cc9902d20dd64f2c5b60cde0ae867db5a11c1d"} May 21 18:16:16.491303 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.491298 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"032b4d76-9eca-4876-9cb8-bd8de236ba18","Type":"ContainerStarted","Data":"a0037701bda827995d45d4689f762e527ccf1ca56098eadaeb24006aaba02dcf"} May 21 18:16:16.491820 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.491312 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"032b4d76-9eca-4876-9cb8-bd8de236ba18","Type":"ContainerStarted","Data":"45e1e114a1b3649bd163b90275a207c51809111c09759575ac1ab1fe6a058330"} May 21 18:16:16.491820 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.491326 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"032b4d76-9eca-4876-9cb8-bd8de236ba18","Type":"ContainerStarted","Data":"b91a7ded577a39c24947e074ee5a7848acbbc52e886a00b125bbc5d705b031fd"} May 21 18:16:16.491820 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.491339 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"032b4d76-9eca-4876-9cb8-bd8de236ba18","Type":"ContainerStarted","Data":"36b445ab5aa9042bf074764bd38d4c9da40b27960bd820a3ddff243c9d8bd0d3"} May 21 18:16:16.491820 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.491351 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"032b4d76-9eca-4876-9cb8-bd8de236ba18","Type":"ContainerStarted","Data":"253e833ff310655fd8e1c1d7648ef8812993a0ecbd84d07e16a197cc22299419"} May 21 18:16:16.495087 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.495057 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dbdf6b59f-9fslv" event={"ID":"5e275137-ae27-4f57-a114-6265e167583c","Type":"ContainerStarted","Data":"d83e8a9f23990218e20b739fd76ca8d4afda6c281036551b89411bbe16c573c0"} May 21 18:16:16.495214 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.495096 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dbdf6b59f-9fslv" event={"ID":"5e275137-ae27-4f57-a114-6265e167583c","Type":"ContainerStarted","Data":"8bdcb1960fc7ebefc9b4e35bcaef9323a91b2cb4d111e10644af3a6564da7f94"} May 21 18:16:16.495214 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.495113 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dbdf6b59f-9fslv" event={"ID":"5e275137-ae27-4f57-a114-6265e167583c","Type":"ContainerStarted","Data":"ca082b1ca49467f5bf0a24741940f209d71fd5ba0fafc83ec5fc3257c94c8504"} May 21 18:16:16.495341 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.495285 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5dbdf6b59f-9fslv" May 21 18:16:16.496360 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.496338 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-54876f9cd5-rz5ws" event={"ID":"8ab70191-1066-4234-b458-d6faee0da7da","Type":"ContainerStarted","Data":"e3383802f5e90beb65f26a1d98eb6888b876a5379cd05ca828f60cf02a5f5b0b"} May 21 18:16:16.522329 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.522276 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.330552298 podStartE2EDuration="5.522258614s" podCreationTimestamp="2026-05-21 18:16:11 +0000 UTC" firstStartedPulling="2026-05-21 18:16:11.995563833 +0000 UTC m=+176.581050248" lastFinishedPulling="2026-05-21 18:16:16.18727015 +0000 UTC m=+180.772756564" observedRunningTime="2026-05-21 18:16:16.519980676 +0000 UTC m=+181.105467112" watchObservedRunningTime="2026-05-21 18:16:16.522258614 +0000 UTC m=+181.107745052" May 21 18:16:16.534765 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.534740 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 18:16:16.537860 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.537835 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.542808 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.542789 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8f1qpsqgb01rn\"" May 21 18:16:16.543136 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.543076 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 21 18:16:16.543497 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.543473 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 21 18:16:16.543600 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.543565 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 21 18:16:16.545127 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.544159 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 21 18:16:16.545127 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.544246 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 21 18:16:16.545127 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.544356 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 21 18:16:16.545127 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.544397 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-w2gk8\"" May 21 18:16:16.545127 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.544477 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 21 18:16:16.545127 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.544752 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 21 18:16:16.545127 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.544979 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 21 18:16:16.545127 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.544999 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 21 18:16:16.545787 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.545766 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 21 18:16:16.546958 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.546568 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 21 18:16:16.547756 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.547688 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5dbdf6b59f-9fslv" podStartSLOduration=1.361567638 podStartE2EDuration="4.547673535s" podCreationTimestamp="2026-05-21 18:16:12 +0000 UTC" firstStartedPulling="2026-05-21 18:16:12.846926918 +0000 UTC m=+177.432413332" lastFinishedPulling="2026-05-21 18:16:16.033032816 +0000 UTC m=+180.618519229" observedRunningTime="2026-05-21 18:16:16.544995082 +0000 UTC m=+181.130481521" watchObservedRunningTime="2026-05-21 18:16:16.547673535 +0000 UTC m=+181.133159971" May 21 18:16:16.554825 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.554805 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 18:16:16.714217 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.714183 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.714217 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.714224 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.714512 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.714311 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/741be498-ff65-48ba-b8c7-574c9d76766d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.714512 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.714337 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.714512 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.714358 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-config\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.714512 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.714391 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.714512 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.714411 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/741be498-ff65-48ba-b8c7-574c9d76766d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.714512 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.714439 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/741be498-ff65-48ba-b8c7-574c9d76766d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.714512 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.714462 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/741be498-ff65-48ba-b8c7-574c9d76766d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.714825 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.714551 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/741be498-ff65-48ba-b8c7-574c9d76766d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.714825 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.714615 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/741be498-ff65-48ba-b8c7-574c9d76766d-config-out\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.714825 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.714642 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/741be498-ff65-48ba-b8c7-574c9d76766d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.714825 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.714671 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7m2z\" (UniqueName: \"kubernetes.io/projected/741be498-ff65-48ba-b8c7-574c9d76766d-kube-api-access-w7m2z\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.714825 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.714702 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-web-config\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.714825 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.714752 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.715084 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.714841 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.715084 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.714875 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.715084 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.714918 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/741be498-ff65-48ba-b8c7-574c9d76766d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.816401 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.816326 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/741be498-ff65-48ba-b8c7-574c9d76766d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.816401 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.816379 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.816606 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.816404 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-config\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.816606 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.816422 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.816606 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.816438 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/741be498-ff65-48ba-b8c7-574c9d76766d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.816606 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.816464 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/741be498-ff65-48ba-b8c7-574c9d76766d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.816606 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.816489 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/741be498-ff65-48ba-b8c7-574c9d76766d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.816606 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.816540 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/741be498-ff65-48ba-b8c7-574c9d76766d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.816606 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.816567 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/741be498-ff65-48ba-b8c7-574c9d76766d-config-out\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.816908 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.816608 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/741be498-ff65-48ba-b8c7-574c9d76766d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.816908 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.816638 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w7m2z\" (UniqueName: \"kubernetes.io/projected/741be498-ff65-48ba-b8c7-574c9d76766d-kube-api-access-w7m2z\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.816908 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.816670 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-web-config\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.816908 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.816699 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.816908 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.816739 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.816908 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.816776 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.816908 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.816814 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/741be498-ff65-48ba-b8c7-574c9d76766d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.816908 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.816859 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.816908 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.816887 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.817324 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.817121 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/741be498-ff65-48ba-b8c7-574c9d76766d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.817433 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.817408 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/741be498-ff65-48ba-b8c7-574c9d76766d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.817789 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.817522 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/741be498-ff65-48ba-b8c7-574c9d76766d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.817913 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.817883 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/741be498-ff65-48ba-b8c7-574c9d76766d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.821852 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.820213 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/741be498-ff65-48ba-b8c7-574c9d76766d-config-out\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.821852 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.820385 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.821852 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.820421 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.821852 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.820638 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/741be498-ff65-48ba-b8c7-574c9d76766d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.821852 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.820873 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-config\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.821852 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.821380 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/741be498-ff65-48ba-b8c7-574c9d76766d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.823200 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.822267 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.823200 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.822988 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-web-config\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.823928 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.823644 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/741be498-ff65-48ba-b8c7-574c9d76766d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.826658 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.824382 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.826658 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.824638 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.826658 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.825887 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.827814 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.827785 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7m2z\" (UniqueName: \"kubernetes.io/projected/741be498-ff65-48ba-b8c7-574c9d76766d-kube-api-access-w7m2z\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.828139 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.828119 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:16.850137 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:16.850109 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:17.298602 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:17.298558 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 18:16:17.300151 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:16:17.300119 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod741be498_ff65_48ba_b8c7_574c9d76766d.slice/crio-d2dd21a004ef02ea1a4ec4b32c319f02daeffb77c6f6c3d334eb427775bbfda9 WatchSource:0}: Error finding container d2dd21a004ef02ea1a4ec4b32c319f02daeffb77c6f6c3d334eb427775bbfda9: Status 404 returned error can't find the container with id d2dd21a004ef02ea1a4ec4b32c319f02daeffb77c6f6c3d334eb427775bbfda9 May 21 18:16:17.501810 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:17.501771 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-54876f9cd5-rz5ws" event={"ID":"8ab70191-1066-4234-b458-d6faee0da7da","Type":"ContainerStarted","Data":"d810f16c8c6ee3c7e3ca9c28bb7120c192112fe35c7afd2b8a8c130318eba7b5"} May 21 18:16:17.503179 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:17.503156 2567 generic.go:358] "Generic (PLEG): container finished" podID="741be498-ff65-48ba-b8c7-574c9d76766d" containerID="e1f71a478780fed2ffa72f95575ac1754b37fded78d772c32ba451aceca6c92b" exitCode=0 May 21 18:16:17.503270 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:17.503240 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"741be498-ff65-48ba-b8c7-574c9d76766d","Type":"ContainerDied","Data":"e1f71a478780fed2ffa72f95575ac1754b37fded78d772c32ba451aceca6c92b"} May 21 18:16:17.503270 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:17.503266 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"741be498-ff65-48ba-b8c7-574c9d76766d","Type":"ContainerStarted","Data":"d2dd21a004ef02ea1a4ec4b32c319f02daeffb77c6f6c3d334eb427775bbfda9"} May 21 18:16:17.511492 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:17.511468 2567 patch_prober.go:28] interesting pod/image-registry-655b874888-tngrh container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 21 18:16:17.511613 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:17.511512 2567 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-655b874888-tngrh" podUID="a748fb72-614d-4d85-aba5-8a243e2cd7bc" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 21 18:16:17.523373 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:17.523327 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-54876f9cd5-rz5ws" podStartSLOduration=1.848815613 podStartE2EDuration="3.523313663s" podCreationTimestamp="2026-05-21 18:16:14 +0000 UTC" firstStartedPulling="2026-05-21 18:16:15.518985364 +0000 UTC m=+180.104471777" lastFinishedPulling="2026-05-21 18:16:17.19348341 +0000 UTC m=+181.778969827" observedRunningTime="2026-05-21 18:16:17.521471849 +0000 UTC m=+182.106958279" watchObservedRunningTime="2026-05-21 18:16:17.523313663 +0000 UTC m=+182.108800098" May 21 18:16:17.536386 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:17.536361 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-655b874888-tngrh"] May 21 18:16:17.540474 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:17.540442 2567 patch_prober.go:28] interesting pod/image-registry-655b874888-tngrh container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 21 18:16:17.540586 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:17.540509 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-655b874888-tngrh" podUID="a748fb72-614d-4d85-aba5-8a243e2cd7bc" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 21 18:16:21.521320 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:21.521284 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"741be498-ff65-48ba-b8c7-574c9d76766d","Type":"ContainerStarted","Data":"c3b0206e4c546daf8a0839e589547f6cd736f2476aa44a7ef9d666d1f63b8e81"} May 21 18:16:21.521320 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:21.521322 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"741be498-ff65-48ba-b8c7-574c9d76766d","Type":"ContainerStarted","Data":"94502bbeff005d11e40b1a9914c7e33ff746e520c3517e56fcab46abedce6149"} May 21 18:16:21.521803 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:21.521338 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"741be498-ff65-48ba-b8c7-574c9d76766d","Type":"ContainerStarted","Data":"66770e7794645fcdead984b097d58ca7b8068e7900c7dcfcf2c30218f5dddb41"} May 21 18:16:21.521803 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:21.521350 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"741be498-ff65-48ba-b8c7-574c9d76766d","Type":"ContainerStarted","Data":"8febac3e3ee6c2eb0f3edb999c82c5805d79ce3c9e6a2a4a8632094f61e318ec"} May 21 18:16:21.521803 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:21.521360 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"741be498-ff65-48ba-b8c7-574c9d76766d","Type":"ContainerStarted","Data":"8b95e50f9d6657fd959bd18494b8956f3879485d6cfcfc100c342e699a50ce11"} May 21 18:16:21.521803 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:21.521372 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"741be498-ff65-48ba-b8c7-574c9d76766d","Type":"ContainerStarted","Data":"da88edcbd624c8cb1e4eb58c6598ff29ba3ed53af1c6c780af755399704be60c"} May 21 18:16:21.550153 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:21.550101 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.2796985149999998 podStartE2EDuration="5.550087056s" podCreationTimestamp="2026-05-21 18:16:16 +0000 UTC" firstStartedPulling="2026-05-21 18:16:17.504551952 +0000 UTC m=+182.090038366" lastFinishedPulling="2026-05-21 18:16:20.774940478 +0000 UTC m=+185.360426907" observedRunningTime="2026-05-21 18:16:21.548236862 +0000 UTC m=+186.133723298" watchObservedRunningTime="2026-05-21 18:16:21.550087056 +0000 UTC m=+186.135573547" May 21 18:16:21.850848 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:21.850763 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 21 18:16:22.509730 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:22.509694 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5dbdf6b59f-9fslv" May 21 18:16:27.540472 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:27.540442 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-655b874888-tngrh" May 21 18:16:35.050024 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:35.049984 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-54876f9cd5-rz5ws" May 21 18:16:35.050024 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:35.050030 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-54876f9cd5-rz5ws" May 21 18:16:42.555294 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:42.555229 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-655b874888-tngrh" podUID="a748fb72-614d-4d85-aba5-8a243e2cd7bc" containerName="registry" containerID="cri-o://8b6bb5cdbf28489deb2c68ca12618d27e2927386c22bddf883ad6454127d1cf2" gracePeriod=30 May 21 18:16:42.809066 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:42.809012 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-655b874888-tngrh" May 21 18:16:42.968813 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:42.968782 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a748fb72-614d-4d85-aba5-8a243e2cd7bc-registry-tls\") pod \"a748fb72-614d-4d85-aba5-8a243e2cd7bc\" (UID: \"a748fb72-614d-4d85-aba5-8a243e2cd7bc\") " May 21 18:16:42.968999 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:42.968834 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a748fb72-614d-4d85-aba5-8a243e2cd7bc-ca-trust-extracted\") pod \"a748fb72-614d-4d85-aba5-8a243e2cd7bc\" (UID: \"a748fb72-614d-4d85-aba5-8a243e2cd7bc\") " May 21 18:16:42.968999 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:42.968871 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a748fb72-614d-4d85-aba5-8a243e2cd7bc-bound-sa-token\") pod \"a748fb72-614d-4d85-aba5-8a243e2cd7bc\" (UID: \"a748fb72-614d-4d85-aba5-8a243e2cd7bc\") " May 21 18:16:42.968999 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:42.968901 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a748fb72-614d-4d85-aba5-8a243e2cd7bc-registry-certificates\") pod \"a748fb72-614d-4d85-aba5-8a243e2cd7bc\" (UID: \"a748fb72-614d-4d85-aba5-8a243e2cd7bc\") " May 21 18:16:42.968999 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:42.968941 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a748fb72-614d-4d85-aba5-8a243e2cd7bc-trusted-ca\") pod \"a748fb72-614d-4d85-aba5-8a243e2cd7bc\" (UID: \"a748fb72-614d-4d85-aba5-8a243e2cd7bc\") " May 21 18:16:42.968999 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:42.968990 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a748fb72-614d-4d85-aba5-8a243e2cd7bc-image-registry-private-configuration\") pod \"a748fb72-614d-4d85-aba5-8a243e2cd7bc\" (UID: \"a748fb72-614d-4d85-aba5-8a243e2cd7bc\") " May 21 18:16:42.969273 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:42.969038 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a748fb72-614d-4d85-aba5-8a243e2cd7bc-installation-pull-secrets\") pod \"a748fb72-614d-4d85-aba5-8a243e2cd7bc\" (UID: \"a748fb72-614d-4d85-aba5-8a243e2cd7bc\") " May 21 18:16:42.969273 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:42.969067 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nvd94\" (UniqueName: \"kubernetes.io/projected/a748fb72-614d-4d85-aba5-8a243e2cd7bc-kube-api-access-nvd94\") pod \"a748fb72-614d-4d85-aba5-8a243e2cd7bc\" (UID: \"a748fb72-614d-4d85-aba5-8a243e2cd7bc\") " May 21 18:16:42.969429 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:42.969396 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a748fb72-614d-4d85-aba5-8a243e2cd7bc-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a748fb72-614d-4d85-aba5-8a243e2cd7bc" (UID: "a748fb72-614d-4d85-aba5-8a243e2cd7bc"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 18:16:42.969757 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:42.969730 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a748fb72-614d-4d85-aba5-8a243e2cd7bc-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a748fb72-614d-4d85-aba5-8a243e2cd7bc" (UID: "a748fb72-614d-4d85-aba5-8a243e2cd7bc"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 18:16:42.971490 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:42.971458 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a748fb72-614d-4d85-aba5-8a243e2cd7bc-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a748fb72-614d-4d85-aba5-8a243e2cd7bc" (UID: "a748fb72-614d-4d85-aba5-8a243e2cd7bc"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 18:16:42.971618 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:42.971460 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a748fb72-614d-4d85-aba5-8a243e2cd7bc-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a748fb72-614d-4d85-aba5-8a243e2cd7bc" (UID: "a748fb72-614d-4d85-aba5-8a243e2cd7bc"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:16:42.971726 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:42.971702 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a748fb72-614d-4d85-aba5-8a243e2cd7bc-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a748fb72-614d-4d85-aba5-8a243e2cd7bc" (UID: "a748fb72-614d-4d85-aba5-8a243e2cd7bc"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 18:16:42.971779 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:42.971752 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a748fb72-614d-4d85-aba5-8a243e2cd7bc-kube-api-access-nvd94" (OuterVolumeSpecName: "kube-api-access-nvd94") pod "a748fb72-614d-4d85-aba5-8a243e2cd7bc" (UID: "a748fb72-614d-4d85-aba5-8a243e2cd7bc"). InnerVolumeSpecName "kube-api-access-nvd94". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:16:42.971819 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:42.971797 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a748fb72-614d-4d85-aba5-8a243e2cd7bc-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a748fb72-614d-4d85-aba5-8a243e2cd7bc" (UID: "a748fb72-614d-4d85-aba5-8a243e2cd7bc"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:16:42.980147 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:42.980120 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a748fb72-614d-4d85-aba5-8a243e2cd7bc-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a748fb72-614d-4d85-aba5-8a243e2cd7bc" (UID: "a748fb72-614d-4d85-aba5-8a243e2cd7bc"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 18:16:43.070421 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:43.070335 2567 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a748fb72-614d-4d85-aba5-8a243e2cd7bc-bound-sa-token\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 21 18:16:43.070421 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:43.070366 2567 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a748fb72-614d-4d85-aba5-8a243e2cd7bc-registry-certificates\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 21 18:16:43.070421 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:43.070381 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a748fb72-614d-4d85-aba5-8a243e2cd7bc-trusted-ca\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 21 18:16:43.070421 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:43.070391 2567 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a748fb72-614d-4d85-aba5-8a243e2cd7bc-image-registry-private-configuration\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 21 18:16:43.070421 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:43.070401 2567 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a748fb72-614d-4d85-aba5-8a243e2cd7bc-installation-pull-secrets\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 21 18:16:43.070421 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:43.070410 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nvd94\" (UniqueName: \"kubernetes.io/projected/a748fb72-614d-4d85-aba5-8a243e2cd7bc-kube-api-access-nvd94\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 21 18:16:43.070421 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:43.070419 2567 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a748fb72-614d-4d85-aba5-8a243e2cd7bc-registry-tls\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 21 18:16:43.070421 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:43.070426 2567 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a748fb72-614d-4d85-aba5-8a243e2cd7bc-ca-trust-extracted\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 21 18:16:43.585335 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:43.585302 2567 generic.go:358] "Generic (PLEG): container finished" podID="a748fb72-614d-4d85-aba5-8a243e2cd7bc" containerID="8b6bb5cdbf28489deb2c68ca12618d27e2927386c22bddf883ad6454127d1cf2" exitCode=0 May 21 18:16:43.585749 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:43.585363 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-655b874888-tngrh" May 21 18:16:43.585749 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:43.585363 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-655b874888-tngrh" event={"ID":"a748fb72-614d-4d85-aba5-8a243e2cd7bc","Type":"ContainerDied","Data":"8b6bb5cdbf28489deb2c68ca12618d27e2927386c22bddf883ad6454127d1cf2"} May 21 18:16:43.585749 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:43.585477 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-655b874888-tngrh" event={"ID":"a748fb72-614d-4d85-aba5-8a243e2cd7bc","Type":"ContainerDied","Data":"39473c9108ada28ef2ac4b11e08070eb6954022345e8e30011a428606fc147d6"} May 21 18:16:43.585749 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:43.585502 2567 scope.go:117] "RemoveContainer" containerID="8b6bb5cdbf28489deb2c68ca12618d27e2927386c22bddf883ad6454127d1cf2" May 21 18:16:43.594516 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:43.594499 2567 scope.go:117] "RemoveContainer" containerID="8b6bb5cdbf28489deb2c68ca12618d27e2927386c22bddf883ad6454127d1cf2" May 21 18:16:43.594804 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:16:43.594784 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b6bb5cdbf28489deb2c68ca12618d27e2927386c22bddf883ad6454127d1cf2\": container with ID starting with 8b6bb5cdbf28489deb2c68ca12618d27e2927386c22bddf883ad6454127d1cf2 not found: ID does not exist" containerID="8b6bb5cdbf28489deb2c68ca12618d27e2927386c22bddf883ad6454127d1cf2" May 21 18:16:43.594876 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:43.594814 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b6bb5cdbf28489deb2c68ca12618d27e2927386c22bddf883ad6454127d1cf2"} err="failed to get container status \"8b6bb5cdbf28489deb2c68ca12618d27e2927386c22bddf883ad6454127d1cf2\": rpc error: code = NotFound desc = could not find container \"8b6bb5cdbf28489deb2c68ca12618d27e2927386c22bddf883ad6454127d1cf2\": container with ID starting with 8b6bb5cdbf28489deb2c68ca12618d27e2927386c22bddf883ad6454127d1cf2 not found: ID does not exist" May 21 18:16:43.605641 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:43.605619 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-655b874888-tngrh"] May 21 18:16:43.609408 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:43.609384 2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-655b874888-tngrh"] May 21 18:16:43.982920 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:43.982889 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a748fb72-614d-4d85-aba5-8a243e2cd7bc" path="/var/lib/kubelet/pods/a748fb72-614d-4d85-aba5-8a243e2cd7bc/volumes" May 21 18:16:48.803047 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:48.803015 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_032b4d76-9eca-4876-9cb8-bd8de236ba18/init-config-reloader/0.log" May 21 18:16:48.808270 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:48.808249 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_032b4d76-9eca-4876-9cb8-bd8de236ba18/alertmanager/0.log" May 21 18:16:48.815780 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:48.815760 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_032b4d76-9eca-4876-9cb8-bd8de236ba18/config-reloader/0.log" May 21 18:16:49.017013 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:49.016986 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_032b4d76-9eca-4876-9cb8-bd8de236ba18/kube-rbac-proxy-web/0.log" May 21 18:16:49.216637 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:49.216610 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_032b4d76-9eca-4876-9cb8-bd8de236ba18/kube-rbac-proxy/0.log" May 21 18:16:49.416996 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:49.416953 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_032b4d76-9eca-4876-9cb8-bd8de236ba18/kube-rbac-proxy-metric/0.log" May 21 18:16:49.617419 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:49.617341 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_032b4d76-9eca-4876-9cb8-bd8de236ba18/prom-label-proxy/0.log" May 21 18:16:50.617192 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:50.617167 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-54876f9cd5-rz5ws_8ab70191-1066-4234-b458-d6faee0da7da/metrics-server/0.log" May 21 18:16:51.016645 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:51.016622 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kf6bz_1da06ee6-5895-4f97-8d35-8967b0bc81e8/init-textfile/0.log" May 21 18:16:51.219145 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:51.219114 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kf6bz_1da06ee6-5895-4f97-8d35-8967b0bc81e8/node-exporter/0.log" May 21 18:16:51.417043 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:51.416972 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kf6bz_1da06ee6-5895-4f97-8d35-8967b0bc81e8/kube-rbac-proxy/0.log" May 21 18:16:52.816680 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:52.816653 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-4mn82_8c1362ee-6e5b-42e5-b041-4c5d9cb57692/kube-rbac-proxy-main/0.log" May 21 18:16:53.016637 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:53.016612 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-4mn82_8c1362ee-6e5b-42e5-b041-4c5d9cb57692/kube-rbac-proxy-self/0.log" May 21 18:16:53.216750 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:53.216726 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-4mn82_8c1362ee-6e5b-42e5-b041-4c5d9cb57692/openshift-state-metrics/0.log" May 21 18:16:53.417185 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:53.417136 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_741be498-ff65-48ba-b8c7-574c9d76766d/init-config-reloader/0.log" May 21 18:16:53.617533 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:53.617507 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_741be498-ff65-48ba-b8c7-574c9d76766d/prometheus/0.log" May 21 18:16:53.816689 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:53.816616 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_741be498-ff65-48ba-b8c7-574c9d76766d/config-reloader/0.log" May 21 18:16:54.016759 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:54.016733 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_741be498-ff65-48ba-b8c7-574c9d76766d/thanos-sidecar/0.log" May 21 18:16:54.216629 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:54.216601 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_741be498-ff65-48ba-b8c7-574c9d76766d/kube-rbac-proxy-web/0.log" May 21 18:16:54.416715 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:54.416689 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_741be498-ff65-48ba-b8c7-574c9d76766d/kube-rbac-proxy/0.log" May 21 18:16:54.617162 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:54.617089 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_741be498-ff65-48ba-b8c7-574c9d76766d/kube-rbac-proxy-thanos/0.log" May 21 18:16:55.055387 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:55.055363 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-54876f9cd5-rz5ws" May 21 18:16:55.059202 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:55.059172 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-54876f9cd5-rz5ws" May 21 18:16:55.417607 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:55.417501 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dbdf6b59f-9fslv_5e275137-ae27-4f57-a114-6265e167583c/thanos-query/0.log" May 21 18:16:55.616931 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:55.616905 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dbdf6b59f-9fslv_5e275137-ae27-4f57-a114-6265e167583c/kube-rbac-proxy-web/0.log" May 21 18:16:55.816621 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:55.816595 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dbdf6b59f-9fslv_5e275137-ae27-4f57-a114-6265e167583c/kube-rbac-proxy/0.log" May 21 18:16:56.016454 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:56.016423 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dbdf6b59f-9fslv_5e275137-ae27-4f57-a114-6265e167583c/prom-label-proxy/0.log" May 21 18:16:56.216902 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:56.216876 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dbdf6b59f-9fslv_5e275137-ae27-4f57-a114-6265e167583c/kube-rbac-proxy-rules/0.log" May 21 18:16:56.416443 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:16:56.416412 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dbdf6b59f-9fslv_5e275137-ae27-4f57-a114-6265e167583c/kube-rbac-proxy-metrics/0.log" May 21 18:17:01.640790 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:01.640711 2567 generic.go:358] "Generic (PLEG): container finished" podID="19902950-4f77-4026-98b8-09db0bc05a05" containerID="4cf03090c24b123a138bc1ac972a5c011332137a0931ad23be416511c3c223c8" exitCode=0 May 21 18:17:01.640790 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:01.640775 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-jxqn7" event={"ID":"19902950-4f77-4026-98b8-09db0bc05a05","Type":"ContainerDied","Data":"4cf03090c24b123a138bc1ac972a5c011332137a0931ad23be416511c3c223c8"} May 21 18:17:01.641164 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:01.641103 2567 scope.go:117] "RemoveContainer" containerID="4cf03090c24b123a138bc1ac972a5c011332137a0931ad23be416511c3c223c8" May 21 18:17:02.647521 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:02.647477 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-jxqn7" event={"ID":"19902950-4f77-4026-98b8-09db0bc05a05","Type":"ContainerStarted","Data":"db3a81ce4caf6341851af91ac2bf8c9f732544a30b3d730eb1dd6355c555d145"} May 21 18:17:16.850899 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:16.850865 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:16.870091 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:16.870064 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:17.704274 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:17.704244 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:27.862859 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:27.862777 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80ec104c-46e1-4fb3-a8bc-f5664e798321-metrics-certs\") pod \"network-metrics-daemon-lk2c6\" (UID: \"80ec104c-46e1-4fb3-a8bc-f5664e798321\") " pod="openshift-multus/network-metrics-daemon-lk2c6" May 21 18:17:27.865048 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:27.865025 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80ec104c-46e1-4fb3-a8bc-f5664e798321-metrics-certs\") pod \"network-metrics-daemon-lk2c6\" (UID: \"80ec104c-46e1-4fb3-a8bc-f5664e798321\") " pod="openshift-multus/network-metrics-daemon-lk2c6" May 21 18:17:27.884388 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:27.884368 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2tccs\"" May 21 18:17:27.892449 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:27.892429 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk2c6" May 21 18:17:28.014535 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:28.014512 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lk2c6"] May 21 18:17:28.017054 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:17:28.017018 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80ec104c_46e1_4fb3_a8bc_f5664e798321.slice/crio-38049966a4e46000c2853002d7a2ca6d41de90df1037d50e3a71823e589ac535 WatchSource:0}: Error finding container 38049966a4e46000c2853002d7a2ca6d41de90df1037d50e3a71823e589ac535: Status 404 returned error can't find the container with id 38049966a4e46000c2853002d7a2ca6d41de90df1037d50e3a71823e589ac535 May 21 18:17:28.721947 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:28.721908 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lk2c6" event={"ID":"80ec104c-46e1-4fb3-a8bc-f5664e798321","Type":"ContainerStarted","Data":"38049966a4e46000c2853002d7a2ca6d41de90df1037d50e3a71823e589ac535"} May 21 18:17:29.726331 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:29.726289 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lk2c6" event={"ID":"80ec104c-46e1-4fb3-a8bc-f5664e798321","Type":"ContainerStarted","Data":"35c1be1fa4a803d5faf3c3abf19ea26a2904b6f5eb760e1fa097dd774cd13623"} May 21 18:17:29.726331 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:29.726334 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lk2c6" event={"ID":"80ec104c-46e1-4fb3-a8bc-f5664e798321","Type":"ContainerStarted","Data":"9f7025a486afdbb6100452969673a25495292ab5a798a8b338aa7a7342b0c21d"} May 21 18:17:29.745117 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:29.745072 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lk2c6" podStartSLOduration=252.709275579 podStartE2EDuration="4m13.745058278s" podCreationTimestamp="2026-05-21 18:13:16 +0000 UTC" firstStartedPulling="2026-05-21 18:17:28.019557206 +0000 UTC m=+252.605043620" lastFinishedPulling="2026-05-21 18:17:29.055339904 +0000 UTC m=+253.640826319" observedRunningTime="2026-05-21 18:17:29.743401114 +0000 UTC m=+254.328887547" watchObservedRunningTime="2026-05-21 18:17:29.745058278 +0000 UTC m=+254.330544713" May 21 18:17:30.562819 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:30.562783 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 18:17:30.563274 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:30.563246 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="032b4d76-9eca-4876-9cb8-bd8de236ba18" containerName="alertmanager" containerID="cri-o://253e833ff310655fd8e1c1d7648ef8812993a0ecbd84d07e16a197cc22299419" gracePeriod=120 May 21 18:17:30.563372 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:30.563326 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="032b4d76-9eca-4876-9cb8-bd8de236ba18" containerName="kube-rbac-proxy-metric" containerID="cri-o://a0037701bda827995d45d4689f762e527ccf1ca56098eadaeb24006aaba02dcf" gracePeriod=120 May 21 18:17:30.563372 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:30.563354 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="032b4d76-9eca-4876-9cb8-bd8de236ba18" containerName="prom-label-proxy" containerID="cri-o://acb3056ed35a3835af2d07a062cc9902d20dd64f2c5b60cde0ae867db5a11c1d" gracePeriod=120 May 21 18:17:30.563490 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:30.563369 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="032b4d76-9eca-4876-9cb8-bd8de236ba18" containerName="config-reloader" containerID="cri-o://36b445ab5aa9042bf074764bd38d4c9da40b27960bd820a3ddff243c9d8bd0d3" gracePeriod=120 May 21 18:17:30.563490 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:30.563336 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="032b4d76-9eca-4876-9cb8-bd8de236ba18" containerName="kube-rbac-proxy-web" containerID="cri-o://b91a7ded577a39c24947e074ee5a7848acbbc52e886a00b125bbc5d705b031fd" gracePeriod=120 May 21 18:17:30.563490 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:30.563364 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="032b4d76-9eca-4876-9cb8-bd8de236ba18" containerName="kube-rbac-proxy" containerID="cri-o://45e1e114a1b3649bd163b90275a207c51809111c09759575ac1ab1fe6a058330" gracePeriod=120 May 21 18:17:30.731478 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:30.731448 2567 generic.go:358] "Generic (PLEG): container finished" podID="032b4d76-9eca-4876-9cb8-bd8de236ba18" containerID="acb3056ed35a3835af2d07a062cc9902d20dd64f2c5b60cde0ae867db5a11c1d" exitCode=0 May 21 18:17:30.731478 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:30.731474 2567 generic.go:358] "Generic (PLEG): container finished" podID="032b4d76-9eca-4876-9cb8-bd8de236ba18" containerID="45e1e114a1b3649bd163b90275a207c51809111c09759575ac1ab1fe6a058330" exitCode=0 May 21 18:17:30.731478 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:30.731483 2567 generic.go:358] "Generic (PLEG): container finished" podID="032b4d76-9eca-4876-9cb8-bd8de236ba18" containerID="36b445ab5aa9042bf074764bd38d4c9da40b27960bd820a3ddff243c9d8bd0d3" exitCode=0 May 21 18:17:30.731921 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:30.731489 2567 generic.go:358] "Generic (PLEG): container finished" podID="032b4d76-9eca-4876-9cb8-bd8de236ba18" containerID="253e833ff310655fd8e1c1d7648ef8812993a0ecbd84d07e16a197cc22299419" exitCode=0 May 21 18:17:30.731921 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:30.731531 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"032b4d76-9eca-4876-9cb8-bd8de236ba18","Type":"ContainerDied","Data":"acb3056ed35a3835af2d07a062cc9902d20dd64f2c5b60cde0ae867db5a11c1d"} May 21 18:17:30.731921 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:30.731608 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"032b4d76-9eca-4876-9cb8-bd8de236ba18","Type":"ContainerDied","Data":"45e1e114a1b3649bd163b90275a207c51809111c09759575ac1ab1fe6a058330"} May 21 18:17:30.731921 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:30.731626 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"032b4d76-9eca-4876-9cb8-bd8de236ba18","Type":"ContainerDied","Data":"36b445ab5aa9042bf074764bd38d4c9da40b27960bd820a3ddff243c9d8bd0d3"} May 21 18:17:30.731921 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:30.731640 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"032b4d76-9eca-4876-9cb8-bd8de236ba18","Type":"ContainerDied","Data":"253e833ff310655fd8e1c1d7648ef8812993a0ecbd84d07e16a197cc22299419"} May 21 18:17:31.737596 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:31.737553 2567 generic.go:358] "Generic (PLEG): container finished" podID="032b4d76-9eca-4876-9cb8-bd8de236ba18" containerID="a0037701bda827995d45d4689f762e527ccf1ca56098eadaeb24006aaba02dcf" exitCode=0 May 21 18:17:31.737596 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:31.737594 2567 generic.go:358] "Generic (PLEG): container finished" podID="032b4d76-9eca-4876-9cb8-bd8de236ba18" containerID="b91a7ded577a39c24947e074ee5a7848acbbc52e886a00b125bbc5d705b031fd" exitCode=0 May 21 18:17:31.737932 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:31.737625 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"032b4d76-9eca-4876-9cb8-bd8de236ba18","Type":"ContainerDied","Data":"a0037701bda827995d45d4689f762e527ccf1ca56098eadaeb24006aaba02dcf"} May 21 18:17:31.737932 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:31.737665 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"032b4d76-9eca-4876-9cb8-bd8de236ba18","Type":"ContainerDied","Data":"b91a7ded577a39c24947e074ee5a7848acbbc52e886a00b125bbc5d705b031fd"} May 21 18:17:31.807744 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:31.807725 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 21 18:17:31.895476 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:31.895384 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/032b4d76-9eca-4876-9cb8-bd8de236ba18-secret-alertmanager-kube-rbac-proxy\") pod \"032b4d76-9eca-4876-9cb8-bd8de236ba18\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " May 21 18:17:31.895476 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:31.895431 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/032b4d76-9eca-4876-9cb8-bd8de236ba18-secret-alertmanager-kube-rbac-proxy-web\") pod \"032b4d76-9eca-4876-9cb8-bd8de236ba18\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " May 21 18:17:31.895476 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:31.895462 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/032b4d76-9eca-4876-9cb8-bd8de236ba18-alertmanager-trusted-ca-bundle\") pod \"032b4d76-9eca-4876-9cb8-bd8de236ba18\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " May 21 18:17:31.895767 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:31.895635 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/032b4d76-9eca-4876-9cb8-bd8de236ba18-alertmanager-main-db\") pod \"032b4d76-9eca-4876-9cb8-bd8de236ba18\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " May 21 18:17:31.895767 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:31.895686 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/032b4d76-9eca-4876-9cb8-bd8de236ba18-secret-alertmanager-main-tls\") pod \"032b4d76-9eca-4876-9cb8-bd8de236ba18\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " May 21 18:17:31.895767 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:31.895715 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/032b4d76-9eca-4876-9cb8-bd8de236ba18-web-config\") pod \"032b4d76-9eca-4876-9cb8-bd8de236ba18\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " May 21 18:17:31.895767 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:31.895744 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/032b4d76-9eca-4876-9cb8-bd8de236ba18-metrics-client-ca\") pod \"032b4d76-9eca-4876-9cb8-bd8de236ba18\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " May 21 18:17:31.895957 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:31.895784 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/032b4d76-9eca-4876-9cb8-bd8de236ba18-cluster-tls-config\") pod \"032b4d76-9eca-4876-9cb8-bd8de236ba18\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " May 21 18:17:31.895957 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:31.895841 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/032b4d76-9eca-4876-9cb8-bd8de236ba18-config-out\") pod \"032b4d76-9eca-4876-9cb8-bd8de236ba18\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " May 21 18:17:31.895957 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:31.895869 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5f6bz\" (UniqueName: \"kubernetes.io/projected/032b4d76-9eca-4876-9cb8-bd8de236ba18-kube-api-access-5f6bz\") pod \"032b4d76-9eca-4876-9cb8-bd8de236ba18\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " May 21 18:17:31.895957 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:31.895919 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/032b4d76-9eca-4876-9cb8-bd8de236ba18-tls-assets\") pod \"032b4d76-9eca-4876-9cb8-bd8de236ba18\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " May 21 18:17:31.895957 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:31.895936 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/032b4d76-9eca-4876-9cb8-bd8de236ba18-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "032b4d76-9eca-4876-9cb8-bd8de236ba18" (UID: "032b4d76-9eca-4876-9cb8-bd8de236ba18"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 18:17:31.896203 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:31.895952 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/032b4d76-9eca-4876-9cb8-bd8de236ba18-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "032b4d76-9eca-4876-9cb8-bd8de236ba18" (UID: "032b4d76-9eca-4876-9cb8-bd8de236ba18"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 18:17:31.896203 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:31.895967 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/032b4d76-9eca-4876-9cb8-bd8de236ba18-secret-alertmanager-kube-rbac-proxy-metric\") pod \"032b4d76-9eca-4876-9cb8-bd8de236ba18\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " May 21 18:17:31.896203 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:31.895995 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/032b4d76-9eca-4876-9cb8-bd8de236ba18-config-volume\") pod \"032b4d76-9eca-4876-9cb8-bd8de236ba18\" (UID: \"032b4d76-9eca-4876-9cb8-bd8de236ba18\") " May 21 18:17:31.896351 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:31.896285 2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/032b4d76-9eca-4876-9cb8-bd8de236ba18-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 21 18:17:31.896351 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:31.896304 2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/032b4d76-9eca-4876-9cb8-bd8de236ba18-alertmanager-main-db\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 21 18:17:31.896807 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:31.896777 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/032b4d76-9eca-4876-9cb8-bd8de236ba18-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "032b4d76-9eca-4876-9cb8-bd8de236ba18" (UID: "032b4d76-9eca-4876-9cb8-bd8de236ba18"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 18:17:31.898387 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:31.898351 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/032b4d76-9eca-4876-9cb8-bd8de236ba18-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "032b4d76-9eca-4876-9cb8-bd8de236ba18" (UID: "032b4d76-9eca-4876-9cb8-bd8de236ba18"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 18:17:31.898715 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:31.898686 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/032b4d76-9eca-4876-9cb8-bd8de236ba18-config-volume" (OuterVolumeSpecName: "config-volume") pod "032b4d76-9eca-4876-9cb8-bd8de236ba18" (UID: "032b4d76-9eca-4876-9cb8-bd8de236ba18"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 18:17:31.898813 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:31.898748 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/032b4d76-9eca-4876-9cb8-bd8de236ba18-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "032b4d76-9eca-4876-9cb8-bd8de236ba18" (UID: "032b4d76-9eca-4876-9cb8-bd8de236ba18"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 18:17:31.898813 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:31.898761 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/032b4d76-9eca-4876-9cb8-bd8de236ba18-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "032b4d76-9eca-4876-9cb8-bd8de236ba18" (UID: "032b4d76-9eca-4876-9cb8-bd8de236ba18"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 18:17:31.898813 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:31.898775 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/032b4d76-9eca-4876-9cb8-bd8de236ba18-config-out" (OuterVolumeSpecName: "config-out") pod "032b4d76-9eca-4876-9cb8-bd8de236ba18" (UID: "032b4d76-9eca-4876-9cb8-bd8de236ba18"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 18:17:31.899305 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:31.899277 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/032b4d76-9eca-4876-9cb8-bd8de236ba18-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "032b4d76-9eca-4876-9cb8-bd8de236ba18" (UID: "032b4d76-9eca-4876-9cb8-bd8de236ba18"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 18:17:31.899409 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:31.899385 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/032b4d76-9eca-4876-9cb8-bd8de236ba18-kube-api-access-5f6bz" (OuterVolumeSpecName: "kube-api-access-5f6bz") pod "032b4d76-9eca-4876-9cb8-bd8de236ba18" (UID: "032b4d76-9eca-4876-9cb8-bd8de236ba18"). InnerVolumeSpecName "kube-api-access-5f6bz". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:17:31.899802 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:31.899783 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/032b4d76-9eca-4876-9cb8-bd8de236ba18-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "032b4d76-9eca-4876-9cb8-bd8de236ba18" (UID: "032b4d76-9eca-4876-9cb8-bd8de236ba18"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:17:31.905087 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:31.905066 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/032b4d76-9eca-4876-9cb8-bd8de236ba18-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "032b4d76-9eca-4876-9cb8-bd8de236ba18" (UID: "032b4d76-9eca-4876-9cb8-bd8de236ba18"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 18:17:31.911565 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:31.911541 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/032b4d76-9eca-4876-9cb8-bd8de236ba18-web-config" (OuterVolumeSpecName: "web-config") pod "032b4d76-9eca-4876-9cb8-bd8de236ba18" (UID: "032b4d76-9eca-4876-9cb8-bd8de236ba18"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 18:17:31.997147 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:31.997122 2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/032b4d76-9eca-4876-9cb8-bd8de236ba18-tls-assets\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 21 18:17:31.997147 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:31.997148 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/032b4d76-9eca-4876-9cb8-bd8de236ba18-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 21 18:17:31.997266 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:31.997158 2567 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/032b4d76-9eca-4876-9cb8-bd8de236ba18-config-volume\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 21 18:17:31.997266 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:31.997167 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/032b4d76-9eca-4876-9cb8-bd8de236ba18-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 21 18:17:31.997266 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:31.997177 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/032b4d76-9eca-4876-9cb8-bd8de236ba18-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 21 18:17:31.997266 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:31.997186 2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/032b4d76-9eca-4876-9cb8-bd8de236ba18-secret-alertmanager-main-tls\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 21 18:17:31.997266 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:31.997196 2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/032b4d76-9eca-4876-9cb8-bd8de236ba18-web-config\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 21 18:17:31.997266 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:31.997204 2567 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/032b4d76-9eca-4876-9cb8-bd8de236ba18-metrics-client-ca\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 21 18:17:31.997266 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:31.997212 2567 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/032b4d76-9eca-4876-9cb8-bd8de236ba18-cluster-tls-config\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 21 18:17:31.997266 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:31.997220 2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/032b4d76-9eca-4876-9cb8-bd8de236ba18-config-out\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 21 18:17:31.997266 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:31.997228 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5f6bz\" (UniqueName: \"kubernetes.io/projected/032b4d76-9eca-4876-9cb8-bd8de236ba18-kube-api-access-5f6bz\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 21 18:17:32.743405 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.743374 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"032b4d76-9eca-4876-9cb8-bd8de236ba18","Type":"ContainerDied","Data":"1766b6a4180185e2d58625331878bd6c6115bde2b4f11a8b65dbdc7c4655d5bb"} May 21 18:17:32.743405 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.743416 2567 scope.go:117] "RemoveContainer" containerID="acb3056ed35a3835af2d07a062cc9902d20dd64f2c5b60cde0ae867db5a11c1d" May 21 18:17:32.743848 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.743483 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 21 18:17:32.750781 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.750757 2567 scope.go:117] "RemoveContainer" containerID="a0037701bda827995d45d4689f762e527ccf1ca56098eadaeb24006aaba02dcf" May 21 18:17:32.757324 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.757308 2567 scope.go:117] "RemoveContainer" containerID="45e1e114a1b3649bd163b90275a207c51809111c09759575ac1ab1fe6a058330" May 21 18:17:32.763457 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.763437 2567 scope.go:117] "RemoveContainer" containerID="b91a7ded577a39c24947e074ee5a7848acbbc52e886a00b125bbc5d705b031fd" May 21 18:17:32.765114 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.765094 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 18:17:32.772041 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.772020 2567 scope.go:117] "RemoveContainer" containerID="36b445ab5aa9042bf074764bd38d4c9da40b27960bd820a3ddff243c9d8bd0d3" May 21 18:17:32.774040 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.774020 2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 18:17:32.778544 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.778527 2567 scope.go:117] "RemoveContainer" containerID="253e833ff310655fd8e1c1d7648ef8812993a0ecbd84d07e16a197cc22299419" May 21 18:17:32.784614 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.784595 2567 scope.go:117] "RemoveContainer" containerID="f584c3cd077e859726f292fa494ddc7b20b490719cd4e0cbc93be77c58fcf898" May 21 18:17:32.797501 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.797482 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 18:17:32.797796 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.797784 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="032b4d76-9eca-4876-9cb8-bd8de236ba18" containerName="alertmanager" May 21 18:17:32.797839 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.797798 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="032b4d76-9eca-4876-9cb8-bd8de236ba18" containerName="alertmanager" May 21 18:17:32.797839 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.797815 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a748fb72-614d-4d85-aba5-8a243e2cd7bc" containerName="registry" May 21 18:17:32.797839 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.797821 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a748fb72-614d-4d85-aba5-8a243e2cd7bc" containerName="registry" May 21 18:17:32.797839 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.797829 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="032b4d76-9eca-4876-9cb8-bd8de236ba18" containerName="kube-rbac-proxy" May 21 18:17:32.797839 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.797838 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="032b4d76-9eca-4876-9cb8-bd8de236ba18" containerName="kube-rbac-proxy" May 21 18:17:32.797992 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.797852 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="032b4d76-9eca-4876-9cb8-bd8de236ba18" containerName="config-reloader" May 21 18:17:32.797992 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.797857 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="032b4d76-9eca-4876-9cb8-bd8de236ba18" containerName="config-reloader" May 21 18:17:32.797992 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.797863 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="032b4d76-9eca-4876-9cb8-bd8de236ba18" containerName="kube-rbac-proxy-metric" May 21 18:17:32.797992 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.797869 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="032b4d76-9eca-4876-9cb8-bd8de236ba18" containerName="kube-rbac-proxy-metric" May 21 18:17:32.797992 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.797875 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="032b4d76-9eca-4876-9cb8-bd8de236ba18" containerName="kube-rbac-proxy-web" May 21 18:17:32.797992 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.797880 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="032b4d76-9eca-4876-9cb8-bd8de236ba18" containerName="kube-rbac-proxy-web" May 21 18:17:32.797992 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.797887 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="032b4d76-9eca-4876-9cb8-bd8de236ba18" containerName="prom-label-proxy" May 21 18:17:32.797992 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.797892 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="032b4d76-9eca-4876-9cb8-bd8de236ba18" containerName="prom-label-proxy" May 21 18:17:32.797992 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.797897 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="032b4d76-9eca-4876-9cb8-bd8de236ba18" containerName="init-config-reloader" May 21 18:17:32.797992 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.797904 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="032b4d76-9eca-4876-9cb8-bd8de236ba18" containerName="init-config-reloader" May 21 18:17:32.797992 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.797956 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="032b4d76-9eca-4876-9cb8-bd8de236ba18" containerName="prom-label-proxy" May 21 18:17:32.797992 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.797965 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="032b4d76-9eca-4876-9cb8-bd8de236ba18" containerName="config-reloader" May 21 18:17:32.797992 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.797970 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="032b4d76-9eca-4876-9cb8-bd8de236ba18" containerName="kube-rbac-proxy" May 21 18:17:32.797992 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.797979 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="032b4d76-9eca-4876-9cb8-bd8de236ba18" containerName="kube-rbac-proxy-metric" May 21 18:17:32.797992 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.797985 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="a748fb72-614d-4d85-aba5-8a243e2cd7bc" containerName="registry" May 21 18:17:32.797992 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.797990 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="032b4d76-9eca-4876-9cb8-bd8de236ba18" containerName="alertmanager" May 21 18:17:32.797992 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.797996 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="032b4d76-9eca-4876-9cb8-bd8de236ba18" containerName="kube-rbac-proxy-web" May 21 18:17:32.803126 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.803110 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 21 18:17:32.805474 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.805455 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 21 18:17:32.805552 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.805482 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-l4qk4\"" May 21 18:17:32.805552 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.805460 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 21 18:17:32.805675 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.805637 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 21 18:17:32.805752 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.805736 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 21 18:17:32.805908 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.805894 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 21 18:17:32.805963 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.805897 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 21 18:17:32.805963 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.805949 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 21 18:17:32.806216 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.806197 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 21 18:17:32.810855 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.810696 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 21 18:17:32.812957 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.812938 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 18:17:32.906388 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.906302 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:17:32.906388 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.906341 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2-config-out\") pod \"alertmanager-main-0\" (UID: \"5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:17:32.906388 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.906358 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:17:32.906388 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.906386 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:17:32.906655 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.906454 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:17:32.906655 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.906505 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2-config-volume\") pod \"alertmanager-main-0\" (UID: \"5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:17:32.906655 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.906531 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:17:32.906655 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.906618 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2-web-config\") pod \"alertmanager-main-0\" (UID: \"5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:17:32.906770 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.906654 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:17:32.906770 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.906682 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:17:32.906770 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.906703 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:17:32.906770 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.906719 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttmc8\" (UniqueName: \"kubernetes.io/projected/5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2-kube-api-access-ttmc8\") pod \"alertmanager-main-0\" (UID: \"5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:17:32.906770 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:32.906758 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:17:33.007876 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:33.007840 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2-web-config\") pod \"alertmanager-main-0\" (UID: \"5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:17:33.007876 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:33.007878 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:17:33.008107 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:33.007908 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:17:33.008107 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:33.007936 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:17:33.008107 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:33.007959 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ttmc8\" (UniqueName: \"kubernetes.io/projected/5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2-kube-api-access-ttmc8\") pod \"alertmanager-main-0\" (UID: \"5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:17:33.008107 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:33.007983 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:17:33.008107 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:33.008009 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:17:33.008107 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:33.008043 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2-config-out\") pod \"alertmanager-main-0\" (UID: \"5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:17:33.008107 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:33.008068 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:17:33.008434 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:33.008110 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:17:33.008434 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:33.008140 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:17:33.008434 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:33.008201 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2-config-volume\") pod \"alertmanager-main-0\" (UID: \"5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:17:33.008434 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:33.008233 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:17:33.008651 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:33.008607 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:17:33.009968 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:33.009696 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:17:33.010958 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:33.010876 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:17:33.011054 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:33.010986 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:17:33.011054 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:33.011006 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2-web-config\") pod \"alertmanager-main-0\" (UID: \"5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:17:33.011175 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:33.011137 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:17:33.011334 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:33.011311 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:17:33.011440 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:33.011421 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:17:33.011549 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:33.011529 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:17:33.011719 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:33.011699 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:17:33.012059 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:33.012041 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2-config-out\") pod \"alertmanager-main-0\" (UID: \"5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:17:33.013071 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:33.013054 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2-config-volume\") pod \"alertmanager-main-0\" (UID: \"5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:17:33.015974 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:33.015956 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttmc8\" (UniqueName: \"kubernetes.io/projected/5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2-kube-api-access-ttmc8\") pod \"alertmanager-main-0\" (UID: \"5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2\") " pod="openshift-monitoring/alertmanager-main-0" May 21 18:17:33.113128 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:33.113100 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 21 18:17:33.238414 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:33.238386 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 18:17:33.240038 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:17:33.240012 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fb0ba0f_79ad_4c3c_874c_a5cb63c3ead2.slice/crio-fa7a5ebe664ebd7ef9ed85a6e813cc7b202e549328f4358a8aa40ab6082f39eb WatchSource:0}: Error finding container fa7a5ebe664ebd7ef9ed85a6e813cc7b202e549328f4358a8aa40ab6082f39eb: Status 404 returned error can't find the container with id fa7a5ebe664ebd7ef9ed85a6e813cc7b202e549328f4358a8aa40ab6082f39eb May 21 18:17:33.747716 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:33.747672 2567 generic.go:358] "Generic (PLEG): container finished" podID="5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2" containerID="984c5a9748472506d5cf3abdd3455ce319433a2aa386478da55f09805c2e5155" exitCode=0 May 21 18:17:33.748121 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:33.747758 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2","Type":"ContainerDied","Data":"984c5a9748472506d5cf3abdd3455ce319433a2aa386478da55f09805c2e5155"} May 21 18:17:33.748121 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:33.747791 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2","Type":"ContainerStarted","Data":"fa7a5ebe664ebd7ef9ed85a6e813cc7b202e549328f4358a8aa40ab6082f39eb"} May 21 18:17:33.983109 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:33.983085 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="032b4d76-9eca-4876-9cb8-bd8de236ba18" path="/var/lib/kubelet/pods/032b4d76-9eca-4876-9cb8-bd8de236ba18/volumes" May 21 18:17:34.754035 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:34.754001 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2","Type":"ContainerStarted","Data":"b488a26ce8368667e891692737612d6740351b6a49f22efde7ac356c23aff710"} May 21 18:17:34.754035 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:34.754035 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2","Type":"ContainerStarted","Data":"a01880cd82322d321b2a19f26121c3e0a7bb3b004ba6a81332ea68cef0d3757c"} May 21 18:17:34.754035 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:34.754044 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2","Type":"ContainerStarted","Data":"b9ab76f3c98de901c3c8e3ce40380ed66f0bfdb8782eee93e7c0de55c5eff00a"} May 21 18:17:34.754480 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:34.754052 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2","Type":"ContainerStarted","Data":"00326bc9679d0f71e297d1000d1926c35c9a6c8979cc97420a0093e036d690c3"} May 21 18:17:34.754480 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:34.754060 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2","Type":"ContainerStarted","Data":"28297fecde45b2f4094633cbe72b68ee66a7235966fd72cd396a36025c17c7f7"} May 21 18:17:34.754480 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:34.754068 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2","Type":"ContainerStarted","Data":"f955a4e38d9f410fa2c4c27724bf83e0fcf860e69ea64ac8727d35f1c41799f9"} May 21 18:17:34.781857 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:34.781800 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.7817868409999997 podStartE2EDuration="2.781786841s" podCreationTimestamp="2026-05-21 18:17:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:17:34.780348908 +0000 UTC m=+259.365835368" watchObservedRunningTime="2026-05-21 18:17:34.781786841 +0000 UTC m=+259.367273275" May 21 18:17:34.882342 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:34.882286 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 18:17:34.882911 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:34.882771 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="741be498-ff65-48ba-b8c7-574c9d76766d" containerName="prometheus" containerID="cri-o://da88edcbd624c8cb1e4eb58c6598ff29ba3ed53af1c6c780af755399704be60c" gracePeriod=600 May 21 18:17:34.882911 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:34.882790 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="741be498-ff65-48ba-b8c7-574c9d76766d" containerName="config-reloader" containerID="cri-o://8b95e50f9d6657fd959bd18494b8956f3879485d6cfcfc100c342e699a50ce11" gracePeriod=600 May 21 18:17:34.882911 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:34.882783 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="741be498-ff65-48ba-b8c7-574c9d76766d" containerName="kube-rbac-proxy" containerID="cri-o://94502bbeff005d11e40b1a9914c7e33ff746e520c3517e56fcab46abedce6149" gracePeriod=600 May 21 18:17:34.882911 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:34.882830 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="741be498-ff65-48ba-b8c7-574c9d76766d" containerName="kube-rbac-proxy-thanos" containerID="cri-o://c3b0206e4c546daf8a0839e589547f6cd736f2476aa44a7ef9d666d1f63b8e81" gracePeriod=600 May 21 18:17:34.882911 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:34.882788 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="741be498-ff65-48ba-b8c7-574c9d76766d" containerName="thanos-sidecar" containerID="cri-o://8febac3e3ee6c2eb0f3edb999c82c5805d79ce3c9e6a2a4a8632094f61e318ec" gracePeriod=600 May 21 18:17:34.883214 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:34.883072 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="741be498-ff65-48ba-b8c7-574c9d76766d" containerName="kube-rbac-proxy-web" containerID="cri-o://66770e7794645fcdead984b097d58ca7b8068e7900c7dcfcf2c30218f5dddb41" gracePeriod=600 May 21 18:17:35.133861 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.133837 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:35.232738 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.232709 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/741be498-ff65-48ba-b8c7-574c9d76766d-prometheus-k8s-rulefiles-0\") pod \"741be498-ff65-48ba-b8c7-574c9d76766d\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " May 21 18:17:35.232897 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.232770 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/741be498-ff65-48ba-b8c7-574c9d76766d-config-out\") pod \"741be498-ff65-48ba-b8c7-574c9d76766d\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " May 21 18:17:35.232897 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.232815 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-web-config\") pod \"741be498-ff65-48ba-b8c7-574c9d76766d\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " May 21 18:17:35.232897 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.232838 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/741be498-ff65-48ba-b8c7-574c9d76766d-prometheus-trusted-ca-bundle\") pod \"741be498-ff65-48ba-b8c7-574c9d76766d\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " May 21 18:17:35.232897 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.232855 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/741be498-ff65-48ba-b8c7-574c9d76766d-configmap-serving-certs-ca-bundle\") pod \"741be498-ff65-48ba-b8c7-574c9d76766d\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " May 21 18:17:35.232897 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.232872 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-secret-grpc-tls\") pod \"741be498-ff65-48ba-b8c7-574c9d76766d\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " May 21 18:17:35.233118 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.232899 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-secret-prometheus-k8s-tls\") pod \"741be498-ff65-48ba-b8c7-574c9d76766d\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " May 21 18:17:35.233118 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.232932 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/741be498-ff65-48ba-b8c7-574c9d76766d-prometheus-k8s-db\") pod \"741be498-ff65-48ba-b8c7-574c9d76766d\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " May 21 18:17:35.233118 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.232955 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7m2z\" (UniqueName: \"kubernetes.io/projected/741be498-ff65-48ba-b8c7-574c9d76766d-kube-api-access-w7m2z\") pod \"741be498-ff65-48ba-b8c7-574c9d76766d\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " May 21 18:17:35.233118 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.233006 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-secret-metrics-client-certs\") pod \"741be498-ff65-48ba-b8c7-574c9d76766d\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " May 21 18:17:35.233118 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.233031 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/741be498-ff65-48ba-b8c7-574c9d76766d-configmap-metrics-client-ca\") pod \"741be498-ff65-48ba-b8c7-574c9d76766d\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " May 21 18:17:35.233118 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.233059 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-thanos-prometheus-http-client-file\") pod \"741be498-ff65-48ba-b8c7-574c9d76766d\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " May 21 18:17:35.233118 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.233088 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/741be498-ff65-48ba-b8c7-574c9d76766d-tls-assets\") pod \"741be498-ff65-48ba-b8c7-574c9d76766d\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " May 21 18:17:35.233118 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.233119 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"741be498-ff65-48ba-b8c7-574c9d76766d\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " May 21 18:17:35.233483 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.233158 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/741be498-ff65-48ba-b8c7-574c9d76766d-configmap-kubelet-serving-ca-bundle\") pod \"741be498-ff65-48ba-b8c7-574c9d76766d\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " May 21 18:17:35.233483 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.233188 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-config\") pod \"741be498-ff65-48ba-b8c7-574c9d76766d\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " May 21 18:17:35.233483 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.233220 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-secret-kube-rbac-proxy\") pod \"741be498-ff65-48ba-b8c7-574c9d76766d\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " May 21 18:17:35.233483 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.233250 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"741be498-ff65-48ba-b8c7-574c9d76766d\" (UID: \"741be498-ff65-48ba-b8c7-574c9d76766d\") " May 21 18:17:35.233483 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.233292 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/741be498-ff65-48ba-b8c7-574c9d76766d-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "741be498-ff65-48ba-b8c7-574c9d76766d" (UID: "741be498-ff65-48ba-b8c7-574c9d76766d"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 18:17:35.233483 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.233286 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/741be498-ff65-48ba-b8c7-574c9d76766d-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "741be498-ff65-48ba-b8c7-574c9d76766d" (UID: "741be498-ff65-48ba-b8c7-574c9d76766d"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 18:17:35.233799 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.233507 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/741be498-ff65-48ba-b8c7-574c9d76766d-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 21 18:17:35.233799 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.233527 2567 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/741be498-ff65-48ba-b8c7-574c9d76766d-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 21 18:17:35.234452 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.234417 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/741be498-ff65-48ba-b8c7-574c9d76766d-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "741be498-ff65-48ba-b8c7-574c9d76766d" (UID: "741be498-ff65-48ba-b8c7-574c9d76766d"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 18:17:35.235316 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.235290 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/741be498-ff65-48ba-b8c7-574c9d76766d-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "741be498-ff65-48ba-b8c7-574c9d76766d" (UID: "741be498-ff65-48ba-b8c7-574c9d76766d"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 18:17:35.235402 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.235378 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/741be498-ff65-48ba-b8c7-574c9d76766d-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "741be498-ff65-48ba-b8c7-574c9d76766d" (UID: "741be498-ff65-48ba-b8c7-574c9d76766d"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 18:17:35.235813 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.235787 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/741be498-ff65-48ba-b8c7-574c9d76766d-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "741be498-ff65-48ba-b8c7-574c9d76766d" (UID: "741be498-ff65-48ba-b8c7-574c9d76766d"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 18:17:35.236272 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.236247 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/741be498-ff65-48ba-b8c7-574c9d76766d-config-out" (OuterVolumeSpecName: "config-out") pod "741be498-ff65-48ba-b8c7-574c9d76766d" (UID: "741be498-ff65-48ba-b8c7-574c9d76766d"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 18:17:35.236702 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.236672 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "741be498-ff65-48ba-b8c7-574c9d76766d" (UID: "741be498-ff65-48ba-b8c7-574c9d76766d"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 18:17:35.236702 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.236677 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/741be498-ff65-48ba-b8c7-574c9d76766d-kube-api-access-w7m2z" (OuterVolumeSpecName: "kube-api-access-w7m2z") pod "741be498-ff65-48ba-b8c7-574c9d76766d" (UID: "741be498-ff65-48ba-b8c7-574c9d76766d"). InnerVolumeSpecName "kube-api-access-w7m2z". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:17:35.236979 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.236949 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/741be498-ff65-48ba-b8c7-574c9d76766d-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "741be498-ff65-48ba-b8c7-574c9d76766d" (UID: "741be498-ff65-48ba-b8c7-574c9d76766d"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:17:35.237048 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.236981 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "741be498-ff65-48ba-b8c7-574c9d76766d" (UID: "741be498-ff65-48ba-b8c7-574c9d76766d"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 18:17:35.237106 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.237077 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "741be498-ff65-48ba-b8c7-574c9d76766d" (UID: "741be498-ff65-48ba-b8c7-574c9d76766d"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 18:17:35.237421 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.237400 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-config" (OuterVolumeSpecName: "config") pod "741be498-ff65-48ba-b8c7-574c9d76766d" (UID: "741be498-ff65-48ba-b8c7-574c9d76766d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 18:17:35.237462 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.237424 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "741be498-ff65-48ba-b8c7-574c9d76766d" (UID: "741be498-ff65-48ba-b8c7-574c9d76766d"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 18:17:35.238077 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.238058 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "741be498-ff65-48ba-b8c7-574c9d76766d" (UID: "741be498-ff65-48ba-b8c7-574c9d76766d"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 18:17:35.238185 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.238170 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "741be498-ff65-48ba-b8c7-574c9d76766d" (UID: "741be498-ff65-48ba-b8c7-574c9d76766d"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 18:17:35.238626 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.238568 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "741be498-ff65-48ba-b8c7-574c9d76766d" (UID: "741be498-ff65-48ba-b8c7-574c9d76766d"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 18:17:35.246719 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.246697 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-web-config" (OuterVolumeSpecName: "web-config") pod "741be498-ff65-48ba-b8c7-574c9d76766d" (UID: "741be498-ff65-48ba-b8c7-574c9d76766d"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 18:17:35.334782 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.334708 2567 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-secret-grpc-tls\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 21 18:17:35.334782 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.334734 2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 21 18:17:35.334782 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.334743 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/741be498-ff65-48ba-b8c7-574c9d76766d-prometheus-k8s-db\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 21 18:17:35.334782 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.334752 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7m2z\" (UniqueName: \"kubernetes.io/projected/741be498-ff65-48ba-b8c7-574c9d76766d-kube-api-access-w7m2z\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 21 18:17:35.334782 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.334762 2567 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-secret-metrics-client-certs\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 21 18:17:35.334782 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.334770 2567 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/741be498-ff65-48ba-b8c7-574c9d76766d-configmap-metrics-client-ca\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 21 18:17:35.334782 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.334779 2567 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 21 18:17:35.334782 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.334788 2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/741be498-ff65-48ba-b8c7-574c9d76766d-tls-assets\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 21 18:17:35.335073 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.334797 2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 21 18:17:35.335073 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.334806 2567 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/741be498-ff65-48ba-b8c7-574c9d76766d-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 21 18:17:35.335073 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.334814 2567 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-config\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 21 18:17:35.335073 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.334823 2567 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-secret-kube-rbac-proxy\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 21 18:17:35.335073 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.334831 2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 21 18:17:35.335073 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.334841 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/741be498-ff65-48ba-b8c7-574c9d76766d-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 21 18:17:35.335073 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.334849 2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/741be498-ff65-48ba-b8c7-574c9d76766d-config-out\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 21 18:17:35.335073 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.334857 2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/741be498-ff65-48ba-b8c7-574c9d76766d-web-config\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 21 18:17:35.759850 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.759814 2567 generic.go:358] "Generic (PLEG): container finished" podID="741be498-ff65-48ba-b8c7-574c9d76766d" containerID="c3b0206e4c546daf8a0839e589547f6cd736f2476aa44a7ef9d666d1f63b8e81" exitCode=0 May 21 18:17:35.759850 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.759841 2567 generic.go:358] "Generic (PLEG): container finished" podID="741be498-ff65-48ba-b8c7-574c9d76766d" containerID="94502bbeff005d11e40b1a9914c7e33ff746e520c3517e56fcab46abedce6149" exitCode=0 May 21 18:17:35.759850 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.759848 2567 generic.go:358] "Generic (PLEG): container finished" podID="741be498-ff65-48ba-b8c7-574c9d76766d" containerID="66770e7794645fcdead984b097d58ca7b8068e7900c7dcfcf2c30218f5dddb41" exitCode=0 May 21 18:17:35.759850 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.759853 2567 generic.go:358] "Generic (PLEG): container finished" podID="741be498-ff65-48ba-b8c7-574c9d76766d" containerID="8febac3e3ee6c2eb0f3edb999c82c5805d79ce3c9e6a2a4a8632094f61e318ec" exitCode=0 May 21 18:17:35.759850 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.759858 2567 generic.go:358] "Generic (PLEG): container finished" podID="741be498-ff65-48ba-b8c7-574c9d76766d" containerID="8b95e50f9d6657fd959bd18494b8956f3879485d6cfcfc100c342e699a50ce11" exitCode=0 May 21 18:17:35.760450 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.759863 2567 generic.go:358] "Generic (PLEG): container finished" podID="741be498-ff65-48ba-b8c7-574c9d76766d" containerID="da88edcbd624c8cb1e4eb58c6598ff29ba3ed53af1c6c780af755399704be60c" exitCode=0 May 21 18:17:35.760450 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.759890 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"741be498-ff65-48ba-b8c7-574c9d76766d","Type":"ContainerDied","Data":"c3b0206e4c546daf8a0839e589547f6cd736f2476aa44a7ef9d666d1f63b8e81"} May 21 18:17:35.760450 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.759925 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:35.760450 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.759930 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"741be498-ff65-48ba-b8c7-574c9d76766d","Type":"ContainerDied","Data":"94502bbeff005d11e40b1a9914c7e33ff746e520c3517e56fcab46abedce6149"} May 21 18:17:35.760450 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.759944 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"741be498-ff65-48ba-b8c7-574c9d76766d","Type":"ContainerDied","Data":"66770e7794645fcdead984b097d58ca7b8068e7900c7dcfcf2c30218f5dddb41"} May 21 18:17:35.760450 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.759954 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"741be498-ff65-48ba-b8c7-574c9d76766d","Type":"ContainerDied","Data":"8febac3e3ee6c2eb0f3edb999c82c5805d79ce3c9e6a2a4a8632094f61e318ec"} May 21 18:17:35.760450 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.759963 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"741be498-ff65-48ba-b8c7-574c9d76766d","Type":"ContainerDied","Data":"8b95e50f9d6657fd959bd18494b8956f3879485d6cfcfc100c342e699a50ce11"} May 21 18:17:35.760450 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.759977 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"741be498-ff65-48ba-b8c7-574c9d76766d","Type":"ContainerDied","Data":"da88edcbd624c8cb1e4eb58c6598ff29ba3ed53af1c6c780af755399704be60c"} May 21 18:17:35.760450 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.759990 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"741be498-ff65-48ba-b8c7-574c9d76766d","Type":"ContainerDied","Data":"d2dd21a004ef02ea1a4ec4b32c319f02daeffb77c6f6c3d334eb427775bbfda9"} May 21 18:17:35.760450 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.760008 2567 scope.go:117] "RemoveContainer" containerID="c3b0206e4c546daf8a0839e589547f6cd736f2476aa44a7ef9d666d1f63b8e81" May 21 18:17:35.768320 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.768302 2567 scope.go:117] "RemoveContainer" containerID="94502bbeff005d11e40b1a9914c7e33ff746e520c3517e56fcab46abedce6149" May 21 18:17:35.775030 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.775016 2567 scope.go:117] "RemoveContainer" containerID="66770e7794645fcdead984b097d58ca7b8068e7900c7dcfcf2c30218f5dddb41" May 21 18:17:35.781142 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.781125 2567 scope.go:117] "RemoveContainer" containerID="8febac3e3ee6c2eb0f3edb999c82c5805d79ce3c9e6a2a4a8632094f61e318ec" May 21 18:17:35.785175 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.784830 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 18:17:35.786636 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.786617 2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 18:17:35.790112 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.790088 2567 scope.go:117] "RemoveContainer" containerID="8b95e50f9d6657fd959bd18494b8956f3879485d6cfcfc100c342e699a50ce11" May 21 18:17:35.796186 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.796171 2567 scope.go:117] "RemoveContainer" containerID="da88edcbd624c8cb1e4eb58c6598ff29ba3ed53af1c6c780af755399704be60c" May 21 18:17:35.802649 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.802635 2567 scope.go:117] "RemoveContainer" containerID="e1f71a478780fed2ffa72f95575ac1754b37fded78d772c32ba451aceca6c92b" May 21 18:17:35.808524 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.808508 2567 scope.go:117] "RemoveContainer" containerID="c3b0206e4c546daf8a0839e589547f6cd736f2476aa44a7ef9d666d1f63b8e81" May 21 18:17:35.808790 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:17:35.808772 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3b0206e4c546daf8a0839e589547f6cd736f2476aa44a7ef9d666d1f63b8e81\": container with ID starting with c3b0206e4c546daf8a0839e589547f6cd736f2476aa44a7ef9d666d1f63b8e81 not found: ID does not exist" containerID="c3b0206e4c546daf8a0839e589547f6cd736f2476aa44a7ef9d666d1f63b8e81" May 21 18:17:35.808858 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.808798 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3b0206e4c546daf8a0839e589547f6cd736f2476aa44a7ef9d666d1f63b8e81"} err="failed to get container status \"c3b0206e4c546daf8a0839e589547f6cd736f2476aa44a7ef9d666d1f63b8e81\": rpc error: code = NotFound desc = could not find container \"c3b0206e4c546daf8a0839e589547f6cd736f2476aa44a7ef9d666d1f63b8e81\": container with ID starting with c3b0206e4c546daf8a0839e589547f6cd736f2476aa44a7ef9d666d1f63b8e81 not found: ID does not exist" May 21 18:17:35.808858 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.808816 2567 scope.go:117] "RemoveContainer" containerID="94502bbeff005d11e40b1a9914c7e33ff746e520c3517e56fcab46abedce6149" May 21 18:17:35.809034 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:17:35.809020 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94502bbeff005d11e40b1a9914c7e33ff746e520c3517e56fcab46abedce6149\": container with ID starting with 94502bbeff005d11e40b1a9914c7e33ff746e520c3517e56fcab46abedce6149 not found: ID does not exist" containerID="94502bbeff005d11e40b1a9914c7e33ff746e520c3517e56fcab46abedce6149" May 21 18:17:35.809073 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.809037 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94502bbeff005d11e40b1a9914c7e33ff746e520c3517e56fcab46abedce6149"} err="failed to get container status \"94502bbeff005d11e40b1a9914c7e33ff746e520c3517e56fcab46abedce6149\": rpc error: code = NotFound desc = could not find container \"94502bbeff005d11e40b1a9914c7e33ff746e520c3517e56fcab46abedce6149\": container with ID starting with 94502bbeff005d11e40b1a9914c7e33ff746e520c3517e56fcab46abedce6149 not found: ID does not exist" May 21 18:17:35.809073 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.809051 2567 scope.go:117] "RemoveContainer" containerID="66770e7794645fcdead984b097d58ca7b8068e7900c7dcfcf2c30218f5dddb41" May 21 18:17:35.809268 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:17:35.809248 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66770e7794645fcdead984b097d58ca7b8068e7900c7dcfcf2c30218f5dddb41\": container with ID starting with 66770e7794645fcdead984b097d58ca7b8068e7900c7dcfcf2c30218f5dddb41 not found: ID does not exist" containerID="66770e7794645fcdead984b097d58ca7b8068e7900c7dcfcf2c30218f5dddb41" May 21 18:17:35.809317 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.809275 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66770e7794645fcdead984b097d58ca7b8068e7900c7dcfcf2c30218f5dddb41"} err="failed to get container status \"66770e7794645fcdead984b097d58ca7b8068e7900c7dcfcf2c30218f5dddb41\": rpc error: code = NotFound desc = could not find container \"66770e7794645fcdead984b097d58ca7b8068e7900c7dcfcf2c30218f5dddb41\": container with ID starting with 66770e7794645fcdead984b097d58ca7b8068e7900c7dcfcf2c30218f5dddb41 not found: ID does not exist" May 21 18:17:35.809317 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.809291 2567 scope.go:117] "RemoveContainer" containerID="8febac3e3ee6c2eb0f3edb999c82c5805d79ce3c9e6a2a4a8632094f61e318ec" May 21 18:17:35.809559 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:17:35.809535 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8febac3e3ee6c2eb0f3edb999c82c5805d79ce3c9e6a2a4a8632094f61e318ec\": container with ID starting with 8febac3e3ee6c2eb0f3edb999c82c5805d79ce3c9e6a2a4a8632094f61e318ec not found: ID does not exist" containerID="8febac3e3ee6c2eb0f3edb999c82c5805d79ce3c9e6a2a4a8632094f61e318ec" May 21 18:17:35.809669 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.809569 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8febac3e3ee6c2eb0f3edb999c82c5805d79ce3c9e6a2a4a8632094f61e318ec"} err="failed to get container status \"8febac3e3ee6c2eb0f3edb999c82c5805d79ce3c9e6a2a4a8632094f61e318ec\": rpc error: code = NotFound desc = could not find container \"8febac3e3ee6c2eb0f3edb999c82c5805d79ce3c9e6a2a4a8632094f61e318ec\": container with ID starting with 8febac3e3ee6c2eb0f3edb999c82c5805d79ce3c9e6a2a4a8632094f61e318ec not found: ID does not exist" May 21 18:17:35.809669 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.809612 2567 scope.go:117] "RemoveContainer" containerID="8b95e50f9d6657fd959bd18494b8956f3879485d6cfcfc100c342e699a50ce11" May 21 18:17:35.809978 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:17:35.809961 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b95e50f9d6657fd959bd18494b8956f3879485d6cfcfc100c342e699a50ce11\": container with ID starting with 8b95e50f9d6657fd959bd18494b8956f3879485d6cfcfc100c342e699a50ce11 not found: ID does not exist" containerID="8b95e50f9d6657fd959bd18494b8956f3879485d6cfcfc100c342e699a50ce11" May 21 18:17:35.810041 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.809981 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b95e50f9d6657fd959bd18494b8956f3879485d6cfcfc100c342e699a50ce11"} err="failed to get container status \"8b95e50f9d6657fd959bd18494b8956f3879485d6cfcfc100c342e699a50ce11\": rpc error: code = NotFound desc = could not find container \"8b95e50f9d6657fd959bd18494b8956f3879485d6cfcfc100c342e699a50ce11\": container with ID starting with 8b95e50f9d6657fd959bd18494b8956f3879485d6cfcfc100c342e699a50ce11 not found: ID does not exist" May 21 18:17:35.810041 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.810014 2567 scope.go:117] "RemoveContainer" containerID="da88edcbd624c8cb1e4eb58c6598ff29ba3ed53af1c6c780af755399704be60c" May 21 18:17:35.810265 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:17:35.810247 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da88edcbd624c8cb1e4eb58c6598ff29ba3ed53af1c6c780af755399704be60c\": container with ID starting with da88edcbd624c8cb1e4eb58c6598ff29ba3ed53af1c6c780af755399704be60c not found: ID does not exist" containerID="da88edcbd624c8cb1e4eb58c6598ff29ba3ed53af1c6c780af755399704be60c" May 21 18:17:35.810344 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.810267 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da88edcbd624c8cb1e4eb58c6598ff29ba3ed53af1c6c780af755399704be60c"} err="failed to get container status \"da88edcbd624c8cb1e4eb58c6598ff29ba3ed53af1c6c780af755399704be60c\": rpc error: code = NotFound desc = could not find container \"da88edcbd624c8cb1e4eb58c6598ff29ba3ed53af1c6c780af755399704be60c\": container with ID starting with da88edcbd624c8cb1e4eb58c6598ff29ba3ed53af1c6c780af755399704be60c not found: ID does not exist" May 21 18:17:35.810344 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.810281 2567 scope.go:117] "RemoveContainer" containerID="e1f71a478780fed2ffa72f95575ac1754b37fded78d772c32ba451aceca6c92b" May 21 18:17:35.810533 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:17:35.810513 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1f71a478780fed2ffa72f95575ac1754b37fded78d772c32ba451aceca6c92b\": container with ID starting with e1f71a478780fed2ffa72f95575ac1754b37fded78d772c32ba451aceca6c92b not found: ID does not exist" containerID="e1f71a478780fed2ffa72f95575ac1754b37fded78d772c32ba451aceca6c92b" May 21 18:17:35.810618 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.810541 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1f71a478780fed2ffa72f95575ac1754b37fded78d772c32ba451aceca6c92b"} err="failed to get container status \"e1f71a478780fed2ffa72f95575ac1754b37fded78d772c32ba451aceca6c92b\": rpc error: code = NotFound desc = could not find container \"e1f71a478780fed2ffa72f95575ac1754b37fded78d772c32ba451aceca6c92b\": container with ID starting with e1f71a478780fed2ffa72f95575ac1754b37fded78d772c32ba451aceca6c92b not found: ID does not exist" May 21 18:17:35.810618 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.810560 2567 scope.go:117] "RemoveContainer" containerID="c3b0206e4c546daf8a0839e589547f6cd736f2476aa44a7ef9d666d1f63b8e81" May 21 18:17:35.810818 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.810797 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3b0206e4c546daf8a0839e589547f6cd736f2476aa44a7ef9d666d1f63b8e81"} err="failed to get container status \"c3b0206e4c546daf8a0839e589547f6cd736f2476aa44a7ef9d666d1f63b8e81\": rpc error: code = NotFound desc = could not find container \"c3b0206e4c546daf8a0839e589547f6cd736f2476aa44a7ef9d666d1f63b8e81\": container with ID starting with c3b0206e4c546daf8a0839e589547f6cd736f2476aa44a7ef9d666d1f63b8e81 not found: ID does not exist" May 21 18:17:35.810870 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.810819 2567 scope.go:117] "RemoveContainer" containerID="94502bbeff005d11e40b1a9914c7e33ff746e520c3517e56fcab46abedce6149" May 21 18:17:35.811076 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.811052 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94502bbeff005d11e40b1a9914c7e33ff746e520c3517e56fcab46abedce6149"} err="failed to get container status \"94502bbeff005d11e40b1a9914c7e33ff746e520c3517e56fcab46abedce6149\": rpc error: code = NotFound desc = could not find container \"94502bbeff005d11e40b1a9914c7e33ff746e520c3517e56fcab46abedce6149\": container with ID starting with 94502bbeff005d11e40b1a9914c7e33ff746e520c3517e56fcab46abedce6149 not found: ID does not exist" May 21 18:17:35.811161 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.811081 2567 scope.go:117] "RemoveContainer" containerID="66770e7794645fcdead984b097d58ca7b8068e7900c7dcfcf2c30218f5dddb41" May 21 18:17:35.811303 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.811284 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66770e7794645fcdead984b097d58ca7b8068e7900c7dcfcf2c30218f5dddb41"} err="failed to get container status \"66770e7794645fcdead984b097d58ca7b8068e7900c7dcfcf2c30218f5dddb41\": rpc error: code = NotFound desc = could not find container \"66770e7794645fcdead984b097d58ca7b8068e7900c7dcfcf2c30218f5dddb41\": container with ID starting with 66770e7794645fcdead984b097d58ca7b8068e7900c7dcfcf2c30218f5dddb41 not found: ID does not exist" May 21 18:17:35.811387 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.811303 2567 scope.go:117] "RemoveContainer" containerID="8febac3e3ee6c2eb0f3edb999c82c5805d79ce3c9e6a2a4a8632094f61e318ec" May 21 18:17:35.811566 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.811548 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 18:17:35.811691 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.811548 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8febac3e3ee6c2eb0f3edb999c82c5805d79ce3c9e6a2a4a8632094f61e318ec"} err="failed to get container status \"8febac3e3ee6c2eb0f3edb999c82c5805d79ce3c9e6a2a4a8632094f61e318ec\": rpc error: code = NotFound desc = could not find container \"8febac3e3ee6c2eb0f3edb999c82c5805d79ce3c9e6a2a4a8632094f61e318ec\": container with ID starting with 8febac3e3ee6c2eb0f3edb999c82c5805d79ce3c9e6a2a4a8632094f61e318ec not found: ID does not exist" May 21 18:17:35.811691 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.811612 2567 scope.go:117] "RemoveContainer" containerID="8b95e50f9d6657fd959bd18494b8956f3879485d6cfcfc100c342e699a50ce11" May 21 18:17:35.811852 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.811832 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b95e50f9d6657fd959bd18494b8956f3879485d6cfcfc100c342e699a50ce11"} err="failed to get container status \"8b95e50f9d6657fd959bd18494b8956f3879485d6cfcfc100c342e699a50ce11\": rpc error: code = NotFound desc = could not find container \"8b95e50f9d6657fd959bd18494b8956f3879485d6cfcfc100c342e699a50ce11\": container with ID starting with 8b95e50f9d6657fd959bd18494b8956f3879485d6cfcfc100c342e699a50ce11 not found: ID does not exist" May 21 18:17:35.811890 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.811854 2567 scope.go:117] "RemoveContainer" containerID="da88edcbd624c8cb1e4eb58c6598ff29ba3ed53af1c6c780af755399704be60c" May 21 18:17:35.811959 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.811945 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="741be498-ff65-48ba-b8c7-574c9d76766d" containerName="thanos-sidecar" May 21 18:17:35.812011 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.811962 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="741be498-ff65-48ba-b8c7-574c9d76766d" containerName="thanos-sidecar" May 21 18:17:35.812011 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.811987 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="741be498-ff65-48ba-b8c7-574c9d76766d" containerName="kube-rbac-proxy-thanos" May 21 18:17:35.812011 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.811997 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="741be498-ff65-48ba-b8c7-574c9d76766d" containerName="kube-rbac-proxy-thanos" May 21 18:17:35.812011 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.812007 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="741be498-ff65-48ba-b8c7-574c9d76766d" containerName="kube-rbac-proxy-web" May 21 18:17:35.812011 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.812013 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="741be498-ff65-48ba-b8c7-574c9d76766d" containerName="kube-rbac-proxy-web" May 21 18:17:35.812164 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.812022 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="741be498-ff65-48ba-b8c7-574c9d76766d" containerName="kube-rbac-proxy" May 21 18:17:35.812164 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.812028 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="741be498-ff65-48ba-b8c7-574c9d76766d" containerName="kube-rbac-proxy" May 21 18:17:35.812164 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.812046 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="741be498-ff65-48ba-b8c7-574c9d76766d" containerName="config-reloader" May 21 18:17:35.812164 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.812052 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="741be498-ff65-48ba-b8c7-574c9d76766d" containerName="config-reloader" May 21 18:17:35.812164 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.812058 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="741be498-ff65-48ba-b8c7-574c9d76766d" containerName="init-config-reloader" May 21 18:17:35.812164 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.812066 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="741be498-ff65-48ba-b8c7-574c9d76766d" containerName="init-config-reloader" May 21 18:17:35.812164 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.812074 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="741be498-ff65-48ba-b8c7-574c9d76766d" containerName="prometheus" May 21 18:17:35.812164 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.812082 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="741be498-ff65-48ba-b8c7-574c9d76766d" containerName="prometheus" May 21 18:17:35.812164 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.812088 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da88edcbd624c8cb1e4eb58c6598ff29ba3ed53af1c6c780af755399704be60c"} err="failed to get container status \"da88edcbd624c8cb1e4eb58c6598ff29ba3ed53af1c6c780af755399704be60c\": rpc error: code = NotFound desc = could not find container \"da88edcbd624c8cb1e4eb58c6598ff29ba3ed53af1c6c780af755399704be60c\": container with ID starting with da88edcbd624c8cb1e4eb58c6598ff29ba3ed53af1c6c780af755399704be60c not found: ID does not exist" May 21 18:17:35.812164 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.812116 2567 scope.go:117] "RemoveContainer" containerID="e1f71a478780fed2ffa72f95575ac1754b37fded78d772c32ba451aceca6c92b" May 21 18:17:35.812164 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.812151 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="741be498-ff65-48ba-b8c7-574c9d76766d" containerName="config-reloader" May 21 18:17:35.812164 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.812166 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="741be498-ff65-48ba-b8c7-574c9d76766d" containerName="prometheus" May 21 18:17:35.812671 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.812176 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="741be498-ff65-48ba-b8c7-574c9d76766d" containerName="thanos-sidecar" May 21 18:17:35.812671 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.812185 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="741be498-ff65-48ba-b8c7-574c9d76766d" containerName="kube-rbac-proxy-web" May 21 18:17:35.812671 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.812193 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="741be498-ff65-48ba-b8c7-574c9d76766d" containerName="kube-rbac-proxy-thanos" May 21 18:17:35.812671 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.812200 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="741be498-ff65-48ba-b8c7-574c9d76766d" containerName="kube-rbac-proxy" May 21 18:17:35.812671 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.812290 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1f71a478780fed2ffa72f95575ac1754b37fded78d772c32ba451aceca6c92b"} err="failed to get container status \"e1f71a478780fed2ffa72f95575ac1754b37fded78d772c32ba451aceca6c92b\": rpc error: code = NotFound desc = could not find container \"e1f71a478780fed2ffa72f95575ac1754b37fded78d772c32ba451aceca6c92b\": container with ID starting with e1f71a478780fed2ffa72f95575ac1754b37fded78d772c32ba451aceca6c92b not found: ID does not exist" May 21 18:17:35.812671 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.812309 2567 scope.go:117] "RemoveContainer" containerID="c3b0206e4c546daf8a0839e589547f6cd736f2476aa44a7ef9d666d1f63b8e81" May 21 18:17:35.812671 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.812540 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3b0206e4c546daf8a0839e589547f6cd736f2476aa44a7ef9d666d1f63b8e81"} err="failed to get container status \"c3b0206e4c546daf8a0839e589547f6cd736f2476aa44a7ef9d666d1f63b8e81\": rpc error: code = NotFound desc = could not find container \"c3b0206e4c546daf8a0839e589547f6cd736f2476aa44a7ef9d666d1f63b8e81\": container with ID starting with c3b0206e4c546daf8a0839e589547f6cd736f2476aa44a7ef9d666d1f63b8e81 not found: ID does not exist" May 21 18:17:35.812671 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.812562 2567 scope.go:117] "RemoveContainer" containerID="94502bbeff005d11e40b1a9914c7e33ff746e520c3517e56fcab46abedce6149" May 21 18:17:35.812905 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.812823 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94502bbeff005d11e40b1a9914c7e33ff746e520c3517e56fcab46abedce6149"} err="failed to get container status \"94502bbeff005d11e40b1a9914c7e33ff746e520c3517e56fcab46abedce6149\": rpc error: code = NotFound desc = could not find container \"94502bbeff005d11e40b1a9914c7e33ff746e520c3517e56fcab46abedce6149\": container with ID starting with 94502bbeff005d11e40b1a9914c7e33ff746e520c3517e56fcab46abedce6149 not found: ID does not exist" May 21 18:17:35.812905 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.812838 2567 scope.go:117] "RemoveContainer" containerID="66770e7794645fcdead984b097d58ca7b8068e7900c7dcfcf2c30218f5dddb41" May 21 18:17:35.813039 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.813024 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66770e7794645fcdead984b097d58ca7b8068e7900c7dcfcf2c30218f5dddb41"} err="failed to get container status \"66770e7794645fcdead984b097d58ca7b8068e7900c7dcfcf2c30218f5dddb41\": rpc error: code = NotFound desc = could not find container \"66770e7794645fcdead984b097d58ca7b8068e7900c7dcfcf2c30218f5dddb41\": container with ID starting with 66770e7794645fcdead984b097d58ca7b8068e7900c7dcfcf2c30218f5dddb41 not found: ID does not exist" May 21 18:17:35.813075 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.813039 2567 scope.go:117] "RemoveContainer" containerID="8febac3e3ee6c2eb0f3edb999c82c5805d79ce3c9e6a2a4a8632094f61e318ec" May 21 18:17:35.813249 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.813233 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8febac3e3ee6c2eb0f3edb999c82c5805d79ce3c9e6a2a4a8632094f61e318ec"} err="failed to get container status \"8febac3e3ee6c2eb0f3edb999c82c5805d79ce3c9e6a2a4a8632094f61e318ec\": rpc error: code = NotFound desc = could not find container \"8febac3e3ee6c2eb0f3edb999c82c5805d79ce3c9e6a2a4a8632094f61e318ec\": container with ID starting with 8febac3e3ee6c2eb0f3edb999c82c5805d79ce3c9e6a2a4a8632094f61e318ec not found: ID does not exist" May 21 18:17:35.813292 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.813249 2567 scope.go:117] "RemoveContainer" containerID="8b95e50f9d6657fd959bd18494b8956f3879485d6cfcfc100c342e699a50ce11" May 21 18:17:35.813482 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.813459 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b95e50f9d6657fd959bd18494b8956f3879485d6cfcfc100c342e699a50ce11"} err="failed to get container status \"8b95e50f9d6657fd959bd18494b8956f3879485d6cfcfc100c342e699a50ce11\": rpc error: code = NotFound desc = could not find container \"8b95e50f9d6657fd959bd18494b8956f3879485d6cfcfc100c342e699a50ce11\": container with ID starting with 8b95e50f9d6657fd959bd18494b8956f3879485d6cfcfc100c342e699a50ce11 not found: ID does not exist" May 21 18:17:35.813548 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.813485 2567 scope.go:117] "RemoveContainer" containerID="da88edcbd624c8cb1e4eb58c6598ff29ba3ed53af1c6c780af755399704be60c" May 21 18:17:35.813722 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.813705 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da88edcbd624c8cb1e4eb58c6598ff29ba3ed53af1c6c780af755399704be60c"} err="failed to get container status \"da88edcbd624c8cb1e4eb58c6598ff29ba3ed53af1c6c780af755399704be60c\": rpc error: code = NotFound desc = could not find container \"da88edcbd624c8cb1e4eb58c6598ff29ba3ed53af1c6c780af755399704be60c\": container with ID starting with da88edcbd624c8cb1e4eb58c6598ff29ba3ed53af1c6c780af755399704be60c not found: ID does not exist" May 21 18:17:35.813789 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.813724 2567 scope.go:117] "RemoveContainer" containerID="e1f71a478780fed2ffa72f95575ac1754b37fded78d772c32ba451aceca6c92b" May 21 18:17:35.813938 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.813922 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1f71a478780fed2ffa72f95575ac1754b37fded78d772c32ba451aceca6c92b"} err="failed to get container status \"e1f71a478780fed2ffa72f95575ac1754b37fded78d772c32ba451aceca6c92b\": rpc error: code = NotFound desc = could not find container \"e1f71a478780fed2ffa72f95575ac1754b37fded78d772c32ba451aceca6c92b\": container with ID starting with e1f71a478780fed2ffa72f95575ac1754b37fded78d772c32ba451aceca6c92b not found: ID does not exist" May 21 18:17:35.813983 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.813939 2567 scope.go:117] "RemoveContainer" containerID="c3b0206e4c546daf8a0839e589547f6cd736f2476aa44a7ef9d666d1f63b8e81" May 21 18:17:35.814080 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.814066 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3b0206e4c546daf8a0839e589547f6cd736f2476aa44a7ef9d666d1f63b8e81"} err="failed to get container status \"c3b0206e4c546daf8a0839e589547f6cd736f2476aa44a7ef9d666d1f63b8e81\": rpc error: code = NotFound desc = could not find container \"c3b0206e4c546daf8a0839e589547f6cd736f2476aa44a7ef9d666d1f63b8e81\": container with ID starting with c3b0206e4c546daf8a0839e589547f6cd736f2476aa44a7ef9d666d1f63b8e81 not found: ID does not exist" May 21 18:17:35.814120 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.814080 2567 scope.go:117] "RemoveContainer" containerID="94502bbeff005d11e40b1a9914c7e33ff746e520c3517e56fcab46abedce6149" May 21 18:17:35.814259 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.814240 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94502bbeff005d11e40b1a9914c7e33ff746e520c3517e56fcab46abedce6149"} err="failed to get container status \"94502bbeff005d11e40b1a9914c7e33ff746e520c3517e56fcab46abedce6149\": rpc error: code = NotFound desc = could not find container \"94502bbeff005d11e40b1a9914c7e33ff746e520c3517e56fcab46abedce6149\": container with ID starting with 94502bbeff005d11e40b1a9914c7e33ff746e520c3517e56fcab46abedce6149 not found: ID does not exist" May 21 18:17:35.814302 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.814260 2567 scope.go:117] "RemoveContainer" containerID="66770e7794645fcdead984b097d58ca7b8068e7900c7dcfcf2c30218f5dddb41" May 21 18:17:35.814462 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.814442 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66770e7794645fcdead984b097d58ca7b8068e7900c7dcfcf2c30218f5dddb41"} err="failed to get container status \"66770e7794645fcdead984b097d58ca7b8068e7900c7dcfcf2c30218f5dddb41\": rpc error: code = NotFound desc = could not find container \"66770e7794645fcdead984b097d58ca7b8068e7900c7dcfcf2c30218f5dddb41\": container with ID starting with 66770e7794645fcdead984b097d58ca7b8068e7900c7dcfcf2c30218f5dddb41 not found: ID does not exist" May 21 18:17:35.814462 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.814460 2567 scope.go:117] "RemoveContainer" containerID="8febac3e3ee6c2eb0f3edb999c82c5805d79ce3c9e6a2a4a8632094f61e318ec" May 21 18:17:35.814698 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.814677 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8febac3e3ee6c2eb0f3edb999c82c5805d79ce3c9e6a2a4a8632094f61e318ec"} err="failed to get container status \"8febac3e3ee6c2eb0f3edb999c82c5805d79ce3c9e6a2a4a8632094f61e318ec\": rpc error: code = NotFound desc = could not find container \"8febac3e3ee6c2eb0f3edb999c82c5805d79ce3c9e6a2a4a8632094f61e318ec\": container with ID starting with 8febac3e3ee6c2eb0f3edb999c82c5805d79ce3c9e6a2a4a8632094f61e318ec not found: ID does not exist" May 21 18:17:35.814698 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.814698 2567 scope.go:117] "RemoveContainer" containerID="8b95e50f9d6657fd959bd18494b8956f3879485d6cfcfc100c342e699a50ce11" May 21 18:17:35.814876 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.814859 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b95e50f9d6657fd959bd18494b8956f3879485d6cfcfc100c342e699a50ce11"} err="failed to get container status \"8b95e50f9d6657fd959bd18494b8956f3879485d6cfcfc100c342e699a50ce11\": rpc error: code = NotFound desc = could not find container \"8b95e50f9d6657fd959bd18494b8956f3879485d6cfcfc100c342e699a50ce11\": container with ID starting with 8b95e50f9d6657fd959bd18494b8956f3879485d6cfcfc100c342e699a50ce11 not found: ID does not exist" May 21 18:17:35.814927 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.814876 2567 scope.go:117] "RemoveContainer" containerID="da88edcbd624c8cb1e4eb58c6598ff29ba3ed53af1c6c780af755399704be60c" May 21 18:17:35.815057 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.815042 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da88edcbd624c8cb1e4eb58c6598ff29ba3ed53af1c6c780af755399704be60c"} err="failed to get container status \"da88edcbd624c8cb1e4eb58c6598ff29ba3ed53af1c6c780af755399704be60c\": rpc error: code = NotFound desc = could not find container \"da88edcbd624c8cb1e4eb58c6598ff29ba3ed53af1c6c780af755399704be60c\": container with ID starting with da88edcbd624c8cb1e4eb58c6598ff29ba3ed53af1c6c780af755399704be60c not found: ID does not exist" May 21 18:17:35.815057 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.815056 2567 scope.go:117] "RemoveContainer" containerID="e1f71a478780fed2ffa72f95575ac1754b37fded78d772c32ba451aceca6c92b" May 21 18:17:35.815274 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.815255 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1f71a478780fed2ffa72f95575ac1754b37fded78d772c32ba451aceca6c92b"} err="failed to get container status \"e1f71a478780fed2ffa72f95575ac1754b37fded78d772c32ba451aceca6c92b\": rpc error: code = NotFound desc = could not find container \"e1f71a478780fed2ffa72f95575ac1754b37fded78d772c32ba451aceca6c92b\": container with ID starting with e1f71a478780fed2ffa72f95575ac1754b37fded78d772c32ba451aceca6c92b not found: ID does not exist" May 21 18:17:35.815274 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.815273 2567 scope.go:117] "RemoveContainer" containerID="c3b0206e4c546daf8a0839e589547f6cd736f2476aa44a7ef9d666d1f63b8e81" May 21 18:17:35.815467 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.815449 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3b0206e4c546daf8a0839e589547f6cd736f2476aa44a7ef9d666d1f63b8e81"} err="failed to get container status \"c3b0206e4c546daf8a0839e589547f6cd736f2476aa44a7ef9d666d1f63b8e81\": rpc error: code = NotFound desc = could not find container \"c3b0206e4c546daf8a0839e589547f6cd736f2476aa44a7ef9d666d1f63b8e81\": container with ID starting with c3b0206e4c546daf8a0839e589547f6cd736f2476aa44a7ef9d666d1f63b8e81 not found: ID does not exist" May 21 18:17:35.815527 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.815468 2567 scope.go:117] "RemoveContainer" containerID="94502bbeff005d11e40b1a9914c7e33ff746e520c3517e56fcab46abedce6149" May 21 18:17:35.815682 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.815665 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94502bbeff005d11e40b1a9914c7e33ff746e520c3517e56fcab46abedce6149"} err="failed to get container status \"94502bbeff005d11e40b1a9914c7e33ff746e520c3517e56fcab46abedce6149\": rpc error: code = NotFound desc = could not find container \"94502bbeff005d11e40b1a9914c7e33ff746e520c3517e56fcab46abedce6149\": container with ID starting with 94502bbeff005d11e40b1a9914c7e33ff746e520c3517e56fcab46abedce6149 not found: ID does not exist" May 21 18:17:35.815731 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.815682 2567 scope.go:117] "RemoveContainer" containerID="66770e7794645fcdead984b097d58ca7b8068e7900c7dcfcf2c30218f5dddb41" May 21 18:17:35.815874 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.815856 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66770e7794645fcdead984b097d58ca7b8068e7900c7dcfcf2c30218f5dddb41"} err="failed to get container status \"66770e7794645fcdead984b097d58ca7b8068e7900c7dcfcf2c30218f5dddb41\": rpc error: code = NotFound desc = could not find container \"66770e7794645fcdead984b097d58ca7b8068e7900c7dcfcf2c30218f5dddb41\": container with ID starting with 66770e7794645fcdead984b097d58ca7b8068e7900c7dcfcf2c30218f5dddb41 not found: ID does not exist" May 21 18:17:35.815913 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.815875 2567 scope.go:117] "RemoveContainer" containerID="8febac3e3ee6c2eb0f3edb999c82c5805d79ce3c9e6a2a4a8632094f61e318ec" May 21 18:17:35.816082 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.816065 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8febac3e3ee6c2eb0f3edb999c82c5805d79ce3c9e6a2a4a8632094f61e318ec"} err="failed to get container status \"8febac3e3ee6c2eb0f3edb999c82c5805d79ce3c9e6a2a4a8632094f61e318ec\": rpc error: code = NotFound desc = could not find container \"8febac3e3ee6c2eb0f3edb999c82c5805d79ce3c9e6a2a4a8632094f61e318ec\": container with ID starting with 8febac3e3ee6c2eb0f3edb999c82c5805d79ce3c9e6a2a4a8632094f61e318ec not found: ID does not exist" May 21 18:17:35.816184 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.816084 2567 scope.go:117] "RemoveContainer" containerID="8b95e50f9d6657fd959bd18494b8956f3879485d6cfcfc100c342e699a50ce11" May 21 18:17:35.816277 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.816259 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b95e50f9d6657fd959bd18494b8956f3879485d6cfcfc100c342e699a50ce11"} err="failed to get container status \"8b95e50f9d6657fd959bd18494b8956f3879485d6cfcfc100c342e699a50ce11\": rpc error: code = NotFound desc = could not find container \"8b95e50f9d6657fd959bd18494b8956f3879485d6cfcfc100c342e699a50ce11\": container with ID starting with 8b95e50f9d6657fd959bd18494b8956f3879485d6cfcfc100c342e699a50ce11 not found: ID does not exist" May 21 18:17:35.816339 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.816280 2567 scope.go:117] "RemoveContainer" containerID="da88edcbd624c8cb1e4eb58c6598ff29ba3ed53af1c6c780af755399704be60c" May 21 18:17:35.816456 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.816442 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da88edcbd624c8cb1e4eb58c6598ff29ba3ed53af1c6c780af755399704be60c"} err="failed to get container status \"da88edcbd624c8cb1e4eb58c6598ff29ba3ed53af1c6c780af755399704be60c\": rpc error: code = NotFound desc = could not find container \"da88edcbd624c8cb1e4eb58c6598ff29ba3ed53af1c6c780af755399704be60c\": container with ID starting with da88edcbd624c8cb1e4eb58c6598ff29ba3ed53af1c6c780af755399704be60c not found: ID does not exist" May 21 18:17:35.816498 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.816456 2567 scope.go:117] "RemoveContainer" containerID="e1f71a478780fed2ffa72f95575ac1754b37fded78d772c32ba451aceca6c92b" May 21 18:17:35.816703 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.816685 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1f71a478780fed2ffa72f95575ac1754b37fded78d772c32ba451aceca6c92b"} err="failed to get container status \"e1f71a478780fed2ffa72f95575ac1754b37fded78d772c32ba451aceca6c92b\": rpc error: code = NotFound desc = could not find container \"e1f71a478780fed2ffa72f95575ac1754b37fded78d772c32ba451aceca6c92b\": container with ID starting with e1f71a478780fed2ffa72f95575ac1754b37fded78d772c32ba451aceca6c92b not found: ID does not exist" May 21 18:17:35.816758 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.816705 2567 scope.go:117] "RemoveContainer" containerID="c3b0206e4c546daf8a0839e589547f6cd736f2476aa44a7ef9d666d1f63b8e81" May 21 18:17:35.816905 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.816888 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3b0206e4c546daf8a0839e589547f6cd736f2476aa44a7ef9d666d1f63b8e81"} err="failed to get container status \"c3b0206e4c546daf8a0839e589547f6cd736f2476aa44a7ef9d666d1f63b8e81\": rpc error: code = NotFound desc = could not find container \"c3b0206e4c546daf8a0839e589547f6cd736f2476aa44a7ef9d666d1f63b8e81\": container with ID starting with c3b0206e4c546daf8a0839e589547f6cd736f2476aa44a7ef9d666d1f63b8e81 not found: ID does not exist" May 21 18:17:35.816950 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.816907 2567 scope.go:117] "RemoveContainer" containerID="94502bbeff005d11e40b1a9914c7e33ff746e520c3517e56fcab46abedce6149" May 21 18:17:35.817118 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.817100 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94502bbeff005d11e40b1a9914c7e33ff746e520c3517e56fcab46abedce6149"} err="failed to get container status \"94502bbeff005d11e40b1a9914c7e33ff746e520c3517e56fcab46abedce6149\": rpc error: code = NotFound desc = could not find container \"94502bbeff005d11e40b1a9914c7e33ff746e520c3517e56fcab46abedce6149\": container with ID starting with 94502bbeff005d11e40b1a9914c7e33ff746e520c3517e56fcab46abedce6149 not found: ID does not exist" May 21 18:17:35.817164 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.817118 2567 scope.go:117] "RemoveContainer" containerID="66770e7794645fcdead984b097d58ca7b8068e7900c7dcfcf2c30218f5dddb41" May 21 18:17:35.817324 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.817308 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66770e7794645fcdead984b097d58ca7b8068e7900c7dcfcf2c30218f5dddb41"} err="failed to get container status \"66770e7794645fcdead984b097d58ca7b8068e7900c7dcfcf2c30218f5dddb41\": rpc error: code = NotFound desc = could not find container \"66770e7794645fcdead984b097d58ca7b8068e7900c7dcfcf2c30218f5dddb41\": container with ID starting with 66770e7794645fcdead984b097d58ca7b8068e7900c7dcfcf2c30218f5dddb41 not found: ID does not exist" May 21 18:17:35.817376 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.817324 2567 scope.go:117] "RemoveContainer" containerID="8febac3e3ee6c2eb0f3edb999c82c5805d79ce3c9e6a2a4a8632094f61e318ec" May 21 18:17:35.817505 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.817485 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8febac3e3ee6c2eb0f3edb999c82c5805d79ce3c9e6a2a4a8632094f61e318ec"} err="failed to get container status \"8febac3e3ee6c2eb0f3edb999c82c5805d79ce3c9e6a2a4a8632094f61e318ec\": rpc error: code = NotFound desc = could not find container \"8febac3e3ee6c2eb0f3edb999c82c5805d79ce3c9e6a2a4a8632094f61e318ec\": container with ID starting with 8febac3e3ee6c2eb0f3edb999c82c5805d79ce3c9e6a2a4a8632094f61e318ec not found: ID does not exist" May 21 18:17:35.817505 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.817502 2567 scope.go:117] "RemoveContainer" containerID="8b95e50f9d6657fd959bd18494b8956f3879485d6cfcfc100c342e699a50ce11" May 21 18:17:35.817683 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.817667 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:35.817728 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.817703 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b95e50f9d6657fd959bd18494b8956f3879485d6cfcfc100c342e699a50ce11"} err="failed to get container status \"8b95e50f9d6657fd959bd18494b8956f3879485d6cfcfc100c342e699a50ce11\": rpc error: code = NotFound desc = could not find container \"8b95e50f9d6657fd959bd18494b8956f3879485d6cfcfc100c342e699a50ce11\": container with ID starting with 8b95e50f9d6657fd959bd18494b8956f3879485d6cfcfc100c342e699a50ce11 not found: ID does not exist" May 21 18:17:35.817728 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.817716 2567 scope.go:117] "RemoveContainer" containerID="da88edcbd624c8cb1e4eb58c6598ff29ba3ed53af1c6c780af755399704be60c" May 21 18:17:35.817969 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.817947 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da88edcbd624c8cb1e4eb58c6598ff29ba3ed53af1c6c780af755399704be60c"} err="failed to get container status \"da88edcbd624c8cb1e4eb58c6598ff29ba3ed53af1c6c780af755399704be60c\": rpc error: code = NotFound desc = could not find container \"da88edcbd624c8cb1e4eb58c6598ff29ba3ed53af1c6c780af755399704be60c\": container with ID starting with da88edcbd624c8cb1e4eb58c6598ff29ba3ed53af1c6c780af755399704be60c not found: ID does not exist" May 21 18:17:35.818047 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.817970 2567 scope.go:117] "RemoveContainer" containerID="e1f71a478780fed2ffa72f95575ac1754b37fded78d772c32ba451aceca6c92b" May 21 18:17:35.818225 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.818200 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1f71a478780fed2ffa72f95575ac1754b37fded78d772c32ba451aceca6c92b"} err="failed to get container status \"e1f71a478780fed2ffa72f95575ac1754b37fded78d772c32ba451aceca6c92b\": rpc error: code = NotFound desc = could not find container \"e1f71a478780fed2ffa72f95575ac1754b37fded78d772c32ba451aceca6c92b\": container with ID starting with e1f71a478780fed2ffa72f95575ac1754b37fded78d772c32ba451aceca6c92b not found: ID does not exist" May 21 18:17:35.820058 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.820039 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 21 18:17:35.820130 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.820039 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 21 18:17:35.820555 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.820535 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 21 18:17:35.820713 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.820621 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-w2gk8\"" May 21 18:17:35.820713 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.820673 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 21 18:17:35.820829 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.820744 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8f1qpsqgb01rn\"" May 21 18:17:35.820997 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.820981 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 21 18:17:35.821079 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.821059 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 21 18:17:35.821135 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.821077 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 21 18:17:35.821135 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.821067 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 21 18:17:35.821350 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.821337 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 21 18:17:35.821741 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.821719 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 21 18:17:35.822958 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.822939 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 21 18:17:35.831934 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.830378 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 21 18:17:35.831934 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.830620 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 18:17:35.939201 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.939121 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f1cb0d4f-775b-4171-b394-75b5fee241ec-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:35.939201 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.939156 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f1cb0d4f-775b-4171-b394-75b5fee241ec-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:35.939201 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.939178 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f1cb0d4f-775b-4171-b394-75b5fee241ec-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:35.939418 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.939228 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1cb0d4f-775b-4171-b394-75b5fee241ec-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:35.939418 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.939281 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqcsn\" (UniqueName: \"kubernetes.io/projected/f1cb0d4f-775b-4171-b394-75b5fee241ec-kube-api-access-kqcsn\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:35.939418 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.939301 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1cb0d4f-775b-4171-b394-75b5fee241ec-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:35.939418 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.939322 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f1cb0d4f-775b-4171-b394-75b5fee241ec-config\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:35.939418 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.939351 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f1cb0d4f-775b-4171-b394-75b5fee241ec-config-out\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:35.939418 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.939366 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f1cb0d4f-775b-4171-b394-75b5fee241ec-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:35.939769 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.939416 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f1cb0d4f-775b-4171-b394-75b5fee241ec-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:35.939769 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.939473 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f1cb0d4f-775b-4171-b394-75b5fee241ec-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:35.939769 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.939508 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f1cb0d4f-775b-4171-b394-75b5fee241ec-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:35.939769 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.939546 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f1cb0d4f-775b-4171-b394-75b5fee241ec-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:35.939769 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.939598 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f1cb0d4f-775b-4171-b394-75b5fee241ec-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:35.939769 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.939632 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f1cb0d4f-775b-4171-b394-75b5fee241ec-web-config\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:35.939769 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.939667 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1cb0d4f-775b-4171-b394-75b5fee241ec-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:35.939769 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.939684 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f1cb0d4f-775b-4171-b394-75b5fee241ec-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:35.939769 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.939699 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1cb0d4f-775b-4171-b394-75b5fee241ec-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:35.984734 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:35.984711 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="741be498-ff65-48ba-b8c7-574c9d76766d" path="/var/lib/kubelet/pods/741be498-ff65-48ba-b8c7-574c9d76766d/volumes" May 21 18:17:36.040715 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:36.040687 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1cb0d4f-775b-4171-b394-75b5fee241ec-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:36.040828 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:36.040721 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kqcsn\" (UniqueName: \"kubernetes.io/projected/f1cb0d4f-775b-4171-b394-75b5fee241ec-kube-api-access-kqcsn\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:36.040828 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:36.040741 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1cb0d4f-775b-4171-b394-75b5fee241ec-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:36.040828 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:36.040770 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f1cb0d4f-775b-4171-b394-75b5fee241ec-config\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:36.040828 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:36.040807 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f1cb0d4f-775b-4171-b394-75b5fee241ec-config-out\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:36.041031 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:36.040829 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f1cb0d4f-775b-4171-b394-75b5fee241ec-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:36.041031 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:36.040855 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f1cb0d4f-775b-4171-b394-75b5fee241ec-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:36.041031 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:36.040883 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f1cb0d4f-775b-4171-b394-75b5fee241ec-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:36.041031 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:36.040906 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f1cb0d4f-775b-4171-b394-75b5fee241ec-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:36.041229 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:36.041108 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f1cb0d4f-775b-4171-b394-75b5fee241ec-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:36.041229 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:36.041151 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f1cb0d4f-775b-4171-b394-75b5fee241ec-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:36.041229 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:36.041186 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f1cb0d4f-775b-4171-b394-75b5fee241ec-web-config\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:36.041229 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:36.041224 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1cb0d4f-775b-4171-b394-75b5fee241ec-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:36.041400 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:36.041251 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f1cb0d4f-775b-4171-b394-75b5fee241ec-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:36.041400 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:36.041277 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1cb0d4f-775b-4171-b394-75b5fee241ec-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:36.041400 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:36.041308 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f1cb0d4f-775b-4171-b394-75b5fee241ec-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:36.041400 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:36.041352 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f1cb0d4f-775b-4171-b394-75b5fee241ec-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:36.041400 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:36.041379 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f1cb0d4f-775b-4171-b394-75b5fee241ec-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:36.041650 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:36.041474 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1cb0d4f-775b-4171-b394-75b5fee241ec-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:36.043908 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:36.041980 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f1cb0d4f-775b-4171-b394-75b5fee241ec-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:36.043908 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:36.042380 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1cb0d4f-775b-4171-b394-75b5fee241ec-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:36.043908 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:36.042664 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1cb0d4f-775b-4171-b394-75b5fee241ec-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:36.043908 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:36.043340 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1cb0d4f-775b-4171-b394-75b5fee241ec-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:36.044165 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:36.043950 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f1cb0d4f-775b-4171-b394-75b5fee241ec-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:36.045093 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:36.045041 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f1cb0d4f-775b-4171-b394-75b5fee241ec-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:36.045369 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:36.045303 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f1cb0d4f-775b-4171-b394-75b5fee241ec-config-out\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:36.045465 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:36.045369 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f1cb0d4f-775b-4171-b394-75b5fee241ec-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:36.045996 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:36.045701 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f1cb0d4f-775b-4171-b394-75b5fee241ec-web-config\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:36.045996 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:36.045735 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f1cb0d4f-775b-4171-b394-75b5fee241ec-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:36.045996 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:36.045790 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f1cb0d4f-775b-4171-b394-75b5fee241ec-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:36.045996 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:36.045937 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f1cb0d4f-775b-4171-b394-75b5fee241ec-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:36.046172 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:36.046001 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f1cb0d4f-775b-4171-b394-75b5fee241ec-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:36.046172 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:36.046083 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f1cb0d4f-775b-4171-b394-75b5fee241ec-config\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:36.047006 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:36.046986 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f1cb0d4f-775b-4171-b394-75b5fee241ec-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:36.047160 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:36.047141 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f1cb0d4f-775b-4171-b394-75b5fee241ec-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:36.049124 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:36.049106 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqcsn\" (UniqueName: \"kubernetes.io/projected/f1cb0d4f-775b-4171-b394-75b5fee241ec-kube-api-access-kqcsn\") pod \"prometheus-k8s-0\" (UID: \"f1cb0d4f-775b-4171-b394-75b5fee241ec\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:36.133222 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:36.133192 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 18:17:36.281275 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:36.281252 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 18:17:36.283809 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:17:36.283779 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1cb0d4f_775b_4171_b394_75b5fee241ec.slice/crio-1dda17e573e5f6af35e6d866f24c390cb1959f7464fc261836f02a119ab5c253 WatchSource:0}: Error finding container 1dda17e573e5f6af35e6d866f24c390cb1959f7464fc261836f02a119ab5c253: Status 404 returned error can't find the container with id 1dda17e573e5f6af35e6d866f24c390cb1959f7464fc261836f02a119ab5c253 May 21 18:17:36.765446 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:36.765417 2567 generic.go:358] "Generic (PLEG): container finished" podID="f1cb0d4f-775b-4171-b394-75b5fee241ec" containerID="bf7464d8b9fc933543a7c5f5d4e0a4f75fadc1dae95697b3240ce624a2ffa3da" exitCode=0 May 21 18:17:36.765856 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:36.765489 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1cb0d4f-775b-4171-b394-75b5fee241ec","Type":"ContainerDied","Data":"bf7464d8b9fc933543a7c5f5d4e0a4f75fadc1dae95697b3240ce624a2ffa3da"} May 21 18:17:36.765856 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:36.765516 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1cb0d4f-775b-4171-b394-75b5fee241ec","Type":"ContainerStarted","Data":"1dda17e573e5f6af35e6d866f24c390cb1959f7464fc261836f02a119ab5c253"} May 21 18:17:37.773181 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:37.773138 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1cb0d4f-775b-4171-b394-75b5fee241ec","Type":"ContainerStarted","Data":"9b1b4c3ba819a7322f0169ededbf1c40699bb5438e65161ac80f09980aa86a47"} May 21 18:17:37.773181 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:37.773186 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1cb0d4f-775b-4171-b394-75b5fee241ec","Type":"ContainerStarted","Data":"1bf4fad831921815cfbeeee50940d6d9e6ff1a78c70e0ee7afaa137cbe3d785a"} May 21 18:17:37.773613 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:37.773199 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1cb0d4f-775b-4171-b394-75b5fee241ec","Type":"ContainerStarted","Data":"a347a03526f05da9eaa10465ec9449db5476881dd7ac799358230b728667aced"} May 21 18:17:37.773613 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:37.773212 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1cb0d4f-775b-4171-b394-75b5fee241ec","Type":"ContainerStarted","Data":"5c92550407b0f20e3f325d084dc3e30c94963a23f682ed3d65a3be3f9ed2528c"} May 21 18:17:37.773613 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:37.773223 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1cb0d4f-775b-4171-b394-75b5fee241ec","Type":"ContainerStarted","Data":"85799788b8c54306cfde4d95e26428b37144148121b22ab3d0a5a5cadd4777ce"} May 21 18:17:37.773613 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:37.773235 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f1cb0d4f-775b-4171-b394-75b5fee241ec","Type":"ContainerStarted","Data":"ba3ff82ac0e24bf246eb1de20a0a3563a8b19d3b3c9b1cd9ff96e32c775deb59"} May 21 18:17:37.801101 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:37.801057 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.8010437059999997 podStartE2EDuration="2.801043706s" podCreationTimestamp="2026-05-21 18:17:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:17:37.798722585 +0000 UTC m=+262.384209020" watchObservedRunningTime="2026-05-21 18:17:37.801043706 +0000 UTC m=+262.386530140" May 21 18:17:41.133694 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:17:41.133643 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 21 18:18:15.936614 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:18:15.936558 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2n5jr_d9537e64-5ba3-4910-998c-e9d3deb97929/ovn-acl-logging/0.log" May 21 18:18:15.936614 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:18:15.936595 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2n5jr_d9537e64-5ba3-4910-998c-e9d3deb97929/ovn-acl-logging/0.log" May 21 18:18:15.943522 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:18:15.943500 2567 kubelet.go:1628] "Image garbage collection succeeded" May 21 18:18:36.133645 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:18:36.133605 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 21 18:18:36.149532 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:18:36.149506 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 21 18:18:36.976398 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:18:36.976370 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 21 18:20:19.342254 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:19.342216 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-bl9kr"] May 21 18:20:19.345480 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:19.345458 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-bl9kr" May 21 18:20:19.348924 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:19.348904 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 21 18:20:19.349771 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:19.349755 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-wxjpt\"" May 21 18:20:19.349827 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:19.349789 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 21 18:20:19.361685 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:19.361662 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-bl9kr"] May 21 18:20:19.450326 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:19.450294 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/22fef043-e039-453e-bd31-c3710b0debcc-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-bl9kr\" (UID: \"22fef043-e039-453e-bd31-c3710b0debcc\") " pod="cert-manager/cert-manager-cainjector-68b757865b-bl9kr" May 21 18:20:19.450537 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:19.450340 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6d8v\" (UniqueName: \"kubernetes.io/projected/22fef043-e039-453e-bd31-c3710b0debcc-kube-api-access-z6d8v\") pod \"cert-manager-cainjector-68b757865b-bl9kr\" (UID: \"22fef043-e039-453e-bd31-c3710b0debcc\") " pod="cert-manager/cert-manager-cainjector-68b757865b-bl9kr" May 21 18:20:19.551065 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:19.551032 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z6d8v\" (UniqueName: \"kubernetes.io/projected/22fef043-e039-453e-bd31-c3710b0debcc-kube-api-access-z6d8v\") pod \"cert-manager-cainjector-68b757865b-bl9kr\" (UID: \"22fef043-e039-453e-bd31-c3710b0debcc\") " pod="cert-manager/cert-manager-cainjector-68b757865b-bl9kr" May 21 18:20:19.551214 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:19.551133 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/22fef043-e039-453e-bd31-c3710b0debcc-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-bl9kr\" (UID: \"22fef043-e039-453e-bd31-c3710b0debcc\") " pod="cert-manager/cert-manager-cainjector-68b757865b-bl9kr" May 21 18:20:19.559764 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:19.559735 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/22fef043-e039-453e-bd31-c3710b0debcc-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-bl9kr\" (UID: \"22fef043-e039-453e-bd31-c3710b0debcc\") " pod="cert-manager/cert-manager-cainjector-68b757865b-bl9kr" May 21 18:20:19.559764 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:19.559747 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6d8v\" (UniqueName: \"kubernetes.io/projected/22fef043-e039-453e-bd31-c3710b0debcc-kube-api-access-z6d8v\") pod \"cert-manager-cainjector-68b757865b-bl9kr\" (UID: \"22fef043-e039-453e-bd31-c3710b0debcc\") " pod="cert-manager/cert-manager-cainjector-68b757865b-bl9kr" May 21 18:20:19.667482 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:19.667404 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-bl9kr" May 21 18:20:19.796606 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:19.796557 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-bl9kr"] May 21 18:20:19.799497 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:20:19.799453 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod22fef043_e039_453e_bd31_c3710b0debcc.slice/crio-e917033120a5c3ffde5a4a2fde9a2d5d530e226cf11a1da5ffc216d6ec9d9955 WatchSource:0}: Error finding container e917033120a5c3ffde5a4a2fde9a2d5d530e226cf11a1da5ffc216d6ec9d9955: Status 404 returned error can't find the container with id e917033120a5c3ffde5a4a2fde9a2d5d530e226cf11a1da5ffc216d6ec9d9955 May 21 18:20:19.801151 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:19.801134 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 18:20:20.265635 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:20.265598 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-bl9kr" event={"ID":"22fef043-e039-453e-bd31-c3710b0debcc","Type":"ContainerStarted","Data":"e917033120a5c3ffde5a4a2fde9a2d5d530e226cf11a1da5ffc216d6ec9d9955"} May 21 18:20:23.277777 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:23.277739 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-bl9kr" event={"ID":"22fef043-e039-453e-bd31-c3710b0debcc","Type":"ContainerStarted","Data":"43a7d830491f4423df50d472eba3da8ddb4bb2f6210990785e93a10821b045a3"} May 21 18:20:23.292699 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:23.292651 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-bl9kr" podStartSLOduration=1.036235516 podStartE2EDuration="4.292636718s" podCreationTimestamp="2026-05-21 18:20:19 +0000 UTC" firstStartedPulling="2026-05-21 18:20:19.801258577 +0000 UTC m=+424.386744991" lastFinishedPulling="2026-05-21 18:20:23.05765977 +0000 UTC m=+427.643146193" observedRunningTime="2026-05-21 18:20:23.291917572 +0000 UTC m=+427.877403999" watchObservedRunningTime="2026-05-21 18:20:23.292636718 +0000 UTC m=+427.878123154" May 21 18:20:31.819819 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:31.819739 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-fnhqx"] May 21 18:20:31.823104 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:31.823088 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-fnhqx" May 21 18:20:31.825687 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:31.825662 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 21 18:20:31.826517 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:31.826501 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 21 18:20:31.826609 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:31.826513 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-f79x6\"" May 21 18:20:31.832130 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:31.832109 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-fnhqx"] May 21 18:20:31.964889 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:31.964859 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a18ec362-c02f-4d5d-ac10-278c58ffdd62-tmp\") pod \"openshift-lws-operator-bfc7f696d-fnhqx\" (UID: \"a18ec362-c02f-4d5d-ac10-278c58ffdd62\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-fnhqx" May 21 18:20:31.965054 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:31.964897 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5hp7\" (UniqueName: \"kubernetes.io/projected/a18ec362-c02f-4d5d-ac10-278c58ffdd62-kube-api-access-d5hp7\") pod \"openshift-lws-operator-bfc7f696d-fnhqx\" (UID: \"a18ec362-c02f-4d5d-ac10-278c58ffdd62\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-fnhqx" May 21 18:20:32.066359 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:32.066324 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a18ec362-c02f-4d5d-ac10-278c58ffdd62-tmp\") pod \"openshift-lws-operator-bfc7f696d-fnhqx\" (UID: \"a18ec362-c02f-4d5d-ac10-278c58ffdd62\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-fnhqx" May 21 18:20:32.066359 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:32.066358 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d5hp7\" (UniqueName: \"kubernetes.io/projected/a18ec362-c02f-4d5d-ac10-278c58ffdd62-kube-api-access-d5hp7\") pod \"openshift-lws-operator-bfc7f696d-fnhqx\" (UID: \"a18ec362-c02f-4d5d-ac10-278c58ffdd62\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-fnhqx" May 21 18:20:32.066704 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:32.066685 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a18ec362-c02f-4d5d-ac10-278c58ffdd62-tmp\") pod \"openshift-lws-operator-bfc7f696d-fnhqx\" (UID: \"a18ec362-c02f-4d5d-ac10-278c58ffdd62\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-fnhqx" May 21 18:20:32.074613 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:32.074525 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5hp7\" (UniqueName: \"kubernetes.io/projected/a18ec362-c02f-4d5d-ac10-278c58ffdd62-kube-api-access-d5hp7\") pod \"openshift-lws-operator-bfc7f696d-fnhqx\" (UID: \"a18ec362-c02f-4d5d-ac10-278c58ffdd62\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-fnhqx" May 21 18:20:32.131977 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:32.131953 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-fnhqx" May 21 18:20:32.257992 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:32.257964 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-fnhqx"] May 21 18:20:32.260670 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:20:32.260622 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda18ec362_c02f_4d5d_ac10_278c58ffdd62.slice/crio-6c63c2676dc2dce5f9646c9df1c2089f936a613d6f02389234b1b0508ea3e36d WatchSource:0}: Error finding container 6c63c2676dc2dce5f9646c9df1c2089f936a613d6f02389234b1b0508ea3e36d: Status 404 returned error can't find the container with id 6c63c2676dc2dce5f9646c9df1c2089f936a613d6f02389234b1b0508ea3e36d May 21 18:20:32.306595 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:32.306545 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-fnhqx" event={"ID":"a18ec362-c02f-4d5d-ac10-278c58ffdd62","Type":"ContainerStarted","Data":"6c63c2676dc2dce5f9646c9df1c2089f936a613d6f02389234b1b0508ea3e36d"} May 21 18:20:35.317712 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:35.317671 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-fnhqx" event={"ID":"a18ec362-c02f-4d5d-ac10-278c58ffdd62","Type":"ContainerStarted","Data":"f40a43236aaf56afbe6cda18e5dcffd78b85c61b2213224d4b133cf964764baf"} May 21 18:20:35.333425 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:35.333377 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-fnhqx" podStartSLOduration=1.6659175510000002 podStartE2EDuration="4.333363349s" podCreationTimestamp="2026-05-21 18:20:31 +0000 UTC" firstStartedPulling="2026-05-21 18:20:32.26190568 +0000 UTC m=+436.847392094" lastFinishedPulling="2026-05-21 18:20:34.929351475 +0000 UTC m=+439.514837892" observedRunningTime="2026-05-21 18:20:35.332498008 +0000 UTC m=+439.917984443" watchObservedRunningTime="2026-05-21 18:20:35.333363349 +0000 UTC m=+439.918849785" May 21 18:20:54.824620 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:54.824587 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-hl4lt"] May 21 18:20:54.832094 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:54.832071 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-hl4lt" May 21 18:20:54.835021 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:54.834985 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 21 18:20:54.835397 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:54.835380 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 21 18:20:54.835498 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:54.835412 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 21 18:20:54.835498 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:54.835467 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xnk8k\"" May 21 18:20:54.835719 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:54.835704 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 21 18:20:54.856800 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:54.856773 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fe13060e-f481-41ce-9560-0d2cbd60ef10-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5948ffb7d5-hl4lt\" (UID: \"fe13060e-f481-41ce-9560-0d2cbd60ef10\") " pod="opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-hl4lt" May 21 18:20:54.856906 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:54.856809 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe13060e-f481-41ce-9560-0d2cbd60ef10-webhook-cert\") pod \"opendatahub-operator-controller-manager-5948ffb7d5-hl4lt\" (UID: \"fe13060e-f481-41ce-9560-0d2cbd60ef10\") " pod="opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-hl4lt" May 21 18:20:54.856906 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:54.856842 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2zz5\" (UniqueName: \"kubernetes.io/projected/fe13060e-f481-41ce-9560-0d2cbd60ef10-kube-api-access-m2zz5\") pod \"opendatahub-operator-controller-manager-5948ffb7d5-hl4lt\" (UID: \"fe13060e-f481-41ce-9560-0d2cbd60ef10\") " pod="opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-hl4lt" May 21 18:20:54.861342 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:54.861316 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-hl4lt"] May 21 18:20:54.958162 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:54.958126 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m2zz5\" (UniqueName: \"kubernetes.io/projected/fe13060e-f481-41ce-9560-0d2cbd60ef10-kube-api-access-m2zz5\") pod \"opendatahub-operator-controller-manager-5948ffb7d5-hl4lt\" (UID: \"fe13060e-f481-41ce-9560-0d2cbd60ef10\") " pod="opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-hl4lt" May 21 18:20:54.958337 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:54.958199 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fe13060e-f481-41ce-9560-0d2cbd60ef10-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5948ffb7d5-hl4lt\" (UID: \"fe13060e-f481-41ce-9560-0d2cbd60ef10\") " pod="opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-hl4lt" May 21 18:20:54.958337 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:54.958229 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe13060e-f481-41ce-9560-0d2cbd60ef10-webhook-cert\") pod \"opendatahub-operator-controller-manager-5948ffb7d5-hl4lt\" (UID: \"fe13060e-f481-41ce-9560-0d2cbd60ef10\") " pod="opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-hl4lt" May 21 18:20:54.960747 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:54.960725 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe13060e-f481-41ce-9560-0d2cbd60ef10-webhook-cert\") pod \"opendatahub-operator-controller-manager-5948ffb7d5-hl4lt\" (UID: \"fe13060e-f481-41ce-9560-0d2cbd60ef10\") " pod="opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-hl4lt" May 21 18:20:54.960869 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:54.960745 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fe13060e-f481-41ce-9560-0d2cbd60ef10-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5948ffb7d5-hl4lt\" (UID: \"fe13060e-f481-41ce-9560-0d2cbd60ef10\") " pod="opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-hl4lt" May 21 18:20:54.966756 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:54.966732 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2zz5\" (UniqueName: \"kubernetes.io/projected/fe13060e-f481-41ce-9560-0d2cbd60ef10-kube-api-access-m2zz5\") pod \"opendatahub-operator-controller-manager-5948ffb7d5-hl4lt\" (UID: \"fe13060e-f481-41ce-9560-0d2cbd60ef10\") " pod="opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-hl4lt" May 21 18:20:55.142243 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:55.142132 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-hl4lt" May 21 18:20:55.276261 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:55.276233 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-hl4lt"] May 21 18:20:55.278750 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:20:55.278721 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe13060e_f481_41ce_9560_0d2cbd60ef10.slice/crio-56e96acfe27776b144c17541f791f02ea1e88a5dd3905e5f189bc57137189df5 WatchSource:0}: Error finding container 56e96acfe27776b144c17541f791f02ea1e88a5dd3905e5f189bc57137189df5: Status 404 returned error can't find the container with id 56e96acfe27776b144c17541f791f02ea1e88a5dd3905e5f189bc57137189df5 May 21 18:20:55.376828 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:55.376791 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-hl4lt" event={"ID":"fe13060e-f481-41ce-9560-0d2cbd60ef10","Type":"ContainerStarted","Data":"56e96acfe27776b144c17541f791f02ea1e88a5dd3905e5f189bc57137189df5"} May 21 18:20:58.389190 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:58.389154 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-hl4lt" event={"ID":"fe13060e-f481-41ce-9560-0d2cbd60ef10","Type":"ContainerStarted","Data":"bdb0f31dfde91e59abb76b57dce56a7b6f64be40d727bb479f2ca37d522ef9af"} May 21 18:20:58.389604 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:58.389294 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-hl4lt" May 21 18:20:58.428255 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:20:58.428202 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-hl4lt" podStartSLOduration=1.977071321 podStartE2EDuration="4.428188779s" podCreationTimestamp="2026-05-21 18:20:54 +0000 UTC" firstStartedPulling="2026-05-21 18:20:55.280387194 +0000 UTC m=+459.865873608" lastFinishedPulling="2026-05-21 18:20:57.731504653 +0000 UTC m=+462.316991066" observedRunningTime="2026-05-21 18:20:58.427097114 +0000 UTC m=+463.012583549" watchObservedRunningTime="2026-05-21 18:20:58.428188779 +0000 UTC m=+463.013675213" May 21 18:21:00.510960 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:00.510924 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-99f48c84-ghw2w"] May 21 18:21:00.513521 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:00.513497 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-99f48c84-ghw2w" May 21 18:21:00.517096 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:00.517073 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 21 18:21:00.517210 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:00.517114 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 21 18:21:00.517210 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:00.517119 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 21 18:21:00.517315 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:00.517119 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-vwdrg\"" May 21 18:21:00.524688 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:00.524666 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-99f48c84-ghw2w"] May 21 18:21:00.614406 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:00.614360 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23c47092-f3fb-4e8e-a980-0f3bbcd4fb04-cert\") pod \"lws-controller-manager-99f48c84-ghw2w\" (UID: \"23c47092-f3fb-4e8e-a980-0f3bbcd4fb04\") " pod="openshift-lws-operator/lws-controller-manager-99f48c84-ghw2w" May 21 18:21:00.614406 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:00.614415 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/23c47092-f3fb-4e8e-a980-0f3bbcd4fb04-metrics-cert\") pod \"lws-controller-manager-99f48c84-ghw2w\" (UID: \"23c47092-f3fb-4e8e-a980-0f3bbcd4fb04\") " pod="openshift-lws-operator/lws-controller-manager-99f48c84-ghw2w" May 21 18:21:00.614651 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:00.614481 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/23c47092-f3fb-4e8e-a980-0f3bbcd4fb04-manager-config\") pod \"lws-controller-manager-99f48c84-ghw2w\" (UID: \"23c47092-f3fb-4e8e-a980-0f3bbcd4fb04\") " pod="openshift-lws-operator/lws-controller-manager-99f48c84-ghw2w" May 21 18:21:00.614651 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:00.614525 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jklz\" (UniqueName: \"kubernetes.io/projected/23c47092-f3fb-4e8e-a980-0f3bbcd4fb04-kube-api-access-6jklz\") pod \"lws-controller-manager-99f48c84-ghw2w\" (UID: \"23c47092-f3fb-4e8e-a980-0f3bbcd4fb04\") " pod="openshift-lws-operator/lws-controller-manager-99f48c84-ghw2w" May 21 18:21:00.715155 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:00.715109 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23c47092-f3fb-4e8e-a980-0f3bbcd4fb04-cert\") pod \"lws-controller-manager-99f48c84-ghw2w\" (UID: \"23c47092-f3fb-4e8e-a980-0f3bbcd4fb04\") " pod="openshift-lws-operator/lws-controller-manager-99f48c84-ghw2w" May 21 18:21:00.715316 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:00.715171 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/23c47092-f3fb-4e8e-a980-0f3bbcd4fb04-metrics-cert\") pod \"lws-controller-manager-99f48c84-ghw2w\" (UID: \"23c47092-f3fb-4e8e-a980-0f3bbcd4fb04\") " pod="openshift-lws-operator/lws-controller-manager-99f48c84-ghw2w" May 21 18:21:00.715316 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:00.715220 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/23c47092-f3fb-4e8e-a980-0f3bbcd4fb04-manager-config\") pod \"lws-controller-manager-99f48c84-ghw2w\" (UID: \"23c47092-f3fb-4e8e-a980-0f3bbcd4fb04\") " pod="openshift-lws-operator/lws-controller-manager-99f48c84-ghw2w" May 21 18:21:00.715316 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:00.715254 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6jklz\" (UniqueName: \"kubernetes.io/projected/23c47092-f3fb-4e8e-a980-0f3bbcd4fb04-kube-api-access-6jklz\") pod \"lws-controller-manager-99f48c84-ghw2w\" (UID: \"23c47092-f3fb-4e8e-a980-0f3bbcd4fb04\") " pod="openshift-lws-operator/lws-controller-manager-99f48c84-ghw2w" May 21 18:21:00.715881 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:00.715857 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/23c47092-f3fb-4e8e-a980-0f3bbcd4fb04-manager-config\") pod \"lws-controller-manager-99f48c84-ghw2w\" (UID: \"23c47092-f3fb-4e8e-a980-0f3bbcd4fb04\") " pod="openshift-lws-operator/lws-controller-manager-99f48c84-ghw2w" May 21 18:21:00.717732 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:00.717707 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/23c47092-f3fb-4e8e-a980-0f3bbcd4fb04-metrics-cert\") pod \"lws-controller-manager-99f48c84-ghw2w\" (UID: \"23c47092-f3fb-4e8e-a980-0f3bbcd4fb04\") " pod="openshift-lws-operator/lws-controller-manager-99f48c84-ghw2w" May 21 18:21:00.717824 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:00.717707 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23c47092-f3fb-4e8e-a980-0f3bbcd4fb04-cert\") pod \"lws-controller-manager-99f48c84-ghw2w\" (UID: \"23c47092-f3fb-4e8e-a980-0f3bbcd4fb04\") " pod="openshift-lws-operator/lws-controller-manager-99f48c84-ghw2w" May 21 18:21:00.725306 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:00.725286 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jklz\" (UniqueName: \"kubernetes.io/projected/23c47092-f3fb-4e8e-a980-0f3bbcd4fb04-kube-api-access-6jklz\") pod \"lws-controller-manager-99f48c84-ghw2w\" (UID: \"23c47092-f3fb-4e8e-a980-0f3bbcd4fb04\") " pod="openshift-lws-operator/lws-controller-manager-99f48c84-ghw2w" May 21 18:21:00.824846 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:00.824744 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-99f48c84-ghw2w" May 21 18:21:00.953121 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:00.953096 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-99f48c84-ghw2w"] May 21 18:21:00.954888 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:21:00.954867 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23c47092_f3fb_4e8e_a980_0f3bbcd4fb04.slice/crio-b499c9a06fd783a151fe1e332eaa5c1ed96c8636812c6bc2e4136b39e38a677e WatchSource:0}: Error finding container b499c9a06fd783a151fe1e332eaa5c1ed96c8636812c6bc2e4136b39e38a677e: Status 404 returned error can't find the container with id b499c9a06fd783a151fe1e332eaa5c1ed96c8636812c6bc2e4136b39e38a677e May 21 18:21:01.402784 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:01.402746 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-99f48c84-ghw2w" event={"ID":"23c47092-f3fb-4e8e-a980-0f3bbcd4fb04","Type":"ContainerStarted","Data":"b499c9a06fd783a151fe1e332eaa5c1ed96c8636812c6bc2e4136b39e38a677e"} May 21 18:21:08.428835 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:08.428797 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-99f48c84-ghw2w" event={"ID":"23c47092-f3fb-4e8e-a980-0f3bbcd4fb04","Type":"ContainerStarted","Data":"c1428041d8d56a2497a4b1a874cdae7d5ae34a738c8b3b52e1c5eb9c2ccd7465"} May 21 18:21:08.429249 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:08.429003 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-99f48c84-ghw2w" May 21 18:21:08.447133 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:08.447090 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-99f48c84-ghw2w" podStartSLOduration=1.497822158 podStartE2EDuration="8.447077119s" podCreationTimestamp="2026-05-21 18:21:00 +0000 UTC" firstStartedPulling="2026-05-21 18:21:00.956669521 +0000 UTC m=+465.542155938" lastFinishedPulling="2026-05-21 18:21:07.905924467 +0000 UTC m=+472.491410899" observedRunningTime="2026-05-21 18:21:08.445023309 +0000 UTC m=+473.030509757" watchObservedRunningTime="2026-05-21 18:21:08.447077119 +0000 UTC m=+473.032563553" May 21 18:21:09.394966 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:09.394936 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-hl4lt" May 21 18:21:19.434526 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:19.434495 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-99f48c84-ghw2w" May 21 18:21:23.162956 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:23.162926 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-78678676dd-qcc86"] May 21 18:21:23.165368 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:23.165347 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-78678676dd-qcc86" May 21 18:21:23.168447 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:23.168425 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 21 18:21:23.168761 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:23.168744 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 21 18:21:23.169304 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:23.169286 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-d4zw6\"" May 21 18:21:23.169375 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:23.169311 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 21 18:21:23.170929 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:23.170902 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 21 18:21:23.243600 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:23.243552 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-78678676dd-qcc86"] May 21 18:21:23.310369 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:23.310334 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwxdr\" (UniqueName: \"kubernetes.io/projected/b5f8c113-1f81-4e61-9e42-62160932379b-kube-api-access-gwxdr\") pod \"kube-auth-proxy-78678676dd-qcc86\" (UID: \"b5f8c113-1f81-4e61-9e42-62160932379b\") " pod="openshift-ingress/kube-auth-proxy-78678676dd-qcc86" May 21 18:21:23.310555 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:23.310378 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5f8c113-1f81-4e61-9e42-62160932379b-tmp\") pod \"kube-auth-proxy-78678676dd-qcc86\" (UID: \"b5f8c113-1f81-4e61-9e42-62160932379b\") " pod="openshift-ingress/kube-auth-proxy-78678676dd-qcc86" May 21 18:21:23.310555 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:23.310402 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5f8c113-1f81-4e61-9e42-62160932379b-tls-certs\") pod \"kube-auth-proxy-78678676dd-qcc86\" (UID: \"b5f8c113-1f81-4e61-9e42-62160932379b\") " pod="openshift-ingress/kube-auth-proxy-78678676dd-qcc86" May 21 18:21:23.410895 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:23.410858 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5f8c113-1f81-4e61-9e42-62160932379b-tls-certs\") pod \"kube-auth-proxy-78678676dd-qcc86\" (UID: \"b5f8c113-1f81-4e61-9e42-62160932379b\") " pod="openshift-ingress/kube-auth-proxy-78678676dd-qcc86" May 21 18:21:23.411065 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:23.410936 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwxdr\" (UniqueName: \"kubernetes.io/projected/b5f8c113-1f81-4e61-9e42-62160932379b-kube-api-access-gwxdr\") pod \"kube-auth-proxy-78678676dd-qcc86\" (UID: \"b5f8c113-1f81-4e61-9e42-62160932379b\") " pod="openshift-ingress/kube-auth-proxy-78678676dd-qcc86" May 21 18:21:23.411065 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:23.410965 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5f8c113-1f81-4e61-9e42-62160932379b-tmp\") pod \"kube-auth-proxy-78678676dd-qcc86\" (UID: \"b5f8c113-1f81-4e61-9e42-62160932379b\") " pod="openshift-ingress/kube-auth-proxy-78678676dd-qcc86" May 21 18:21:23.411065 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:21:23.411004 2567 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found May 21 18:21:23.411161 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:21:23.411077 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5f8c113-1f81-4e61-9e42-62160932379b-tls-certs podName:b5f8c113-1f81-4e61-9e42-62160932379b nodeName:}" failed. No retries permitted until 2026-05-21 18:21:23.911061342 +0000 UTC m=+488.496547760 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/b5f8c113-1f81-4e61-9e42-62160932379b-tls-certs") pod "kube-auth-proxy-78678676dd-qcc86" (UID: "b5f8c113-1f81-4e61-9e42-62160932379b") : secret "kube-auth-proxy-tls" not found May 21 18:21:23.413184 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:23.413140 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5f8c113-1f81-4e61-9e42-62160932379b-tmp\") pod \"kube-auth-proxy-78678676dd-qcc86\" (UID: \"b5f8c113-1f81-4e61-9e42-62160932379b\") " pod="openshift-ingress/kube-auth-proxy-78678676dd-qcc86" May 21 18:21:23.422811 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:23.422786 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwxdr\" (UniqueName: \"kubernetes.io/projected/b5f8c113-1f81-4e61-9e42-62160932379b-kube-api-access-gwxdr\") pod \"kube-auth-proxy-78678676dd-qcc86\" (UID: \"b5f8c113-1f81-4e61-9e42-62160932379b\") " pod="openshift-ingress/kube-auth-proxy-78678676dd-qcc86" May 21 18:21:23.916502 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:23.916466 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5f8c113-1f81-4e61-9e42-62160932379b-tls-certs\") pod \"kube-auth-proxy-78678676dd-qcc86\" (UID: \"b5f8c113-1f81-4e61-9e42-62160932379b\") " pod="openshift-ingress/kube-auth-proxy-78678676dd-qcc86" May 21 18:21:23.918860 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:23.918839 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5f8c113-1f81-4e61-9e42-62160932379b-tls-certs\") pod \"kube-auth-proxy-78678676dd-qcc86\" (UID: \"b5f8c113-1f81-4e61-9e42-62160932379b\") " pod="openshift-ingress/kube-auth-proxy-78678676dd-qcc86" May 21 18:21:24.075374 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:24.075338 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-78678676dd-qcc86" May 21 18:21:24.200191 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:24.200124 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-78678676dd-qcc86"] May 21 18:21:24.202437 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:21:24.202411 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5f8c113_1f81_4e61_9e42_62160932379b.slice/crio-0d4c559d23da447978abb833553c5bf0e53fff6e0007efbba325391f20a0f732 WatchSource:0}: Error finding container 0d4c559d23da447978abb833553c5bf0e53fff6e0007efbba325391f20a0f732: Status 404 returned error can't find the container with id 0d4c559d23da447978abb833553c5bf0e53fff6e0007efbba325391f20a0f732 May 21 18:21:24.482265 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:24.482229 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-78678676dd-qcc86" event={"ID":"b5f8c113-1f81-4e61-9e42-62160932379b","Type":"ContainerStarted","Data":"0d4c559d23da447978abb833553c5bf0e53fff6e0007efbba325391f20a0f732"} May 21 18:21:28.498024 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:28.497989 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-78678676dd-qcc86" event={"ID":"b5f8c113-1f81-4e61-9e42-62160932379b","Type":"ContainerStarted","Data":"6b9729c232e5279def64d51d7b5a7a12a4166cabfe4f6e2e4cc300983249c4ff"} May 21 18:21:28.516660 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:21:28.516613 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-78678676dd-qcc86" podStartSLOduration=2.126478041 podStartE2EDuration="5.516598615s" podCreationTimestamp="2026-05-21 18:21:23 +0000 UTC" firstStartedPulling="2026-05-21 18:21:24.2041136 +0000 UTC m=+488.789600013" lastFinishedPulling="2026-05-21 18:21:27.594234169 +0000 UTC m=+492.179720587" observedRunningTime="2026-05-21 18:21:28.515658596 +0000 UTC m=+493.101145031" watchObservedRunningTime="2026-05-21 18:21:28.516598615 +0000 UTC m=+493.102085050" May 21 18:23:15.961298 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:23:15.961265 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2n5jr_d9537e64-5ba3-4910-998c-e9d3deb97929/ovn-acl-logging/0.log" May 21 18:23:15.962561 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:23:15.962539 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2n5jr_d9537e64-5ba3-4910-998c-e9d3deb97929/ovn-acl-logging/0.log" May 21 18:23:56.933606 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:23:56.933548 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:23:56.937219 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:23:56.937199 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-9bv9j" May 21 18:23:56.940672 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:23:56.940643 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 21 18:23:56.941417 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:23:56.941390 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 21 18:23:56.941524 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:23:56.941434 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 21 18:23:56.941765 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:23:56.941749 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hh95b\"" May 21 18:23:56.953606 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:23:56.953547 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:23:56.975661 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:23:56.975611 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/138bba33-de92-4e60-8a2c-6317f3c0c6d9-config-file\") pod \"limitador-limitador-78c99df468-9bv9j\" (UID: \"138bba33-de92-4e60-8a2c-6317f3c0c6d9\") " pod="kuadrant-system/limitador-limitador-78c99df468-9bv9j" May 21 18:23:56.975846 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:23:56.975688 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6j2s\" (UniqueName: \"kubernetes.io/projected/138bba33-de92-4e60-8a2c-6317f3c0c6d9-kube-api-access-x6j2s\") pod \"limitador-limitador-78c99df468-9bv9j\" (UID: \"138bba33-de92-4e60-8a2c-6317f3c0c6d9\") " pod="kuadrant-system/limitador-limitador-78c99df468-9bv9j" May 21 18:23:56.994087 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:23:56.994052 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:23:57.077002 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:23:57.076961 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/138bba33-de92-4e60-8a2c-6317f3c0c6d9-config-file\") pod \"limitador-limitador-78c99df468-9bv9j\" (UID: \"138bba33-de92-4e60-8a2c-6317f3c0c6d9\") " pod="kuadrant-system/limitador-limitador-78c99df468-9bv9j" May 21 18:23:57.077182 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:23:57.077135 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x6j2s\" (UniqueName: \"kubernetes.io/projected/138bba33-de92-4e60-8a2c-6317f3c0c6d9-kube-api-access-x6j2s\") pod \"limitador-limitador-78c99df468-9bv9j\" (UID: \"138bba33-de92-4e60-8a2c-6317f3c0c6d9\") " pod="kuadrant-system/limitador-limitador-78c99df468-9bv9j" May 21 18:23:57.077670 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:23:57.077651 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/138bba33-de92-4e60-8a2c-6317f3c0c6d9-config-file\") pod \"limitador-limitador-78c99df468-9bv9j\" (UID: \"138bba33-de92-4e60-8a2c-6317f3c0c6d9\") " pod="kuadrant-system/limitador-limitador-78c99df468-9bv9j" May 21 18:23:57.088409 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:23:57.088376 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6j2s\" (UniqueName: \"kubernetes.io/projected/138bba33-de92-4e60-8a2c-6317f3c0c6d9-kube-api-access-x6j2s\") pod \"limitador-limitador-78c99df468-9bv9j\" (UID: \"138bba33-de92-4e60-8a2c-6317f3c0c6d9\") " pod="kuadrant-system/limitador-limitador-78c99df468-9bv9j" May 21 18:23:57.248175 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:23:57.248143 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-9bv9j" May 21 18:23:57.429789 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:23:57.429763 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:23:57.432425 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:23:57.432391 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod138bba33_de92_4e60_8a2c_6317f3c0c6d9.slice/crio-74a145de5e69a4b74dfd9a26755056c7f943b36514017440b945324a67e6bcd9 WatchSource:0}: Error finding container 74a145de5e69a4b74dfd9a26755056c7f943b36514017440b945324a67e6bcd9: Status 404 returned error can't find the container with id 74a145de5e69a4b74dfd9a26755056c7f943b36514017440b945324a67e6bcd9 May 21 18:23:57.931902 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:23:57.931866 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-pnphd"] May 21 18:23:57.935892 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:23:57.935867 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-pnphd" May 21 18:23:57.939768 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:23:57.939722 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-62rk2\"" May 21 18:23:57.948091 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:23:57.948031 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-pnphd"] May 21 18:23:57.986010 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:23:57.985817 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cllm\" (UniqueName: \"kubernetes.io/projected/9551f5ef-59d4-461f-8619-7efca985cae7-kube-api-access-8cllm\") pod \"authorino-7498df8756-pnphd\" (UID: \"9551f5ef-59d4-461f-8619-7efca985cae7\") " pod="kuadrant-system/authorino-7498df8756-pnphd" May 21 18:23:58.000301 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:23:58.000206 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-9bv9j" event={"ID":"138bba33-de92-4e60-8a2c-6317f3c0c6d9","Type":"ContainerStarted","Data":"74a145de5e69a4b74dfd9a26755056c7f943b36514017440b945324a67e6bcd9"} May 21 18:23:58.086950 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:23:58.086903 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8cllm\" (UniqueName: \"kubernetes.io/projected/9551f5ef-59d4-461f-8619-7efca985cae7-kube-api-access-8cllm\") pod \"authorino-7498df8756-pnphd\" (UID: \"9551f5ef-59d4-461f-8619-7efca985cae7\") " pod="kuadrant-system/authorino-7498df8756-pnphd" May 21 18:23:58.113307 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:23:58.113273 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cllm\" (UniqueName: \"kubernetes.io/projected/9551f5ef-59d4-461f-8619-7efca985cae7-kube-api-access-8cllm\") pod \"authorino-7498df8756-pnphd\" (UID: \"9551f5ef-59d4-461f-8619-7efca985cae7\") " pod="kuadrant-system/authorino-7498df8756-pnphd" May 21 18:23:58.251346 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:23:58.251304 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-pnphd" May 21 18:23:58.400917 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:23:58.400721 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-pnphd"] May 21 18:23:58.403812 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:23:58.403782 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9551f5ef_59d4_461f_8619_7efca985cae7.slice/crio-13c65b418ca5be713d7b5ed3c782c6fc4034edb578b381f632a9f625d2ae159c WatchSource:0}: Error finding container 13c65b418ca5be713d7b5ed3c782c6fc4034edb578b381f632a9f625d2ae159c: Status 404 returned error can't find the container with id 13c65b418ca5be713d7b5ed3c782c6fc4034edb578b381f632a9f625d2ae159c May 21 18:23:59.005738 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:23:59.005703 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-pnphd" event={"ID":"9551f5ef-59d4-461f-8619-7efca985cae7","Type":"ContainerStarted","Data":"13c65b418ca5be713d7b5ed3c782c6fc4034edb578b381f632a9f625d2ae159c"} May 21 18:24:01.014045 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:24:01.014010 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-9bv9j" event={"ID":"138bba33-de92-4e60-8a2c-6317f3c0c6d9","Type":"ContainerStarted","Data":"7303ff4af5fd114a728b95ddf8fc865d2508db878cd53a94ebc77bfd3cb41a17"} May 21 18:24:01.014495 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:24:01.014110 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-9bv9j" May 21 18:24:01.034961 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:24:01.034916 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-9bv9j" podStartSLOduration=2.411157357 podStartE2EDuration="5.034902683s" podCreationTimestamp="2026-05-21 18:23:56 +0000 UTC" firstStartedPulling="2026-05-21 18:23:57.434168411 +0000 UTC m=+642.019654824" lastFinishedPulling="2026-05-21 18:24:00.057903415 +0000 UTC m=+644.643400150" observedRunningTime="2026-05-21 18:24:01.034589724 +0000 UTC m=+645.620076161" watchObservedRunningTime="2026-05-21 18:24:01.034902683 +0000 UTC m=+645.620389118" May 21 18:24:02.018928 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:24:02.018877 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-pnphd" event={"ID":"9551f5ef-59d4-461f-8619-7efca985cae7","Type":"ContainerStarted","Data":"3aed8981a92e558fea30964a517570e7e2fa6ed61de5fea9d79d9741babc8232"} May 21 18:24:12.020469 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:24:12.020443 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-9bv9j" May 21 18:24:12.042424 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:24:12.042378 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-pnphd" podStartSLOduration=11.549230364 podStartE2EDuration="15.042364109s" podCreationTimestamp="2026-05-21 18:23:57 +0000 UTC" firstStartedPulling="2026-05-21 18:23:58.405533783 +0000 UTC m=+642.991020202" lastFinishedPulling="2026-05-21 18:24:01.898667534 +0000 UTC m=+646.484153947" observedRunningTime="2026-05-21 18:24:02.039639689 +0000 UTC m=+646.625126125" watchObservedRunningTime="2026-05-21 18:24:12.042364109 +0000 UTC m=+656.627850545" May 21 18:24:30.518453 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:24:30.518412 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-vvx9k"] May 21 18:24:30.521901 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:24:30.521883 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-vvx9k" May 21 18:24:30.538374 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:24:30.538343 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-vvx9k"] May 21 18:24:30.685035 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:24:30.684983 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pn56m\" (UniqueName: \"kubernetes.io/projected/7f834981-f63a-4171-aa9d-c2db8521808d-kube-api-access-pn56m\") pod \"authorino-8b475cf9f-vvx9k\" (UID: \"7f834981-f63a-4171-aa9d-c2db8521808d\") " pod="kuadrant-system/authorino-8b475cf9f-vvx9k" May 21 18:24:30.764339 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:24:30.764301 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-vvx9k"] May 21 18:24:30.764597 ip-10-0-141-59 kubenswrapper[2567]: E0521 18:24:30.764564 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-pn56m], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-8b475cf9f-vvx9k" podUID="7f834981-f63a-4171-aa9d-c2db8521808d" May 21 18:24:30.786139 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:24:30.786066 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pn56m\" (UniqueName: \"kubernetes.io/projected/7f834981-f63a-4171-aa9d-c2db8521808d-kube-api-access-pn56m\") pod \"authorino-8b475cf9f-vvx9k\" (UID: \"7f834981-f63a-4171-aa9d-c2db8521808d\") " pod="kuadrant-system/authorino-8b475cf9f-vvx9k" May 21 18:24:30.799414 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:24:30.799385 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pn56m\" (UniqueName: \"kubernetes.io/projected/7f834981-f63a-4171-aa9d-c2db8521808d-kube-api-access-pn56m\") pod \"authorino-8b475cf9f-vvx9k\" (UID: \"7f834981-f63a-4171-aa9d-c2db8521808d\") " pod="kuadrant-system/authorino-8b475cf9f-vvx9k" May 21 18:24:31.114046 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:24:31.113956 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-vvx9k" May 21 18:24:31.119080 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:24:31.119056 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-vvx9k" May 21 18:24:31.190292 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:24:31.190253 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pn56m\" (UniqueName: \"kubernetes.io/projected/7f834981-f63a-4171-aa9d-c2db8521808d-kube-api-access-pn56m\") pod \"7f834981-f63a-4171-aa9d-c2db8521808d\" (UID: \"7f834981-f63a-4171-aa9d-c2db8521808d\") " May 21 18:24:31.192346 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:24:31.192316 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f834981-f63a-4171-aa9d-c2db8521808d-kube-api-access-pn56m" (OuterVolumeSpecName: "kube-api-access-pn56m") pod "7f834981-f63a-4171-aa9d-c2db8521808d" (UID: "7f834981-f63a-4171-aa9d-c2db8521808d"). InnerVolumeSpecName "kube-api-access-pn56m". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:24:31.290931 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:24:31.290889 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pn56m\" (UniqueName: \"kubernetes.io/projected/7f834981-f63a-4171-aa9d-c2db8521808d-kube-api-access-pn56m\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 21 18:24:32.117751 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:24:32.117719 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-vvx9k" May 21 18:24:32.164886 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:24:32.164825 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-vvx9k"] May 21 18:24:32.168453 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:24:32.168425 2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-vvx9k"] May 21 18:24:32.997934 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:24:32.997895 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-pnphd"] May 21 18:24:32.998114 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:24:32.998094 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-pnphd" podUID="9551f5ef-59d4-461f-8619-7efca985cae7" containerName="authorino" containerID="cri-o://3aed8981a92e558fea30964a517570e7e2fa6ed61de5fea9d79d9741babc8232" gracePeriod=30 May 21 18:24:33.123604 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:24:33.123544 2567 generic.go:358] "Generic (PLEG): container finished" podID="9551f5ef-59d4-461f-8619-7efca985cae7" containerID="3aed8981a92e558fea30964a517570e7e2fa6ed61de5fea9d79d9741babc8232" exitCode=0 May 21 18:24:33.124052 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:24:33.123613 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-pnphd" event={"ID":"9551f5ef-59d4-461f-8619-7efca985cae7","Type":"ContainerDied","Data":"3aed8981a92e558fea30964a517570e7e2fa6ed61de5fea9d79d9741babc8232"} May 21 18:24:33.250227 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:24:33.250163 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-pnphd" May 21 18:24:33.406354 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:24:33.406298 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8cllm\" (UniqueName: \"kubernetes.io/projected/9551f5ef-59d4-461f-8619-7efca985cae7-kube-api-access-8cllm\") pod \"9551f5ef-59d4-461f-8619-7efca985cae7\" (UID: \"9551f5ef-59d4-461f-8619-7efca985cae7\") " May 21 18:24:33.408488 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:24:33.408453 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9551f5ef-59d4-461f-8619-7efca985cae7-kube-api-access-8cllm" (OuterVolumeSpecName: "kube-api-access-8cllm") pod "9551f5ef-59d4-461f-8619-7efca985cae7" (UID: "9551f5ef-59d4-461f-8619-7efca985cae7"). InnerVolumeSpecName "kube-api-access-8cllm". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:24:33.507855 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:24:33.507761 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8cllm\" (UniqueName: \"kubernetes.io/projected/9551f5ef-59d4-461f-8619-7efca985cae7-kube-api-access-8cllm\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 21 18:24:33.983846 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:24:33.983813 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f834981-f63a-4171-aa9d-c2db8521808d" path="/var/lib/kubelet/pods/7f834981-f63a-4171-aa9d-c2db8521808d/volumes" May 21 18:24:34.128405 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:24:34.128370 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-pnphd" event={"ID":"9551f5ef-59d4-461f-8619-7efca985cae7","Type":"ContainerDied","Data":"13c65b418ca5be713d7b5ed3c782c6fc4034edb578b381f632a9f625d2ae159c"} May 21 18:24:34.128405 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:24:34.128396 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-pnphd" May 21 18:24:34.128897 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:24:34.128420 2567 scope.go:117] "RemoveContainer" containerID="3aed8981a92e558fea30964a517570e7e2fa6ed61de5fea9d79d9741babc8232" May 21 18:24:34.145781 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:24:34.145748 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-pnphd"] May 21 18:24:34.149652 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:24:34.149622 2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-pnphd"] May 21 18:24:35.983930 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:24:35.983894 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9551f5ef-59d4-461f-8619-7efca985cae7" path="/var/lib/kubelet/pods/9551f5ef-59d4-461f-8619-7efca985cae7/volumes" May 21 18:25:10.741281 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:25:10.741192 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:25:24.773785 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:25:24.773746 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:25:26.980587 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:25:26.980545 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:25:38.708830 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:25:38.708797 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:26:03.577201 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:26:03.577161 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:26:06.877530 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:26:06.877494 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:26:13.090679 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:26:13.090643 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:26:15.045058 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:26:15.045021 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d67f6bbf-2gprs"] May 21 18:26:15.045428 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:26:15.045409 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9551f5ef-59d4-461f-8619-7efca985cae7" containerName="authorino" May 21 18:26:15.045428 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:26:15.045421 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9551f5ef-59d4-461f-8619-7efca985cae7" containerName="authorino" May 21 18:26:15.045497 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:26:15.045476 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="9551f5ef-59d4-461f-8619-7efca985cae7" containerName="authorino" May 21 18:26:15.048424 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:26:15.048407 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d67f6bbf-2gprs" May 21 18:26:15.051677 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:26:15.051647 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-62rk2\"" May 21 18:26:15.051677 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:26:15.051665 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" May 21 18:26:15.054654 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:26:15.054629 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d67f6bbf-2gprs"] May 21 18:26:15.121413 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:26:15.121382 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ce9d9246-a261-46b5-ba44-fc5afa8f3a13-tls-cert\") pod \"authorino-75d67f6bbf-2gprs\" (UID: \"ce9d9246-a261-46b5-ba44-fc5afa8f3a13\") " pod="kuadrant-system/authorino-75d67f6bbf-2gprs" May 21 18:26:15.121587 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:26:15.121444 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs75w\" (UniqueName: \"kubernetes.io/projected/ce9d9246-a261-46b5-ba44-fc5afa8f3a13-kube-api-access-gs75w\") pod \"authorino-75d67f6bbf-2gprs\" (UID: \"ce9d9246-a261-46b5-ba44-fc5afa8f3a13\") " pod="kuadrant-system/authorino-75d67f6bbf-2gprs" May 21 18:26:15.222312 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:26:15.222276 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gs75w\" (UniqueName: \"kubernetes.io/projected/ce9d9246-a261-46b5-ba44-fc5afa8f3a13-kube-api-access-gs75w\") pod \"authorino-75d67f6bbf-2gprs\" (UID: \"ce9d9246-a261-46b5-ba44-fc5afa8f3a13\") " pod="kuadrant-system/authorino-75d67f6bbf-2gprs" May 21 18:26:15.222491 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:26:15.222347 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ce9d9246-a261-46b5-ba44-fc5afa8f3a13-tls-cert\") pod \"authorino-75d67f6bbf-2gprs\" (UID: \"ce9d9246-a261-46b5-ba44-fc5afa8f3a13\") " pod="kuadrant-system/authorino-75d67f6bbf-2gprs" May 21 18:26:15.224778 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:26:15.224751 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ce9d9246-a261-46b5-ba44-fc5afa8f3a13-tls-cert\") pod \"authorino-75d67f6bbf-2gprs\" (UID: \"ce9d9246-a261-46b5-ba44-fc5afa8f3a13\") " pod="kuadrant-system/authorino-75d67f6bbf-2gprs" May 21 18:26:15.229713 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:26:15.229695 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs75w\" (UniqueName: \"kubernetes.io/projected/ce9d9246-a261-46b5-ba44-fc5afa8f3a13-kube-api-access-gs75w\") pod \"authorino-75d67f6bbf-2gprs\" (UID: \"ce9d9246-a261-46b5-ba44-fc5afa8f3a13\") " pod="kuadrant-system/authorino-75d67f6bbf-2gprs" May 21 18:26:15.358998 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:26:15.358899 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d67f6bbf-2gprs" May 21 18:26:15.487724 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:26:15.487654 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d67f6bbf-2gprs"] May 21 18:26:15.490507 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:26:15.490477 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce9d9246_a261_46b5_ba44_fc5afa8f3a13.slice/crio-b72d2012554ba283d3bf6afd65e4f5b71956f8cc73c3388853552f7a5c10d40c WatchSource:0}: Error finding container b72d2012554ba283d3bf6afd65e4f5b71956f8cc73c3388853552f7a5c10d40c: Status 404 returned error can't find the container with id b72d2012554ba283d3bf6afd65e4f5b71956f8cc73c3388853552f7a5c10d40c May 21 18:26:15.491751 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:26:15.491731 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 18:26:16.488726 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:26:16.488685 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d67f6bbf-2gprs" event={"ID":"ce9d9246-a261-46b5-ba44-fc5afa8f3a13","Type":"ContainerStarted","Data":"8f3639f7d42df25ba7d96f744729b49e4b918ce4a222a5bd8713a08aef3000a9"} May 21 18:26:16.488726 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:26:16.488723 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d67f6bbf-2gprs" event={"ID":"ce9d9246-a261-46b5-ba44-fc5afa8f3a13","Type":"ContainerStarted","Data":"b72d2012554ba283d3bf6afd65e4f5b71956f8cc73c3388853552f7a5c10d40c"} May 21 18:26:16.504462 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:26:16.504406 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-75d67f6bbf-2gprs" podStartSLOduration=1.068383671 podStartE2EDuration="1.504388975s" podCreationTimestamp="2026-05-21 18:26:15 +0000 UTC" firstStartedPulling="2026-05-21 18:26:15.491852053 +0000 UTC m=+780.077338467" lastFinishedPulling="2026-05-21 18:26:15.927857353 +0000 UTC m=+780.513343771" observedRunningTime="2026-05-21 18:26:16.503522068 +0000 UTC m=+781.089008510" watchObservedRunningTime="2026-05-21 18:26:16.504388975 +0000 UTC m=+781.089875412" May 21 18:26:35.784136 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:26:35.784045 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:26:40.486129 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:26:40.486093 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:26:46.988311 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:26:46.988276 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:26:57.671280 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:26:57.671246 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:27:06.179936 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:27:06.179903 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:27:16.572325 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:27:16.572279 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:27:25.582242 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:27:25.582195 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:27:35.478363 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:27:35.478327 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:28:07.671331 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:28:07.671249 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:28:12.467217 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:28:12.467185 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:28:15.985937 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:28:15.985907 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2n5jr_d9537e64-5ba3-4910-998c-e9d3deb97929/ovn-acl-logging/0.log" May 21 18:28:15.988217 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:28:15.988194 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2n5jr_d9537e64-5ba3-4910-998c-e9d3deb97929/ovn-acl-logging/0.log" May 21 18:28:47.795780 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:28:47.795739 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:29:03.775402 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:29:03.775365 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:29:42.848861 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:29:42.848772 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:29:58.987608 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:29:58.987558 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:30:00.148169 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:30:00.148123 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29656470-c5tb7"] May 21 18:30:00.151791 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:30:00.151764 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656470-c5tb7" May 21 18:30:00.154595 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:30:00.154552 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-dlbq6\"" May 21 18:30:00.173477 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:30:00.173440 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29656470-c5tb7"] May 21 18:30:00.210853 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:30:00.210810 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2rn2\" (UniqueName: \"kubernetes.io/projected/00c9cf6d-2e18-444c-b05f-15ce97e67d09-kube-api-access-z2rn2\") pod \"maas-api-key-cleanup-29656470-c5tb7\" (UID: \"00c9cf6d-2e18-444c-b05f-15ce97e67d09\") " pod="opendatahub/maas-api-key-cleanup-29656470-c5tb7" May 21 18:30:00.312083 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:30:00.312040 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z2rn2\" (UniqueName: \"kubernetes.io/projected/00c9cf6d-2e18-444c-b05f-15ce97e67d09-kube-api-access-z2rn2\") pod \"maas-api-key-cleanup-29656470-c5tb7\" (UID: \"00c9cf6d-2e18-444c-b05f-15ce97e67d09\") " pod="opendatahub/maas-api-key-cleanup-29656470-c5tb7" May 21 18:30:00.321003 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:30:00.320969 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2rn2\" (UniqueName: \"kubernetes.io/projected/00c9cf6d-2e18-444c-b05f-15ce97e67d09-kube-api-access-z2rn2\") pod \"maas-api-key-cleanup-29656470-c5tb7\" (UID: \"00c9cf6d-2e18-444c-b05f-15ce97e67d09\") " pod="opendatahub/maas-api-key-cleanup-29656470-c5tb7" May 21 18:30:00.462378 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:30:00.462289 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656470-c5tb7" May 21 18:30:00.592190 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:30:00.592074 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29656470-c5tb7"] May 21 18:30:00.595028 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:30:00.594995 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00c9cf6d_2e18_444c_b05f_15ce97e67d09.slice/crio-8d1ba2df09b093b6cb5f02b4a27853854efd14a5fad8fa22297c0b5e2121f415 WatchSource:0}: Error finding container 8d1ba2df09b093b6cb5f02b4a27853854efd14a5fad8fa22297c0b5e2121f415: Status 404 returned error can't find the container with id 8d1ba2df09b093b6cb5f02b4a27853854efd14a5fad8fa22297c0b5e2121f415 May 21 18:30:01.243713 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:30:01.243679 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656470-c5tb7" event={"ID":"00c9cf6d-2e18-444c-b05f-15ce97e67d09","Type":"ContainerStarted","Data":"8d1ba2df09b093b6cb5f02b4a27853854efd14a5fad8fa22297c0b5e2121f415"} May 21 18:30:04.255829 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:30:04.255785 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656470-c5tb7" event={"ID":"00c9cf6d-2e18-444c-b05f-15ce97e67d09","Type":"ContainerStarted","Data":"9931f30b7d43521489affd60d7783e027bd1e88e79c382b3681466d120bbdee0"} May 21 18:30:04.275398 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:30:04.275334 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29656470-c5tb7" podStartSLOduration=0.979569341 podStartE2EDuration="4.275315645s" podCreationTimestamp="2026-05-21 18:30:00 +0000 UTC" firstStartedPulling="2026-05-21 18:30:00.596786354 +0000 UTC m=+1005.182272768" lastFinishedPulling="2026-05-21 18:30:03.892532655 +0000 UTC m=+1008.478019072" observedRunningTime="2026-05-21 18:30:04.273994933 +0000 UTC m=+1008.859481370" watchObservedRunningTime="2026-05-21 18:30:04.275315645 +0000 UTC m=+1008.860802080" May 21 18:30:05.263107 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:30:05.263070 2567 generic.go:358] "Generic (PLEG): container finished" podID="00c9cf6d-2e18-444c-b05f-15ce97e67d09" containerID="9931f30b7d43521489affd60d7783e027bd1e88e79c382b3681466d120bbdee0" exitCode=0 May 21 18:30:05.263487 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:30:05.263134 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656470-c5tb7" event={"ID":"00c9cf6d-2e18-444c-b05f-15ce97e67d09","Type":"ContainerDied","Data":"9931f30b7d43521489affd60d7783e027bd1e88e79c382b3681466d120bbdee0"} May 21 18:30:06.395997 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:30:06.395973 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656470-c5tb7" May 21 18:30:06.463854 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:30:06.463824 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z2rn2\" (UniqueName: \"kubernetes.io/projected/00c9cf6d-2e18-444c-b05f-15ce97e67d09-kube-api-access-z2rn2\") pod \"00c9cf6d-2e18-444c-b05f-15ce97e67d09\" (UID: \"00c9cf6d-2e18-444c-b05f-15ce97e67d09\") " May 21 18:30:06.465987 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:30:06.465954 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00c9cf6d-2e18-444c-b05f-15ce97e67d09-kube-api-access-z2rn2" (OuterVolumeSpecName: "kube-api-access-z2rn2") pod "00c9cf6d-2e18-444c-b05f-15ce97e67d09" (UID: "00c9cf6d-2e18-444c-b05f-15ce97e67d09"). InnerVolumeSpecName "kube-api-access-z2rn2". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:30:06.565004 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:30:06.564916 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2rn2\" (UniqueName: \"kubernetes.io/projected/00c9cf6d-2e18-444c-b05f-15ce97e67d09-kube-api-access-z2rn2\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 21 18:30:07.271049 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:30:07.271016 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656470-c5tb7" May 21 18:30:07.271049 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:30:07.271026 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656470-c5tb7" event={"ID":"00c9cf6d-2e18-444c-b05f-15ce97e67d09","Type":"ContainerDied","Data":"8d1ba2df09b093b6cb5f02b4a27853854efd14a5fad8fa22297c0b5e2121f415"} May 21 18:30:07.271261 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:30:07.271060 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8d1ba2df09b093b6cb5f02b4a27853854efd14a5fad8fa22297c0b5e2121f415" May 21 18:30:13.878765 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:30:13.878728 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:30:30.090506 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:30:30.090465 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:31:26.075729 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:31:26.075641 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:31:34.475526 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:31:34.475493 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:31:51.283351 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:31:51.283315 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:32:00.174898 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:32:00.174850 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:32:17.871901 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:32:17.871863 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:32:25.781807 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:32:25.781772 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:32:58.487015 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:32:58.486976 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:33:06.274320 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:33:06.274289 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:33:15.781197 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:33:15.781163 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:33:16.010559 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:33:16.010529 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2n5jr_d9537e64-5ba3-4910-998c-e9d3deb97929/ovn-acl-logging/0.log" May 21 18:33:16.015050 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:33:16.015028 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2n5jr_d9537e64-5ba3-4910-998c-e9d3deb97929/ovn-acl-logging/0.log" May 21 18:33:23.693683 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:33:23.693644 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:33:31.975049 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:33:31.975014 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:33:49.278362 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:33:49.278321 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:34:01.881018 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:34:01.880979 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:34:50.571116 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:34:50.571079 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:34:55.311801 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:34:55.311768 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:35:01.609605 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:35:01.609143 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:35:09.770464 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:35:09.770427 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:35:21.075518 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:35:21.075479 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:35:28.288569 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:35:28.288479 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:35:36.577243 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:35:36.577205 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:35:45.673317 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:35:45.673284 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:35:54.578982 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:35:54.578935 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:36:02.793616 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:36:02.791156 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:36:11.781377 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:36:11.781339 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:36:20.171464 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:36:20.171410 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:36:29.178836 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:36:29.178795 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:36:37.273280 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:36:37.273244 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:36:46.273902 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:36:46.273870 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:36:54.575965 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:36:54.575931 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:37:04.577548 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:37:04.577459 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:37:12.878411 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:37:12.878376 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:38:16.034763 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:38:16.034740 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2n5jr_d9537e64-5ba3-4910-998c-e9d3deb97929/ovn-acl-logging/0.log" May 21 18:38:16.040826 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:38:16.040805 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2n5jr_d9537e64-5ba3-4910-998c-e9d3deb97929/ovn-acl-logging/0.log" May 21 18:39:29.362127 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:39:29.362087 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:39:34.876647 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:39:34.876611 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:40:00.583124 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:40:00.583042 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:40:05.288073 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:40:05.288035 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:40:15.585028 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:40:15.584993 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:40:24.997905 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:40:24.997862 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:40:34.972982 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:40:34.972943 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:40:45.671862 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:40:45.671815 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:40:53.482068 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:40:53.482032 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:41:04.572521 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:41:04.572481 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:41:12.880592 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:41:12.880549 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:41:23.579339 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:41:23.579296 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:41:32.881617 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:41:32.881517 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:42:05.387027 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:42:05.386986 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:42:48.473857 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:42:48.473821 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:42:57.899158 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:42:57.899071 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:43:06.169876 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:43:06.169845 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:43:14.994059 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:43:14.994017 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:43:16.062706 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:43:16.062673 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2n5jr_d9537e64-5ba3-4910-998c-e9d3deb97929/ovn-acl-logging/0.log" May 21 18:43:16.069169 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:43:16.069151 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2n5jr_d9537e64-5ba3-4910-998c-e9d3deb97929/ovn-acl-logging/0.log" May 21 18:43:23.177136 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:43:23.177098 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:43:36.676334 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:43:36.676300 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:43:44.316257 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:43:44.316222 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:43:52.519440 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:43:52.519403 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:44:01.975265 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:44:01.975232 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:44:10.381248 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:44:10.381210 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:44:17.970956 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:44:17.970916 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:44:28.680675 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:44:28.680562 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:44:45.776980 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:44:45.776942 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:44:54.070219 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:44:54.070178 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:45:00.148253 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:45:00.148216 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29656485-hzn7x"] May 21 18:45:00.148649 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:45:00.148591 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00c9cf6d-2e18-444c-b05f-15ce97e67d09" containerName="cleanup" May 21 18:45:00.148649 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:45:00.148603 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="00c9cf6d-2e18-444c-b05f-15ce97e67d09" containerName="cleanup" May 21 18:45:00.148725 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:45:00.148667 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="00c9cf6d-2e18-444c-b05f-15ce97e67d09" containerName="cleanup" May 21 18:45:00.151796 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:45:00.151779 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656485-hzn7x" May 21 18:45:00.155140 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:45:00.155115 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-dlbq6\"" May 21 18:45:00.169002 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:45:00.168976 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29656485-hzn7x"] May 21 18:45:00.236934 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:45:00.236886 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rhpj\" (UniqueName: \"kubernetes.io/projected/4d1c4d0a-f78e-4a12-a59d-7378a4c7c264-kube-api-access-2rhpj\") pod \"maas-api-key-cleanup-29656485-hzn7x\" (UID: \"4d1c4d0a-f78e-4a12-a59d-7378a4c7c264\") " pod="opendatahub/maas-api-key-cleanup-29656485-hzn7x" May 21 18:45:00.338377 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:45:00.338327 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2rhpj\" (UniqueName: \"kubernetes.io/projected/4d1c4d0a-f78e-4a12-a59d-7378a4c7c264-kube-api-access-2rhpj\") pod \"maas-api-key-cleanup-29656485-hzn7x\" (UID: \"4d1c4d0a-f78e-4a12-a59d-7378a4c7c264\") " pod="opendatahub/maas-api-key-cleanup-29656485-hzn7x" May 21 18:45:00.346341 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:45:00.346315 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rhpj\" (UniqueName: \"kubernetes.io/projected/4d1c4d0a-f78e-4a12-a59d-7378a4c7c264-kube-api-access-2rhpj\") pod \"maas-api-key-cleanup-29656485-hzn7x\" (UID: \"4d1c4d0a-f78e-4a12-a59d-7378a4c7c264\") " pod="opendatahub/maas-api-key-cleanup-29656485-hzn7x" May 21 18:45:00.461632 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:45:00.461524 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656485-hzn7x" May 21 18:45:00.594888 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:45:00.585399 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29656485-hzn7x"] May 21 18:45:00.594888 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:45:00.588146 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d1c4d0a_f78e_4a12_a59d_7378a4c7c264.slice/crio-793bfc41501234e51cfce58e31a8034d309754cfd223f9c977602c67e237e951 WatchSource:0}: Error finding container 793bfc41501234e51cfce58e31a8034d309754cfd223f9c977602c67e237e951: Status 404 returned error can't find the container with id 793bfc41501234e51cfce58e31a8034d309754cfd223f9c977602c67e237e951 May 21 18:45:00.594888 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:45:00.589951 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 18:45:01.288458 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:45:01.288414 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656485-hzn7x" event={"ID":"4d1c4d0a-f78e-4a12-a59d-7378a4c7c264","Type":"ContainerStarted","Data":"b91e0a66026b274e5ea3d22f0c24ff5ea0ff2ca6c7c84ee90d140cd5438bf587"} May 21 18:45:01.288458 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:45:01.288462 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656485-hzn7x" event={"ID":"4d1c4d0a-f78e-4a12-a59d-7378a4c7c264","Type":"ContainerStarted","Data":"793bfc41501234e51cfce58e31a8034d309754cfd223f9c977602c67e237e951"} May 21 18:45:01.304117 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:45:01.304067 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29656485-hzn7x" podStartSLOduration=1.304053011 podStartE2EDuration="1.304053011s" podCreationTimestamp="2026-05-21 18:45:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:45:01.30239672 +0000 UTC m=+1905.887883155" watchObservedRunningTime="2026-05-21 18:45:01.304053011 +0000 UTC m=+1905.889539480" May 21 18:45:02.293376 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:45:02.293338 2567 generic.go:358] "Generic (PLEG): container finished" podID="4d1c4d0a-f78e-4a12-a59d-7378a4c7c264" containerID="b91e0a66026b274e5ea3d22f0c24ff5ea0ff2ca6c7c84ee90d140cd5438bf587" exitCode=0 May 21 18:45:02.293760 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:45:02.293385 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656485-hzn7x" event={"ID":"4d1c4d0a-f78e-4a12-a59d-7378a4c7c264","Type":"ContainerDied","Data":"b91e0a66026b274e5ea3d22f0c24ff5ea0ff2ca6c7c84ee90d140cd5438bf587"} May 21 18:45:03.377618 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:45:03.377557 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:45:03.423050 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:45:03.423027 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656485-hzn7x" May 21 18:45:03.569383 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:45:03.569293 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rhpj\" (UniqueName: \"kubernetes.io/projected/4d1c4d0a-f78e-4a12-a59d-7378a4c7c264-kube-api-access-2rhpj\") pod \"4d1c4d0a-f78e-4a12-a59d-7378a4c7c264\" (UID: \"4d1c4d0a-f78e-4a12-a59d-7378a4c7c264\") " May 21 18:45:03.571425 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:45:03.571385 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d1c4d0a-f78e-4a12-a59d-7378a4c7c264-kube-api-access-2rhpj" (OuterVolumeSpecName: "kube-api-access-2rhpj") pod "4d1c4d0a-f78e-4a12-a59d-7378a4c7c264" (UID: "4d1c4d0a-f78e-4a12-a59d-7378a4c7c264"). InnerVolumeSpecName "kube-api-access-2rhpj". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 18:45:03.670431 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:45:03.670385 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rhpj\" (UniqueName: \"kubernetes.io/projected/4d1c4d0a-f78e-4a12-a59d-7378a4c7c264-kube-api-access-2rhpj\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" May 21 18:45:04.300658 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:45:04.300563 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656485-hzn7x" May 21 18:45:04.300809 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:45:04.300567 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656485-hzn7x" event={"ID":"4d1c4d0a-f78e-4a12-a59d-7378a4c7c264","Type":"ContainerDied","Data":"793bfc41501234e51cfce58e31a8034d309754cfd223f9c977602c67e237e951"} May 21 18:45:04.300809 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:45:04.300691 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="793bfc41501234e51cfce58e31a8034d309754cfd223f9c977602c67e237e951" May 21 18:45:11.876904 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:45:11.876862 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:45:29.279707 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:45:29.279669 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:45:37.182256 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:45:37.182223 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:45:46.678509 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:45:46.678473 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:45:54.580042 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:45:54.580008 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:46:04.034116 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:46:04.034012 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:46:11.822406 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:46:11.822371 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:46:21.521179 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:46:21.521141 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:46:32.474235 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:46:32.474199 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:46:41.380451 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:46:41.380403 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:46:52.574230 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:46:52.574195 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:47:01.784804 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:47:01.784765 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:47:07.879463 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:47:07.879420 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:47:17.101425 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:47:17.101395 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:47:24.771083 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:47:24.771049 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:47:41.679418 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:47:41.679326 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:47:51.580735 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:47:51.580698 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:47:59.479986 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:47:59.479952 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:48:07.584180 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:48:07.584146 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:48:16.087979 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:48:16.087946 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2n5jr_d9537e64-5ba3-4910-998c-e9d3deb97929/ovn-acl-logging/0.log" May 21 18:48:16.094076 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:48:16.094045 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2n5jr_d9537e64-5ba3-4910-998c-e9d3deb97929/ovn-acl-logging/0.log" May 21 18:48:31.172530 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:48:31.172494 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:48:44.084893 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:48:44.084855 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9bv9j"] May 21 18:48:47.385749 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:48:47.385719 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-75d67f6bbf-2gprs_ce9d9246-a261-46b5-ba44-fc5afa8f3a13/authorino/0.log" May 21 18:48:52.044408 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:48:52.044380 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29656470-c5tb7_00c9cf6d-2e18-444c-b05f-15ce97e67d09/cleanup/0.log" May 21 18:48:52.160413 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:48:52.160382 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29656485-hzn7x_4d1c4d0a-f78e-4a12-a59d-7378a4c7c264/cleanup/0.log" May 21 18:48:52.528798 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:48:52.528767 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5948ffb7d5-hl4lt_fe13060e-f481-41ce-9560-0d2cbd60ef10/manager/0.log" May 21 18:48:54.104357 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:48:54.104328 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-75d67f6bbf-2gprs_ce9d9246-a261-46b5-ba44-fc5afa8f3a13/authorino/0.log" May 21 18:48:54.793090 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:48:54.793064 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-9bv9j_138bba33-de92-4e60-8a2c-6317f3c0c6d9/limitador/0.log" May 21 18:48:55.574746 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:48:55.574712 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-78678676dd-qcc86_b5f8c113-1f81-4e61-9e42-62160932379b/kube-auth-proxy/0.log" May 21 18:49:01.272285 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:01.272205 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-44fjf/must-gather-8sp54"] May 21 18:49:01.272748 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:01.272546 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d1c4d0a-f78e-4a12-a59d-7378a4c7c264" containerName="cleanup" May 21 18:49:01.272748 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:01.272557 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d1c4d0a-f78e-4a12-a59d-7378a4c7c264" containerName="cleanup" May 21 18:49:01.272748 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:01.272647 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="4d1c4d0a-f78e-4a12-a59d-7378a4c7c264" containerName="cleanup" May 21 18:49:01.275831 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:01.275813 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-44fjf/must-gather-8sp54" May 21 18:49:01.278655 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:01.278636 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-44fjf\"/\"kube-root-ca.crt\"" May 21 18:49:01.279530 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:01.279514 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-44fjf\"/\"default-dockercfg-h4s9z\"" May 21 18:49:01.279798 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:01.279781 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-44fjf\"/\"openshift-service-ca.crt\"" May 21 18:49:01.296362 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:01.296336 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-44fjf/must-gather-8sp54"] May 21 18:49:01.356137 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:01.356109 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ba8a80af-edf5-498c-8a42-b5df0efc8078-must-gather-output\") pod \"must-gather-8sp54\" (UID: \"ba8a80af-edf5-498c-8a42-b5df0efc8078\") " pod="openshift-must-gather-44fjf/must-gather-8sp54" May 21 18:49:01.356270 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:01.356176 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlzxc\" (UniqueName: \"kubernetes.io/projected/ba8a80af-edf5-498c-8a42-b5df0efc8078-kube-api-access-dlzxc\") pod \"must-gather-8sp54\" (UID: \"ba8a80af-edf5-498c-8a42-b5df0efc8078\") " pod="openshift-must-gather-44fjf/must-gather-8sp54" May 21 18:49:01.457530 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:01.457502 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ba8a80af-edf5-498c-8a42-b5df0efc8078-must-gather-output\") pod \"must-gather-8sp54\" (UID: \"ba8a80af-edf5-498c-8a42-b5df0efc8078\") " pod="openshift-must-gather-44fjf/must-gather-8sp54" May 21 18:49:01.457727 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:01.457555 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dlzxc\" (UniqueName: \"kubernetes.io/projected/ba8a80af-edf5-498c-8a42-b5df0efc8078-kube-api-access-dlzxc\") pod \"must-gather-8sp54\" (UID: \"ba8a80af-edf5-498c-8a42-b5df0efc8078\") " pod="openshift-must-gather-44fjf/must-gather-8sp54" May 21 18:49:01.457871 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:01.457850 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ba8a80af-edf5-498c-8a42-b5df0efc8078-must-gather-output\") pod \"must-gather-8sp54\" (UID: \"ba8a80af-edf5-498c-8a42-b5df0efc8078\") " pod="openshift-must-gather-44fjf/must-gather-8sp54" May 21 18:49:01.467013 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:01.466990 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlzxc\" (UniqueName: \"kubernetes.io/projected/ba8a80af-edf5-498c-8a42-b5df0efc8078-kube-api-access-dlzxc\") pod \"must-gather-8sp54\" (UID: \"ba8a80af-edf5-498c-8a42-b5df0efc8078\") " pod="openshift-must-gather-44fjf/must-gather-8sp54" May 21 18:49:01.585236 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:01.585152 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-44fjf/must-gather-8sp54" May 21 18:49:01.708739 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:01.708707 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-44fjf/must-gather-8sp54"] May 21 18:49:01.710669 ip-10-0-141-59 kubenswrapper[2567]: W0521 18:49:01.710642 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podba8a80af_edf5_498c_8a42_b5df0efc8078.slice/crio-c95c8cec9d452f4430208519a69fda9736e009d7b16bc9bd1d682a921b804e1f WatchSource:0}: Error finding container c95c8cec9d452f4430208519a69fda9736e009d7b16bc9bd1d682a921b804e1f: Status 404 returned error can't find the container with id c95c8cec9d452f4430208519a69fda9736e009d7b16bc9bd1d682a921b804e1f May 21 18:49:02.115025 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:02.114992 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-44fjf/must-gather-8sp54" event={"ID":"ba8a80af-edf5-498c-8a42-b5df0efc8078","Type":"ContainerStarted","Data":"c95c8cec9d452f4430208519a69fda9736e009d7b16bc9bd1d682a921b804e1f"} May 21 18:49:03.121258 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:03.121212 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-44fjf/must-gather-8sp54" event={"ID":"ba8a80af-edf5-498c-8a42-b5df0efc8078","Type":"ContainerStarted","Data":"5a78ca2962ae979eaf2fd1bdb0db4b47ec31c169bfa5922dd78bcd4c80cd9825"} May 21 18:49:03.121258 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:03.121263 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-44fjf/must-gather-8sp54" event={"ID":"ba8a80af-edf5-498c-8a42-b5df0efc8078","Type":"ContainerStarted","Data":"ec6b5ec9b6c8a984a6db8edd764b618a029bab67c85423c6f4a39dac4d826b65"} May 21 18:49:03.138027 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:03.137982 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-44fjf/must-gather-8sp54" podStartSLOduration=1.2002639689999999 podStartE2EDuration="2.137966022s" podCreationTimestamp="2026-05-21 18:49:01 +0000 UTC" firstStartedPulling="2026-05-21 18:49:01.712340423 +0000 UTC m=+2146.297826840" lastFinishedPulling="2026-05-21 18:49:02.65004247 +0000 UTC m=+2147.235528893" observedRunningTime="2026-05-21 18:49:03.13576064 +0000 UTC m=+2147.721247089" watchObservedRunningTime="2026-05-21 18:49:03.137966022 +0000 UTC m=+2147.723452499" May 21 18:49:04.279254 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:04.279211 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-99nkl_3f3c9bbc-1112-4856-9a53-6a1e76ca54e0/global-pull-secret-syncer/0.log" May 21 18:49:04.439030 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:04.438995 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-l82nt_5ec61c29-892e-485c-b233-01e2eafa1ff4/konnectivity-agent/0.log" May 21 18:49:04.490723 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:04.490668 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-59.ec2.internal_865c2e3735c54eea4d9ac88d1c24d330/haproxy/0.log" May 21 18:49:08.752559 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:08.752515 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-75d67f6bbf-2gprs_ce9d9246-a261-46b5-ba44-fc5afa8f3a13/authorino/0.log" May 21 18:49:09.009170 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:09.009077 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-9bv9j_138bba33-de92-4e60-8a2c-6317f3c0c6d9/limitador/0.log" May 21 18:49:10.457256 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:10.457227 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2/alertmanager/0.log" May 21 18:49:10.492968 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:10.492940 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2/config-reloader/0.log" May 21 18:49:10.520263 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:10.520238 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2/kube-rbac-proxy-web/0.log" May 21 18:49:10.548499 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:10.548445 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2/kube-rbac-proxy/0.log" May 21 18:49:10.580935 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:10.580901 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2/kube-rbac-proxy-metric/0.log" May 21 18:49:10.602772 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:10.602746 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2/prom-label-proxy/0.log" May 21 18:49:10.629779 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:10.629569 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5fb0ba0f-79ad-4c3c-874c-a5cb63c3ead2/init-config-reloader/0.log" May 21 18:49:10.801355 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:10.801319 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-54876f9cd5-rz5ws_8ab70191-1066-4234-b458-d6faee0da7da/metrics-server/0.log" May 21 18:49:10.889266 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:10.889186 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kf6bz_1da06ee6-5895-4f97-8d35-8967b0bc81e8/node-exporter/0.log" May 21 18:49:10.916500 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:10.916473 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kf6bz_1da06ee6-5895-4f97-8d35-8967b0bc81e8/kube-rbac-proxy/0.log" May 21 18:49:10.944605 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:10.944551 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kf6bz_1da06ee6-5895-4f97-8d35-8967b0bc81e8/init-textfile/0.log" May 21 18:49:11.152436 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:11.152369 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-4mn82_8c1362ee-6e5b-42e5-b041-4c5d9cb57692/kube-rbac-proxy-main/0.log" May 21 18:49:11.176699 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:11.176666 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-4mn82_8c1362ee-6e5b-42e5-b041-4c5d9cb57692/kube-rbac-proxy-self/0.log" May 21 18:49:11.204856 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:11.204831 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-4mn82_8c1362ee-6e5b-42e5-b041-4c5d9cb57692/openshift-state-metrics/0.log" May 21 18:49:11.282968 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:11.282936 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f1cb0d4f-775b-4171-b394-75b5fee241ec/prometheus/0.log" May 21 18:49:11.313455 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:11.313419 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f1cb0d4f-775b-4171-b394-75b5fee241ec/config-reloader/0.log" May 21 18:49:11.334390 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:11.334355 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f1cb0d4f-775b-4171-b394-75b5fee241ec/thanos-sidecar/0.log" May 21 18:49:11.357017 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:11.356968 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f1cb0d4f-775b-4171-b394-75b5fee241ec/kube-rbac-proxy-web/0.log" May 21 18:49:11.380765 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:11.380733 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f1cb0d4f-775b-4171-b394-75b5fee241ec/kube-rbac-proxy/0.log" May 21 18:49:11.405876 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:11.405800 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f1cb0d4f-775b-4171-b394-75b5fee241ec/kube-rbac-proxy-thanos/0.log" May 21 18:49:11.431096 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:11.431068 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f1cb0d4f-775b-4171-b394-75b5fee241ec/init-config-reloader/0.log" May 21 18:49:11.631009 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:11.630976 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dbdf6b59f-9fslv_5e275137-ae27-4f57-a114-6265e167583c/thanos-query/0.log" May 21 18:49:11.656208 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:11.656133 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dbdf6b59f-9fslv_5e275137-ae27-4f57-a114-6265e167583c/kube-rbac-proxy-web/0.log" May 21 18:49:11.680197 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:11.680167 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dbdf6b59f-9fslv_5e275137-ae27-4f57-a114-6265e167583c/kube-rbac-proxy/0.log" May 21 18:49:11.703392 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:11.703344 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dbdf6b59f-9fslv_5e275137-ae27-4f57-a114-6265e167583c/prom-label-proxy/0.log" May 21 18:49:11.728839 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:11.728793 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dbdf6b59f-9fslv_5e275137-ae27-4f57-a114-6265e167583c/kube-rbac-proxy-rules/0.log" May 21 18:49:11.751951 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:11.751909 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dbdf6b59f-9fslv_5e275137-ae27-4f57-a114-6265e167583c/kube-rbac-proxy-metrics/0.log" May 21 18:49:12.888180 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:12.888141 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-44fjf/perf-node-gather-daemonset-hlx8q"] May 21 18:49:12.895487 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:12.895458 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-hlx8q" May 21 18:49:12.901287 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:12.901257 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-44fjf/perf-node-gather-daemonset-hlx8q"] May 21 18:49:12.973238 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:12.973191 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72985967-576a-428b-b0a3-717af7061ecb-lib-modules\") pod \"perf-node-gather-daemonset-hlx8q\" (UID: \"72985967-576a-428b-b0a3-717af7061ecb\") " pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-hlx8q" May 21 18:49:12.973439 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:12.973264 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/72985967-576a-428b-b0a3-717af7061ecb-podres\") pod \"perf-node-gather-daemonset-hlx8q\" (UID: \"72985967-576a-428b-b0a3-717af7061ecb\") " pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-hlx8q" May 21 18:49:12.973439 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:12.973333 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stmbk\" (UniqueName: \"kubernetes.io/projected/72985967-576a-428b-b0a3-717af7061ecb-kube-api-access-stmbk\") pod \"perf-node-gather-daemonset-hlx8q\" (UID: \"72985967-576a-428b-b0a3-717af7061ecb\") " pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-hlx8q" May 21 18:49:12.973439 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:12.973400 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72985967-576a-428b-b0a3-717af7061ecb-sys\") pod \"perf-node-gather-daemonset-hlx8q\" (UID: \"72985967-576a-428b-b0a3-717af7061ecb\") " pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-hlx8q" May 21 18:49:12.973439 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:12.973424 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/72985967-576a-428b-b0a3-717af7061ecb-proc\") pod \"perf-node-gather-daemonset-hlx8q\" (UID: \"72985967-576a-428b-b0a3-717af7061ecb\") " pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-hlx8q" May 21 18:49:13.073934 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:13.073899 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-stmbk\" (UniqueName: \"kubernetes.io/projected/72985967-576a-428b-b0a3-717af7061ecb-kube-api-access-stmbk\") pod \"perf-node-gather-daemonset-hlx8q\" (UID: \"72985967-576a-428b-b0a3-717af7061ecb\") " pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-hlx8q" May 21 18:49:13.074127 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:13.073955 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72985967-576a-428b-b0a3-717af7061ecb-sys\") pod \"perf-node-gather-daemonset-hlx8q\" (UID: \"72985967-576a-428b-b0a3-717af7061ecb\") " pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-hlx8q" May 21 18:49:13.074127 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:13.073973 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/72985967-576a-428b-b0a3-717af7061ecb-proc\") pod \"perf-node-gather-daemonset-hlx8q\" (UID: \"72985967-576a-428b-b0a3-717af7061ecb\") " pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-hlx8q" May 21 18:49:13.074127 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:13.074008 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72985967-576a-428b-b0a3-717af7061ecb-lib-modules\") pod \"perf-node-gather-daemonset-hlx8q\" (UID: \"72985967-576a-428b-b0a3-717af7061ecb\") " pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-hlx8q" May 21 18:49:13.074127 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:13.074035 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/72985967-576a-428b-b0a3-717af7061ecb-podres\") pod \"perf-node-gather-daemonset-hlx8q\" (UID: \"72985967-576a-428b-b0a3-717af7061ecb\") " pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-hlx8q" May 21 18:49:13.074127 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:13.074042 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72985967-576a-428b-b0a3-717af7061ecb-sys\") pod \"perf-node-gather-daemonset-hlx8q\" (UID: \"72985967-576a-428b-b0a3-717af7061ecb\") " pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-hlx8q" May 21 18:49:13.074365 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:13.074137 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/72985967-576a-428b-b0a3-717af7061ecb-proc\") pod \"perf-node-gather-daemonset-hlx8q\" (UID: \"72985967-576a-428b-b0a3-717af7061ecb\") " pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-hlx8q" May 21 18:49:13.074365 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:13.074187 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/72985967-576a-428b-b0a3-717af7061ecb-podres\") pod \"perf-node-gather-daemonset-hlx8q\" (UID: \"72985967-576a-428b-b0a3-717af7061ecb\") " pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-hlx8q" May 21 18:49:13.074365 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:13.074238 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72985967-576a-428b-b0a3-717af7061ecb-lib-modules\") pod \"perf-node-gather-daemonset-hlx8q\" (UID: \"72985967-576a-428b-b0a3-717af7061ecb\") " pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-hlx8q" May 21 18:49:13.081676 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:13.081652 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stmbk\" (UniqueName: \"kubernetes.io/projected/72985967-576a-428b-b0a3-717af7061ecb-kube-api-access-stmbk\") pod \"perf-node-gather-daemonset-hlx8q\" (UID: \"72985967-576a-428b-b0a3-717af7061ecb\") " pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-hlx8q" May 21 18:49:13.208943 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:13.208408 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-hlx8q" May 21 18:49:13.382322 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:13.382296 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-44fjf/perf-node-gather-daemonset-hlx8q"] May 21 18:49:14.172825 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:14.172786 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-hlx8q" event={"ID":"72985967-576a-428b-b0a3-717af7061ecb","Type":"ContainerStarted","Data":"f41ebf8ee3bc16889ff7e6beddf72b19de2f2bf4a3b1bd2a6f0bd7e94d224e39"} May 21 18:49:14.172825 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:14.172828 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-hlx8q" event={"ID":"72985967-576a-428b-b0a3-717af7061ecb","Type":"ContainerStarted","Data":"e4afc756549b8d65268e78eb5e42e81f226d8e2a2610026771a75c7f1e82de18"} May 21 18:49:14.173256 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:14.172979 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-hlx8q" May 21 18:49:14.189464 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:14.189418 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-hlx8q" podStartSLOduration=2.189381581 podStartE2EDuration="2.189381581s" podCreationTimestamp="2026-05-21 18:49:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:49:14.18884558 +0000 UTC m=+2158.774332017" watchObservedRunningTime="2026-05-21 18:49:14.189381581 +0000 UTC m=+2158.774868016" May 21 18:49:15.578634 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:15.578595 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x42gp_e5f9e615-faab-4e8d-aff3-b1fb8007d012/dns/0.log" May 21 18:49:15.599009 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:15.598982 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x42gp_e5f9e615-faab-4e8d-aff3-b1fb8007d012/kube-rbac-proxy/0.log" May 21 18:49:15.621036 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:15.621010 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6h54k_806b4e1a-170a-44ac-b356-92e2c2337e02/dns-node-resolver/0.log" May 21 18:49:16.183564 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:16.183526 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fwkk2_e3c0da04-85d7-4c03-8f44-42c8748c4218/node-ca/0.log" May 21 18:49:17.283288 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:17.283259 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-78678676dd-qcc86_b5f8c113-1f81-4e61-9e42-62160932379b/kube-auth-proxy/0.log" May 21 18:49:18.041831 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:18.041803 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jmg7k_1a74d1a0-0bba-4463-8e3f-e9aa3157eaf8/serve-healthcheck-canary/0.log" May 21 18:49:18.605785 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:18.605754 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hvk4x_a34d53fe-0e5b-4781-ae13-d702722fd7d1/kube-rbac-proxy/0.log" May 21 18:49:18.627366 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:18.627341 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hvk4x_a34d53fe-0e5b-4781-ae13-d702722fd7d1/exporter/0.log" May 21 18:49:18.649694 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:18.649672 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hvk4x_a34d53fe-0e5b-4781-ae13-d702722fd7d1/extractor/0.log" May 21 18:49:20.191138 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:20.190228 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-hlx8q" May 21 18:49:20.674403 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:20.674369 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29656470-c5tb7_00c9cf6d-2e18-444c-b05f-15ce97e67d09/cleanup/0.log" May 21 18:49:20.698677 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:20.698651 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29656485-hzn7x_4d1c4d0a-f78e-4a12-a59d-7378a4c7c264/cleanup/0.log" May 21 18:49:20.906493 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:20.906454 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5948ffb7d5-hl4lt_fe13060e-f481-41ce-9560-0d2cbd60ef10/manager/0.log" May 21 18:49:22.344009 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:22.343973 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-99f48c84-ghw2w_23c47092-f3fb-4e8e-a980-0f3bbcd4fb04/manager/0.log" May 21 18:49:22.406077 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:22.405969 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-fnhqx_a18ec362-c02f-4d5d-ac10-278c58ffdd62/openshift-lws-operator/0.log" May 21 18:49:26.754403 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:26.754338 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-sv552_d8dc7a52-a103-4b9c-90e7-a7ff58a9a58a/migrator/0.log" May 21 18:49:26.775611 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:26.775559 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-sv552_d8dc7a52-a103-4b9c-90e7-a7ff58a9a58a/graceful-termination/0.log" May 21 18:49:27.161395 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:27.161316 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-jxqn7_19902950-4f77-4026-98b8-09db0bc05a05/kube-storage-version-migrator-operator/1.log" May 21 18:49:27.162770 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:27.162729 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-jxqn7_19902950-4f77-4026-98b8-09db0bc05a05/kube-storage-version-migrator-operator/0.log" May 21 18:49:28.311003 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:28.310971 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jx9sz_868c9a60-0d4e-4bda-9e1d-8c1087daa9e5/kube-multus-additional-cni-plugins/0.log" May 21 18:49:28.335875 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:28.335849 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jx9sz_868c9a60-0d4e-4bda-9e1d-8c1087daa9e5/egress-router-binary-copy/0.log" May 21 18:49:28.357788 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:28.357757 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jx9sz_868c9a60-0d4e-4bda-9e1d-8c1087daa9e5/cni-plugins/0.log" May 21 18:49:28.379867 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:28.379843 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jx9sz_868c9a60-0d4e-4bda-9e1d-8c1087daa9e5/bond-cni-plugin/0.log" May 21 18:49:28.402029 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:28.401997 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jx9sz_868c9a60-0d4e-4bda-9e1d-8c1087daa9e5/routeoverride-cni/0.log" May 21 18:49:28.423906 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:28.423875 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jx9sz_868c9a60-0d4e-4bda-9e1d-8c1087daa9e5/whereabouts-cni-bincopy/0.log" May 21 18:49:28.448434 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:28.448404 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jx9sz_868c9a60-0d4e-4bda-9e1d-8c1087daa9e5/whereabouts-cni/0.log" May 21 18:49:28.700650 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:28.700561 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-zkz67_151a7f52-0d11-42c8-a0d5-87d0d3cd7598/kube-multus/0.log" May 21 18:49:28.824407 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:28.824379 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lk2c6_80ec104c-46e1-4fb3-a8bc-f5664e798321/network-metrics-daemon/0.log" May 21 18:49:28.844661 ip-10-0-141-59 kubenswrapper[2567]: I0521 18:49:28.844629 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lk2c6_80ec104c-46e1-4fb3-a8bc-f5664e798321/kube-rbac-proxy/0.log"