May 25 14:09:42.092871 ip-10-0-140-29 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 25 14:09:42.093149 ip-10-0-140-29 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 25 14:09:42.093715 ip-10-0-140-29 systemd[1]: kubelet.service: Failed with result 'resources'. May 25 14:09:42.094343 ip-10-0-140-29 systemd[1]: Failed to start Kubernetes Kubelet. May 25 14:09:52.191915 ip-10-0-140-29 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 25 14:09:52.191937 ip-10-0-140-29 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot e117d9e3e3f847c69e9e5326ce96be9c -- May 25 14:12:25.676691 ip-10-0-140-29 systemd[1]: Starting Kubernetes Kubelet... May 25 14:12:26.110305 ip-10-0-140-29 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 25 14:12:26.110305 ip-10-0-140-29 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 25 14:12:26.110305 ip-10-0-140-29 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 25 14:12:26.110305 ip-10-0-140-29 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 25 14:12:26.110305 ip-10-0-140-29 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 25 14:12:26.112672 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.112584 2562 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 25 14:12:26.115899 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.115884 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 25 14:12:26.115899 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.115899 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 25 14:12:26.115961 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.115903 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 25 14:12:26.115961 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.115906 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 25 14:12:26.115961 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.115909 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 25 14:12:26.115961 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.115913 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 25 14:12:26.115961 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.115915 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 25 14:12:26.115961 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.115919 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 25 14:12:26.115961 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.115922 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 25 14:12:26.115961 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.115925 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 25 14:12:26.115961 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.115927 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 25 14:12:26.115961 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.115930 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 25 14:12:26.115961 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.115932 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 25 14:12:26.115961 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.115935 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 25 14:12:26.115961 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.115939 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 25 14:12:26.115961 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.115943 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 25 14:12:26.115961 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.115946 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 25 14:12:26.115961 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.115949 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 25 14:12:26.115961 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.115951 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 25 14:12:26.115961 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.115954 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 25 14:12:26.115961 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.115956 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores May 25 14:12:26.116409 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.115959 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 25 14:12:26.116409 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.115961 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 25 14:12:26.116409 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.115964 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 25 14:12:26.116409 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.115967 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 25 14:12:26.116409 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.115969 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 25 14:12:26.116409 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.115972 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 25 14:12:26.116409 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.115975 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 25 14:12:26.116409 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.115977 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 25 14:12:26.116409 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.115980 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 25 14:12:26.116409 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.115982 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 25 14:12:26.116409 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.115985 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 25 14:12:26.116409 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.115988 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 25 14:12:26.116409 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.115990 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 25 14:12:26.116409 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.115992 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 25 14:12:26.116409 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.115996 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 25 14:12:26.116409 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.115998 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 25 14:12:26.116409 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116001 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 25 14:12:26.116409 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116004 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 25 14:12:26.116409 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116006 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 25 14:12:26.116409 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116009 2562 feature_gate.go:328] unrecognized feature gate: Example2 May 25 14:12:26.116939 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116012 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 25 14:12:26.116939 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116014 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 25 14:12:26.116939 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116017 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 25 14:12:26.116939 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116019 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 25 14:12:26.116939 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116021 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 25 14:12:26.116939 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116023 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 25 14:12:26.116939 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116026 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 25 14:12:26.116939 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116028 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 25 14:12:26.116939 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116031 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 25 14:12:26.116939 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116033 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages May 25 14:12:26.116939 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116036 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 25 14:12:26.116939 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116038 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability May 25 14:12:26.116939 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116040 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 25 14:12:26.116939 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116044 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 25 14:12:26.116939 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116046 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 25 14:12:26.116939 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116049 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 25 14:12:26.116939 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116051 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 25 14:12:26.116939 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116053 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 25 14:12:26.116939 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116056 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 25 14:12:26.116939 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116058 2562 feature_gate.go:328] unrecognized feature gate: Example May 25 14:12:26.117445 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116060 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 25 14:12:26.117445 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116063 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 25 14:12:26.117445 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116066 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 25 14:12:26.117445 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116068 2562 feature_gate.go:328] unrecognized feature gate: DualReplica May 25 14:12:26.117445 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116070 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 25 14:12:26.117445 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116073 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 25 14:12:26.117445 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116075 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 25 14:12:26.117445 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116077 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 25 14:12:26.117445 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116080 2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 25 14:12:26.117445 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116082 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 25 14:12:26.117445 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116084 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 25 14:12:26.117445 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116087 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 25 14:12:26.117445 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116090 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 25 14:12:26.117445 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116092 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 25 14:12:26.117445 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116094 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 25 14:12:26.117445 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116097 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 25 14:12:26.117445 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116099 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 25 14:12:26.117445 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116101 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 25 14:12:26.117445 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116105 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 25 14:12:26.117445 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116107 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 25 14:12:26.117920 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116109 2562 feature_gate.go:328] unrecognized feature gate: NewOLM May 25 14:12:26.117920 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116112 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 25 14:12:26.117920 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116114 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 25 14:12:26.117920 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116116 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 25 14:12:26.117920 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116120 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 25 14:12:26.117920 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116512 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 25 14:12:26.117920 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116517 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 25 14:12:26.117920 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116520 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 25 14:12:26.117920 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116523 2562 feature_gate.go:328] unrecognized feature gate: DualReplica May 25 14:12:26.117920 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116525 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 25 14:12:26.117920 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116528 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 25 14:12:26.117920 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116531 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 25 14:12:26.117920 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116534 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 25 14:12:26.117920 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116536 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 25 14:12:26.117920 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116539 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 25 14:12:26.117920 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116541 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 25 14:12:26.117920 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116544 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 25 14:12:26.117920 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116546 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 25 14:12:26.117920 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116548 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 25 14:12:26.118482 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116551 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 25 14:12:26.118482 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116553 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 25 14:12:26.118482 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116556 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 25 14:12:26.118482 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116558 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 25 14:12:26.118482 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116560 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 25 14:12:26.118482 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116564 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 25 14:12:26.118482 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116567 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 25 14:12:26.118482 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116569 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 25 14:12:26.118482 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116572 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 25 14:12:26.118482 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116574 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 25 14:12:26.118482 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116576 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages May 25 14:12:26.118482 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116579 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 25 14:12:26.118482 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116581 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 25 14:12:26.118482 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116583 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 25 14:12:26.118482 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116587 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 25 14:12:26.118482 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116590 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 25 14:12:26.118482 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116593 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 25 14:12:26.118482 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116596 2562 feature_gate.go:328] unrecognized feature gate: Example2 May 25 14:12:26.118482 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116600 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 25 14:12:26.118482 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116603 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 25 14:12:26.118960 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116605 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 25 14:12:26.118960 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116607 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 25 14:12:26.118960 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116610 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 25 14:12:26.118960 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116612 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 25 14:12:26.118960 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116615 2562 feature_gate.go:328] unrecognized feature gate: NewOLM May 25 14:12:26.118960 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116617 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 25 14:12:26.118960 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116619 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 25 14:12:26.118960 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116622 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 25 14:12:26.118960 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116624 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 25 14:12:26.118960 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116626 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 25 14:12:26.118960 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116629 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores May 25 14:12:26.118960 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116631 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 25 14:12:26.118960 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116633 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability May 25 14:12:26.118960 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116636 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 25 14:12:26.118960 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116638 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 25 14:12:26.118960 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116640 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 25 14:12:26.118960 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116643 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 25 14:12:26.118960 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116645 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 25 14:12:26.118960 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116648 2562 feature_gate.go:328] unrecognized feature gate: Example May 25 14:12:26.118960 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116651 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 25 14:12:26.119487 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116653 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 25 14:12:26.119487 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116656 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 25 14:12:26.119487 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116659 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 25 14:12:26.119487 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116661 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 25 14:12:26.119487 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116664 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 25 14:12:26.119487 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116666 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 25 14:12:26.119487 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116669 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 25 14:12:26.119487 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116671 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 25 14:12:26.119487 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116674 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 25 14:12:26.119487 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116676 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 25 14:12:26.119487 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116680 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 25 14:12:26.119487 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116682 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 25 14:12:26.119487 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116685 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 25 14:12:26.119487 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116687 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 25 14:12:26.119487 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116689 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 25 14:12:26.119487 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116692 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 25 14:12:26.119487 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116694 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 25 14:12:26.119487 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116697 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 25 14:12:26.119487 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116699 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 25 14:12:26.119929 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116701 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 25 14:12:26.119929 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116704 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 25 14:12:26.119929 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116706 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 25 14:12:26.119929 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116708 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 25 14:12:26.119929 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116711 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 25 14:12:26.119929 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116713 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 25 14:12:26.119929 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116715 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 25 14:12:26.119929 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116718 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 25 14:12:26.119929 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116721 2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 25 14:12:26.119929 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116725 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 25 14:12:26.119929 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116729 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 25 14:12:26.119929 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116732 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 25 14:12:26.119929 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.116735 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 25 14:12:26.119929 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117689 2562 flags.go:64] FLAG: --address="0.0.0.0" May 25 14:12:26.119929 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117700 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 25 14:12:26.119929 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117706 2562 flags.go:64] FLAG: --anonymous-auth="true" May 25 14:12:26.119929 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117711 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" May 25 14:12:26.119929 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117715 2562 flags.go:64] FLAG: --authentication-token-webhook="false" May 25 14:12:26.119929 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117718 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 25 14:12:26.119929 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117723 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 25 14:12:26.119929 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117727 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 25 14:12:26.120444 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117730 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 25 14:12:26.120444 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117733 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 25 14:12:26.120444 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117737 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 25 14:12:26.120444 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117740 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 25 14:12:26.120444 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117743 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 25 14:12:26.120444 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117746 2562 flags.go:64] FLAG: --cgroup-root="" May 25 14:12:26.120444 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117749 2562 flags.go:64] FLAG: --cgroups-per-qos="true" May 25 14:12:26.120444 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117752 2562 flags.go:64] FLAG: --client-ca-file="" May 25 14:12:26.120444 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117755 2562 flags.go:64] FLAG: --cloud-config="" May 25 14:12:26.120444 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117758 2562 flags.go:64] FLAG: --cloud-provider="external" May 25 14:12:26.120444 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117761 2562 flags.go:64] FLAG: --cluster-dns="[]" May 25 14:12:26.120444 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117766 2562 flags.go:64] FLAG: --cluster-domain="" May 25 14:12:26.120444 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117769 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 25 14:12:26.120444 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117772 2562 flags.go:64] FLAG: --config-dir="" May 25 14:12:26.120444 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117774 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 25 14:12:26.120444 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117778 2562 flags.go:64] FLAG: --container-log-max-files="5" May 25 14:12:26.120444 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117781 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" May 25 14:12:26.120444 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117784 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 25 14:12:26.120444 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117787 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 25 14:12:26.120444 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117790 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 25 14:12:26.120444 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117793 2562 flags.go:64] FLAG: --contention-profiling="false" May 25 14:12:26.120444 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117796 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" May 25 14:12:26.120444 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117799 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 25 14:12:26.120444 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117802 2562 flags.go:64] FLAG: --cpu-manager-policy="none" May 25 14:12:26.120444 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117806 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" May 25 14:12:26.121060 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117810 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 25 14:12:26.121060 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117814 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 25 14:12:26.121060 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117817 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" May 25 14:12:26.121060 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117820 2562 flags.go:64] FLAG: --enable-load-reader="false" May 25 14:12:26.121060 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117823 2562 flags.go:64] FLAG: --enable-server="true" May 25 14:12:26.121060 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117825 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 25 14:12:26.121060 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117830 2562 flags.go:64] FLAG: --event-burst="100" May 25 14:12:26.121060 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117832 2562 flags.go:64] FLAG: --event-qps="50" May 25 14:12:26.121060 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117836 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 25 14:12:26.121060 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117839 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 25 14:12:26.121060 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117841 2562 flags.go:64] FLAG: --eviction-hard="" May 25 14:12:26.121060 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117845 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 25 14:12:26.121060 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117848 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 25 14:12:26.121060 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117851 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 25 14:12:26.121060 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117853 2562 flags.go:64] FLAG: --eviction-soft="" May 25 14:12:26.121060 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117857 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" May 25 14:12:26.121060 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117860 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" May 25 14:12:26.121060 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117863 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 25 14:12:26.121060 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117865 2562 flags.go:64] FLAG: --experimental-mounter-path="" May 25 14:12:26.121060 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117868 2562 flags.go:64] FLAG: --fail-cgroupv1="false" May 25 14:12:26.121060 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117875 2562 flags.go:64] FLAG: --fail-swap-on="true" May 25 14:12:26.121060 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117878 2562 flags.go:64] FLAG: --feature-gates="" May 25 14:12:26.121060 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117882 2562 flags.go:64] FLAG: --file-check-frequency="20s" May 25 14:12:26.121060 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117885 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 25 14:12:26.121060 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117889 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 25 14:12:26.121694 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117892 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 25 14:12:26.121694 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117895 2562 flags.go:64] FLAG: --healthz-port="10248" May 25 14:12:26.121694 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117898 2562 flags.go:64] FLAG: --help="false" May 25 14:12:26.121694 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117901 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-140-29.ec2.internal" May 25 14:12:26.121694 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117904 2562 flags.go:64] FLAG: --housekeeping-interval="10s" May 25 14:12:26.121694 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117907 2562 flags.go:64] FLAG: --http-check-frequency="20s" May 25 14:12:26.121694 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117910 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 25 14:12:26.121694 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117914 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 25 14:12:26.121694 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117917 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" May 25 14:12:26.121694 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117920 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" May 25 14:12:26.121694 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117924 2562 flags.go:64] FLAG: --image-service-endpoint="" May 25 14:12:26.121694 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117927 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" May 25 14:12:26.121694 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117930 2562 flags.go:64] FLAG: --kube-api-burst="100" May 25 14:12:26.121694 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117932 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 25 14:12:26.121694 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117936 2562 flags.go:64] FLAG: --kube-api-qps="50" May 25 14:12:26.121694 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117938 2562 flags.go:64] FLAG: --kube-reserved="" May 25 14:12:26.121694 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117941 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" May 25 14:12:26.121694 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117944 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 25 14:12:26.121694 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117946 2562 flags.go:64] FLAG: --kubelet-cgroups="" May 25 14:12:26.121694 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117949 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 25 14:12:26.121694 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117952 2562 flags.go:64] FLAG: --lock-file="" May 25 14:12:26.121694 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117954 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" May 25 14:12:26.121694 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117957 2562 flags.go:64] FLAG: --log-flush-frequency="5s" May 25 14:12:26.121694 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117960 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 25 14:12:26.122281 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117965 2562 flags.go:64] FLAG: --log-json-split-stream="false" May 25 14:12:26.122281 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117968 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 25 14:12:26.122281 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117971 2562 flags.go:64] FLAG: --log-text-split-stream="false" May 25 14:12:26.122281 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117976 2562 flags.go:64] FLAG: --logging-format="text" May 25 14:12:26.122281 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117978 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 25 14:12:26.122281 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117982 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" May 25 14:12:26.122281 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117984 2562 flags.go:64] FLAG: --manifest-url="" May 25 14:12:26.122281 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.117987 2562 flags.go:64] FLAG: --manifest-url-header="" May 25 14:12:26.122281 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118005 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 25 14:12:26.122281 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118008 2562 flags.go:64] FLAG: --max-open-files="1000000" May 25 14:12:26.122281 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118012 2562 flags.go:64] FLAG: --max-pods="110" May 25 14:12:26.122281 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118015 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" May 25 14:12:26.122281 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118017 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 25 14:12:26.122281 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118020 2562 flags.go:64] FLAG: --memory-manager-policy="None" May 25 14:12:26.122281 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118023 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 25 14:12:26.122281 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118026 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 25 14:12:26.122281 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118029 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" May 25 14:12:26.122281 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118032 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 25 14:12:26.122281 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118039 2562 flags.go:64] FLAG: --node-status-max-images="50" May 25 14:12:26.122281 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118042 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" May 25 14:12:26.122281 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118045 2562 flags.go:64] FLAG: --oom-score-adj="-999" May 25 14:12:26.122281 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118048 2562 flags.go:64] FLAG: --pod-cidr="" May 25 14:12:26.122281 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118051 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 25 14:12:26.122843 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118058 2562 flags.go:64] FLAG: --pod-manifest-path="" May 25 14:12:26.122843 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118061 2562 flags.go:64] FLAG: --pod-max-pids="-1" May 25 14:12:26.122843 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118063 2562 flags.go:64] FLAG: --pods-per-core="0" May 25 14:12:26.122843 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118066 2562 flags.go:64] FLAG: --port="10250" May 25 14:12:26.122843 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118069 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" May 25 14:12:26.122843 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118072 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03598ab012a873589" May 25 14:12:26.122843 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118075 2562 flags.go:64] FLAG: --qos-reserved="" May 25 14:12:26.122843 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118078 2562 flags.go:64] FLAG: --read-only-port="10255" May 25 14:12:26.122843 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118081 2562 flags.go:64] FLAG: --register-node="true" May 25 14:12:26.122843 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118083 2562 flags.go:64] FLAG: --register-schedulable="true" May 25 14:12:26.122843 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118086 2562 flags.go:64] FLAG: --register-with-taints="" May 25 14:12:26.122843 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118089 2562 flags.go:64] FLAG: --registry-burst="10" May 25 14:12:26.122843 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118092 2562 flags.go:64] FLAG: --registry-qps="5" May 25 14:12:26.122843 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118096 2562 flags.go:64] FLAG: --reserved-cpus="" May 25 14:12:26.122843 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118098 2562 flags.go:64] FLAG: --reserved-memory="" May 25 14:12:26.122843 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118102 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 25 14:12:26.122843 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118105 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 25 14:12:26.122843 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118108 2562 flags.go:64] FLAG: --rotate-certificates="false" May 25 14:12:26.122843 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118111 2562 flags.go:64] FLAG: --rotate-server-certificates="false" May 25 14:12:26.122843 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118114 2562 flags.go:64] FLAG: --runonce="false" May 25 14:12:26.122843 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118117 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 25 14:12:26.122843 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118119 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 25 14:12:26.122843 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118122 2562 flags.go:64] FLAG: --seccomp-default="false" May 25 14:12:26.122843 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118125 2562 flags.go:64] FLAG: --serialize-image-pulls="true" May 25 14:12:26.122843 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118128 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 25 14:12:26.122843 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118131 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 25 14:12:26.123468 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118135 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 25 14:12:26.123468 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118138 2562 flags.go:64] FLAG: --storage-driver-password="root" May 25 14:12:26.123468 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118141 2562 flags.go:64] FLAG: --storage-driver-secure="false" May 25 14:12:26.123468 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118144 2562 flags.go:64] FLAG: --storage-driver-table="stats" May 25 14:12:26.123468 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118146 2562 flags.go:64] FLAG: --storage-driver-user="root" May 25 14:12:26.123468 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118149 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 25 14:12:26.123468 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118152 2562 flags.go:64] FLAG: --sync-frequency="1m0s" May 25 14:12:26.123468 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118155 2562 flags.go:64] FLAG: --system-cgroups="" May 25 14:12:26.123468 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118157 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 25 14:12:26.123468 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118162 2562 flags.go:64] FLAG: --system-reserved-cgroup="" May 25 14:12:26.123468 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118165 2562 flags.go:64] FLAG: --tls-cert-file="" May 25 14:12:26.123468 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118168 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" May 25 14:12:26.123468 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118172 2562 flags.go:64] FLAG: --tls-min-version="" May 25 14:12:26.123468 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118175 2562 flags.go:64] FLAG: --tls-private-key-file="" May 25 14:12:26.123468 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118178 2562 flags.go:64] FLAG: --topology-manager-policy="none" May 25 14:12:26.123468 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118181 2562 flags.go:64] FLAG: --topology-manager-policy-options="" May 25 14:12:26.123468 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118183 2562 flags.go:64] FLAG: --topology-manager-scope="container" May 25 14:12:26.123468 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118186 2562 flags.go:64] FLAG: --v="2" May 25 14:12:26.123468 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118190 2562 flags.go:64] FLAG: --version="false" May 25 14:12:26.123468 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118195 2562 flags.go:64] FLAG: --vmodule="" May 25 14:12:26.123468 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118199 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 25 14:12:26.123468 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.118203 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 25 14:12:26.123468 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118303 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 25 14:12:26.123468 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118307 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 25 14:12:26.124023 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118310 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 25 14:12:26.124023 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118313 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 25 14:12:26.124023 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118316 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 25 14:12:26.124023 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118318 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 25 14:12:26.124023 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118321 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 25 14:12:26.124023 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118323 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 25 14:12:26.124023 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118326 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 25 14:12:26.124023 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118328 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores May 25 14:12:26.124023 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118330 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 25 14:12:26.124023 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118333 2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 25 14:12:26.124023 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118336 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages May 25 14:12:26.124023 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118338 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 25 14:12:26.124023 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118340 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 25 14:12:26.124023 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118343 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 25 14:12:26.124023 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118345 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 25 14:12:26.124023 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118348 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 25 14:12:26.124023 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118350 2562 feature_gate.go:328] unrecognized feature gate: Example2 May 25 14:12:26.124023 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118353 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 25 14:12:26.124023 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118356 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 25 14:12:26.124023 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118358 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 25 14:12:26.124553 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118360 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 25 14:12:26.124553 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118362 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 25 14:12:26.124553 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118365 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 25 14:12:26.124553 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118367 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 25 14:12:26.124553 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118383 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 25 14:12:26.124553 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118385 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 25 14:12:26.124553 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118388 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 25 14:12:26.124553 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118392 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 25 14:12:26.124553 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118394 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 25 14:12:26.124553 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118397 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 25 14:12:26.124553 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118399 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 25 14:12:26.124553 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118403 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 25 14:12:26.124553 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118407 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 25 14:12:26.124553 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118409 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 25 14:12:26.124553 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118412 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 25 14:12:26.124553 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118414 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 25 14:12:26.124553 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118417 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 25 14:12:26.124553 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118419 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 25 14:12:26.124553 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118422 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 25 14:12:26.124553 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118424 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 25 14:12:26.125081 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118427 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 25 14:12:26.125081 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118429 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 25 14:12:26.125081 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118435 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 25 14:12:26.125081 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118437 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 25 14:12:26.125081 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118440 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 25 14:12:26.125081 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118442 2562 feature_gate.go:328] unrecognized feature gate: Example May 25 14:12:26.125081 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118445 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 25 14:12:26.125081 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118447 2562 feature_gate.go:328] unrecognized feature gate: NewOLM May 25 14:12:26.125081 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118449 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 25 14:12:26.125081 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118452 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 25 14:12:26.125081 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118454 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 25 14:12:26.125081 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118456 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 25 14:12:26.125081 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118459 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 25 14:12:26.125081 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118461 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 25 14:12:26.125081 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118464 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 25 14:12:26.125081 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118466 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 25 14:12:26.125081 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118468 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 25 14:12:26.125081 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118471 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 25 14:12:26.125081 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118473 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 25 14:12:26.125081 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118477 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 25 14:12:26.125911 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118480 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 25 14:12:26.125911 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118482 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 25 14:12:26.125911 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118486 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 25 14:12:26.125911 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118489 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 25 14:12:26.125911 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118491 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 25 14:12:26.125911 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118494 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 25 14:12:26.125911 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118497 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 25 14:12:26.125911 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118499 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 25 14:12:26.125911 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118502 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 25 14:12:26.125911 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118504 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 25 14:12:26.125911 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118508 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 25 14:12:26.125911 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118512 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 25 14:12:26.125911 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118515 2562 feature_gate.go:328] unrecognized feature gate: DualReplica May 25 14:12:26.125911 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118517 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 25 14:12:26.125911 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118520 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 25 14:12:26.125911 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118523 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability May 25 14:12:26.125911 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118526 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 25 14:12:26.125911 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118529 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 25 14:12:26.125911 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118531 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 25 14:12:26.126425 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118534 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 25 14:12:26.126425 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118536 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 25 14:12:26.126425 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118539 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 25 14:12:26.126425 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118541 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 25 14:12:26.126425 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.118544 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 25 14:12:26.126425 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.119109 2562 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 25 14:12:26.126745 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.126720 2562 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 25 14:12:26.126776 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.126747 2562 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 25 14:12:26.126805 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126798 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 25 14:12:26.126805 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126803 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 25 14:12:26.126855 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126807 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 25 14:12:26.126855 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126810 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 25 14:12:26.126855 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126814 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 25 14:12:26.126855 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126817 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 25 14:12:26.126855 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126819 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 25 14:12:26.126855 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126822 2562 feature_gate.go:328] unrecognized feature gate: NewOLM May 25 14:12:26.126855 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126824 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 25 14:12:26.126855 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126827 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 25 14:12:26.126855 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126829 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 25 14:12:26.126855 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126832 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 25 14:12:26.126855 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126834 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 25 14:12:26.126855 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126837 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 25 14:12:26.126855 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126840 2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 25 14:12:26.126855 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126842 2562 feature_gate.go:328] unrecognized feature gate: DualReplica May 25 14:12:26.126855 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126845 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 25 14:12:26.126855 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126850 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 25 14:12:26.126855 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126852 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 25 14:12:26.126855 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126856 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 25 14:12:26.126855 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126861 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 25 14:12:26.127309 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126865 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 25 14:12:26.127309 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126867 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 25 14:12:26.127309 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126870 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 25 14:12:26.127309 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126873 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 25 14:12:26.127309 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126875 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 25 14:12:26.127309 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126878 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 25 14:12:26.127309 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126880 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 25 14:12:26.127309 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126883 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 25 14:12:26.127309 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126885 2562 feature_gate.go:328] unrecognized feature gate: Example May 25 14:12:26.127309 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126888 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 25 14:12:26.127309 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126891 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages May 25 14:12:26.127309 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126893 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 25 14:12:26.127309 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126896 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 25 14:12:26.127309 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126898 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 25 14:12:26.127309 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126901 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 25 14:12:26.127309 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126903 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 25 14:12:26.127309 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126906 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 25 14:12:26.127309 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126908 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 25 14:12:26.127309 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126910 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 25 14:12:26.127309 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126913 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 25 14:12:26.127807 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126915 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 25 14:12:26.127807 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126918 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 25 14:12:26.127807 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126921 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 25 14:12:26.127807 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126923 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 25 14:12:26.127807 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126925 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 25 14:12:26.127807 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126928 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 25 14:12:26.127807 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126930 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 25 14:12:26.127807 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126933 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 25 14:12:26.127807 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126935 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 25 14:12:26.127807 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126937 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 25 14:12:26.127807 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126939 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 25 14:12:26.127807 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126942 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 25 14:12:26.127807 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126944 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 25 14:12:26.127807 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126947 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 25 14:12:26.127807 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126950 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 25 14:12:26.127807 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126952 2562 feature_gate.go:328] unrecognized feature gate: Example2 May 25 14:12:26.127807 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126955 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability May 25 14:12:26.127807 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126958 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 25 14:12:26.127807 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126960 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 25 14:12:26.127807 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126962 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 25 14:12:26.128282 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126964 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 25 14:12:26.128282 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126967 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 25 14:12:26.128282 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126969 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 25 14:12:26.128282 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126972 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 25 14:12:26.128282 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126974 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 25 14:12:26.128282 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126976 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 25 14:12:26.128282 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126979 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 25 14:12:26.128282 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126981 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 25 14:12:26.128282 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126984 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 25 14:12:26.128282 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126986 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 25 14:12:26.128282 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126988 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 25 14:12:26.128282 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126991 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 25 14:12:26.128282 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126993 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores May 25 14:12:26.128282 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126996 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 25 14:12:26.128282 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.126998 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 25 14:12:26.128282 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127001 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 25 14:12:26.128282 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127003 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 25 14:12:26.128282 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127006 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 25 14:12:26.128282 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127008 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 25 14:12:26.128282 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127010 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 25 14:12:26.128778 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127013 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 25 14:12:26.128778 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127015 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 25 14:12:26.128778 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127017 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 25 14:12:26.128778 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127020 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 25 14:12:26.128778 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127023 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 25 14:12:26.128778 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.127028 2562 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 25 14:12:26.128778 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127124 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 25 14:12:26.128778 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127129 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 25 14:12:26.128778 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127133 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 25 14:12:26.128778 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127136 2562 feature_gate.go:328] unrecognized feature gate: NewOLM May 25 14:12:26.128778 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127138 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 25 14:12:26.128778 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127141 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 25 14:12:26.128778 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127144 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 25 14:12:26.128778 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127147 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 25 14:12:26.128778 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127150 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 25 14:12:26.128778 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127152 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 25 14:12:26.129223 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127155 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 25 14:12:26.129223 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127157 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 25 14:12:26.129223 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127160 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 25 14:12:26.129223 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127162 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 25 14:12:26.129223 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127165 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 25 14:12:26.129223 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127167 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 25 14:12:26.129223 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127169 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 25 14:12:26.129223 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127172 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 25 14:12:26.129223 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127174 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 25 14:12:26.129223 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127176 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 25 14:12:26.129223 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127179 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 25 14:12:26.129223 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127181 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 25 14:12:26.129223 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127185 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 25 14:12:26.129223 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127187 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 25 14:12:26.129223 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127191 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 25 14:12:26.129223 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127195 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 25 14:12:26.129223 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127197 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 25 14:12:26.129223 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127200 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 25 14:12:26.129223 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127203 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 25 14:12:26.129699 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127205 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 25 14:12:26.129699 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127208 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 25 14:12:26.129699 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127210 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 25 14:12:26.129699 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127212 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 25 14:12:26.129699 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127215 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 25 14:12:26.129699 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127218 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 25 14:12:26.129699 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127220 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 25 14:12:26.129699 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127222 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 25 14:12:26.129699 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127225 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 25 14:12:26.129699 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127227 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 25 14:12:26.129699 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127229 2562 feature_gate.go:328] unrecognized feature gate: Example2 May 25 14:12:26.129699 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127232 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 25 14:12:26.129699 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127234 2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 25 14:12:26.129699 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127236 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 25 14:12:26.129699 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127239 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 25 14:12:26.129699 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127241 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 25 14:12:26.129699 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127245 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 25 14:12:26.129699 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127248 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 25 14:12:26.129699 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127250 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 25 14:12:26.129699 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127252 2562 feature_gate.go:328] unrecognized feature gate: Example May 25 14:12:26.130189 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127255 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 25 14:12:26.130189 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127257 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 25 14:12:26.130189 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127259 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 25 14:12:26.130189 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127262 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 25 14:12:26.130189 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127264 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 25 14:12:26.130189 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127266 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 25 14:12:26.130189 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127270 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 25 14:12:26.130189 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127272 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 25 14:12:26.130189 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127275 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 25 14:12:26.130189 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127277 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages May 25 14:12:26.130189 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127279 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 25 14:12:26.130189 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127282 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 25 14:12:26.130189 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127284 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 25 14:12:26.130189 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127287 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 25 14:12:26.130189 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127289 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 25 14:12:26.130189 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127292 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 25 14:12:26.130189 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127294 2562 feature_gate.go:328] unrecognized feature gate: DualReplica May 25 14:12:26.130189 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127296 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 25 14:12:26.130189 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127299 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability May 25 14:12:26.130189 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127301 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 25 14:12:26.130681 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127304 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 25 14:12:26.130681 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127306 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 25 14:12:26.130681 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127308 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 25 14:12:26.130681 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127311 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 25 14:12:26.130681 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127313 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 25 14:12:26.130681 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127316 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 25 14:12:26.130681 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127318 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 25 14:12:26.130681 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127321 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 25 14:12:26.130681 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127323 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 25 14:12:26.130681 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127326 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 25 14:12:26.130681 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127329 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores May 25 14:12:26.130681 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127331 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 25 14:12:26.130681 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127334 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 25 14:12:26.130681 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127336 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 25 14:12:26.130681 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127338 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 25 14:12:26.130681 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127341 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 25 14:12:26.130681 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:26.127343 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 25 14:12:26.131088 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.127348 2562 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 25 14:12:26.131088 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.128056 2562 server.go:962] "Client rotation is on, will bootstrap in background" May 25 14:12:26.133249 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.133234 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 25 14:12:26.134112 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.134102 2562 server.go:1019] "Starting client certificate rotation" May 25 14:12:26.134223 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.134205 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 25 14:12:26.134253 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.134246 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 25 14:12:26.160195 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.160164 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 25 14:12:26.161941 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.161920 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 25 14:12:26.175032 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.175001 2562 log.go:25] "Validated CRI v1 runtime API" May 25 14:12:26.179578 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.179563 2562 log.go:25] "Validated CRI v1 image API" May 25 14:12:26.182546 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.182527 2562 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 25 14:12:26.186683 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.186657 2562 fs.go:135] Filesystem UUIDs: map[59577431-e013-4887-8e28-5a1053fd3863:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 877a6914-395f-4293-be63-7c9ad3600298:/dev/nvme0n1p3] May 25 14:12:26.186733 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.186683 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 25 14:12:26.187068 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.187048 2562 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 25 14:12:26.192340 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.192205 2562 manager.go:217] Machine: {Timestamp:2026-05-25 14:12:26.191639028 +0000 UTC m=+0.398886204 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3190612 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c312c1b175c115a47abbc771980f1 SystemUUID:ec2c312c-1b17-5c11-5a47-abbc771980f1 BootID:e117d9e3-e3f8-47c6-9e9e-5326ce96be9c Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:41:2f:63:0c:e9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:41:2f:63:0c:e9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e6:05:89:33:b7:7f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 25 14:12:26.192918 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.192904 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 25 14:12:26.193031 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.193014 2562 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 25 14:12:26.195242 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.195217 2562 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 25 14:12:26.195401 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.195246 2562 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-29.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 25 14:12:26.195451 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.195411 2562 topology_manager.go:138] "Creating topology manager with none policy" May 25 14:12:26.195451 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.195420 2562 container_manager_linux.go:306] "Creating device plugin manager" May 25 14:12:26.195451 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.195427 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 25 14:12:26.196222 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.196212 2562 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 25 14:12:26.197863 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.197852 2562 state_mem.go:36] "Initialized new in-memory state store" May 25 14:12:26.197975 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.197966 2562 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 25 14:12:26.201989 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.201976 2562 kubelet.go:491] "Attempting to sync node with API server" May 25 14:12:26.202042 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.201993 2562 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 25 14:12:26.202042 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.202017 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 25 14:12:26.202042 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.202026 2562 kubelet.go:397] "Adding apiserver pod source" May 25 14:12:26.202042 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.202039 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 25 14:12:26.203170 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.203156 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 25 14:12:26.203205 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.203184 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 25 14:12:26.206298 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.206283 2562 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 25 14:12:26.208039 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.208026 2562 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 25 14:12:26.208836 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.208817 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 25 14:12:26.208905 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.208849 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 25 14:12:26.208905 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.208855 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 25 14:12:26.208905 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.208862 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 25 14:12:26.208905 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.208891 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 25 14:12:26.208905 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.208899 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 25 14:12:26.208905 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.208904 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 25 14:12:26.209136 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.208910 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 25 14:12:26.209136 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.208917 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 25 14:12:26.209136 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.208924 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 25 14:12:26.209136 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.208933 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 25 14:12:26.209278 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.209181 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 25 14:12:26.210964 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.210952 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 25 14:12:26.210964 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.210963 2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 25 14:12:26.212360 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.212340 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2bm2s" May 25 14:12:26.214580 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.214568 2562 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 25 14:12:26.214637 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.214600 2562 server.go:1295] "Started kubelet" May 25 14:12:26.214702 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.214681 2562 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-29.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 25 14:12:26.214776 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:26.214744 2562 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 25 14:12:26.214776 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:26.214746 2562 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-29.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 25 14:12:26.214776 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.214738 2562 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 25 14:12:26.214944 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.214774 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 25 14:12:26.214944 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.214799 2562 server_v1.go:47] "podresources" method="list" useActivePods=true May 25 14:12:26.215485 ip-10-0-140-29 systemd[1]: Started Kubernetes Kubelet. May 25 14:12:26.216066 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.215772 2562 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 25 14:12:26.217013 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.216995 2562 server.go:317] "Adding debug handlers to kubelet server" May 25 14:12:26.219590 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.219567 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2bm2s" May 25 14:12:26.222116 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.222095 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 25 14:12:26.222116 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.222112 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 25 14:12:26.222267 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.222151 2562 volume_manager.go:295] "The desired_state_of_world populator starts" May 25 14:12:26.222267 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.222158 2562 volume_manager.go:297] "Starting Kubelet Volume Manager" May 25 14:12:26.222267 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.222190 2562 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 25 14:12:26.222267 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.222241 2562 reconstruct.go:97] "Volume reconstruction finished" May 25 14:12:26.222267 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.222251 2562 reconciler.go:26] "Reconciler: start to sync state" May 25 14:12:26.224709 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:26.224340 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-29.ec2.internal\" not found" May 25 14:12:26.224709 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.224405 2562 factory.go:55] Registering systemd factory May 25 14:12:26.224709 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.224422 2562 factory.go:223] Registration of the systemd container factory successfully May 25 14:12:26.224709 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.224637 2562 factory.go:153] Registering CRI-O factory May 25 14:12:26.224709 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.224647 2562 factory.go:223] Registration of the crio container factory successfully May 25 14:12:26.224709 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.224695 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 25 14:12:26.224709 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.224709 2562 factory.go:103] Registering Raw factory May 25 14:12:26.224992 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.224724 2562 manager.go:1196] Started watching for new ooms in manager May 25 14:12:26.225126 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.225107 2562 manager.go:319] Starting recovery of all containers May 25 14:12:26.228923 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.228894 2562 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 25 14:12:26.229282 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:26.229264 2562 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 25 14:12:26.230934 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:26.230911 2562 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-140-29.ec2.internal\" not found" node="ip-10-0-140-29.ec2.internal" May 25 14:12:26.231481 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.231433 2562 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 25 14:12:26.237948 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.237785 2562 manager.go:324] Recovery completed May 25 14:12:26.242078 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.242067 2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 25 14:12:26.243775 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.243757 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-29.ec2.internal" event="NodeHasSufficientMemory" May 25 14:12:26.243849 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.243789 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-29.ec2.internal" event="NodeHasNoDiskPressure" May 25 14:12:26.243849 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.243799 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-29.ec2.internal" event="NodeHasSufficientPID" May 25 14:12:26.244284 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.244270 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" May 25 14:12:26.244318 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.244286 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 25 14:12:26.244318 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.244302 2562 state_mem.go:36] "Initialized new in-memory state store" May 25 14:12:26.246540 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.246528 2562 policy_none.go:49] "None policy: Start" May 25 14:12:26.246586 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.246547 2562 memory_manager.go:186] "Starting memorymanager" policy="None" May 25 14:12:26.246586 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.246557 2562 state_mem.go:35] "Initializing new in-memory state store" May 25 14:12:26.291145 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.291124 2562 manager.go:341] "Starting Device Plugin manager" May 25 14:12:26.295572 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:26.291168 2562 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 25 14:12:26.295572 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.291182 2562 server.go:85] "Starting device plugin registration server" May 25 14:12:26.295572 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.291501 2562 eviction_manager.go:189] "Eviction manager: starting control loop" May 25 14:12:26.295572 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.291515 2562 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 25 14:12:26.295572 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.291609 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 25 14:12:26.295572 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.291707 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 25 14:12:26.295572 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.291715 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 25 14:12:26.295572 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:26.292295 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 25 14:12:26.295572 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:26.292327 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-29.ec2.internal\" not found" May 25 14:12:26.360434 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.360354 2562 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 25 14:12:26.360434 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.360399 2562 status_manager.go:230] "Starting to sync pod status with apiserver" May 25 14:12:26.360434 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.360429 2562 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 25 14:12:26.360434 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.360434 2562 kubelet.go:2451] "Starting kubelet main sync loop" May 25 14:12:26.360686 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:26.360473 2562 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 25 14:12:26.365730 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.365709 2562 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 25 14:12:26.392309 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.392279 2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 25 14:12:26.393257 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.393239 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-29.ec2.internal" event="NodeHasSufficientMemory" May 25 14:12:26.393347 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.393269 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-29.ec2.internal" event="NodeHasNoDiskPressure" May 25 14:12:26.393347 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.393285 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-29.ec2.internal" event="NodeHasSufficientPID" May 25 14:12:26.393347 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.393307 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-29.ec2.internal" May 25 14:12:26.401662 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.401638 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-29.ec2.internal" May 25 14:12:26.401757 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:26.401668 2562 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-29.ec2.internal\": node \"ip-10-0-140-29.ec2.internal\" not found" May 25 14:12:26.420258 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:26.420230 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-29.ec2.internal\" not found" May 25 14:12:26.461363 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.461320 2562 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-29.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-29.ec2.internal"] May 25 14:12:26.461441 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.461427 2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 25 14:12:26.462446 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.462429 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-29.ec2.internal" event="NodeHasSufficientMemory" May 25 14:12:26.462531 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.462461 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-29.ec2.internal" event="NodeHasNoDiskPressure" May 25 14:12:26.462531 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.462471 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-29.ec2.internal" event="NodeHasSufficientPID" May 25 14:12:26.463699 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.463687 2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 25 14:12:26.463900 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.463862 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-29.ec2.internal" May 25 14:12:26.463900 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.463891 2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 25 14:12:26.464431 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.464418 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-29.ec2.internal" event="NodeHasSufficientMemory" May 25 14:12:26.464494 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.464442 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-29.ec2.internal" event="NodeHasNoDiskPressure" May 25 14:12:26.464494 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.464453 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-29.ec2.internal" event="NodeHasSufficientPID" May 25 14:12:26.464570 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.464422 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-29.ec2.internal" event="NodeHasSufficientMemory" May 25 14:12:26.464570 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.464516 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-29.ec2.internal" event="NodeHasNoDiskPressure" May 25 14:12:26.464570 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.464525 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-29.ec2.internal" event="NodeHasSufficientPID" May 25 14:12:26.465521 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.465508 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-29.ec2.internal" May 25 14:12:26.465561 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.465532 2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 25 14:12:26.466203 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.466185 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-29.ec2.internal" event="NodeHasSufficientMemory" May 25 14:12:26.466272 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.466217 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-29.ec2.internal" event="NodeHasNoDiskPressure" May 25 14:12:26.466272 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.466232 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-29.ec2.internal" event="NodeHasSufficientPID" May 25 14:12:26.500198 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:26.500168 2562 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-29.ec2.internal\" not found" node="ip-10-0-140-29.ec2.internal" May 25 14:12:26.504406 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:26.504367 2562 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-29.ec2.internal\" not found" node="ip-10-0-140-29.ec2.internal" May 25 14:12:26.520860 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:26.520819 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-29.ec2.internal\" not found" May 25 14:12:26.524957 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.524925 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2a24073830ae5c95f5d5093d408de332-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-29.ec2.internal\" (UID: \"2a24073830ae5c95f5d5093d408de332\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-29.ec2.internal" May 25 14:12:26.525083 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.524956 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a24073830ae5c95f5d5093d408de332-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-29.ec2.internal\" (UID: \"2a24073830ae5c95f5d5093d408de332\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-29.ec2.internal" May 25 14:12:26.525083 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.524983 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bcb5c6667f8450704515b5a4ad2ed7fc-config\") pod \"kube-apiserver-proxy-ip-10-0-140-29.ec2.internal\" (UID: \"bcb5c6667f8450704515b5a4ad2ed7fc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-29.ec2.internal" May 25 14:12:26.621723 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:26.621622 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-29.ec2.internal\" not found" May 25 14:12:26.625924 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.625906 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2a24073830ae5c95f5d5093d408de332-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-29.ec2.internal\" (UID: \"2a24073830ae5c95f5d5093d408de332\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-29.ec2.internal" May 25 14:12:26.625990 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.625934 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a24073830ae5c95f5d5093d408de332-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-29.ec2.internal\" (UID: \"2a24073830ae5c95f5d5093d408de332\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-29.ec2.internal" May 25 14:12:26.625990 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.625954 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bcb5c6667f8450704515b5a4ad2ed7fc-config\") pod \"kube-apiserver-proxy-ip-10-0-140-29.ec2.internal\" (UID: \"bcb5c6667f8450704515b5a4ad2ed7fc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-29.ec2.internal" May 25 14:12:26.626073 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.626009 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bcb5c6667f8450704515b5a4ad2ed7fc-config\") pod \"kube-apiserver-proxy-ip-10-0-140-29.ec2.internal\" (UID: \"bcb5c6667f8450704515b5a4ad2ed7fc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-29.ec2.internal" May 25 14:12:26.626073 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.626009 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2a24073830ae5c95f5d5093d408de332-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-29.ec2.internal\" (UID: \"2a24073830ae5c95f5d5093d408de332\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-29.ec2.internal" May 25 14:12:26.626073 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.626009 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a24073830ae5c95f5d5093d408de332-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-29.ec2.internal\" (UID: \"2a24073830ae5c95f5d5093d408de332\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-29.ec2.internal" May 25 14:12:26.722434 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:26.722395 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-29.ec2.internal\" not found" May 25 14:12:26.802716 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.802688 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-29.ec2.internal" May 25 14:12:26.806460 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:26.806436 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-29.ec2.internal" May 25 14:12:26.823039 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:26.823009 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-29.ec2.internal\" not found" May 25 14:12:26.923500 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:26.923411 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-29.ec2.internal\" not found" May 25 14:12:27.023864 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:27.023832 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-29.ec2.internal\" not found" May 25 14:12:27.124277 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:27.124253 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-29.ec2.internal\" not found" May 25 14:12:27.134602 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:27.134581 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 25 14:12:27.134752 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:27.134733 2562 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 25 14:12:27.134799 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:27.134758 2562 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 25 14:12:27.221576 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:27.221536 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-24 14:07:26 +0000 UTC" deadline="2028-01-03 18:20:07.299937395 +0000 UTC" May 25 14:12:27.221576 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:27.221574 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14116h7m40.078367016s" May 25 14:12:27.222331 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:27.222316 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 25 14:12:27.224889 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:27.224844 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-29.ec2.internal\" not found" May 25 14:12:27.227296 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:27.227263 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcb5c6667f8450704515b5a4ad2ed7fc.slice/crio-77a8e16ab99e564c4d278bbe1d656c17bdc86f6c7d0d340d17231d309f7932b6 WatchSource:0}: Error finding container 77a8e16ab99e564c4d278bbe1d656c17bdc86f6c7d0d340d17231d309f7932b6: Status 404 returned error can't find the container with id 77a8e16ab99e564c4d278bbe1d656c17bdc86f6c7d0d340d17231d309f7932b6 May 25 14:12:27.227598 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:27.227580 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a24073830ae5c95f5d5093d408de332.slice/crio-7a62274c56388295799feeb1a98fd7ed9c5c8efdeb4dd4b84128350df26c40ea WatchSource:0}: Error finding container 7a62274c56388295799feeb1a98fd7ed9c5c8efdeb4dd4b84128350df26c40ea: Status 404 returned error can't find the container with id 7a62274c56388295799feeb1a98fd7ed9c5c8efdeb4dd4b84128350df26c40ea May 25 14:12:27.231178 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:27.231160 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 25 14:12:27.234690 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:27.234671 2562 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 25 14:12:27.258620 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:27.258588 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fwtrb" May 25 14:12:27.265967 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:27.265943 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fwtrb" May 25 14:12:27.325752 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:27.325717 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-29.ec2.internal\" not found" May 25 14:12:27.364440 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:27.364389 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-29.ec2.internal" event={"ID":"2a24073830ae5c95f5d5093d408de332","Type":"ContainerStarted","Data":"7a62274c56388295799feeb1a98fd7ed9c5c8efdeb4dd4b84128350df26c40ea"} May 25 14:12:27.365291 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:27.365270 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-29.ec2.internal" event={"ID":"bcb5c6667f8450704515b5a4ad2ed7fc","Type":"ContainerStarted","Data":"77a8e16ab99e564c4d278bbe1d656c17bdc86f6c7d0d340d17231d309f7932b6"} May 25 14:12:27.426603 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:27.426571 2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-29.ec2.internal\" not found" May 25 14:12:27.447308 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:27.447282 2562 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 25 14:12:27.523464 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:27.523362 2562 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-29.ec2.internal" May 25 14:12:27.534593 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:27.534571 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 25 14:12:27.536234 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:27.536217 2562 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-29.ec2.internal" May 25 14:12:27.543047 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:27.543026 2562 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 25 14:12:27.544402 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:27.544386 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 25 14:12:27.969389 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:27.969341 2562 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 25 14:12:28.203973 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.203931 2562 apiserver.go:52] "Watching apiserver" May 25 14:12:28.212045 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.212025 2562 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 25 14:12:28.212428 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.212395 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-zrq2g","kube-system/kube-apiserver-proxy-ip-10-0-140-29.ec2.internal","openshift-dns/node-resolver-td67w","openshift-multus/multus-additional-cni-plugins-qdkw4","openshift-multus/multus-l5kmt","openshift-network-diagnostics/network-check-target-wrh74","openshift-network-operator/iptables-alerter-bwn7t","openshift-ovn-kubernetes/ovnkube-node-b2gmj","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njldq","openshift-cluster-node-tuning-operator/tuned-5bb7j","openshift-image-registry/node-ca-wmrkq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-29.ec2.internal","openshift-multus/network-metrics-daemon-p6784"] May 25 14:12:28.215224 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.214731 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bwn7t" May 25 14:12:28.215996 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.215978 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-td67w" May 25 14:12:28.216105 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.216086 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qdkw4" May 25 14:12:28.217421 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.217362 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 25 14:12:28.217537 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.217516 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xc9sh\"" May 25 14:12:28.217639 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.217624 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 25 14:12:28.217778 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.217757 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 25 14:12:28.218783 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.218516 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-l5kmt" May 25 14:12:28.218783 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.218598 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrh74" May 25 14:12:28.218783 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:28.218648 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrh74" podUID="14bb3377-8d7b-4231-a2c1-cf5a7e7abbea" May 25 14:12:28.218967 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.218840 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 25 14:12:28.219018 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.218971 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vvvbw\"" May 25 14:12:28.219064 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.219044 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 25 14:12:28.219159 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.219090 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 25 14:12:28.219247 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.219229 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 25 14:12:28.219334 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.219313 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7zjbk\"" May 25 14:12:28.219974 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.219925 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zrq2g" May 25 14:12:28.220130 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.220113 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 25 14:12:28.220232 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.220212 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 25 14:12:28.220320 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.220304 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 25 14:12:28.220877 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.220834 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 25 14:12:28.220995 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.220976 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ljg8j\"" May 25 14:12:28.221362 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.221342 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.222191 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.222174 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 25 14:12:28.222300 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.222272 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5pnnb\"" May 25 14:12:28.222407 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.222391 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 25 14:12:28.226278 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.223559 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2l9sp\"" May 25 14:12:28.226278 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.223723 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 25 14:12:28.226278 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.223950 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 25 14:12:28.226278 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.224218 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njldq" May 25 14:12:28.226278 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.225811 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5bb7j" May 25 14:12:28.226647 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.226586 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 25 14:12:28.226647 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.226633 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6vs6n\"" May 25 14:12:28.226780 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.226749 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 25 14:12:28.226868 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.226852 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 25 14:12:28.226930 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.226897 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 25 14:12:28.226982 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.226963 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 25 14:12:28.227247 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.227069 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 25 14:12:28.227247 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.227190 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 25 14:12:28.227530 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.227515 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p6784" May 25 14:12:28.227620 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:28.227599 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p6784" podUID="7b48e369-ae21-483b-897e-fb9b4ecd1818" May 25 14:12:28.227739 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.227726 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wmrkq" May 25 14:12:28.228625 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.228601 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-q5sx4\"" May 25 14:12:28.228625 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.228618 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 25 14:12:28.228753 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.228716 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 25 14:12:28.230351 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.230334 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 25 14:12:28.230846 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.230646 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-85kpr\"" May 25 14:12:28.230846 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.230761 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 25 14:12:28.230846 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.230647 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 25 14:12:28.235043 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.235024 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/95eb3cbd-2c41-4d96-af85-a21ad8aaf82b-var-lib-kubelet\") pod \"tuned-5bb7j\" (UID: \"95eb3cbd-2c41-4d96-af85-a21ad8aaf82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5bb7j" May 25 14:12:28.235132 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.235056 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9ea1fab0-ccd9-4900-939f-9e7aa433972f-iptables-alerter-script\") pod \"iptables-alerter-bwn7t\" (UID: \"9ea1fab0-ccd9-4900-939f-9e7aa433972f\") " pod="openshift-network-operator/iptables-alerter-bwn7t" May 25 14:12:28.235132 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.235120 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4htm7\" (UniqueName: \"kubernetes.io/projected/823e5406-c4ba-45f5-bd46-f82b17b0495c-kube-api-access-4htm7\") pod \"multus-additional-cni-plugins-qdkw4\" (UID: \"823e5406-c4ba-45f5-bd46-f82b17b0495c\") " pod="openshift-multus/multus-additional-cni-plugins-qdkw4" May 25 14:12:28.235242 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.235146 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-run-systemd\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.235242 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.235167 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-host-cni-bin\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.235242 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.235182 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/949098c1-c4c0-401c-8faf-db03fa09d898-agent-certs\") pod \"konnectivity-agent-zrq2g\" (UID: \"949098c1-c4c0-401c-8faf-db03fa09d898\") " pod="kube-system/konnectivity-agent-zrq2g" May 25 14:12:28.235242 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.235199 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/95eb3cbd-2c41-4d96-af85-a21ad8aaf82b-etc-tuned\") pod \"tuned-5bb7j\" (UID: \"95eb3cbd-2c41-4d96-af85-a21ad8aaf82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5bb7j" May 25 14:12:28.235242 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.235217 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95eb3cbd-2c41-4d96-af85-a21ad8aaf82b-tmp\") pod \"tuned-5bb7j\" (UID: \"95eb3cbd-2c41-4d96-af85-a21ad8aaf82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5bb7j" May 25 14:12:28.235242 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.235237 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75sqt\" (UniqueName: \"kubernetes.io/projected/95eb3cbd-2c41-4d96-af85-a21ad8aaf82b-kube-api-access-75sqt\") pod \"tuned-5bb7j\" (UID: \"95eb3cbd-2c41-4d96-af85-a21ad8aaf82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5bb7j" May 25 14:12:28.235545 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.235261 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/823e5406-c4ba-45f5-bd46-f82b17b0495c-system-cni-dir\") pod \"multus-additional-cni-plugins-qdkw4\" (UID: \"823e5406-c4ba-45f5-bd46-f82b17b0495c\") " pod="openshift-multus/multus-additional-cni-plugins-qdkw4" May 25 14:12:28.235545 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.235288 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-host-kubelet\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.235545 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.235305 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/251e865d-d65c-4abf-b045-ac55fee054da-tmp-dir\") pod \"node-resolver-td67w\" (UID: \"251e865d-d65c-4abf-b045-ac55fee054da\") " pod="openshift-dns/node-resolver-td67w" May 25 14:12:28.235545 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.235325 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e081d292-f999-4a5d-8e11-7d2ccac47593-host-run-k8s-cni-cncf-io\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.235545 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.235349 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e081d292-f999-4a5d-8e11-7d2ccac47593-host-run-multus-certs\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.235545 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.235385 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/56be8261-ba14-4828-bbf9-5c1e581a4e8b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-njldq\" (UID: \"56be8261-ba14-4828-bbf9-5c1e581a4e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njldq" May 25 14:12:28.235545 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.235405 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-var-lib-openvswitch\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.235545 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.235425 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-node-log\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.235545 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.235449 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snnlx\" (UniqueName: \"kubernetes.io/projected/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-kube-api-access-snnlx\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.235545 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.235471 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/56be8261-ba14-4828-bbf9-5c1e581a4e8b-socket-dir\") pod \"aws-ebs-csi-driver-node-njldq\" (UID: \"56be8261-ba14-4828-bbf9-5c1e581a4e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njldq" May 25 14:12:28.235545 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.235491 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/95eb3cbd-2c41-4d96-af85-a21ad8aaf82b-run\") pod \"tuned-5bb7j\" (UID: \"95eb3cbd-2c41-4d96-af85-a21ad8aaf82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5bb7j" May 25 14:12:28.235545 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.235516 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95eb3cbd-2c41-4d96-af85-a21ad8aaf82b-sys\") pod \"tuned-5bb7j\" (UID: \"95eb3cbd-2c41-4d96-af85-a21ad8aaf82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5bb7j" May 25 14:12:28.235956 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.235560 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/823e5406-c4ba-45f5-bd46-f82b17b0495c-cni-binary-copy\") pod \"multus-additional-cni-plugins-qdkw4\" (UID: \"823e5406-c4ba-45f5-bd46-f82b17b0495c\") " pod="openshift-multus/multus-additional-cni-plugins-qdkw4" May 25 14:12:28.235956 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.235594 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-run-ovn\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.235956 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.235622 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-ovn-node-metrics-cert\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.235956 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.235646 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh29x\" (UniqueName: \"kubernetes.io/projected/251e865d-d65c-4abf-b045-ac55fee054da-kube-api-access-vh29x\") pod \"node-resolver-td67w\" (UID: \"251e865d-d65c-4abf-b045-ac55fee054da\") " pod="openshift-dns/node-resolver-td67w" May 25 14:12:28.235956 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.235670 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-host-run-ovn-kubernetes\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.235956 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.235693 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-ovnkube-config\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.235956 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.235715 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/95eb3cbd-2c41-4d96-af85-a21ad8aaf82b-etc-sysconfig\") pod \"tuned-5bb7j\" (UID: \"95eb3cbd-2c41-4d96-af85-a21ad8aaf82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5bb7j" May 25 14:12:28.235956 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.235736 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/823e5406-c4ba-45f5-bd46-f82b17b0495c-os-release\") pod \"multus-additional-cni-plugins-qdkw4\" (UID: \"823e5406-c4ba-45f5-bd46-f82b17b0495c\") " pod="openshift-multus/multus-additional-cni-plugins-qdkw4" May 25 14:12:28.235956 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.235792 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e081d292-f999-4a5d-8e11-7d2ccac47593-cni-binary-copy\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.235956 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.235842 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e081d292-f999-4a5d-8e11-7d2ccac47593-host-var-lib-cni-multus\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.235956 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.235865 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e081d292-f999-4a5d-8e11-7d2ccac47593-host-var-lib-kubelet\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.235956 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.235887 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/95eb3cbd-2c41-4d96-af85-a21ad8aaf82b-host\") pod \"tuned-5bb7j\" (UID: \"95eb3cbd-2c41-4d96-af85-a21ad8aaf82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5bb7j" May 25 14:12:28.235956 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.235911 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e081d292-f999-4a5d-8e11-7d2ccac47593-hostroot\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.236482 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.235949 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/95eb3cbd-2c41-4d96-af85-a21ad8aaf82b-etc-sysctl-conf\") pod \"tuned-5bb7j\" (UID: \"95eb3cbd-2c41-4d96-af85-a21ad8aaf82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5bb7j" May 25 14:12:28.236482 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.236011 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e081d292-f999-4a5d-8e11-7d2ccac47593-os-release\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.236482 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.236035 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e081d292-f999-4a5d-8e11-7d2ccac47593-etc-kubernetes\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.236482 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.236107 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/56be8261-ba14-4828-bbf9-5c1e581a4e8b-sys-fs\") pod \"aws-ebs-csi-driver-node-njldq\" (UID: \"56be8261-ba14-4828-bbf9-5c1e581a4e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njldq" May 25 14:12:28.236482 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.236140 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/95eb3cbd-2c41-4d96-af85-a21ad8aaf82b-etc-sysctl-d\") pod \"tuned-5bb7j\" (UID: \"95eb3cbd-2c41-4d96-af85-a21ad8aaf82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5bb7j" May 25 14:12:28.236482 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.236159 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-run-openvswitch\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.236482 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.236173 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e081d292-f999-4a5d-8e11-7d2ccac47593-host-run-netns\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.236482 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.236195 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/823e5406-c4ba-45f5-bd46-f82b17b0495c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qdkw4\" (UID: \"823e5406-c4ba-45f5-bd46-f82b17b0495c\") " pod="openshift-multus/multus-additional-cni-plugins-qdkw4" May 25 14:12:28.236482 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.236234 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-host-run-netns\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.236482 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.236265 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-log-socket\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.236482 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.236313 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.236482 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.236342 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e081d292-f999-4a5d-8e11-7d2ccac47593-host-var-lib-cni-bin\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.236482 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.236364 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/56be8261-ba14-4828-bbf9-5c1e581a4e8b-device-dir\") pod \"aws-ebs-csi-driver-node-njldq\" (UID: \"56be8261-ba14-4828-bbf9-5c1e581a4e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njldq" May 25 14:12:28.236482 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.236423 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/95eb3cbd-2c41-4d96-af85-a21ad8aaf82b-etc-modprobe-d\") pod \"tuned-5bb7j\" (UID: \"95eb3cbd-2c41-4d96-af85-a21ad8aaf82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5bb7j" May 25 14:12:28.236482 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.236448 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9ea1fab0-ccd9-4900-939f-9e7aa433972f-host-slash\") pod \"iptables-alerter-bwn7t\" (UID: \"9ea1fab0-ccd9-4900-939f-9e7aa433972f\") " pod="openshift-network-operator/iptables-alerter-bwn7t" May 25 14:12:28.236482 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.236470 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8n7m\" (UniqueName: \"kubernetes.io/projected/9ea1fab0-ccd9-4900-939f-9e7aa433972f-kube-api-access-h8n7m\") pod \"iptables-alerter-bwn7t\" (UID: \"9ea1fab0-ccd9-4900-939f-9e7aa433972f\") " pod="openshift-network-operator/iptables-alerter-bwn7t" May 25 14:12:28.237218 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.236493 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-etc-openvswitch\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.237218 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.236523 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e081d292-f999-4a5d-8e11-7d2ccac47593-system-cni-dir\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.237218 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.236541 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e081d292-f999-4a5d-8e11-7d2ccac47593-cnibin\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.237218 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.236560 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/251e865d-d65c-4abf-b045-ac55fee054da-hosts-file\") pod \"node-resolver-td67w\" (UID: \"251e865d-d65c-4abf-b045-ac55fee054da\") " pod="openshift-dns/node-resolver-td67w" May 25 14:12:28.237218 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.236585 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e081d292-f999-4a5d-8e11-7d2ccac47593-multus-conf-dir\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.237218 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.236622 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/56be8261-ba14-4828-bbf9-5c1e581a4e8b-etc-selinux\") pod \"aws-ebs-csi-driver-node-njldq\" (UID: \"56be8261-ba14-4828-bbf9-5c1e581a4e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njldq" May 25 14:12:28.237218 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.236658 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg679\" (UniqueName: \"kubernetes.io/projected/56be8261-ba14-4828-bbf9-5c1e581a4e8b-kube-api-access-mg679\") pod \"aws-ebs-csi-driver-node-njldq\" (UID: \"56be8261-ba14-4828-bbf9-5c1e581a4e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njldq" May 25 14:12:28.237218 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.236698 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95eb3cbd-2c41-4d96-af85-a21ad8aaf82b-etc-kubernetes\") pod \"tuned-5bb7j\" (UID: \"95eb3cbd-2c41-4d96-af85-a21ad8aaf82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5bb7j" May 25 14:12:28.237218 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.236724 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/823e5406-c4ba-45f5-bd46-f82b17b0495c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qdkw4\" (UID: \"823e5406-c4ba-45f5-bd46-f82b17b0495c\") " pod="openshift-multus/multus-additional-cni-plugins-qdkw4" May 25 14:12:28.237218 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.236752 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-systemd-units\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.237218 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.236771 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-env-overrides\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.237218 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.236787 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/949098c1-c4c0-401c-8faf-db03fa09d898-konnectivity-ca\") pod \"konnectivity-agent-zrq2g\" (UID: \"949098c1-c4c0-401c-8faf-db03fa09d898\") " pod="kube-system/konnectivity-agent-zrq2g" May 25 14:12:28.237218 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.236817 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/95eb3cbd-2c41-4d96-af85-a21ad8aaf82b-etc-systemd\") pod \"tuned-5bb7j\" (UID: \"95eb3cbd-2c41-4d96-af85-a21ad8aaf82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5bb7j" May 25 14:12:28.237218 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.236837 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/823e5406-c4ba-45f5-bd46-f82b17b0495c-cnibin\") pod \"multus-additional-cni-plugins-qdkw4\" (UID: \"823e5406-c4ba-45f5-bd46-f82b17b0495c\") " pod="openshift-multus/multus-additional-cni-plugins-qdkw4" May 25 14:12:28.237218 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.236876 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/823e5406-c4ba-45f5-bd46-f82b17b0495c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qdkw4\" (UID: \"823e5406-c4ba-45f5-bd46-f82b17b0495c\") " pod="openshift-multus/multus-additional-cni-plugins-qdkw4" May 25 14:12:28.237218 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.236891 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-ovnkube-script-lib\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.237960 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.236906 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e081d292-f999-4a5d-8e11-7d2ccac47593-multus-socket-dir-parent\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.237960 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.236923 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/56be8261-ba14-4828-bbf9-5c1e581a4e8b-registration-dir\") pod \"aws-ebs-csi-driver-node-njldq\" (UID: \"56be8261-ba14-4828-bbf9-5c1e581a4e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njldq" May 25 14:12:28.237960 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.236944 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/95eb3cbd-2c41-4d96-af85-a21ad8aaf82b-lib-modules\") pod \"tuned-5bb7j\" (UID: \"95eb3cbd-2c41-4d96-af85-a21ad8aaf82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5bb7j" May 25 14:12:28.237960 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.236962 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frx7c\" (UniqueName: \"kubernetes.io/projected/14bb3377-8d7b-4231-a2c1-cf5a7e7abbea-kube-api-access-frx7c\") pod \"network-check-target-wrh74\" (UID: \"14bb3377-8d7b-4231-a2c1-cf5a7e7abbea\") " pod="openshift-network-diagnostics/network-check-target-wrh74" May 25 14:12:28.237960 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.236993 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-host-cni-netd\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.237960 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.237034 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e081d292-f999-4a5d-8e11-7d2ccac47593-multus-daemon-config\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.237960 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.237057 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-host-slash\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.237960 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.237083 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e081d292-f999-4a5d-8e11-7d2ccac47593-multus-cni-dir\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.237960 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.237107 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78bqg\" (UniqueName: \"kubernetes.io/projected/e081d292-f999-4a5d-8e11-7d2ccac47593-kube-api-access-78bqg\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.266625 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.266592 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-24 14:07:27 +0000 UTC" deadline="2028-02-05 13:03:42.946289614 +0000 UTC" May 25 14:12:28.266625 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.266621 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14902h51m14.679671513s" May 25 14:12:28.322920 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.322890 2562 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 25 14:12:28.338189 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.338158 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/949098c1-c4c0-401c-8faf-db03fa09d898-agent-certs\") pod \"konnectivity-agent-zrq2g\" (UID: \"949098c1-c4c0-401c-8faf-db03fa09d898\") " pod="kube-system/konnectivity-agent-zrq2g" May 25 14:12:28.338387 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.338201 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/95eb3cbd-2c41-4d96-af85-a21ad8aaf82b-etc-tuned\") pod \"tuned-5bb7j\" (UID: \"95eb3cbd-2c41-4d96-af85-a21ad8aaf82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5bb7j" May 25 14:12:28.338387 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.338228 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95eb3cbd-2c41-4d96-af85-a21ad8aaf82b-tmp\") pod \"tuned-5bb7j\" (UID: \"95eb3cbd-2c41-4d96-af85-a21ad8aaf82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5bb7j" May 25 14:12:28.338527 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.338506 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-75sqt\" (UniqueName: \"kubernetes.io/projected/95eb3cbd-2c41-4d96-af85-a21ad8aaf82b-kube-api-access-75sqt\") pod \"tuned-5bb7j\" (UID: \"95eb3cbd-2c41-4d96-af85-a21ad8aaf82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5bb7j" May 25 14:12:28.338601 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.338548 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/823e5406-c4ba-45f5-bd46-f82b17b0495c-system-cni-dir\") pod \"multus-additional-cni-plugins-qdkw4\" (UID: \"823e5406-c4ba-45f5-bd46-f82b17b0495c\") " pod="openshift-multus/multus-additional-cni-plugins-qdkw4" May 25 14:12:28.338601 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.338576 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-host-kubelet\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.338691 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.338594 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 25 14:12:28.338691 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.338663 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/823e5406-c4ba-45f5-bd46-f82b17b0495c-system-cni-dir\") pod \"multus-additional-cni-plugins-qdkw4\" (UID: \"823e5406-c4ba-45f5-bd46-f82b17b0495c\") " pod="openshift-multus/multus-additional-cni-plugins-qdkw4" May 25 14:12:28.338769 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.338610 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5da677c4-73fb-4b42-be1a-c7fb68aa56d0-serviceca\") pod \"node-ca-wmrkq\" (UID: \"5da677c4-73fb-4b42-be1a-c7fb68aa56d0\") " pod="openshift-image-registry/node-ca-wmrkq" May 25 14:12:28.338769 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.338760 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/251e865d-d65c-4abf-b045-ac55fee054da-tmp-dir\") pod \"node-resolver-td67w\" (UID: \"251e865d-d65c-4abf-b045-ac55fee054da\") " pod="openshift-dns/node-resolver-td67w" May 25 14:12:28.339137 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.338707 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-host-kubelet\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.339137 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.339117 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e081d292-f999-4a5d-8e11-7d2ccac47593-host-run-k8s-cni-cncf-io\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.339266 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.339172 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e081d292-f999-4a5d-8e11-7d2ccac47593-host-run-k8s-cni-cncf-io\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.339351 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.339328 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e081d292-f999-4a5d-8e11-7d2ccac47593-host-run-multus-certs\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.339518 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.339502 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/251e865d-d65c-4abf-b045-ac55fee054da-tmp-dir\") pod \"node-resolver-td67w\" (UID: \"251e865d-d65c-4abf-b045-ac55fee054da\") " pod="openshift-dns/node-resolver-td67w" May 25 14:12:28.339829 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.339805 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e081d292-f999-4a5d-8e11-7d2ccac47593-host-run-multus-certs\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.339943 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.339860 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/56be8261-ba14-4828-bbf9-5c1e581a4e8b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-njldq\" (UID: \"56be8261-ba14-4828-bbf9-5c1e581a4e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njldq" May 25 14:12:28.339943 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.339888 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-var-lib-openvswitch\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.340042 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.339939 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-node-log\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.340042 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.339970 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/56be8261-ba14-4828-bbf9-5c1e581a4e8b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-njldq\" (UID: \"56be8261-ba14-4828-bbf9-5c1e581a4e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njldq" May 25 14:12:28.340042 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.339973 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-snnlx\" (UniqueName: \"kubernetes.io/projected/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-kube-api-access-snnlx\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.340042 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.340025 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/56be8261-ba14-4828-bbf9-5c1e581a4e8b-socket-dir\") pod \"aws-ebs-csi-driver-node-njldq\" (UID: \"56be8261-ba14-4828-bbf9-5c1e581a4e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njldq" May 25 14:12:28.340188 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.340056 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/95eb3cbd-2c41-4d96-af85-a21ad8aaf82b-run\") pod \"tuned-5bb7j\" (UID: \"95eb3cbd-2c41-4d96-af85-a21ad8aaf82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5bb7j" May 25 14:12:28.340188 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.340078 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95eb3cbd-2c41-4d96-af85-a21ad8aaf82b-sys\") pod \"tuned-5bb7j\" (UID: \"95eb3cbd-2c41-4d96-af85-a21ad8aaf82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5bb7j" May 25 14:12:28.340188 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.340104 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/823e5406-c4ba-45f5-bd46-f82b17b0495c-cni-binary-copy\") pod \"multus-additional-cni-plugins-qdkw4\" (UID: \"823e5406-c4ba-45f5-bd46-f82b17b0495c\") " pod="openshift-multus/multus-additional-cni-plugins-qdkw4" May 25 14:12:28.340188 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.340132 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-run-ovn\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.340188 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.340157 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-ovn-node-metrics-cert\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.340188 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.340186 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg69g\" (UniqueName: \"kubernetes.io/projected/5da677c4-73fb-4b42-be1a-c7fb68aa56d0-kube-api-access-tg69g\") pod \"node-ca-wmrkq\" (UID: \"5da677c4-73fb-4b42-be1a-c7fb68aa56d0\") " pod="openshift-image-registry/node-ca-wmrkq" May 25 14:12:28.340422 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.340211 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vh29x\" (UniqueName: \"kubernetes.io/projected/251e865d-d65c-4abf-b045-ac55fee054da-kube-api-access-vh29x\") pod \"node-resolver-td67w\" (UID: \"251e865d-d65c-4abf-b045-ac55fee054da\") " pod="openshift-dns/node-resolver-td67w" May 25 14:12:28.340422 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.340240 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-host-run-ovn-kubernetes\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.340422 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.340272 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-ovnkube-config\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.340422 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.340281 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-var-lib-openvswitch\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.340422 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.340305 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/95eb3cbd-2c41-4d96-af85-a21ad8aaf82b-etc-sysconfig\") pod \"tuned-5bb7j\" (UID: \"95eb3cbd-2c41-4d96-af85-a21ad8aaf82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5bb7j" May 25 14:12:28.340422 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.340332 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-node-log\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.340422 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.340408 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-run-ovn\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.340705 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.340435 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/823e5406-c4ba-45f5-bd46-f82b17b0495c-os-release\") pod \"multus-additional-cni-plugins-qdkw4\" (UID: \"823e5406-c4ba-45f5-bd46-f82b17b0495c\") " pod="openshift-multus/multus-additional-cni-plugins-qdkw4" May 25 14:12:28.340705 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.340532 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/56be8261-ba14-4828-bbf9-5c1e581a4e8b-socket-dir\") pod \"aws-ebs-csi-driver-node-njldq\" (UID: \"56be8261-ba14-4828-bbf9-5c1e581a4e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njldq" May 25 14:12:28.340705 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.340548 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e081d292-f999-4a5d-8e11-7d2ccac47593-cni-binary-copy\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.340705 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.340605 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/95eb3cbd-2c41-4d96-af85-a21ad8aaf82b-run\") pod \"tuned-5bb7j\" (UID: \"95eb3cbd-2c41-4d96-af85-a21ad8aaf82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5bb7j" May 25 14:12:28.340705 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.340643 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e081d292-f999-4a5d-8e11-7d2ccac47593-host-var-lib-cni-multus\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.340705 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.340685 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e081d292-f999-4a5d-8e11-7d2ccac47593-host-var-lib-kubelet\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.340938 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.340713 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/95eb3cbd-2c41-4d96-af85-a21ad8aaf82b-host\") pod \"tuned-5bb7j\" (UID: \"95eb3cbd-2c41-4d96-af85-a21ad8aaf82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5bb7j" May 25 14:12:28.340938 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.340743 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e081d292-f999-4a5d-8e11-7d2ccac47593-hostroot\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.340938 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.340775 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/95eb3cbd-2c41-4d96-af85-a21ad8aaf82b-etc-sysctl-conf\") pod \"tuned-5bb7j\" (UID: \"95eb3cbd-2c41-4d96-af85-a21ad8aaf82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5bb7j" May 25 14:12:28.340938 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.340814 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e081d292-f999-4a5d-8e11-7d2ccac47593-os-release\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.340938 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.340862 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e081d292-f999-4a5d-8e11-7d2ccac47593-etc-kubernetes\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.340938 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.340893 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/56be8261-ba14-4828-bbf9-5c1e581a4e8b-sys-fs\") pod \"aws-ebs-csi-driver-node-njldq\" (UID: \"56be8261-ba14-4828-bbf9-5c1e581a4e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njldq" May 25 14:12:28.340938 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.340928 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/95eb3cbd-2c41-4d96-af85-a21ad8aaf82b-etc-sysctl-d\") pod \"tuned-5bb7j\" (UID: \"95eb3cbd-2c41-4d96-af85-a21ad8aaf82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5bb7j" May 25 14:12:28.341188 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.340959 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-run-openvswitch\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.341188 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.341001 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b48e369-ae21-483b-897e-fb9b4ecd1818-metrics-certs\") pod \"network-metrics-daemon-p6784\" (UID: \"7b48e369-ae21-483b-897e-fb9b4ecd1818\") " pod="openshift-multus/network-metrics-daemon-p6784" May 25 14:12:28.341188 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.341035 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5da677c4-73fb-4b42-be1a-c7fb68aa56d0-host\") pod \"node-ca-wmrkq\" (UID: \"5da677c4-73fb-4b42-be1a-c7fb68aa56d0\") " pod="openshift-image-registry/node-ca-wmrkq" May 25 14:12:28.341188 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.341063 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e081d292-f999-4a5d-8e11-7d2ccac47593-host-run-netns\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.341188 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.341094 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/823e5406-c4ba-45f5-bd46-f82b17b0495c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qdkw4\" (UID: \"823e5406-c4ba-45f5-bd46-f82b17b0495c\") " pod="openshift-multus/multus-additional-cni-plugins-qdkw4" May 25 14:12:28.341188 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.341125 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-host-run-netns\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.341188 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.341143 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e081d292-f999-4a5d-8e11-7d2ccac47593-cni-binary-copy\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.341188 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.341157 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-log-socket\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.341492 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.341191 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.341492 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.341238 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-host-run-ovn-kubernetes\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.341492 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.341414 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.341611 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.341502 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/95eb3cbd-2c41-4d96-af85-a21ad8aaf82b-etc-sysconfig\") pod \"tuned-5bb7j\" (UID: \"95eb3cbd-2c41-4d96-af85-a21ad8aaf82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5bb7j" May 25 14:12:28.341611 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.341519 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95eb3cbd-2c41-4d96-af85-a21ad8aaf82b-sys\") pod \"tuned-5bb7j\" (UID: \"95eb3cbd-2c41-4d96-af85-a21ad8aaf82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5bb7j" May 25 14:12:28.342590 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.342057 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/95eb3cbd-2c41-4d96-af85-a21ad8aaf82b-etc-sysctl-d\") pod \"tuned-5bb7j\" (UID: \"95eb3cbd-2c41-4d96-af85-a21ad8aaf82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5bb7j" May 25 14:12:28.342590 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.342079 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/823e5406-c4ba-45f5-bd46-f82b17b0495c-cni-binary-copy\") pod \"multus-additional-cni-plugins-qdkw4\" (UID: \"823e5406-c4ba-45f5-bd46-f82b17b0495c\") " pod="openshift-multus/multus-additional-cni-plugins-qdkw4" May 25 14:12:28.342590 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.342150 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e081d292-f999-4a5d-8e11-7d2ccac47593-hostroot\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.342590 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.342224 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e081d292-f999-4a5d-8e11-7d2ccac47593-host-var-lib-cni-multus\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.342590 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.342259 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/95eb3cbd-2c41-4d96-af85-a21ad8aaf82b-etc-sysctl-conf\") pod \"tuned-5bb7j\" (UID: \"95eb3cbd-2c41-4d96-af85-a21ad8aaf82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5bb7j" May 25 14:12:28.342590 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.342278 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e081d292-f999-4a5d-8e11-7d2ccac47593-host-var-lib-kubelet\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.342590 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.342284 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e081d292-f999-4a5d-8e11-7d2ccac47593-os-release\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.342590 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.342327 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/95eb3cbd-2c41-4d96-af85-a21ad8aaf82b-host\") pod \"tuned-5bb7j\" (UID: \"95eb3cbd-2c41-4d96-af85-a21ad8aaf82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5bb7j" May 25 14:12:28.342590 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.342330 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e081d292-f999-4a5d-8e11-7d2ccac47593-etc-kubernetes\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.342590 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.342325 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/823e5406-c4ba-45f5-bd46-f82b17b0495c-os-release\") pod \"multus-additional-cni-plugins-qdkw4\" (UID: \"823e5406-c4ba-45f5-bd46-f82b17b0495c\") " pod="openshift-multus/multus-additional-cni-plugins-qdkw4" May 25 14:12:28.342590 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.342400 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmhn2\" (UniqueName: \"kubernetes.io/projected/7b48e369-ae21-483b-897e-fb9b4ecd1818-kube-api-access-vmhn2\") pod \"network-metrics-daemon-p6784\" (UID: \"7b48e369-ae21-483b-897e-fb9b4ecd1818\") " pod="openshift-multus/network-metrics-daemon-p6784" May 25 14:12:28.342590 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.342547 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e081d292-f999-4a5d-8e11-7d2ccac47593-host-var-lib-cni-bin\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.342590 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.342547 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-run-openvswitch\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.343115 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.342599 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e081d292-f999-4a5d-8e11-7d2ccac47593-host-run-netns\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.343115 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.342609 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-host-run-netns\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.343115 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.342650 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/56be8261-ba14-4828-bbf9-5c1e581a4e8b-device-dir\") pod \"aws-ebs-csi-driver-node-njldq\" (UID: \"56be8261-ba14-4828-bbf9-5c1e581a4e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njldq" May 25 14:12:28.343115 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.342701 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/95eb3cbd-2c41-4d96-af85-a21ad8aaf82b-etc-modprobe-d\") pod \"tuned-5bb7j\" (UID: \"95eb3cbd-2c41-4d96-af85-a21ad8aaf82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5bb7j" May 25 14:12:28.343115 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.342723 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/823e5406-c4ba-45f5-bd46-f82b17b0495c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qdkw4\" (UID: \"823e5406-c4ba-45f5-bd46-f82b17b0495c\") " pod="openshift-multus/multus-additional-cni-plugins-qdkw4" May 25 14:12:28.343115 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.342729 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9ea1fab0-ccd9-4900-939f-9e7aa433972f-host-slash\") pod \"iptables-alerter-bwn7t\" (UID: \"9ea1fab0-ccd9-4900-939f-9e7aa433972f\") " pod="openshift-network-operator/iptables-alerter-bwn7t" May 25 14:12:28.343115 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.342773 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e081d292-f999-4a5d-8e11-7d2ccac47593-host-var-lib-cni-bin\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.343115 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.342820 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-log-socket\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.343115 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.342860 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/56be8261-ba14-4828-bbf9-5c1e581a4e8b-sys-fs\") pod \"aws-ebs-csi-driver-node-njldq\" (UID: \"56be8261-ba14-4828-bbf9-5c1e581a4e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njldq" May 25 14:12:28.343115 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.342910 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9ea1fab0-ccd9-4900-939f-9e7aa433972f-host-slash\") pod \"iptables-alerter-bwn7t\" (UID: \"9ea1fab0-ccd9-4900-939f-9e7aa433972f\") " pod="openshift-network-operator/iptables-alerter-bwn7t" May 25 14:12:28.343115 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.342924 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/56be8261-ba14-4828-bbf9-5c1e581a4e8b-device-dir\") pod \"aws-ebs-csi-driver-node-njldq\" (UID: \"56be8261-ba14-4828-bbf9-5c1e581a4e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njldq" May 25 14:12:28.343115 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.342955 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h8n7m\" (UniqueName: \"kubernetes.io/projected/9ea1fab0-ccd9-4900-939f-9e7aa433972f-kube-api-access-h8n7m\") pod \"iptables-alerter-bwn7t\" (UID: \"9ea1fab0-ccd9-4900-939f-9e7aa433972f\") " pod="openshift-network-operator/iptables-alerter-bwn7t" May 25 14:12:28.343598 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.343122 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-etc-openvswitch\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.343598 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.343154 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e081d292-f999-4a5d-8e11-7d2ccac47593-system-cni-dir\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.343598 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.343210 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e081d292-f999-4a5d-8e11-7d2ccac47593-cnibin\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.343598 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.343226 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/95eb3cbd-2c41-4d96-af85-a21ad8aaf82b-etc-modprobe-d\") pod \"tuned-5bb7j\" (UID: \"95eb3cbd-2c41-4d96-af85-a21ad8aaf82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5bb7j" May 25 14:12:28.343598 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.343243 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/251e865d-d65c-4abf-b045-ac55fee054da-hosts-file\") pod \"node-resolver-td67w\" (UID: \"251e865d-d65c-4abf-b045-ac55fee054da\") " pod="openshift-dns/node-resolver-td67w" May 25 14:12:28.343598 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.343270 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-etc-openvswitch\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.343598 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.343275 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e081d292-f999-4a5d-8e11-7d2ccac47593-multus-conf-dir\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.343598 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.343311 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/251e865d-d65c-4abf-b045-ac55fee054da-hosts-file\") pod \"node-resolver-td67w\" (UID: \"251e865d-d65c-4abf-b045-ac55fee054da\") " pod="openshift-dns/node-resolver-td67w" May 25 14:12:28.343598 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.343340 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e081d292-f999-4a5d-8e11-7d2ccac47593-system-cni-dir\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.343598 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.343400 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/56be8261-ba14-4828-bbf9-5c1e581a4e8b-etc-selinux\") pod \"aws-ebs-csi-driver-node-njldq\" (UID: \"56be8261-ba14-4828-bbf9-5c1e581a4e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njldq" May 25 14:12:28.343598 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.343432 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mg679\" (UniqueName: \"kubernetes.io/projected/56be8261-ba14-4828-bbf9-5c1e581a4e8b-kube-api-access-mg679\") pod \"aws-ebs-csi-driver-node-njldq\" (UID: \"56be8261-ba14-4828-bbf9-5c1e581a4e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njldq" May 25 14:12:28.343598 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.343462 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95eb3cbd-2c41-4d96-af85-a21ad8aaf82b-etc-kubernetes\") pod \"tuned-5bb7j\" (UID: \"95eb3cbd-2c41-4d96-af85-a21ad8aaf82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5bb7j" May 25 14:12:28.343598 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.343467 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-ovnkube-config\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.343598 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.343540 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/823e5406-c4ba-45f5-bd46-f82b17b0495c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qdkw4\" (UID: \"823e5406-c4ba-45f5-bd46-f82b17b0495c\") " pod="openshift-multus/multus-additional-cni-plugins-qdkw4" May 25 14:12:28.343598 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.343545 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e081d292-f999-4a5d-8e11-7d2ccac47593-cnibin\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.343598 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.343577 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-systemd-units\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.344237 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.343620 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/56be8261-ba14-4828-bbf9-5c1e581a4e8b-etc-selinux\") pod \"aws-ebs-csi-driver-node-njldq\" (UID: \"56be8261-ba14-4828-bbf9-5c1e581a4e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njldq" May 25 14:12:28.344237 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.343623 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-env-overrides\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.344237 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.343686 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95eb3cbd-2c41-4d96-af85-a21ad8aaf82b-etc-kubernetes\") pod \"tuned-5bb7j\" (UID: \"95eb3cbd-2c41-4d96-af85-a21ad8aaf82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5bb7j" May 25 14:12:28.344237 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.343692 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/949098c1-c4c0-401c-8faf-db03fa09d898-konnectivity-ca\") pod \"konnectivity-agent-zrq2g\" (UID: \"949098c1-c4c0-401c-8faf-db03fa09d898\") " pod="kube-system/konnectivity-agent-zrq2g" May 25 14:12:28.344237 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.343738 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/95eb3cbd-2c41-4d96-af85-a21ad8aaf82b-etc-systemd\") pod \"tuned-5bb7j\" (UID: \"95eb3cbd-2c41-4d96-af85-a21ad8aaf82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5bb7j" May 25 14:12:28.344237 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.343765 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/823e5406-c4ba-45f5-bd46-f82b17b0495c-cnibin\") pod \"multus-additional-cni-plugins-qdkw4\" (UID: \"823e5406-c4ba-45f5-bd46-f82b17b0495c\") " pod="openshift-multus/multus-additional-cni-plugins-qdkw4" May 25 14:12:28.344237 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.343823 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/823e5406-c4ba-45f5-bd46-f82b17b0495c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qdkw4\" (UID: \"823e5406-c4ba-45f5-bd46-f82b17b0495c\") " pod="openshift-multus/multus-additional-cni-plugins-qdkw4" May 25 14:12:28.344237 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.343860 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-ovnkube-script-lib\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.344237 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.343897 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e081d292-f999-4a5d-8e11-7d2ccac47593-multus-socket-dir-parent\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.344237 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.343947 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/56be8261-ba14-4828-bbf9-5c1e581a4e8b-registration-dir\") pod \"aws-ebs-csi-driver-node-njldq\" (UID: \"56be8261-ba14-4828-bbf9-5c1e581a4e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njldq" May 25 14:12:28.344237 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.343979 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/95eb3cbd-2c41-4d96-af85-a21ad8aaf82b-lib-modules\") pod \"tuned-5bb7j\" (UID: \"95eb3cbd-2c41-4d96-af85-a21ad8aaf82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5bb7j" May 25 14:12:28.344237 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.344012 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-frx7c\" (UniqueName: \"kubernetes.io/projected/14bb3377-8d7b-4231-a2c1-cf5a7e7abbea-kube-api-access-frx7c\") pod \"network-check-target-wrh74\" (UID: \"14bb3377-8d7b-4231-a2c1-cf5a7e7abbea\") " pod="openshift-network-diagnostics/network-check-target-wrh74" May 25 14:12:28.344237 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.344105 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-env-overrides\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.344237 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.344112 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-host-cni-netd\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.344237 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.344134 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/823e5406-c4ba-45f5-bd46-f82b17b0495c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qdkw4\" (UID: \"823e5406-c4ba-45f5-bd46-f82b17b0495c\") " pod="openshift-multus/multus-additional-cni-plugins-qdkw4" May 25 14:12:28.344237 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.344168 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/823e5406-c4ba-45f5-bd46-f82b17b0495c-cnibin\") pod \"multus-additional-cni-plugins-qdkw4\" (UID: \"823e5406-c4ba-45f5-bd46-f82b17b0495c\") " pod="openshift-multus/multus-additional-cni-plugins-qdkw4" May 25 14:12:28.344237 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.344190 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e081d292-f999-4a5d-8e11-7d2ccac47593-multus-conf-dir\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.344958 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.344222 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/95eb3cbd-2c41-4d96-af85-a21ad8aaf82b-etc-systemd\") pod \"tuned-5bb7j\" (UID: \"95eb3cbd-2c41-4d96-af85-a21ad8aaf82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5bb7j" May 25 14:12:28.344958 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.344268 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-host-cni-netd\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.344958 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.344459 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-systemd-units\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.344958 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.344523 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e081d292-f999-4a5d-8e11-7d2ccac47593-multus-socket-dir-parent\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.344958 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.344583 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/949098c1-c4c0-401c-8faf-db03fa09d898-konnectivity-ca\") pod \"konnectivity-agent-zrq2g\" (UID: \"949098c1-c4c0-401c-8faf-db03fa09d898\") " pod="kube-system/konnectivity-agent-zrq2g" May 25 14:12:28.344958 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.344599 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/56be8261-ba14-4828-bbf9-5c1e581a4e8b-registration-dir\") pod \"aws-ebs-csi-driver-node-njldq\" (UID: \"56be8261-ba14-4828-bbf9-5c1e581a4e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njldq" May 25 14:12:28.344958 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.344626 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e081d292-f999-4a5d-8e11-7d2ccac47593-multus-daemon-config\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.344958 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.344667 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-host-slash\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.344958 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.344715 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/95eb3cbd-2c41-4d96-af85-a21ad8aaf82b-lib-modules\") pod \"tuned-5bb7j\" (UID: \"95eb3cbd-2c41-4d96-af85-a21ad8aaf82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5bb7j" May 25 14:12:28.344958 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.344730 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e081d292-f999-4a5d-8e11-7d2ccac47593-multus-cni-dir\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.344958 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.344764 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-78bqg\" (UniqueName: \"kubernetes.io/projected/e081d292-f999-4a5d-8e11-7d2ccac47593-kube-api-access-78bqg\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.344958 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.344769 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-host-slash\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.344958 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.344803 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/95eb3cbd-2c41-4d96-af85-a21ad8aaf82b-var-lib-kubelet\") pod \"tuned-5bb7j\" (UID: \"95eb3cbd-2c41-4d96-af85-a21ad8aaf82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5bb7j" May 25 14:12:28.344958 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.344868 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9ea1fab0-ccd9-4900-939f-9e7aa433972f-iptables-alerter-script\") pod \"iptables-alerter-bwn7t\" (UID: \"9ea1fab0-ccd9-4900-939f-9e7aa433972f\") " pod="openshift-network-operator/iptables-alerter-bwn7t" May 25 14:12:28.344958 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.344942 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4htm7\" (UniqueName: \"kubernetes.io/projected/823e5406-c4ba-45f5-bd46-f82b17b0495c-kube-api-access-4htm7\") pod \"multus-additional-cni-plugins-qdkw4\" (UID: \"823e5406-c4ba-45f5-bd46-f82b17b0495c\") " pod="openshift-multus/multus-additional-cni-plugins-qdkw4" May 25 14:12:28.345592 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.344976 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-run-systemd\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.345592 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.345003 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-host-cni-bin\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.345592 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.345029 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/823e5406-c4ba-45f5-bd46-f82b17b0495c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qdkw4\" (UID: \"823e5406-c4ba-45f5-bd46-f82b17b0495c\") " pod="openshift-multus/multus-additional-cni-plugins-qdkw4" May 25 14:12:28.345592 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.345112 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-run-systemd\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.345592 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.345112 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e081d292-f999-4a5d-8e11-7d2ccac47593-multus-cni-dir\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.345592 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.345202 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e081d292-f999-4a5d-8e11-7d2ccac47593-multus-daemon-config\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.345592 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.345324 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-host-cni-bin\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.345592 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.345475 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/95eb3cbd-2c41-4d96-af85-a21ad8aaf82b-etc-tuned\") pod \"tuned-5bb7j\" (UID: \"95eb3cbd-2c41-4d96-af85-a21ad8aaf82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5bb7j" May 25 14:12:28.345592 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.345545 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/95eb3cbd-2c41-4d96-af85-a21ad8aaf82b-var-lib-kubelet\") pod \"tuned-5bb7j\" (UID: \"95eb3cbd-2c41-4d96-af85-a21ad8aaf82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5bb7j" May 25 14:12:28.345957 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.345775 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/949098c1-c4c0-401c-8faf-db03fa09d898-agent-certs\") pod \"konnectivity-agent-zrq2g\" (UID: \"949098c1-c4c0-401c-8faf-db03fa09d898\") " pod="kube-system/konnectivity-agent-zrq2g" May 25 14:12:28.345957 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.345841 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-ovnkube-script-lib\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.345957 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.345869 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9ea1fab0-ccd9-4900-939f-9e7aa433972f-iptables-alerter-script\") pod \"iptables-alerter-bwn7t\" (UID: \"9ea1fab0-ccd9-4900-939f-9e7aa433972f\") " pod="openshift-network-operator/iptables-alerter-bwn7t" May 25 14:12:28.346091 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.346026 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95eb3cbd-2c41-4d96-af85-a21ad8aaf82b-tmp\") pod \"tuned-5bb7j\" (UID: \"95eb3cbd-2c41-4d96-af85-a21ad8aaf82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5bb7j" May 25 14:12:28.347828 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.347804 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-ovn-node-metrics-cert\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.350587 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:28.350556 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 14:12:28.350587 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:28.350582 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 14:12:28.351275 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:28.350605 2562 projected.go:194] Error preparing data for projected volume kube-api-access-frx7c for pod openshift-network-diagnostics/network-check-target-wrh74: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 14:12:28.351275 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:28.350722 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14bb3377-8d7b-4231-a2c1-cf5a7e7abbea-kube-api-access-frx7c podName:14bb3377-8d7b-4231-a2c1-cf5a7e7abbea nodeName:}" failed. No retries permitted until 2026-05-25 14:12:28.850664154 +0000 UTC m=+3.057911333 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-frx7c" (UniqueName: "kubernetes.io/projected/14bb3377-8d7b-4231-a2c1-cf5a7e7abbea-kube-api-access-frx7c") pod "network-check-target-wrh74" (UID: "14bb3377-8d7b-4231-a2c1-cf5a7e7abbea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 14:12:28.351275 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.351262 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75sqt\" (UniqueName: \"kubernetes.io/projected/95eb3cbd-2c41-4d96-af85-a21ad8aaf82b-kube-api-access-75sqt\") pod \"tuned-5bb7j\" (UID: \"95eb3cbd-2c41-4d96-af85-a21ad8aaf82b\") " pod="openshift-cluster-node-tuning-operator/tuned-5bb7j" May 25 14:12:28.351564 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.351346 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh29x\" (UniqueName: \"kubernetes.io/projected/251e865d-d65c-4abf-b045-ac55fee054da-kube-api-access-vh29x\") pod \"node-resolver-td67w\" (UID: \"251e865d-d65c-4abf-b045-ac55fee054da\") " pod="openshift-dns/node-resolver-td67w" May 25 14:12:28.351564 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.351465 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snnlx\" (UniqueName: \"kubernetes.io/projected/b5ab1333-fc5e-46eb-a0ee-bd4d08c45527-kube-api-access-snnlx\") pod \"ovnkube-node-b2gmj\" (UID: \"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527\") " pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.353501 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.353480 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg679\" (UniqueName: \"kubernetes.io/projected/56be8261-ba14-4828-bbf9-5c1e581a4e8b-kube-api-access-mg679\") pod \"aws-ebs-csi-driver-node-njldq\" (UID: \"56be8261-ba14-4828-bbf9-5c1e581a4e8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njldq" May 25 14:12:28.353710 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.353687 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8n7m\" (UniqueName: \"kubernetes.io/projected/9ea1fab0-ccd9-4900-939f-9e7aa433972f-kube-api-access-h8n7m\") pod \"iptables-alerter-bwn7t\" (UID: \"9ea1fab0-ccd9-4900-939f-9e7aa433972f\") " pod="openshift-network-operator/iptables-alerter-bwn7t" May 25 14:12:28.354205 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.354182 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4htm7\" (UniqueName: \"kubernetes.io/projected/823e5406-c4ba-45f5-bd46-f82b17b0495c-kube-api-access-4htm7\") pod \"multus-additional-cni-plugins-qdkw4\" (UID: \"823e5406-c4ba-45f5-bd46-f82b17b0495c\") " pod="openshift-multus/multus-additional-cni-plugins-qdkw4" May 25 14:12:28.354981 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.354956 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78bqg\" (UniqueName: \"kubernetes.io/projected/e081d292-f999-4a5d-8e11-7d2ccac47593-kube-api-access-78bqg\") pod \"multus-l5kmt\" (UID: \"e081d292-f999-4a5d-8e11-7d2ccac47593\") " pod="openshift-multus/multus-l5kmt" May 25 14:12:28.445888 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.445859 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b48e369-ae21-483b-897e-fb9b4ecd1818-metrics-certs\") pod \"network-metrics-daemon-p6784\" (UID: \"7b48e369-ae21-483b-897e-fb9b4ecd1818\") " pod="openshift-multus/network-metrics-daemon-p6784" May 25 14:12:28.445888 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.445892 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5da677c4-73fb-4b42-be1a-c7fb68aa56d0-host\") pod \"node-ca-wmrkq\" (UID: \"5da677c4-73fb-4b42-be1a-c7fb68aa56d0\") " pod="openshift-image-registry/node-ca-wmrkq" May 25 14:12:28.446095 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.445921 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vmhn2\" (UniqueName: \"kubernetes.io/projected/7b48e369-ae21-483b-897e-fb9b4ecd1818-kube-api-access-vmhn2\") pod \"network-metrics-daemon-p6784\" (UID: \"7b48e369-ae21-483b-897e-fb9b4ecd1818\") " pod="openshift-multus/network-metrics-daemon-p6784" May 25 14:12:28.446095 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.445988 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5da677c4-73fb-4b42-be1a-c7fb68aa56d0-serviceca\") pod \"node-ca-wmrkq\" (UID: \"5da677c4-73fb-4b42-be1a-c7fb68aa56d0\") " pod="openshift-image-registry/node-ca-wmrkq" May 25 14:12:28.446095 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.445997 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5da677c4-73fb-4b42-be1a-c7fb68aa56d0-host\") pod \"node-ca-wmrkq\" (UID: \"5da677c4-73fb-4b42-be1a-c7fb68aa56d0\") " pod="openshift-image-registry/node-ca-wmrkq" May 25 14:12:28.446095 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:28.446029 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 14:12:28.446095 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.446028 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tg69g\" (UniqueName: \"kubernetes.io/projected/5da677c4-73fb-4b42-be1a-c7fb68aa56d0-kube-api-access-tg69g\") pod \"node-ca-wmrkq\" (UID: \"5da677c4-73fb-4b42-be1a-c7fb68aa56d0\") " pod="openshift-image-registry/node-ca-wmrkq" May 25 14:12:28.446095 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:28.446088 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b48e369-ae21-483b-897e-fb9b4ecd1818-metrics-certs podName:7b48e369-ae21-483b-897e-fb9b4ecd1818 nodeName:}" failed. No retries permitted until 2026-05-25 14:12:28.946067965 +0000 UTC m=+3.153315173 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b48e369-ae21-483b-897e-fb9b4ecd1818-metrics-certs") pod "network-metrics-daemon-p6784" (UID: "7b48e369-ae21-483b-897e-fb9b4ecd1818") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 14:12:28.446563 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.446546 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5da677c4-73fb-4b42-be1a-c7fb68aa56d0-serviceca\") pod \"node-ca-wmrkq\" (UID: \"5da677c4-73fb-4b42-be1a-c7fb68aa56d0\") " pod="openshift-image-registry/node-ca-wmrkq" May 25 14:12:28.454566 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.454541 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg69g\" (UniqueName: \"kubernetes.io/projected/5da677c4-73fb-4b42-be1a-c7fb68aa56d0-kube-api-access-tg69g\") pod \"node-ca-wmrkq\" (UID: \"5da677c4-73fb-4b42-be1a-c7fb68aa56d0\") " pod="openshift-image-registry/node-ca-wmrkq" May 25 14:12:28.454895 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.454881 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmhn2\" (UniqueName: \"kubernetes.io/projected/7b48e369-ae21-483b-897e-fb9b4ecd1818-kube-api-access-vmhn2\") pod \"network-metrics-daemon-p6784\" (UID: \"7b48e369-ae21-483b-897e-fb9b4ecd1818\") " pod="openshift-multus/network-metrics-daemon-p6784" May 25 14:12:28.528010 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.527931 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bwn7t" May 25 14:12:28.536781 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.536753 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-td67w" May 25 14:12:28.543562 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.543538 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qdkw4" May 25 14:12:28.548543 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.548523 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-l5kmt" May 25 14:12:28.555174 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.555155 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zrq2g" May 25 14:12:28.561808 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.561786 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:28.569481 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.569457 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njldq" May 25 14:12:28.576035 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.576016 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5bb7j" May 25 14:12:28.580536 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.580515 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wmrkq" May 25 14:12:28.589553 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.589531 2562 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 25 14:12:28.902719 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:28.902670 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod949098c1_c4c0_401c_8faf_db03fa09d898.slice/crio-1197f299e07c8d3de034fae4e12e23ad5431b0e9b2fa6abf046eeffbeaa592c0 WatchSource:0}: Error finding container 1197f299e07c8d3de034fae4e12e23ad5431b0e9b2fa6abf046eeffbeaa592c0: Status 404 returned error can't find the container with id 1197f299e07c8d3de034fae4e12e23ad5431b0e9b2fa6abf046eeffbeaa592c0 May 25 14:12:28.905411 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:28.905363 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95eb3cbd_2c41_4d96_af85_a21ad8aaf82b.slice/crio-fd3adca10fb18487315ee6619723cb3cbd0232f8acc4efc78ac237d75a7982d7 WatchSource:0}: Error finding container fd3adca10fb18487315ee6619723cb3cbd0232f8acc4efc78ac237d75a7982d7: Status 404 returned error can't find the container with id fd3adca10fb18487315ee6619723cb3cbd0232f8acc4efc78ac237d75a7982d7 May 25 14:12:28.907586 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:28.907555 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode081d292_f999_4a5d_8e11_7d2ccac47593.slice/crio-e062a10c11318ae93e5f160969a0f285c941966366ec706bf019a4b8b78060c8 WatchSource:0}: Error finding container e062a10c11318ae93e5f160969a0f285c941966366ec706bf019a4b8b78060c8: Status 404 returned error can't find the container with id e062a10c11318ae93e5f160969a0f285c941966366ec706bf019a4b8b78060c8 May 25 14:12:28.912884 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:28.911626 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ea1fab0_ccd9_4900_939f_9e7aa433972f.slice/crio-b48ab0639d095dcfa1fa1f6765b1c3a95e5fbbd43b649f2aa8d78caf1361f446 WatchSource:0}: Error finding container b48ab0639d095dcfa1fa1f6765b1c3a95e5fbbd43b649f2aa8d78caf1361f446: Status 404 returned error can't find the container with id b48ab0639d095dcfa1fa1f6765b1c3a95e5fbbd43b649f2aa8d78caf1361f446 May 25 14:12:28.913265 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:28.913226 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56be8261_ba14_4828_bbf9_5c1e581a4e8b.slice/crio-0e09a3dddfab8b704d5c940a9c43115d7d8eeacfc34ebb0bd64d2e4052969e3a WatchSource:0}: Error finding container 0e09a3dddfab8b704d5c940a9c43115d7d8eeacfc34ebb0bd64d2e4052969e3a: Status 404 returned error can't find the container with id 0e09a3dddfab8b704d5c940a9c43115d7d8eeacfc34ebb0bd64d2e4052969e3a May 25 14:12:28.914579 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:28.914560 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod823e5406_c4ba_45f5_bd46_f82b17b0495c.slice/crio-31e0cdcc319ccfe4930a026ccc3f1296222326be923db93e1425a17957cab00e WatchSource:0}: Error finding container 31e0cdcc319ccfe4930a026ccc3f1296222326be923db93e1425a17957cab00e: Status 404 returned error can't find the container with id 31e0cdcc319ccfe4930a026ccc3f1296222326be923db93e1425a17957cab00e May 25 14:12:28.915518 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:12:28.915499 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod251e865d_d65c_4abf_b045_ac55fee054da.slice/crio-e0f57f997b4b836921728e508d1c550945b5539ae70c417889d91fa758c46400 WatchSource:0}: Error finding container e0f57f997b4b836921728e508d1c550945b5539ae70c417889d91fa758c46400: Status 404 returned error can't find the container with id e0f57f997b4b836921728e508d1c550945b5539ae70c417889d91fa758c46400 May 25 14:12:28.949076 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.948646 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b48e369-ae21-483b-897e-fb9b4ecd1818-metrics-certs\") pod \"network-metrics-daemon-p6784\" (UID: \"7b48e369-ae21-483b-897e-fb9b4ecd1818\") " pod="openshift-multus/network-metrics-daemon-p6784" May 25 14:12:28.949076 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:28.948896 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-frx7c\" (UniqueName: \"kubernetes.io/projected/14bb3377-8d7b-4231-a2c1-cf5a7e7abbea-kube-api-access-frx7c\") pod \"network-check-target-wrh74\" (UID: \"14bb3377-8d7b-4231-a2c1-cf5a7e7abbea\") " pod="openshift-network-diagnostics/network-check-target-wrh74" May 25 14:12:28.949076 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:28.948780 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 14:12:28.949076 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:28.948997 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 14:12:28.949076 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:28.949009 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 14:12:28.949076 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:28.949018 2562 projected.go:194] Error preparing data for projected volume kube-api-access-frx7c for pod openshift-network-diagnostics/network-check-target-wrh74: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 14:12:28.949076 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:28.949030 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b48e369-ae21-483b-897e-fb9b4ecd1818-metrics-certs podName:7b48e369-ae21-483b-897e-fb9b4ecd1818 nodeName:}" failed. No retries permitted until 2026-05-25 14:12:29.94900484 +0000 UTC m=+4.156252019 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b48e369-ae21-483b-897e-fb9b4ecd1818-metrics-certs") pod "network-metrics-daemon-p6784" (UID: "7b48e369-ae21-483b-897e-fb9b4ecd1818") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 14:12:28.949076 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:28.949062 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14bb3377-8d7b-4231-a2c1-cf5a7e7abbea-kube-api-access-frx7c podName:14bb3377-8d7b-4231-a2c1-cf5a7e7abbea nodeName:}" failed. No retries permitted until 2026-05-25 14:12:29.949043628 +0000 UTC m=+4.156290790 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-frx7c" (UniqueName: "kubernetes.io/projected/14bb3377-8d7b-4231-a2c1-cf5a7e7abbea-kube-api-access-frx7c") pod "network-check-target-wrh74" (UID: "14bb3377-8d7b-4231-a2c1-cf5a7e7abbea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 14:12:29.267735 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:29.267693 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-24 14:07:27 +0000 UTC" deadline="2028-02-22 14:21:10.368439912 +0000 UTC" May 25 14:12:29.267735 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:29.267727 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15312h8m41.100714873s" May 25 14:12:29.361248 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:29.360732 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p6784" May 25 14:12:29.361248 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:29.360893 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p6784" podUID="7b48e369-ae21-483b-897e-fb9b4ecd1818" May 25 14:12:29.370475 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:29.370155 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njldq" event={"ID":"56be8261-ba14-4828-bbf9-5c1e581a4e8b","Type":"ContainerStarted","Data":"0e09a3dddfab8b704d5c940a9c43115d7d8eeacfc34ebb0bd64d2e4052969e3a"} May 25 14:12:29.375585 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:29.375516 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wmrkq" event={"ID":"5da677c4-73fb-4b42-be1a-c7fb68aa56d0","Type":"ContainerStarted","Data":"aac2c3b81e9f5406ae34ff078b1df3a625e585b7cfc0694e8e1a7f96ba9dd123"} May 25 14:12:29.378506 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:29.378452 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-l5kmt" event={"ID":"e081d292-f999-4a5d-8e11-7d2ccac47593","Type":"ContainerStarted","Data":"e062a10c11318ae93e5f160969a0f285c941966366ec706bf019a4b8b78060c8"} May 25 14:12:29.385055 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:29.384306 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-29.ec2.internal" event={"ID":"bcb5c6667f8450704515b5a4ad2ed7fc","Type":"ContainerStarted","Data":"1fafe5a0739ce768933469fb27d1c1a7a148f48a5fb86715d0c0ee39077f9a77"} May 25 14:12:29.389957 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:29.389898 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bwn7t" event={"ID":"9ea1fab0-ccd9-4900-939f-9e7aa433972f","Type":"ContainerStarted","Data":"b48ab0639d095dcfa1fa1f6765b1c3a95e5fbbd43b649f2aa8d78caf1361f446"} May 25 14:12:29.398937 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:29.398883 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" event={"ID":"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527","Type":"ContainerStarted","Data":"154d4222a4e0a6adb17865aa34ca8c979cbd73a6d89b79ca33a209a610285ec9"} May 25 14:12:29.409362 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:29.409315 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5bb7j" event={"ID":"95eb3cbd-2c41-4d96-af85-a21ad8aaf82b","Type":"ContainerStarted","Data":"fd3adca10fb18487315ee6619723cb3cbd0232f8acc4efc78ac237d75a7982d7"} May 25 14:12:29.412701 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:29.412646 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zrq2g" event={"ID":"949098c1-c4c0-401c-8faf-db03fa09d898","Type":"ContainerStarted","Data":"1197f299e07c8d3de034fae4e12e23ad5431b0e9b2fa6abf046eeffbeaa592c0"} May 25 14:12:29.445689 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:29.444828 2562 generic.go:358] "Generic (PLEG): container finished" podID="2a24073830ae5c95f5d5093d408de332" containerID="6c33064399a36a54215d4b7188cbfa94c27dffef2dc8957fb659b1979eb4ef02" exitCode=0 May 25 14:12:29.445689 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:29.444936 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-29.ec2.internal" event={"ID":"2a24073830ae5c95f5d5093d408de332","Type":"ContainerDied","Data":"6c33064399a36a54215d4b7188cbfa94c27dffef2dc8957fb659b1979eb4ef02"} May 25 14:12:29.459419 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:29.459280 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-29.ec2.internal" podStartSLOduration=2.45926033 podStartE2EDuration="2.45926033s" podCreationTimestamp="2026-05-25 14:12:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 14:12:29.402555548 +0000 UTC m=+3.609802732" watchObservedRunningTime="2026-05-25 14:12:29.45926033 +0000 UTC m=+3.666507514" May 25 14:12:29.459948 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:29.459701 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-td67w" event={"ID":"251e865d-d65c-4abf-b045-ac55fee054da","Type":"ContainerStarted","Data":"e0f57f997b4b836921728e508d1c550945b5539ae70c417889d91fa758c46400"} May 25 14:12:29.468628 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:29.468597 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qdkw4" event={"ID":"823e5406-c4ba-45f5-bd46-f82b17b0495c","Type":"ContainerStarted","Data":"31e0cdcc319ccfe4930a026ccc3f1296222326be923db93e1425a17957cab00e"} May 25 14:12:29.959016 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:29.958906 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b48e369-ae21-483b-897e-fb9b4ecd1818-metrics-certs\") pod \"network-metrics-daemon-p6784\" (UID: \"7b48e369-ae21-483b-897e-fb9b4ecd1818\") " pod="openshift-multus/network-metrics-daemon-p6784" May 25 14:12:29.959016 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:29.958974 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-frx7c\" (UniqueName: \"kubernetes.io/projected/14bb3377-8d7b-4231-a2c1-cf5a7e7abbea-kube-api-access-frx7c\") pod \"network-check-target-wrh74\" (UID: \"14bb3377-8d7b-4231-a2c1-cf5a7e7abbea\") " pod="openshift-network-diagnostics/network-check-target-wrh74" May 25 14:12:29.959241 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:29.959119 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 14:12:29.959241 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:29.959137 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 14:12:29.959241 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:29.959149 2562 projected.go:194] Error preparing data for projected volume kube-api-access-frx7c for pod openshift-network-diagnostics/network-check-target-wrh74: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 14:12:29.959241 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:29.959206 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14bb3377-8d7b-4231-a2c1-cf5a7e7abbea-kube-api-access-frx7c podName:14bb3377-8d7b-4231-a2c1-cf5a7e7abbea nodeName:}" failed. No retries permitted until 2026-05-25 14:12:31.959187551 +0000 UTC m=+6.166434732 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-frx7c" (UniqueName: "kubernetes.io/projected/14bb3377-8d7b-4231-a2c1-cf5a7e7abbea-kube-api-access-frx7c") pod "network-check-target-wrh74" (UID: "14bb3377-8d7b-4231-a2c1-cf5a7e7abbea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 14:12:29.959653 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:29.959635 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 14:12:29.959721 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:29.959689 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b48e369-ae21-483b-897e-fb9b4ecd1818-metrics-certs podName:7b48e369-ae21-483b-897e-fb9b4ecd1818 nodeName:}" failed. No retries permitted until 2026-05-25 14:12:31.959673879 +0000 UTC m=+6.166921047 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b48e369-ae21-483b-897e-fb9b4ecd1818-metrics-certs") pod "network-metrics-daemon-p6784" (UID: "7b48e369-ae21-483b-897e-fb9b4ecd1818") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 14:12:30.360701 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:30.360662 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrh74" May 25 14:12:30.361224 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:30.360897 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrh74" podUID="14bb3377-8d7b-4231-a2c1-cf5a7e7abbea" May 25 14:12:30.487766 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:30.487710 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-29.ec2.internal" event={"ID":"2a24073830ae5c95f5d5093d408de332","Type":"ContainerStarted","Data":"252f27baa276875926405a35ef5df18ab80dfa8645f95800f9f8553b208ac9ac"} May 25 14:12:31.361924 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:31.361399 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p6784" May 25 14:12:31.361924 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:31.361552 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p6784" podUID="7b48e369-ae21-483b-897e-fb9b4ecd1818" May 25 14:12:31.974479 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:31.974435 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-frx7c\" (UniqueName: \"kubernetes.io/projected/14bb3377-8d7b-4231-a2c1-cf5a7e7abbea-kube-api-access-frx7c\") pod \"network-check-target-wrh74\" (UID: \"14bb3377-8d7b-4231-a2c1-cf5a7e7abbea\") " pod="openshift-network-diagnostics/network-check-target-wrh74" May 25 14:12:31.974640 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:31.974524 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b48e369-ae21-483b-897e-fb9b4ecd1818-metrics-certs\") pod \"network-metrics-daemon-p6784\" (UID: \"7b48e369-ae21-483b-897e-fb9b4ecd1818\") " pod="openshift-multus/network-metrics-daemon-p6784" May 25 14:12:31.974640 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:31.974628 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 14:12:31.974732 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:31.974680 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b48e369-ae21-483b-897e-fb9b4ecd1818-metrics-certs podName:7b48e369-ae21-483b-897e-fb9b4ecd1818 nodeName:}" failed. No retries permitted until 2026-05-25 14:12:35.974666088 +0000 UTC m=+10.181913249 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b48e369-ae21-483b-897e-fb9b4ecd1818-metrics-certs") pod "network-metrics-daemon-p6784" (UID: "7b48e369-ae21-483b-897e-fb9b4ecd1818") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 14:12:31.975080 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:31.975056 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 14:12:31.975080 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:31.975084 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 14:12:31.975230 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:31.975096 2562 projected.go:194] Error preparing data for projected volume kube-api-access-frx7c for pod openshift-network-diagnostics/network-check-target-wrh74: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 14:12:31.975230 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:31.975143 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14bb3377-8d7b-4231-a2c1-cf5a7e7abbea-kube-api-access-frx7c podName:14bb3377-8d7b-4231-a2c1-cf5a7e7abbea nodeName:}" failed. No retries permitted until 2026-05-25 14:12:35.975126703 +0000 UTC m=+10.182373880 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-frx7c" (UniqueName: "kubernetes.io/projected/14bb3377-8d7b-4231-a2c1-cf5a7e7abbea-kube-api-access-frx7c") pod "network-check-target-wrh74" (UID: "14bb3377-8d7b-4231-a2c1-cf5a7e7abbea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 14:12:32.365769 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:32.365730 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrh74" May 25 14:12:32.366194 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:32.365865 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrh74" podUID="14bb3377-8d7b-4231-a2c1-cf5a7e7abbea" May 25 14:12:33.361615 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:33.361579 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p6784" May 25 14:12:33.361811 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:33.361690 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p6784" podUID="7b48e369-ae21-483b-897e-fb9b4ecd1818" May 25 14:12:34.364265 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:34.364234 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrh74" May 25 14:12:34.364849 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:34.364359 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrh74" podUID="14bb3377-8d7b-4231-a2c1-cf5a7e7abbea" May 25 14:12:35.361158 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:35.361128 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p6784" May 25 14:12:35.361479 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:35.361254 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p6784" podUID="7b48e369-ae21-483b-897e-fb9b4ecd1818" May 25 14:12:36.008214 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:36.008174 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b48e369-ae21-483b-897e-fb9b4ecd1818-metrics-certs\") pod \"network-metrics-daemon-p6784\" (UID: \"7b48e369-ae21-483b-897e-fb9b4ecd1818\") " pod="openshift-multus/network-metrics-daemon-p6784" May 25 14:12:36.008688 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:36.008252 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-frx7c\" (UniqueName: \"kubernetes.io/projected/14bb3377-8d7b-4231-a2c1-cf5a7e7abbea-kube-api-access-frx7c\") pod \"network-check-target-wrh74\" (UID: \"14bb3377-8d7b-4231-a2c1-cf5a7e7abbea\") " pod="openshift-network-diagnostics/network-check-target-wrh74" May 25 14:12:36.008688 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:36.008420 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 14:12:36.008688 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:36.008437 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 14:12:36.008688 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:36.008449 2562 projected.go:194] Error preparing data for projected volume kube-api-access-frx7c for pod openshift-network-diagnostics/network-check-target-wrh74: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 14:12:36.008688 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:36.008503 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14bb3377-8d7b-4231-a2c1-cf5a7e7abbea-kube-api-access-frx7c podName:14bb3377-8d7b-4231-a2c1-cf5a7e7abbea nodeName:}" failed. No retries permitted until 2026-05-25 14:12:44.008486211 +0000 UTC m=+18.215733380 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-frx7c" (UniqueName: "kubernetes.io/projected/14bb3377-8d7b-4231-a2c1-cf5a7e7abbea-kube-api-access-frx7c") pod "network-check-target-wrh74" (UID: "14bb3377-8d7b-4231-a2c1-cf5a7e7abbea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 14:12:36.008937 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:36.008918 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 14:12:36.008976 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:36.008971 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b48e369-ae21-483b-897e-fb9b4ecd1818-metrics-certs podName:7b48e369-ae21-483b-897e-fb9b4ecd1818 nodeName:}" failed. No retries permitted until 2026-05-25 14:12:44.00895512 +0000 UTC m=+18.216202302 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b48e369-ae21-483b-897e-fb9b4ecd1818-metrics-certs") pod "network-metrics-daemon-p6784" (UID: "7b48e369-ae21-483b-897e-fb9b4ecd1818") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 14:12:36.366877 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:36.366848 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrh74" May 25 14:12:36.367043 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:36.366949 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrh74" podUID="14bb3377-8d7b-4231-a2c1-cf5a7e7abbea" May 25 14:12:37.361000 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:37.360964 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p6784" May 25 14:12:37.361419 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:37.361096 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p6784" podUID="7b48e369-ae21-483b-897e-fb9b4ecd1818" May 25 14:12:38.361341 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:38.361300 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrh74" May 25 14:12:38.361780 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:38.361490 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrh74" podUID="14bb3377-8d7b-4231-a2c1-cf5a7e7abbea" May 25 14:12:39.361539 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:39.361498 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p6784" May 25 14:12:39.361979 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:39.361655 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p6784" podUID="7b48e369-ae21-483b-897e-fb9b4ecd1818" May 25 14:12:40.361110 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:40.361075 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrh74" May 25 14:12:40.361311 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:40.361209 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrh74" podUID="14bb3377-8d7b-4231-a2c1-cf5a7e7abbea" May 25 14:12:41.361443 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:41.361406 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p6784" May 25 14:12:41.361942 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:41.361559 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p6784" podUID="7b48e369-ae21-483b-897e-fb9b4ecd1818" May 25 14:12:42.361758 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:42.361710 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrh74" May 25 14:12:42.362232 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:42.361857 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrh74" podUID="14bb3377-8d7b-4231-a2c1-cf5a7e7abbea" May 25 14:12:43.361472 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:43.361435 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p6784" May 25 14:12:43.361652 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:43.361574 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p6784" podUID="7b48e369-ae21-483b-897e-fb9b4ecd1818" May 25 14:12:44.069258 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:44.069215 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-frx7c\" (UniqueName: \"kubernetes.io/projected/14bb3377-8d7b-4231-a2c1-cf5a7e7abbea-kube-api-access-frx7c\") pod \"network-check-target-wrh74\" (UID: \"14bb3377-8d7b-4231-a2c1-cf5a7e7abbea\") " pod="openshift-network-diagnostics/network-check-target-wrh74" May 25 14:12:44.069680 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:44.069285 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b48e369-ae21-483b-897e-fb9b4ecd1818-metrics-certs\") pod \"network-metrics-daemon-p6784\" (UID: \"7b48e369-ae21-483b-897e-fb9b4ecd1818\") " pod="openshift-multus/network-metrics-daemon-p6784" May 25 14:12:44.069680 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:44.069405 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 14:12:44.069680 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:44.069424 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 14:12:44.069680 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:44.069434 2562 projected.go:194] Error preparing data for projected volume kube-api-access-frx7c for pod openshift-network-diagnostics/network-check-target-wrh74: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 14:12:44.069680 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:44.069480 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14bb3377-8d7b-4231-a2c1-cf5a7e7abbea-kube-api-access-frx7c podName:14bb3377-8d7b-4231-a2c1-cf5a7e7abbea nodeName:}" failed. No retries permitted until 2026-05-25 14:13:00.069463198 +0000 UTC m=+34.276710359 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-frx7c" (UniqueName: "kubernetes.io/projected/14bb3377-8d7b-4231-a2c1-cf5a7e7abbea-kube-api-access-frx7c") pod "network-check-target-wrh74" (UID: "14bb3377-8d7b-4231-a2c1-cf5a7e7abbea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 14:12:44.069680 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:44.069403 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 14:12:44.069680 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:44.069521 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b48e369-ae21-483b-897e-fb9b4ecd1818-metrics-certs podName:7b48e369-ae21-483b-897e-fb9b4ecd1818 nodeName:}" failed. No retries permitted until 2026-05-25 14:13:00.069509455 +0000 UTC m=+34.276756616 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b48e369-ae21-483b-897e-fb9b4ecd1818-metrics-certs") pod "network-metrics-daemon-p6784" (UID: "7b48e369-ae21-483b-897e-fb9b4ecd1818") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 14:12:44.361629 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:44.361539 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrh74" May 25 14:12:44.361787 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:44.361703 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrh74" podUID="14bb3377-8d7b-4231-a2c1-cf5a7e7abbea" May 25 14:12:45.361671 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:45.361624 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p6784" May 25 14:12:45.362055 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:45.361755 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p6784" podUID="7b48e369-ae21-483b-897e-fb9b4ecd1818" May 25 14:12:46.362163 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:46.362131 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrh74" May 25 14:12:46.362521 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:46.362247 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrh74" podUID="14bb3377-8d7b-4231-a2c1-cf5a7e7abbea" May 25 14:12:47.360851 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:47.360603 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p6784" May 25 14:12:47.360999 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:47.360974 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p6784" podUID="7b48e369-ae21-483b-897e-fb9b4ecd1818" May 25 14:12:47.521243 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:47.521079 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b2gmj_b5ab1333-fc5e-46eb-a0ee-bd4d08c45527/ovn-acl-logging/0.log" May 25 14:12:47.521918 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:47.521514 2562 generic.go:358] "Generic (PLEG): container finished" podID="b5ab1333-fc5e-46eb-a0ee-bd4d08c45527" containerID="b64d16ceb7830b0b5789552c1449cf1e7d7892a970ff49ae2883e95cab5f497f" exitCode=1 May 25 14:12:47.521918 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:47.521579 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" event={"ID":"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527","Type":"ContainerStarted","Data":"b7af17cea7e28f9f6c9f2deaecf049daabc1907e31001f4bad1a5b94975641a9"} May 25 14:12:47.521918 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:47.521607 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" event={"ID":"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527","Type":"ContainerStarted","Data":"9d390cb21e978030265d07037a592d460c6a463bb7564e63072927ee7bf440e6"} May 25 14:12:47.521918 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:47.521617 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" event={"ID":"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527","Type":"ContainerDied","Data":"b64d16ceb7830b0b5789552c1449cf1e7d7892a970ff49ae2883e95cab5f497f"} May 25 14:12:47.521918 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:47.521632 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" event={"ID":"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527","Type":"ContainerStarted","Data":"cf577b6eb4feeeb1bea76ddef2b2b70cff55a14d4c18e5f4ab507c6f218014c9"} May 25 14:12:47.522819 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:47.522794 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5bb7j" event={"ID":"95eb3cbd-2c41-4d96-af85-a21ad8aaf82b","Type":"ContainerStarted","Data":"752de4da0a58ce00871e89429786a41a381161f1486a4f860527e6da86c164e7"} May 25 14:12:47.523952 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:47.523922 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zrq2g" event={"ID":"949098c1-c4c0-401c-8faf-db03fa09d898","Type":"ContainerStarted","Data":"4f0a019b0ba9d7828d148e51d10584c18c1dc3eb97645a098078cc1976572fca"} May 25 14:12:47.525409 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:47.525391 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-td67w" event={"ID":"251e865d-d65c-4abf-b045-ac55fee054da","Type":"ContainerStarted","Data":"5eeecf3ea6c5b667c476813424c0c91f45535671685ffe8dacc7c6de0432a185"} May 25 14:12:47.526823 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:47.526805 2562 generic.go:358] "Generic (PLEG): container finished" podID="823e5406-c4ba-45f5-bd46-f82b17b0495c" containerID="9d0842a9ed58887cf4eefca084fc92f4f388df409a140d72bcac99511bdb67ba" exitCode=0 May 25 14:12:47.526909 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:47.526865 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qdkw4" event={"ID":"823e5406-c4ba-45f5-bd46-f82b17b0495c","Type":"ContainerDied","Data":"9d0842a9ed58887cf4eefca084fc92f4f388df409a140d72bcac99511bdb67ba"} May 25 14:12:47.528406 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:47.528321 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njldq" event={"ID":"56be8261-ba14-4828-bbf9-5c1e581a4e8b","Type":"ContainerStarted","Data":"68e3faa0cb4a335dbe596af39f17706af22a8535140dbcfffc104fdebf07a1f7"} May 25 14:12:47.529764 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:47.529742 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wmrkq" event={"ID":"5da677c4-73fb-4b42-be1a-c7fb68aa56d0","Type":"ContainerStarted","Data":"c9a885f8b04007f020d79ec338ad43baa946222efe500cc15dc3661e65f402a5"} May 25 14:12:47.530928 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:47.530906 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-l5kmt" event={"ID":"e081d292-f999-4a5d-8e11-7d2ccac47593","Type":"ContainerStarted","Data":"39fb26135ddd86dc2784654fc69431e5c8099b9e664d3aacb9c40d97ae3f6b8a"} May 25 14:12:47.539083 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:47.539047 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5bb7j" podStartSLOduration=3.835028349 podStartE2EDuration="21.539034482s" podCreationTimestamp="2026-05-25 14:12:26 +0000 UTC" firstStartedPulling="2026-05-25 14:12:28.907401361 +0000 UTC m=+3.114648536" lastFinishedPulling="2026-05-25 14:12:46.611407508 +0000 UTC m=+20.818654669" observedRunningTime="2026-05-25 14:12:47.538476683 +0000 UTC m=+21.745723877" watchObservedRunningTime="2026-05-25 14:12:47.539034482 +0000 UTC m=+21.746281668" May 25 14:12:47.539197 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:47.539176 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-29.ec2.internal" podStartSLOduration=20.539172303 podStartE2EDuration="20.539172303s" podCreationTimestamp="2026-05-25 14:12:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 14:12:30.503150091 +0000 UTC m=+4.710397274" watchObservedRunningTime="2026-05-25 14:12:47.539172303 +0000 UTC m=+21.746419485" May 25 14:12:47.576706 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:47.576639 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-l5kmt" podStartSLOduration=3.838994382 podStartE2EDuration="21.576620193s" podCreationTimestamp="2026-05-25 14:12:26 +0000 UTC" firstStartedPulling="2026-05-25 14:12:28.910659647 +0000 UTC m=+3.117906822" lastFinishedPulling="2026-05-25 14:12:46.648285461 +0000 UTC m=+20.855532633" observedRunningTime="2026-05-25 14:12:47.576549516 +0000 UTC m=+21.783796698" watchObservedRunningTime="2026-05-25 14:12:47.576620193 +0000 UTC m=+21.783867378" May 25 14:12:47.590736 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:47.590682 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-td67w" podStartSLOduration=3.89842388 podStartE2EDuration="21.59066917s" podCreationTimestamp="2026-05-25 14:12:26 +0000 UTC" firstStartedPulling="2026-05-25 14:12:28.917465071 +0000 UTC m=+3.124712237" lastFinishedPulling="2026-05-25 14:12:46.60971035 +0000 UTC m=+20.816957527" observedRunningTime="2026-05-25 14:12:47.590349972 +0000 UTC m=+21.797597156" watchObservedRunningTime="2026-05-25 14:12:47.59066917 +0000 UTC m=+21.797916352" May 25 14:12:47.605167 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:47.605117 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zrq2g" podStartSLOduration=3.899884729 podStartE2EDuration="21.605103967s" podCreationTimestamp="2026-05-25 14:12:26 +0000 UTC" firstStartedPulling="2026-05-25 14:12:28.904484729 +0000 UTC m=+3.111731895" lastFinishedPulling="2026-05-25 14:12:46.609703957 +0000 UTC m=+20.816951133" observedRunningTime="2026-05-25 14:12:47.604942149 +0000 UTC m=+21.812189334" watchObservedRunningTime="2026-05-25 14:12:47.605103967 +0000 UTC m=+21.812351150" May 25 14:12:47.618452 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:47.618394 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wmrkq" podStartSLOduration=8.398125069 podStartE2EDuration="21.618361196s" podCreationTimestamp="2026-05-25 14:12:26 +0000 UTC" firstStartedPulling="2026-05-25 14:12:28.910784113 +0000 UTC m=+3.118031274" lastFinishedPulling="2026-05-25 14:12:42.131020229 +0000 UTC m=+16.338267401" observedRunningTime="2026-05-25 14:12:47.617942345 +0000 UTC m=+21.825189528" watchObservedRunningTime="2026-05-25 14:12:47.618361196 +0000 UTC m=+21.825608378" May 25 14:12:48.081142 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:48.081111 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 25 14:12:48.301559 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:48.301421 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-25T14:12:48.081135821Z","UUID":"55e469c0-6dbe-45a1-a58e-8b35e7655e43","Handler":null,"Name":"","Endpoint":""} May 25 14:12:48.305063 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:48.305042 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 25 14:12:48.305063 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:48.305066 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 25 14:12:48.361243 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:48.361208 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrh74" May 25 14:12:48.361438 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:48.361318 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrh74" podUID="14bb3377-8d7b-4231-a2c1-cf5a7e7abbea" May 25 14:12:48.538059 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:48.538008 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njldq" event={"ID":"56be8261-ba14-4828-bbf9-5c1e581a4e8b","Type":"ContainerStarted","Data":"b9c4d90d054174f7a1b6409d6faeba53207e31509d272712dcdf16f38cd32478"} May 25 14:12:48.539837 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:48.539463 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bwn7t" event={"ID":"9ea1fab0-ccd9-4900-939f-9e7aa433972f","Type":"ContainerStarted","Data":"3af1bcbbe7a2a07838cef2ad6b4ed43c91458cf718176e612e2539790f088dfa"} May 25 14:12:48.543711 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:48.543685 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b2gmj_b5ab1333-fc5e-46eb-a0ee-bd4d08c45527/ovn-acl-logging/0.log" May 25 14:12:48.544175 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:48.544148 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" event={"ID":"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527","Type":"ContainerStarted","Data":"79ccc86a12c78da900e33499ec887c94f65c37677b9797459ee9a4307c14ab13"} May 25 14:12:48.544262 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:48.544188 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" event={"ID":"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527","Type":"ContainerStarted","Data":"afee15bd9740a9d0041b0598782ba61d41ab16fd86aaed26532ea4816c2e3c99"} May 25 14:12:49.360930 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:49.360891 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p6784" May 25 14:12:49.361095 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:49.361035 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p6784" podUID="7b48e369-ae21-483b-897e-fb9b4ecd1818" May 25 14:12:49.547621 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:49.547529 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njldq" event={"ID":"56be8261-ba14-4828-bbf9-5c1e581a4e8b","Type":"ContainerStarted","Data":"cb98e69cdb8bbce092829b881d7b2a436996dfa68b91611c490e0db6f4b7ce8d"} May 25 14:12:49.565959 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:49.565880 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bwn7t" podStartSLOduration=5.869112827 podStartE2EDuration="23.565864602s" podCreationTimestamp="2026-05-25 14:12:26 +0000 UTC" firstStartedPulling="2026-05-25 14:12:28.913350153 +0000 UTC m=+3.120597329" lastFinishedPulling="2026-05-25 14:12:46.610101943 +0000 UTC m=+20.817349104" observedRunningTime="2026-05-25 14:12:48.579255085 +0000 UTC m=+22.786502269" watchObservedRunningTime="2026-05-25 14:12:49.565864602 +0000 UTC m=+23.773111791" May 25 14:12:49.566225 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:49.566198 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njldq" podStartSLOduration=3.339428709 podStartE2EDuration="23.566189665s" podCreationTimestamp="2026-05-25 14:12:26 +0000 UTC" firstStartedPulling="2026-05-25 14:12:28.914966886 +0000 UTC m=+3.122214049" lastFinishedPulling="2026-05-25 14:12:49.141727826 +0000 UTC m=+23.348975005" observedRunningTime="2026-05-25 14:12:49.56540218 +0000 UTC m=+23.772649365" watchObservedRunningTime="2026-05-25 14:12:49.566189665 +0000 UTC m=+23.773436848" May 25 14:12:50.361707 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:50.361461 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrh74" May 25 14:12:50.361901 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:50.361811 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrh74" podUID="14bb3377-8d7b-4231-a2c1-cf5a7e7abbea" May 25 14:12:50.553093 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:50.553067 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b2gmj_b5ab1333-fc5e-46eb-a0ee-bd4d08c45527/ovn-acl-logging/0.log" May 25 14:12:50.553541 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:50.553473 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" event={"ID":"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527","Type":"ContainerStarted","Data":"8eaefa38864488249c487215d20a24a054fe986f3b1e4e02965160dd22951844"} May 25 14:12:51.360709 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:51.360673 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p6784" May 25 14:12:51.360913 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:51.360837 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p6784" podUID="7b48e369-ae21-483b-897e-fb9b4ecd1818" May 25 14:12:52.361195 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:52.361018 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrh74" May 25 14:12:52.361876 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:52.361279 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrh74" podUID="14bb3377-8d7b-4231-a2c1-cf5a7e7abbea" May 25 14:12:52.442718 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:52.442680 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zrq2g" May 25 14:12:52.443405 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:52.443362 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zrq2g" May 25 14:12:52.560440 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:52.560408 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b2gmj_b5ab1333-fc5e-46eb-a0ee-bd4d08c45527/ovn-acl-logging/0.log" May 25 14:12:52.560788 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:52.560735 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" event={"ID":"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527","Type":"ContainerStarted","Data":"a82a2f9e164e97cce9c47f36c6bde5bb31379511b48cb5f8fef72c77676c8c7f"} May 25 14:12:52.561055 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:52.561030 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:52.561255 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:52.561232 2562 scope.go:117] "RemoveContainer" containerID="b64d16ceb7830b0b5789552c1449cf1e7d7892a970ff49ae2883e95cab5f497f" May 25 14:12:52.562434 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:52.562414 2562 generic.go:358] "Generic (PLEG): container finished" podID="823e5406-c4ba-45f5-bd46-f82b17b0495c" containerID="9d0c8a4918ba6b238f78506da2218ac3b057a1543d3663d2b6ba20fc782f015d" exitCode=0 May 25 14:12:52.562521 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:52.562486 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qdkw4" event={"ID":"823e5406-c4ba-45f5-bd46-f82b17b0495c","Type":"ContainerDied","Data":"9d0c8a4918ba6b238f78506da2218ac3b057a1543d3663d2b6ba20fc782f015d"} May 25 14:12:52.578267 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:52.578249 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:53.360913 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:53.360870 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p6784" May 25 14:12:53.361167 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:53.361034 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p6784" podUID="7b48e369-ae21-483b-897e-fb9b4ecd1818" May 25 14:12:53.568453 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:53.568430 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b2gmj_b5ab1333-fc5e-46eb-a0ee-bd4d08c45527/ovn-acl-logging/0.log" May 25 14:12:53.568954 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:53.568769 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" event={"ID":"b5ab1333-fc5e-46eb-a0ee-bd4d08c45527","Type":"ContainerStarted","Data":"de0de7289a710691668624d5c294ab8c0a74123c4b6a5f5f8dc1070d90a5d2d9"} May 25 14:12:53.569022 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:53.569006 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:53.569171 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:53.569146 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:53.571181 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:53.571154 2562 generic.go:358] "Generic (PLEG): container finished" podID="823e5406-c4ba-45f5-bd46-f82b17b0495c" containerID="7c91e198d6402a84e5d6bcc45c1a3f2c8de7e2df7edf77e4c08c0dbb517b08c7" exitCode=0 May 25 14:12:53.571322 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:53.571198 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qdkw4" event={"ID":"823e5406-c4ba-45f5-bd46-f82b17b0495c","Type":"ContainerDied","Data":"7c91e198d6402a84e5d6bcc45c1a3f2c8de7e2df7edf77e4c08c0dbb517b08c7"} May 25 14:12:53.585842 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:53.585810 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:12:53.597468 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:53.597411 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" podStartSLOduration=9.527909466 podStartE2EDuration="27.597391122s" podCreationTimestamp="2026-05-25 14:12:26 +0000 UTC" firstStartedPulling="2026-05-25 14:12:28.911735815 +0000 UTC m=+3.118982989" lastFinishedPulling="2026-05-25 14:12:46.981217468 +0000 UTC m=+21.188464645" observedRunningTime="2026-05-25 14:12:53.596975489 +0000 UTC m=+27.804222673" watchObservedRunningTime="2026-05-25 14:12:53.597391122 +0000 UTC m=+27.804638300" May 25 14:12:54.048472 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:54.048433 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wrh74"] May 25 14:12:54.048650 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:54.048590 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrh74" May 25 14:12:54.048718 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:54.048696 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrh74" podUID="14bb3377-8d7b-4231-a2c1-cf5a7e7abbea" May 25 14:12:54.050780 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:54.050752 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-p6784"] May 25 14:12:54.050905 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:54.050887 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p6784" May 25 14:12:54.051172 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:54.051000 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p6784" podUID="7b48e369-ae21-483b-897e-fb9b4ecd1818" May 25 14:12:54.575659 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:54.575402 2562 generic.go:358] "Generic (PLEG): container finished" podID="823e5406-c4ba-45f5-bd46-f82b17b0495c" containerID="bd24e4b257179565645ffff578ee42d5346dae70175b959f5e736677d17db33e" exitCode=0 May 25 14:12:54.576064 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:54.575475 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qdkw4" event={"ID":"823e5406-c4ba-45f5-bd46-f82b17b0495c","Type":"ContainerDied","Data":"bd24e4b257179565645ffff578ee42d5346dae70175b959f5e736677d17db33e"} May 25 14:12:55.361235 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:55.361205 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrh74" May 25 14:12:55.361415 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:55.361366 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrh74" podUID="14bb3377-8d7b-4231-a2c1-cf5a7e7abbea" May 25 14:12:56.368871 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:56.368841 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p6784" May 25 14:12:56.369279 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:56.368981 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p6784" podUID="7b48e369-ae21-483b-897e-fb9b4ecd1818" May 25 14:12:57.360780 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:57.360743 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrh74" May 25 14:12:57.360966 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:57.360869 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrh74" podUID="14bb3377-8d7b-4231-a2c1-cf5a7e7abbea" May 25 14:12:58.298900 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:58.298858 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zrq2g" May 25 14:12:58.299564 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:58.299037 2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 25 14:12:58.299783 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:58.299763 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zrq2g" May 25 14:12:58.365182 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:58.365097 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p6784" May 25 14:12:58.365332 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:58.365216 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p6784" podUID="7b48e369-ae21-483b-897e-fb9b4ecd1818" May 25 14:12:59.360815 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:59.360782 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrh74" May 25 14:12:59.361231 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:59.360903 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrh74" podUID="14bb3377-8d7b-4231-a2c1-cf5a7e7abbea" May 25 14:12:59.601615 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:59.601572 2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-29.ec2.internal" event="NodeReady" May 25 14:12:59.601806 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:59.601711 2562 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 25 14:12:59.650181 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:59.650093 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-k4lxb"] May 25 14:12:59.690293 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:59.690253 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2pcq6"] May 25 14:12:59.690490 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:59.690409 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k4lxb" May 25 14:12:59.693479 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:59.693305 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 25 14:12:59.693479 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:59.693337 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 25 14:12:59.693479 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:59.693413 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bh6nj\"" May 25 14:12:59.708390 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:59.708354 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-k4lxb"] May 25 14:12:59.708526 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:59.708401 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2pcq6"] May 25 14:12:59.708526 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:59.708499 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2pcq6" May 25 14:12:59.711100 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:59.711076 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 25 14:12:59.711300 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:59.711280 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 25 14:12:59.711405 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:59.711323 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 25 14:12:59.711405 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:59.711352 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hfq77\"" May 25 14:12:59.785070 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:59.785034 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldbdx\" (UniqueName: \"kubernetes.io/projected/009111ca-e828-4238-accf-5381fbdf7799-kube-api-access-ldbdx\") pod \"ingress-canary-2pcq6\" (UID: \"009111ca-e828-4238-accf-5381fbdf7799\") " pod="openshift-ingress-canary/ingress-canary-2pcq6" May 25 14:12:59.785070 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:59.785080 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/261f5fa7-41fd-46aa-a56b-7042da67b7bc-metrics-tls\") pod \"dns-default-k4lxb\" (UID: \"261f5fa7-41fd-46aa-a56b-7042da67b7bc\") " pod="openshift-dns/dns-default-k4lxb" May 25 14:12:59.785332 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:59.785104 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzqpq\" (UniqueName: \"kubernetes.io/projected/261f5fa7-41fd-46aa-a56b-7042da67b7bc-kube-api-access-zzqpq\") pod \"dns-default-k4lxb\" (UID: \"261f5fa7-41fd-46aa-a56b-7042da67b7bc\") " pod="openshift-dns/dns-default-k4lxb" May 25 14:12:59.785332 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:59.785124 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/009111ca-e828-4238-accf-5381fbdf7799-cert\") pod \"ingress-canary-2pcq6\" (UID: \"009111ca-e828-4238-accf-5381fbdf7799\") " pod="openshift-ingress-canary/ingress-canary-2pcq6" May 25 14:12:59.785332 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:59.785161 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/261f5fa7-41fd-46aa-a56b-7042da67b7bc-tmp-dir\") pod \"dns-default-k4lxb\" (UID: \"261f5fa7-41fd-46aa-a56b-7042da67b7bc\") " pod="openshift-dns/dns-default-k4lxb" May 25 14:12:59.785332 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:59.785285 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/261f5fa7-41fd-46aa-a56b-7042da67b7bc-config-volume\") pod \"dns-default-k4lxb\" (UID: \"261f5fa7-41fd-46aa-a56b-7042da67b7bc\") " pod="openshift-dns/dns-default-k4lxb" May 25 14:12:59.886542 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:59.886508 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ldbdx\" (UniqueName: \"kubernetes.io/projected/009111ca-e828-4238-accf-5381fbdf7799-kube-api-access-ldbdx\") pod \"ingress-canary-2pcq6\" (UID: \"009111ca-e828-4238-accf-5381fbdf7799\") " pod="openshift-ingress-canary/ingress-canary-2pcq6" May 25 14:12:59.886542 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:59.886547 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/261f5fa7-41fd-46aa-a56b-7042da67b7bc-metrics-tls\") pod \"dns-default-k4lxb\" (UID: \"261f5fa7-41fd-46aa-a56b-7042da67b7bc\") " pod="openshift-dns/dns-default-k4lxb" May 25 14:12:59.886793 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:59.886574 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zzqpq\" (UniqueName: \"kubernetes.io/projected/261f5fa7-41fd-46aa-a56b-7042da67b7bc-kube-api-access-zzqpq\") pod \"dns-default-k4lxb\" (UID: \"261f5fa7-41fd-46aa-a56b-7042da67b7bc\") " pod="openshift-dns/dns-default-k4lxb" May 25 14:12:59.886793 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:59.886633 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/009111ca-e828-4238-accf-5381fbdf7799-cert\") pod \"ingress-canary-2pcq6\" (UID: \"009111ca-e828-4238-accf-5381fbdf7799\") " pod="openshift-ingress-canary/ingress-canary-2pcq6" May 25 14:12:59.886793 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:59.886717 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 14:12:59.886793 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:59.886724 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/261f5fa7-41fd-46aa-a56b-7042da67b7bc-tmp-dir\") pod \"dns-default-k4lxb\" (UID: \"261f5fa7-41fd-46aa-a56b-7042da67b7bc\") " pod="openshift-dns/dns-default-k4lxb" May 25 14:12:59.886984 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:59.886797 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/261f5fa7-41fd-46aa-a56b-7042da67b7bc-metrics-tls podName:261f5fa7-41fd-46aa-a56b-7042da67b7bc nodeName:}" failed. No retries permitted until 2026-05-25 14:13:00.386773265 +0000 UTC m=+34.594020451 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/261f5fa7-41fd-46aa-a56b-7042da67b7bc-metrics-tls") pod "dns-default-k4lxb" (UID: "261f5fa7-41fd-46aa-a56b-7042da67b7bc") : secret "dns-default-metrics-tls" not found May 25 14:12:59.886984 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:59.886833 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/261f5fa7-41fd-46aa-a56b-7042da67b7bc-config-volume\") pod \"dns-default-k4lxb\" (UID: \"261f5fa7-41fd-46aa-a56b-7042da67b7bc\") " pod="openshift-dns/dns-default-k4lxb" May 25 14:12:59.886984 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:59.886950 2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 14:12:59.887123 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:12:59.887017 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/009111ca-e828-4238-accf-5381fbdf7799-cert podName:009111ca-e828-4238-accf-5381fbdf7799 nodeName:}" failed. No retries permitted until 2026-05-25 14:13:00.386998899 +0000 UTC m=+34.594246073 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/009111ca-e828-4238-accf-5381fbdf7799-cert") pod "ingress-canary-2pcq6" (UID: "009111ca-e828-4238-accf-5381fbdf7799") : secret "canary-serving-cert" not found May 25 14:12:59.887189 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:59.887119 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/261f5fa7-41fd-46aa-a56b-7042da67b7bc-tmp-dir\") pod \"dns-default-k4lxb\" (UID: \"261f5fa7-41fd-46aa-a56b-7042da67b7bc\") " pod="openshift-dns/dns-default-k4lxb" May 25 14:12:59.887426 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:59.887409 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/261f5fa7-41fd-46aa-a56b-7042da67b7bc-config-volume\") pod \"dns-default-k4lxb\" (UID: \"261f5fa7-41fd-46aa-a56b-7042da67b7bc\") " pod="openshift-dns/dns-default-k4lxb" May 25 14:12:59.900567 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:59.900498 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzqpq\" (UniqueName: \"kubernetes.io/projected/261f5fa7-41fd-46aa-a56b-7042da67b7bc-kube-api-access-zzqpq\") pod \"dns-default-k4lxb\" (UID: \"261f5fa7-41fd-46aa-a56b-7042da67b7bc\") " pod="openshift-dns/dns-default-k4lxb" May 25 14:12:59.900711 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:12:59.900683 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldbdx\" (UniqueName: \"kubernetes.io/projected/009111ca-e828-4238-accf-5381fbdf7799-kube-api-access-ldbdx\") pod \"ingress-canary-2pcq6\" (UID: \"009111ca-e828-4238-accf-5381fbdf7799\") " pod="openshift-ingress-canary/ingress-canary-2pcq6" May 25 14:13:00.088215 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:13:00.088177 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b48e369-ae21-483b-897e-fb9b4ecd1818-metrics-certs\") pod \"network-metrics-daemon-p6784\" (UID: \"7b48e369-ae21-483b-897e-fb9b4ecd1818\") " pod="openshift-multus/network-metrics-daemon-p6784" May 25 14:13:00.088428 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:13:00.088253 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-frx7c\" (UniqueName: \"kubernetes.io/projected/14bb3377-8d7b-4231-a2c1-cf5a7e7abbea-kube-api-access-frx7c\") pod \"network-check-target-wrh74\" (UID: \"14bb3377-8d7b-4231-a2c1-cf5a7e7abbea\") " pod="openshift-network-diagnostics/network-check-target-wrh74" May 25 14:13:00.088428 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:13:00.088334 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 14:13:00.088428 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:13:00.088426 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b48e369-ae21-483b-897e-fb9b4ecd1818-metrics-certs podName:7b48e369-ae21-483b-897e-fb9b4ecd1818 nodeName:}" failed. No retries permitted until 2026-05-25 14:13:32.088409104 +0000 UTC m=+66.295656285 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b48e369-ae21-483b-897e-fb9b4ecd1818-metrics-certs") pod "network-metrics-daemon-p6784" (UID: "7b48e369-ae21-483b-897e-fb9b4ecd1818") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 14:13:00.088599 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:13:00.088455 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 14:13:00.088599 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:13:00.088482 2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 14:13:00.088599 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:13:00.088496 2562 projected.go:194] Error preparing data for projected volume kube-api-access-frx7c for pod openshift-network-diagnostics/network-check-target-wrh74: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 14:13:00.088599 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:13:00.088555 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14bb3377-8d7b-4231-a2c1-cf5a7e7abbea-kube-api-access-frx7c podName:14bb3377-8d7b-4231-a2c1-cf5a7e7abbea nodeName:}" failed. No retries permitted until 2026-05-25 14:13:32.088538078 +0000 UTC m=+66.295785260 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-frx7c" (UniqueName: "kubernetes.io/projected/14bb3377-8d7b-4231-a2c1-cf5a7e7abbea-kube-api-access-frx7c") pod "network-check-target-wrh74" (UID: "14bb3377-8d7b-4231-a2c1-cf5a7e7abbea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 14:13:00.363973 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:13:00.363948 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p6784" May 25 14:13:00.367004 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:13:00.366980 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 25 14:13:00.367128 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:13:00.367045 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5vlbv\"" May 25 14:13:00.390657 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:13:00.390620 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/261f5fa7-41fd-46aa-a56b-7042da67b7bc-metrics-tls\") pod \"dns-default-k4lxb\" (UID: \"261f5fa7-41fd-46aa-a56b-7042da67b7bc\") " pod="openshift-dns/dns-default-k4lxb" May 25 14:13:00.390657 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:13:00.390657 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/009111ca-e828-4238-accf-5381fbdf7799-cert\") pod \"ingress-canary-2pcq6\" (UID: \"009111ca-e828-4238-accf-5381fbdf7799\") " pod="openshift-ingress-canary/ingress-canary-2pcq6" May 25 14:13:00.390901 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:13:00.390756 2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 14:13:00.390901 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:13:00.390773 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 14:13:00.390901 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:13:00.390807 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/009111ca-e828-4238-accf-5381fbdf7799-cert podName:009111ca-e828-4238-accf-5381fbdf7799 nodeName:}" failed. No retries permitted until 2026-05-25 14:13:01.390793235 +0000 UTC m=+35.598040398 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/009111ca-e828-4238-accf-5381fbdf7799-cert") pod "ingress-canary-2pcq6" (UID: "009111ca-e828-4238-accf-5381fbdf7799") : secret "canary-serving-cert" not found May 25 14:13:00.390901 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:13:00.390829 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/261f5fa7-41fd-46aa-a56b-7042da67b7bc-metrics-tls podName:261f5fa7-41fd-46aa-a56b-7042da67b7bc nodeName:}" failed. No retries permitted until 2026-05-25 14:13:01.390813894 +0000 UTC m=+35.598061077 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/261f5fa7-41fd-46aa-a56b-7042da67b7bc-metrics-tls") pod "dns-default-k4lxb" (UID: "261f5fa7-41fd-46aa-a56b-7042da67b7bc") : secret "dns-default-metrics-tls" not found May 25 14:13:01.361234 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:13:01.361199 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrh74" May 25 14:13:01.365006 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:13:01.364982 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 25 14:13:01.367061 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:13:01.366896 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vlvbn\"" May 25 14:13:01.367061 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:13:01.366915 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 25 14:13:01.397732 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:13:01.397695 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/261f5fa7-41fd-46aa-a56b-7042da67b7bc-metrics-tls\") pod \"dns-default-k4lxb\" (UID: \"261f5fa7-41fd-46aa-a56b-7042da67b7bc\") " pod="openshift-dns/dns-default-k4lxb" May 25 14:13:01.397732 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:13:01.397733 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/009111ca-e828-4238-accf-5381fbdf7799-cert\") pod \"ingress-canary-2pcq6\" (UID: \"009111ca-e828-4238-accf-5381fbdf7799\") " pod="openshift-ingress-canary/ingress-canary-2pcq6" May 25 14:13:01.397962 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:13:01.397840 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 14:13:01.397962 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:13:01.397845 2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 14:13:01.397962 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:13:01.397897 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/261f5fa7-41fd-46aa-a56b-7042da67b7bc-metrics-tls podName:261f5fa7-41fd-46aa-a56b-7042da67b7bc nodeName:}" failed. No retries permitted until 2026-05-25 14:13:03.397883125 +0000 UTC m=+37.605130293 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/261f5fa7-41fd-46aa-a56b-7042da67b7bc-metrics-tls") pod "dns-default-k4lxb" (UID: "261f5fa7-41fd-46aa-a56b-7042da67b7bc") : secret "dns-default-metrics-tls" not found May 25 14:13:01.397962 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:13:01.397911 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/009111ca-e828-4238-accf-5381fbdf7799-cert podName:009111ca-e828-4238-accf-5381fbdf7799 nodeName:}" failed. No retries permitted until 2026-05-25 14:13:03.397904839 +0000 UTC m=+37.605152001 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/009111ca-e828-4238-accf-5381fbdf7799-cert") pod "ingress-canary-2pcq6" (UID: "009111ca-e828-4238-accf-5381fbdf7799") : secret "canary-serving-cert" not found May 25 14:13:01.593225 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:13:01.593195 2562 generic.go:358] "Generic (PLEG): container finished" podID="823e5406-c4ba-45f5-bd46-f82b17b0495c" containerID="f0100f8ce3c45b0729788fdb0973ac0aa399b4a5d8e95236d1b5a1dd1d7ebeb8" exitCode=0 May 25 14:13:01.593395 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:13:01.593251 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qdkw4" event={"ID":"823e5406-c4ba-45f5-bd46-f82b17b0495c","Type":"ContainerDied","Data":"f0100f8ce3c45b0729788fdb0973ac0aa399b4a5d8e95236d1b5a1dd1d7ebeb8"} May 25 14:13:02.600937 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:13:02.600905 2562 generic.go:358] "Generic (PLEG): container finished" podID="823e5406-c4ba-45f5-bd46-f82b17b0495c" containerID="aa7efeefc38d1dbdad76ba2ae34fe2a5ea8eae956a4f4b56fce7dadbe1e09df3" exitCode=0 May 25 14:13:02.601339 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:13:02.600948 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qdkw4" event={"ID":"823e5406-c4ba-45f5-bd46-f82b17b0495c","Type":"ContainerDied","Data":"aa7efeefc38d1dbdad76ba2ae34fe2a5ea8eae956a4f4b56fce7dadbe1e09df3"} May 25 14:13:03.410622 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:13:03.410583 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/261f5fa7-41fd-46aa-a56b-7042da67b7bc-metrics-tls\") pod \"dns-default-k4lxb\" (UID: \"261f5fa7-41fd-46aa-a56b-7042da67b7bc\") " pod="openshift-dns/dns-default-k4lxb" May 25 14:13:03.410622 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:13:03.410621 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/009111ca-e828-4238-accf-5381fbdf7799-cert\") pod \"ingress-canary-2pcq6\" (UID: \"009111ca-e828-4238-accf-5381fbdf7799\") " pod="openshift-ingress-canary/ingress-canary-2pcq6" May 25 14:13:03.410829 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:13:03.410734 2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 14:13:03.410829 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:13:03.410734 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 14:13:03.410829 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:13:03.410801 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/009111ca-e828-4238-accf-5381fbdf7799-cert podName:009111ca-e828-4238-accf-5381fbdf7799 nodeName:}" failed. No retries permitted until 2026-05-25 14:13:07.410781613 +0000 UTC m=+41.618028794 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/009111ca-e828-4238-accf-5381fbdf7799-cert") pod "ingress-canary-2pcq6" (UID: "009111ca-e828-4238-accf-5381fbdf7799") : secret "canary-serving-cert" not found May 25 14:13:03.410829 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:13:03.410818 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/261f5fa7-41fd-46aa-a56b-7042da67b7bc-metrics-tls podName:261f5fa7-41fd-46aa-a56b-7042da67b7bc nodeName:}" failed. No retries permitted until 2026-05-25 14:13:07.410809896 +0000 UTC m=+41.618057060 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/261f5fa7-41fd-46aa-a56b-7042da67b7bc-metrics-tls") pod "dns-default-k4lxb" (UID: "261f5fa7-41fd-46aa-a56b-7042da67b7bc") : secret "dns-default-metrics-tls" not found May 25 14:13:03.606078 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:13:03.606043 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qdkw4" event={"ID":"823e5406-c4ba-45f5-bd46-f82b17b0495c","Type":"ContainerStarted","Data":"559b39b99b46ab75d1a0e9ac90085769cdf50327a7e09beb1377036c76b426c0"} May 25 14:13:03.631497 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:13:03.631329 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qdkw4" podStartSLOduration=6.068690376 podStartE2EDuration="37.631309831s" podCreationTimestamp="2026-05-25 14:12:26 +0000 UTC" firstStartedPulling="2026-05-25 14:12:28.916101501 +0000 UTC m=+3.123348666" lastFinishedPulling="2026-05-25 14:13:00.478720946 +0000 UTC m=+34.685968121" observedRunningTime="2026-05-25 14:13:03.630010602 +0000 UTC m=+37.837257786" watchObservedRunningTime="2026-05-25 14:13:03.631309831 +0000 UTC m=+37.838557014" May 25 14:13:07.444171 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:13:07.444118 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/261f5fa7-41fd-46aa-a56b-7042da67b7bc-metrics-tls\") pod \"dns-default-k4lxb\" (UID: \"261f5fa7-41fd-46aa-a56b-7042da67b7bc\") " pod="openshift-dns/dns-default-k4lxb" May 25 14:13:07.444171 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:13:07.444171 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/009111ca-e828-4238-accf-5381fbdf7799-cert\") pod \"ingress-canary-2pcq6\" (UID: \"009111ca-e828-4238-accf-5381fbdf7799\") " pod="openshift-ingress-canary/ingress-canary-2pcq6" May 25 14:13:07.444766 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:13:07.444280 2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 14:13:07.444766 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:13:07.444283 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 14:13:07.444766 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:13:07.444329 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/009111ca-e828-4238-accf-5381fbdf7799-cert podName:009111ca-e828-4238-accf-5381fbdf7799 nodeName:}" failed. No retries permitted until 2026-05-25 14:13:15.444316126 +0000 UTC m=+49.651563289 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/009111ca-e828-4238-accf-5381fbdf7799-cert") pod "ingress-canary-2pcq6" (UID: "009111ca-e828-4238-accf-5381fbdf7799") : secret "canary-serving-cert" not found May 25 14:13:07.444766 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:13:07.444353 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/261f5fa7-41fd-46aa-a56b-7042da67b7bc-metrics-tls podName:261f5fa7-41fd-46aa-a56b-7042da67b7bc nodeName:}" failed. No retries permitted until 2026-05-25 14:13:15.444334348 +0000 UTC m=+49.651581516 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/261f5fa7-41fd-46aa-a56b-7042da67b7bc-metrics-tls") pod "dns-default-k4lxb" (UID: "261f5fa7-41fd-46aa-a56b-7042da67b7bc") : secret "dns-default-metrics-tls" not found May 25 14:13:15.499392 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:13:15.499335 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/261f5fa7-41fd-46aa-a56b-7042da67b7bc-metrics-tls\") pod \"dns-default-k4lxb\" (UID: \"261f5fa7-41fd-46aa-a56b-7042da67b7bc\") " pod="openshift-dns/dns-default-k4lxb" May 25 14:13:15.499850 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:13:15.499403 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/009111ca-e828-4238-accf-5381fbdf7799-cert\") pod \"ingress-canary-2pcq6\" (UID: \"009111ca-e828-4238-accf-5381fbdf7799\") " pod="openshift-ingress-canary/ingress-canary-2pcq6" May 25 14:13:15.499850 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:13:15.499494 2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 14:13:15.499850 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:13:15.499494 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 14:13:15.499850 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:13:15.499565 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/261f5fa7-41fd-46aa-a56b-7042da67b7bc-metrics-tls podName:261f5fa7-41fd-46aa-a56b-7042da67b7bc nodeName:}" failed. No retries permitted until 2026-05-25 14:13:31.499544325 +0000 UTC m=+65.706791486 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/261f5fa7-41fd-46aa-a56b-7042da67b7bc-metrics-tls") pod "dns-default-k4lxb" (UID: "261f5fa7-41fd-46aa-a56b-7042da67b7bc") : secret "dns-default-metrics-tls" not found May 25 14:13:15.499850 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:13:15.499583 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/009111ca-e828-4238-accf-5381fbdf7799-cert podName:009111ca-e828-4238-accf-5381fbdf7799 nodeName:}" failed. No retries permitted until 2026-05-25 14:13:31.499574971 +0000 UTC m=+65.706822136 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/009111ca-e828-4238-accf-5381fbdf7799-cert") pod "ingress-canary-2pcq6" (UID: "009111ca-e828-4238-accf-5381fbdf7799") : secret "canary-serving-cert" not found May 25 14:13:25.588884 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:13:25.588851 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b2gmj" May 25 14:13:31.517024 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:13:31.516985 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/261f5fa7-41fd-46aa-a56b-7042da67b7bc-metrics-tls\") pod \"dns-default-k4lxb\" (UID: \"261f5fa7-41fd-46aa-a56b-7042da67b7bc\") " pod="openshift-dns/dns-default-k4lxb" May 25 14:13:31.517024 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:13:31.517027 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/009111ca-e828-4238-accf-5381fbdf7799-cert\") pod \"ingress-canary-2pcq6\" (UID: \"009111ca-e828-4238-accf-5381fbdf7799\") " pod="openshift-ingress-canary/ingress-canary-2pcq6" May 25 14:13:31.517629 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:13:31.517136 2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 14:13:31.517629 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:13:31.517174 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 14:13:31.517629 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:13:31.517189 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/009111ca-e828-4238-accf-5381fbdf7799-cert podName:009111ca-e828-4238-accf-5381fbdf7799 nodeName:}" failed. No retries permitted until 2026-05-25 14:14:03.517174381 +0000 UTC m=+97.724421543 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/009111ca-e828-4238-accf-5381fbdf7799-cert") pod "ingress-canary-2pcq6" (UID: "009111ca-e828-4238-accf-5381fbdf7799") : secret "canary-serving-cert" not found May 25 14:13:31.517629 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:13:31.517254 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/261f5fa7-41fd-46aa-a56b-7042da67b7bc-metrics-tls podName:261f5fa7-41fd-46aa-a56b-7042da67b7bc nodeName:}" failed. No retries permitted until 2026-05-25 14:14:03.517234865 +0000 UTC m=+97.724482027 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/261f5fa7-41fd-46aa-a56b-7042da67b7bc-metrics-tls") pod "dns-default-k4lxb" (UID: "261f5fa7-41fd-46aa-a56b-7042da67b7bc") : secret "dns-default-metrics-tls" not found May 25 14:13:32.121015 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:13:32.120973 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b48e369-ae21-483b-897e-fb9b4ecd1818-metrics-certs\") pod \"network-metrics-daemon-p6784\" (UID: \"7b48e369-ae21-483b-897e-fb9b4ecd1818\") " pod="openshift-multus/network-metrics-daemon-p6784" May 25 14:13:32.121198 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:13:32.121032 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-frx7c\" (UniqueName: \"kubernetes.io/projected/14bb3377-8d7b-4231-a2c1-cf5a7e7abbea-kube-api-access-frx7c\") pod \"network-check-target-wrh74\" (UID: \"14bb3377-8d7b-4231-a2c1-cf5a7e7abbea\") " pod="openshift-network-diagnostics/network-check-target-wrh74" May 25 14:13:32.123956 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:13:32.123930 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 25 14:13:32.124082 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:13:32.124065 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 25 14:13:32.132245 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:13:32.132212 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 25 14:13:32.132367 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:13:32.132291 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b48e369-ae21-483b-897e-fb9b4ecd1818-metrics-certs podName:7b48e369-ae21-483b-897e-fb9b4ecd1818 nodeName:}" failed. No retries permitted until 2026-05-25 14:14:36.13227442 +0000 UTC m=+130.339521587 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b48e369-ae21-483b-897e-fb9b4ecd1818-metrics-certs") pod "network-metrics-daemon-p6784" (UID: "7b48e369-ae21-483b-897e-fb9b4ecd1818") : secret "metrics-daemon-secret" not found May 25 14:13:32.134755 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:13:32.134738 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 25 14:13:32.145908 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:13:32.145881 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frx7c\" (UniqueName: \"kubernetes.io/projected/14bb3377-8d7b-4231-a2c1-cf5a7e7abbea-kube-api-access-frx7c\") pod \"network-check-target-wrh74\" (UID: \"14bb3377-8d7b-4231-a2c1-cf5a7e7abbea\") " pod="openshift-network-diagnostics/network-check-target-wrh74" May 25 14:13:32.272526 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:13:32.272496 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vlvbn\"" May 25 14:13:32.279908 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:13:32.279883 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrh74" May 25 14:13:32.415037 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:13:32.414959 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wrh74"] May 25 14:13:32.418687 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:13:32.418661 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14bb3377_8d7b_4231_a2c1_cf5a7e7abbea.slice/crio-5eb3cc4dc36c3b7bad35a5639c42f76d3814327242d32053da3efd1805964721 WatchSource:0}: Error finding container 5eb3cc4dc36c3b7bad35a5639c42f76d3814327242d32053da3efd1805964721: Status 404 returned error can't find the container with id 5eb3cc4dc36c3b7bad35a5639c42f76d3814327242d32053da3efd1805964721 May 25 14:13:32.662731 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:13:32.662698 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wrh74" event={"ID":"14bb3377-8d7b-4231-a2c1-cf5a7e7abbea","Type":"ContainerStarted","Data":"5eb3cc4dc36c3b7bad35a5639c42f76d3814327242d32053da3efd1805964721"} May 25 14:13:36.671540 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:13:36.671498 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wrh74" event={"ID":"14bb3377-8d7b-4231-a2c1-cf5a7e7abbea","Type":"ContainerStarted","Data":"3ea9b66a7a90af33af4bdb6a36df0a5bec00e15b72530a0498d68f69250c89a0"} May 25 14:13:36.671943 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:13:36.671657 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wrh74" May 25 14:13:36.692654 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:13:36.692602 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wrh74" podStartSLOduration=66.984075033 podStartE2EDuration="1m10.692586473s" podCreationTimestamp="2026-05-25 14:12:26 +0000 UTC" firstStartedPulling="2026-05-25 14:13:32.420547792 +0000 UTC m=+66.627794954" lastFinishedPulling="2026-05-25 14:13:36.129059217 +0000 UTC m=+70.336306394" observedRunningTime="2026-05-25 14:13:36.691671156 +0000 UTC m=+70.898918341" watchObservedRunningTime="2026-05-25 14:13:36.692586473 +0000 UTC m=+70.899833681" May 25 14:14:03.538748 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:03.538702 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/261f5fa7-41fd-46aa-a56b-7042da67b7bc-metrics-tls\") pod \"dns-default-k4lxb\" (UID: \"261f5fa7-41fd-46aa-a56b-7042da67b7bc\") " pod="openshift-dns/dns-default-k4lxb" May 25 14:14:03.538748 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:03.538749 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/009111ca-e828-4238-accf-5381fbdf7799-cert\") pod \"ingress-canary-2pcq6\" (UID: \"009111ca-e828-4238-accf-5381fbdf7799\") " pod="openshift-ingress-canary/ingress-canary-2pcq6" May 25 14:14:03.539318 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:14:03.538859 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 14:14:03.539318 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:14:03.538932 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/261f5fa7-41fd-46aa-a56b-7042da67b7bc-metrics-tls podName:261f5fa7-41fd-46aa-a56b-7042da67b7bc nodeName:}" failed. No retries permitted until 2026-05-25 14:15:07.538917325 +0000 UTC m=+161.746164487 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/261f5fa7-41fd-46aa-a56b-7042da67b7bc-metrics-tls") pod "dns-default-k4lxb" (UID: "261f5fa7-41fd-46aa-a56b-7042da67b7bc") : secret "dns-default-metrics-tls" not found May 25 14:14:03.539318 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:14:03.538862 2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 14:14:03.539318 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:14:03.539031 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/009111ca-e828-4238-accf-5381fbdf7799-cert podName:009111ca-e828-4238-accf-5381fbdf7799 nodeName:}" failed. No retries permitted until 2026-05-25 14:15:07.539008821 +0000 UTC m=+161.746255990 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/009111ca-e828-4238-accf-5381fbdf7799-cert") pod "ingress-canary-2pcq6" (UID: "009111ca-e828-4238-accf-5381fbdf7799") : secret "canary-serving-cert" not found May 25 14:14:07.676529 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:07.676492 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wrh74" May 25 14:14:34.271307 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.271276 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-hvwbq"] May 25 14:14:34.273003 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.272979 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-h6vdt"] May 25 14:14:34.273250 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.273122 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-hvwbq" May 25 14:14:34.274894 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.274872 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-h6vdt" May 25 14:14:34.275876 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.275850 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" May 25 14:14:34.275987 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.275901 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" May 25 14:14:34.275987 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.275982 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-db44c\"" May 25 14:14:34.277573 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.277554 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" May 25 14:14:34.277687 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.277578 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-ccf8d\"" May 25 14:14:34.277806 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.277718 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" May 25 14:14:34.277916 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.277899 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" May 25 14:14:34.281220 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.281199 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-hvwbq"] May 25 14:14:34.284124 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.284101 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-h6vdt"] May 25 14:14:34.353027 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.352985 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fp2fr\" (UniqueName: \"kubernetes.io/projected/98dabd97-cedd-48fb-ae54-c674d14d50bf-kube-api-access-fp2fr\") pod \"volume-data-source-validator-5cf8c89d64-hvwbq\" (UID: \"98dabd97-cedd-48fb-ae54-c674d14d50bf\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-hvwbq" May 25 14:14:34.353208 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.353068 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a968cf5d-ba6c-4796-a43d-ff94e55fb20b-samples-operator-tls\") pod \"cluster-samples-operator-697587599-h6vdt\" (UID: \"a968cf5d-ba6c-4796-a43d-ff94e55fb20b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-h6vdt" May 25 14:14:34.353208 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.353102 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfqhz\" (UniqueName: \"kubernetes.io/projected/a968cf5d-ba6c-4796-a43d-ff94e55fb20b-kube-api-access-qfqhz\") pod \"cluster-samples-operator-697587599-h6vdt\" (UID: \"a968cf5d-ba6c-4796-a43d-ff94e55fb20b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-h6vdt" May 25 14:14:34.377707 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.377674 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-l4gxh"] May 25 14:14:34.379564 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.379545 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8456cd4ddc-kksfv"] May 25 14:14:34.379703 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.379687 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-l4gxh" May 25 14:14:34.381178 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.381160 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8456cd4ddc-kksfv" May 25 14:14:34.382709 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.382691 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" May 25 14:14:34.382791 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.382706 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-hnx2s\"" May 25 14:14:34.382901 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.382889 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" May 25 14:14:34.383084 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.383064 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 25 14:14:34.383236 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.383222 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 25 14:14:34.387788 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.387769 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 25 14:14:34.387888 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.387800 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 25 14:14:34.387888 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.387838 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 25 14:14:34.389042 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.389023 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" May 25 14:14:34.390681 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.390660 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vg7gs\"" May 25 14:14:34.396108 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.396067 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-l4gxh"] May 25 14:14:34.397116 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.397095 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 25 14:14:34.397300 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.397225 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8456cd4ddc-kksfv"] May 25 14:14:34.453844 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.453801 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/94f8408d-e962-47e4-a6df-db75d8d04164-trusted-ca\") pod \"image-registry-8456cd4ddc-kksfv\" (UID: \"94f8408d-e962-47e4-a6df-db75d8d04164\") " pod="openshift-image-registry/image-registry-8456cd4ddc-kksfv" May 25 14:14:34.453844 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.453849 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aec84fa8-ab52-471b-87c9-5abb8d795238-serving-cert\") pod \"insights-operator-78bdfb888c-l4gxh\" (UID: \"aec84fa8-ab52-471b-87c9-5abb8d795238\") " pod="openshift-insights/insights-operator-78bdfb888c-l4gxh" May 25 14:14:34.454059 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.453878 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/94f8408d-e962-47e4-a6df-db75d8d04164-installation-pull-secrets\") pod \"image-registry-8456cd4ddc-kksfv\" (UID: \"94f8408d-e962-47e4-a6df-db75d8d04164\") " pod="openshift-image-registry/image-registry-8456cd4ddc-kksfv" May 25 14:14:34.454059 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.453970 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qfqhz\" (UniqueName: \"kubernetes.io/projected/a968cf5d-ba6c-4796-a43d-ff94e55fb20b-kube-api-access-qfqhz\") pod \"cluster-samples-operator-697587599-h6vdt\" (UID: \"a968cf5d-ba6c-4796-a43d-ff94e55fb20b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-h6vdt" May 25 14:14:34.454059 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.454018 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aec84fa8-ab52-471b-87c9-5abb8d795238-tmp\") pod \"insights-operator-78bdfb888c-l4gxh\" (UID: \"aec84fa8-ab52-471b-87c9-5abb8d795238\") " pod="openshift-insights/insights-operator-78bdfb888c-l4gxh" May 25 14:14:34.454059 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.454040 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aec84fa8-ab52-471b-87c9-5abb8d795238-service-ca-bundle\") pod \"insights-operator-78bdfb888c-l4gxh\" (UID: \"aec84fa8-ab52-471b-87c9-5abb8d795238\") " pod="openshift-insights/insights-operator-78bdfb888c-l4gxh" May 25 14:14:34.454059 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.454057 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/94f8408d-e962-47e4-a6df-db75d8d04164-image-registry-private-configuration\") pod \"image-registry-8456cd4ddc-kksfv\" (UID: \"94f8408d-e962-47e4-a6df-db75d8d04164\") " pod="openshift-image-registry/image-registry-8456cd4ddc-kksfv" May 25 14:14:34.454246 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.454086 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aec84fa8-ab52-471b-87c9-5abb8d795238-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-l4gxh\" (UID: \"aec84fa8-ab52-471b-87c9-5abb8d795238\") " pod="openshift-insights/insights-operator-78bdfb888c-l4gxh" May 25 14:14:34.454246 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.454133 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fp2fr\" (UniqueName: \"kubernetes.io/projected/98dabd97-cedd-48fb-ae54-c674d14d50bf-kube-api-access-fp2fr\") pod \"volume-data-source-validator-5cf8c89d64-hvwbq\" (UID: \"98dabd97-cedd-48fb-ae54-c674d14d50bf\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-hvwbq" May 25 14:14:34.454246 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.454149 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/94f8408d-e962-47e4-a6df-db75d8d04164-ca-trust-extracted\") pod \"image-registry-8456cd4ddc-kksfv\" (UID: \"94f8408d-e962-47e4-a6df-db75d8d04164\") " pod="openshift-image-registry/image-registry-8456cd4ddc-kksfv" May 25 14:14:34.454246 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.454190 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfbxv\" (UniqueName: \"kubernetes.io/projected/aec84fa8-ab52-471b-87c9-5abb8d795238-kube-api-access-vfbxv\") pod \"insights-operator-78bdfb888c-l4gxh\" (UID: \"aec84fa8-ab52-471b-87c9-5abb8d795238\") " pod="openshift-insights/insights-operator-78bdfb888c-l4gxh" May 25 14:14:34.454246 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.454207 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/94f8408d-e962-47e4-a6df-db75d8d04164-registry-certificates\") pod \"image-registry-8456cd4ddc-kksfv\" (UID: \"94f8408d-e962-47e4-a6df-db75d8d04164\") " pod="openshift-image-registry/image-registry-8456cd4ddc-kksfv" May 25 14:14:34.454246 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.454231 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/94f8408d-e962-47e4-a6df-db75d8d04164-bound-sa-token\") pod \"image-registry-8456cd4ddc-kksfv\" (UID: \"94f8408d-e962-47e4-a6df-db75d8d04164\") " pod="openshift-image-registry/image-registry-8456cd4ddc-kksfv" May 25 14:14:34.454553 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.454252 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/aec84fa8-ab52-471b-87c9-5abb8d795238-snapshots\") pod \"insights-operator-78bdfb888c-l4gxh\" (UID: \"aec84fa8-ab52-471b-87c9-5abb8d795238\") " pod="openshift-insights/insights-operator-78bdfb888c-l4gxh" May 25 14:14:34.454553 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.454280 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/94f8408d-e962-47e4-a6df-db75d8d04164-registry-tls\") pod \"image-registry-8456cd4ddc-kksfv\" (UID: \"94f8408d-e962-47e4-a6df-db75d8d04164\") " pod="openshift-image-registry/image-registry-8456cd4ddc-kksfv" May 25 14:14:34.454553 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.454309 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7xw8\" (UniqueName: \"kubernetes.io/projected/94f8408d-e962-47e4-a6df-db75d8d04164-kube-api-access-z7xw8\") pod \"image-registry-8456cd4ddc-kksfv\" (UID: \"94f8408d-e962-47e4-a6df-db75d8d04164\") " pod="openshift-image-registry/image-registry-8456cd4ddc-kksfv" May 25 14:14:34.454553 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.454328 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a968cf5d-ba6c-4796-a43d-ff94e55fb20b-samples-operator-tls\") pod \"cluster-samples-operator-697587599-h6vdt\" (UID: \"a968cf5d-ba6c-4796-a43d-ff94e55fb20b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-h6vdt" May 25 14:14:34.454553 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:14:34.454458 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 25 14:14:34.454553 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:14:34.454523 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a968cf5d-ba6c-4796-a43d-ff94e55fb20b-samples-operator-tls podName:a968cf5d-ba6c-4796-a43d-ff94e55fb20b nodeName:}" failed. No retries permitted until 2026-05-25 14:14:34.954503264 +0000 UTC m=+129.161750437 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a968cf5d-ba6c-4796-a43d-ff94e55fb20b-samples-operator-tls") pod "cluster-samples-operator-697587599-h6vdt" (UID: "a968cf5d-ba6c-4796-a43d-ff94e55fb20b") : secret "samples-operator-tls" not found May 25 14:14:34.463339 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.463311 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfqhz\" (UniqueName: \"kubernetes.io/projected/a968cf5d-ba6c-4796-a43d-ff94e55fb20b-kube-api-access-qfqhz\") pod \"cluster-samples-operator-697587599-h6vdt\" (UID: \"a968cf5d-ba6c-4796-a43d-ff94e55fb20b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-h6vdt" May 25 14:14:34.463490 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.463398 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fp2fr\" (UniqueName: \"kubernetes.io/projected/98dabd97-cedd-48fb-ae54-c674d14d50bf-kube-api-access-fp2fr\") pod \"volume-data-source-validator-5cf8c89d64-hvwbq\" (UID: \"98dabd97-cedd-48fb-ae54-c674d14d50bf\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-hvwbq" May 25 14:14:34.481941 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.481906 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-rb4mc"] May 25 14:14:34.484100 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.484081 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-gqf6p"] May 25 14:14:34.484237 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.484219 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-rb4mc" May 25 14:14:34.485847 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.485801 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-gqf6p" May 25 14:14:34.486995 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.486973 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" May 25 14:14:34.487115 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.487062 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-jwflk\"" May 25 14:14:34.487195 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.487180 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" May 25 14:14:34.487652 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.487635 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" May 25 14:14:34.488160 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.488143 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" May 25 14:14:34.488243 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.488229 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" May 25 14:14:34.488457 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.488441 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" May 25 14:14:34.488519 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.488509 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" May 25 14:14:34.488644 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.488622 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" May 25 14:14:34.489026 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.489012 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-2wpgw\"" May 25 14:14:34.495291 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.495250 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-rb4mc"] May 25 14:14:34.496324 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.496305 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-gqf6p"] May 25 14:14:34.554817 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.554778 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/94f8408d-e962-47e4-a6df-db75d8d04164-registry-tls\") pod \"image-registry-8456cd4ddc-kksfv\" (UID: \"94f8408d-e962-47e4-a6df-db75d8d04164\") " pod="openshift-image-registry/image-registry-8456cd4ddc-kksfv" May 25 14:14:34.554817 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.554818 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z7xw8\" (UniqueName: \"kubernetes.io/projected/94f8408d-e962-47e4-a6df-db75d8d04164-kube-api-access-z7xw8\") pod \"image-registry-8456cd4ddc-kksfv\" (UID: \"94f8408d-e962-47e4-a6df-db75d8d04164\") " pod="openshift-image-registry/image-registry-8456cd4ddc-kksfv" May 25 14:14:34.555068 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.554841 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6ff41224-f404-410d-907d-7b7ee3f12ab7-serving-cert\") pod \"service-ca-operator-57b5b68b8-gqf6p\" (UID: \"6ff41224-f404-410d-907d-7b7ee3f12ab7\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-gqf6p" May 25 14:14:34.555068 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.554859 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8f57\" (UniqueName: \"kubernetes.io/projected/6ff41224-f404-410d-907d-7b7ee3f12ab7-kube-api-access-g8f57\") pod \"service-ca-operator-57b5b68b8-gqf6p\" (UID: \"6ff41224-f404-410d-907d-7b7ee3f12ab7\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-gqf6p" May 25 14:14:34.555068 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.554887 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/94f8408d-e962-47e4-a6df-db75d8d04164-trusted-ca\") pod \"image-registry-8456cd4ddc-kksfv\" (UID: \"94f8408d-e962-47e4-a6df-db75d8d04164\") " pod="openshift-image-registry/image-registry-8456cd4ddc-kksfv" May 25 14:14:34.555068 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.554902 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6ff41224-f404-410d-907d-7b7ee3f12ab7-config\") pod \"service-ca-operator-57b5b68b8-gqf6p\" (UID: \"6ff41224-f404-410d-907d-7b7ee3f12ab7\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-gqf6p" May 25 14:14:34.555068 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:14:34.554937 2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 25 14:14:34.555068 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.554953 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aec84fa8-ab52-471b-87c9-5abb8d795238-serving-cert\") pod \"insights-operator-78bdfb888c-l4gxh\" (UID: \"aec84fa8-ab52-471b-87c9-5abb8d795238\") " pod="openshift-insights/insights-operator-78bdfb888c-l4gxh" May 25 14:14:34.555068 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.554988 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/94f8408d-e962-47e4-a6df-db75d8d04164-installation-pull-secrets\") pod \"image-registry-8456cd4ddc-kksfv\" (UID: \"94f8408d-e962-47e4-a6df-db75d8d04164\") " pod="openshift-image-registry/image-registry-8456cd4ddc-kksfv" May 25 14:14:34.555068 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:14:34.554963 2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8456cd4ddc-kksfv: secret "image-registry-tls" not found May 25 14:14:34.555068 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.555049 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aec84fa8-ab52-471b-87c9-5abb8d795238-tmp\") pod \"insights-operator-78bdfb888c-l4gxh\" (UID: \"aec84fa8-ab52-471b-87c9-5abb8d795238\") " pod="openshift-insights/insights-operator-78bdfb888c-l4gxh" May 25 14:14:34.555526 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.555079 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aec84fa8-ab52-471b-87c9-5abb8d795238-service-ca-bundle\") pod \"insights-operator-78bdfb888c-l4gxh\" (UID: \"aec84fa8-ab52-471b-87c9-5abb8d795238\") " pod="openshift-insights/insights-operator-78bdfb888c-l4gxh" May 25 14:14:34.555526 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:14:34.555116 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94f8408d-e962-47e4-a6df-db75d8d04164-registry-tls podName:94f8408d-e962-47e4-a6df-db75d8d04164 nodeName:}" failed. No retries permitted until 2026-05-25 14:14:35.055087383 +0000 UTC m=+129.262334563 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/94f8408d-e962-47e4-a6df-db75d8d04164-registry-tls") pod "image-registry-8456cd4ddc-kksfv" (UID: "94f8408d-e962-47e4-a6df-db75d8d04164") : secret "image-registry-tls" not found May 25 14:14:34.555526 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.555159 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/94f8408d-e962-47e4-a6df-db75d8d04164-image-registry-private-configuration\") pod \"image-registry-8456cd4ddc-kksfv\" (UID: \"94f8408d-e962-47e4-a6df-db75d8d04164\") " pod="openshift-image-registry/image-registry-8456cd4ddc-kksfv" May 25 14:14:34.555526 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.555198 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6cddc246-de40-4ec5-8dd8-25e94b917240-config\") pod \"kube-storage-version-migrator-operator-565644f49-rb4mc\" (UID: \"6cddc246-de40-4ec5-8dd8-25e94b917240\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-rb4mc" May 25 14:14:34.555526 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.555229 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfqvt\" (UniqueName: \"kubernetes.io/projected/6cddc246-de40-4ec5-8dd8-25e94b917240-kube-api-access-qfqvt\") pod \"kube-storage-version-migrator-operator-565644f49-rb4mc\" (UID: \"6cddc246-de40-4ec5-8dd8-25e94b917240\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-rb4mc" May 25 14:14:34.555526 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.555275 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aec84fa8-ab52-471b-87c9-5abb8d795238-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-l4gxh\" (UID: \"aec84fa8-ab52-471b-87c9-5abb8d795238\") " pod="openshift-insights/insights-operator-78bdfb888c-l4gxh" May 25 14:14:34.555526 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.555312 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/94f8408d-e962-47e4-a6df-db75d8d04164-ca-trust-extracted\") pod \"image-registry-8456cd4ddc-kksfv\" (UID: \"94f8408d-e962-47e4-a6df-db75d8d04164\") " pod="openshift-image-registry/image-registry-8456cd4ddc-kksfv" May 25 14:14:34.555862 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.555601 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vfbxv\" (UniqueName: \"kubernetes.io/projected/aec84fa8-ab52-471b-87c9-5abb8d795238-kube-api-access-vfbxv\") pod \"insights-operator-78bdfb888c-l4gxh\" (UID: \"aec84fa8-ab52-471b-87c9-5abb8d795238\") " pod="openshift-insights/insights-operator-78bdfb888c-l4gxh" May 25 14:14:34.555862 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.555632 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/94f8408d-e962-47e4-a6df-db75d8d04164-registry-certificates\") pod \"image-registry-8456cd4ddc-kksfv\" (UID: \"94f8408d-e962-47e4-a6df-db75d8d04164\") " pod="openshift-image-registry/image-registry-8456cd4ddc-kksfv" May 25 14:14:34.555862 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.555673 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6cddc246-de40-4ec5-8dd8-25e94b917240-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-rb4mc\" (UID: \"6cddc246-de40-4ec5-8dd8-25e94b917240\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-rb4mc" May 25 14:14:34.555862 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.555717 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/94f8408d-e962-47e4-a6df-db75d8d04164-bound-sa-token\") pod \"image-registry-8456cd4ddc-kksfv\" (UID: \"94f8408d-e962-47e4-a6df-db75d8d04164\") " pod="openshift-image-registry/image-registry-8456cd4ddc-kksfv" May 25 14:14:34.555862 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.555753 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/aec84fa8-ab52-471b-87c9-5abb8d795238-snapshots\") pod \"insights-operator-78bdfb888c-l4gxh\" (UID: \"aec84fa8-ab52-471b-87c9-5abb8d795238\") " pod="openshift-insights/insights-operator-78bdfb888c-l4gxh" May 25 14:14:34.556059 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.555923 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aec84fa8-ab52-471b-87c9-5abb8d795238-service-ca-bundle\") pod \"insights-operator-78bdfb888c-l4gxh\" (UID: \"aec84fa8-ab52-471b-87c9-5abb8d795238\") " pod="openshift-insights/insights-operator-78bdfb888c-l4gxh" May 25 14:14:34.556059 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.555965 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aec84fa8-ab52-471b-87c9-5abb8d795238-tmp\") pod \"insights-operator-78bdfb888c-l4gxh\" (UID: \"aec84fa8-ab52-471b-87c9-5abb8d795238\") " pod="openshift-insights/insights-operator-78bdfb888c-l4gxh" May 25 14:14:34.556059 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.556048 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/94f8408d-e962-47e4-a6df-db75d8d04164-trusted-ca\") pod \"image-registry-8456cd4ddc-kksfv\" (UID: \"94f8408d-e962-47e4-a6df-db75d8d04164\") " pod="openshift-image-registry/image-registry-8456cd4ddc-kksfv" May 25 14:14:34.556352 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.556326 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/aec84fa8-ab52-471b-87c9-5abb8d795238-snapshots\") pod \"insights-operator-78bdfb888c-l4gxh\" (UID: \"aec84fa8-ab52-471b-87c9-5abb8d795238\") " pod="openshift-insights/insights-operator-78bdfb888c-l4gxh" May 25 14:14:34.556503 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.556447 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/94f8408d-e962-47e4-a6df-db75d8d04164-ca-trust-extracted\") pod \"image-registry-8456cd4ddc-kksfv\" (UID: \"94f8408d-e962-47e4-a6df-db75d8d04164\") " pod="openshift-image-registry/image-registry-8456cd4ddc-kksfv" May 25 14:14:34.556578 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.556506 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aec84fa8-ab52-471b-87c9-5abb8d795238-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-l4gxh\" (UID: \"aec84fa8-ab52-471b-87c9-5abb8d795238\") " pod="openshift-insights/insights-operator-78bdfb888c-l4gxh" May 25 14:14:34.556622 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.556422 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/94f8408d-e962-47e4-a6df-db75d8d04164-registry-certificates\") pod \"image-registry-8456cd4ddc-kksfv\" (UID: \"94f8408d-e962-47e4-a6df-db75d8d04164\") " pod="openshift-image-registry/image-registry-8456cd4ddc-kksfv" May 25 14:14:34.557781 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.557761 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aec84fa8-ab52-471b-87c9-5abb8d795238-serving-cert\") pod \"insights-operator-78bdfb888c-l4gxh\" (UID: \"aec84fa8-ab52-471b-87c9-5abb8d795238\") " pod="openshift-insights/insights-operator-78bdfb888c-l4gxh" May 25 14:14:34.557870 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.557789 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/94f8408d-e962-47e4-a6df-db75d8d04164-installation-pull-secrets\") pod \"image-registry-8456cd4ddc-kksfv\" (UID: \"94f8408d-e962-47e4-a6df-db75d8d04164\") " pod="openshift-image-registry/image-registry-8456cd4ddc-kksfv" May 25 14:14:34.558206 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.558182 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/94f8408d-e962-47e4-a6df-db75d8d04164-image-registry-private-configuration\") pod \"image-registry-8456cd4ddc-kksfv\" (UID: \"94f8408d-e962-47e4-a6df-db75d8d04164\") " pod="openshift-image-registry/image-registry-8456cd4ddc-kksfv" May 25 14:14:34.564462 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.564436 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7xw8\" (UniqueName: \"kubernetes.io/projected/94f8408d-e962-47e4-a6df-db75d8d04164-kube-api-access-z7xw8\") pod \"image-registry-8456cd4ddc-kksfv\" (UID: \"94f8408d-e962-47e4-a6df-db75d8d04164\") " pod="openshift-image-registry/image-registry-8456cd4ddc-kksfv" May 25 14:14:34.564868 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.564845 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/94f8408d-e962-47e4-a6df-db75d8d04164-bound-sa-token\") pod \"image-registry-8456cd4ddc-kksfv\" (UID: \"94f8408d-e962-47e4-a6df-db75d8d04164\") " pod="openshift-image-registry/image-registry-8456cd4ddc-kksfv" May 25 14:14:34.564942 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.564899 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfbxv\" (UniqueName: \"kubernetes.io/projected/aec84fa8-ab52-471b-87c9-5abb8d795238-kube-api-access-vfbxv\") pod \"insights-operator-78bdfb888c-l4gxh\" (UID: \"aec84fa8-ab52-471b-87c9-5abb8d795238\") " pod="openshift-insights/insights-operator-78bdfb888c-l4gxh" May 25 14:14:34.583946 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.583907 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-hvwbq" May 25 14:14:34.656922 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.656893 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6cddc246-de40-4ec5-8dd8-25e94b917240-config\") pod \"kube-storage-version-migrator-operator-565644f49-rb4mc\" (UID: \"6cddc246-de40-4ec5-8dd8-25e94b917240\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-rb4mc" May 25 14:14:34.657108 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.656927 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qfqvt\" (UniqueName: \"kubernetes.io/projected/6cddc246-de40-4ec5-8dd8-25e94b917240-kube-api-access-qfqvt\") pod \"kube-storage-version-migrator-operator-565644f49-rb4mc\" (UID: \"6cddc246-de40-4ec5-8dd8-25e94b917240\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-rb4mc" May 25 14:14:34.657108 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.657054 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6cddc246-de40-4ec5-8dd8-25e94b917240-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-rb4mc\" (UID: \"6cddc246-de40-4ec5-8dd8-25e94b917240\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-rb4mc" May 25 14:14:34.657217 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.657139 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6ff41224-f404-410d-907d-7b7ee3f12ab7-serving-cert\") pod \"service-ca-operator-57b5b68b8-gqf6p\" (UID: \"6ff41224-f404-410d-907d-7b7ee3f12ab7\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-gqf6p" May 25 14:14:34.657217 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.657170 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g8f57\" (UniqueName: \"kubernetes.io/projected/6ff41224-f404-410d-907d-7b7ee3f12ab7-kube-api-access-g8f57\") pod \"service-ca-operator-57b5b68b8-gqf6p\" (UID: \"6ff41224-f404-410d-907d-7b7ee3f12ab7\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-gqf6p" May 25 14:14:34.657354 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.657307 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6ff41224-f404-410d-907d-7b7ee3f12ab7-config\") pod \"service-ca-operator-57b5b68b8-gqf6p\" (UID: \"6ff41224-f404-410d-907d-7b7ee3f12ab7\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-gqf6p" May 25 14:14:34.657494 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.657477 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6cddc246-de40-4ec5-8dd8-25e94b917240-config\") pod \"kube-storage-version-migrator-operator-565644f49-rb4mc\" (UID: \"6cddc246-de40-4ec5-8dd8-25e94b917240\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-rb4mc" May 25 14:14:34.657799 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.657778 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6ff41224-f404-410d-907d-7b7ee3f12ab7-config\") pod \"service-ca-operator-57b5b68b8-gqf6p\" (UID: \"6ff41224-f404-410d-907d-7b7ee3f12ab7\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-gqf6p" May 25 14:14:34.659547 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.659524 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6ff41224-f404-410d-907d-7b7ee3f12ab7-serving-cert\") pod \"service-ca-operator-57b5b68b8-gqf6p\" (UID: \"6ff41224-f404-410d-907d-7b7ee3f12ab7\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-gqf6p" May 25 14:14:34.659663 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.659592 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6cddc246-de40-4ec5-8dd8-25e94b917240-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-rb4mc\" (UID: \"6cddc246-de40-4ec5-8dd8-25e94b917240\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-rb4mc" May 25 14:14:34.666213 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.666180 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8f57\" (UniqueName: \"kubernetes.io/projected/6ff41224-f404-410d-907d-7b7ee3f12ab7-kube-api-access-g8f57\") pod \"service-ca-operator-57b5b68b8-gqf6p\" (UID: \"6ff41224-f404-410d-907d-7b7ee3f12ab7\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-gqf6p" May 25 14:14:34.666720 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.666682 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfqvt\" (UniqueName: \"kubernetes.io/projected/6cddc246-de40-4ec5-8dd8-25e94b917240-kube-api-access-qfqvt\") pod \"kube-storage-version-migrator-operator-565644f49-rb4mc\" (UID: \"6cddc246-de40-4ec5-8dd8-25e94b917240\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-rb4mc" May 25 14:14:34.690677 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.690647 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-l4gxh" May 25 14:14:34.710082 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.710050 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-hvwbq"] May 25 14:14:34.714478 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:14:34.714441 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98dabd97_cedd_48fb_ae54_c674d14d50bf.slice/crio-644e470e56779aade116e301242ad9c8af3944ca457ad1ee6e11cb96631c80cd WatchSource:0}: Error finding container 644e470e56779aade116e301242ad9c8af3944ca457ad1ee6e11cb96631c80cd: Status 404 returned error can't find the container with id 644e470e56779aade116e301242ad9c8af3944ca457ad1ee6e11cb96631c80cd May 25 14:14:34.780267 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.780235 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-hvwbq" event={"ID":"98dabd97-cedd-48fb-ae54-c674d14d50bf","Type":"ContainerStarted","Data":"644e470e56779aade116e301242ad9c8af3944ca457ad1ee6e11cb96631c80cd"} May 25 14:14:34.795530 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.795500 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-rb4mc" May 25 14:14:34.800983 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.800951 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-gqf6p" May 25 14:14:34.820223 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.820164 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-l4gxh"] May 25 14:14:34.824205 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:14:34.824171 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaec84fa8_ab52_471b_87c9_5abb8d795238.slice/crio-debb02bee926b24d35deccc0bb5f532de3239c9e8b7b93445f77e53ac0d929a1 WatchSource:0}: Error finding container debb02bee926b24d35deccc0bb5f532de3239c9e8b7b93445f77e53ac0d929a1: Status 404 returned error can't find the container with id debb02bee926b24d35deccc0bb5f532de3239c9e8b7b93445f77e53ac0d929a1 May 25 14:14:34.935149 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.935119 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-rb4mc"] May 25 14:14:34.938361 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:14:34.938336 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cddc246_de40_4ec5_8dd8_25e94b917240.slice/crio-df5bc7c0da810008424f8c25199935e6fa17570e3b35ba19b4049a212e3a1b08 WatchSource:0}: Error finding container df5bc7c0da810008424f8c25199935e6fa17570e3b35ba19b4049a212e3a1b08: Status 404 returned error can't find the container with id df5bc7c0da810008424f8c25199935e6fa17570e3b35ba19b4049a212e3a1b08 May 25 14:14:34.954805 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.954776 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-gqf6p"] May 25 14:14:34.958108 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:14:34.958078 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ff41224_f404_410d_907d_7b7ee3f12ab7.slice/crio-1e98acc693a69ecf78aa68a1292fce11e8d09e57b6ecc31dda683a3b528ae03f WatchSource:0}: Error finding container 1e98acc693a69ecf78aa68a1292fce11e8d09e57b6ecc31dda683a3b528ae03f: Status 404 returned error can't find the container with id 1e98acc693a69ecf78aa68a1292fce11e8d09e57b6ecc31dda683a3b528ae03f May 25 14:14:34.960193 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:34.960146 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a968cf5d-ba6c-4796-a43d-ff94e55fb20b-samples-operator-tls\") pod \"cluster-samples-operator-697587599-h6vdt\" (UID: \"a968cf5d-ba6c-4796-a43d-ff94e55fb20b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-h6vdt" May 25 14:14:34.960291 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:14:34.960276 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 25 14:14:34.960346 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:14:34.960336 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a968cf5d-ba6c-4796-a43d-ff94e55fb20b-samples-operator-tls podName:a968cf5d-ba6c-4796-a43d-ff94e55fb20b nodeName:}" failed. No retries permitted until 2026-05-25 14:14:35.960320758 +0000 UTC m=+130.167567920 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a968cf5d-ba6c-4796-a43d-ff94e55fb20b-samples-operator-tls") pod "cluster-samples-operator-697587599-h6vdt" (UID: "a968cf5d-ba6c-4796-a43d-ff94e55fb20b") : secret "samples-operator-tls" not found May 25 14:14:35.060872 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:35.060772 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/94f8408d-e962-47e4-a6df-db75d8d04164-registry-tls\") pod \"image-registry-8456cd4ddc-kksfv\" (UID: \"94f8408d-e962-47e4-a6df-db75d8d04164\") " pod="openshift-image-registry/image-registry-8456cd4ddc-kksfv" May 25 14:14:35.061021 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:14:35.060927 2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 25 14:14:35.061021 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:14:35.060949 2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8456cd4ddc-kksfv: secret "image-registry-tls" not found May 25 14:14:35.061021 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:14:35.061008 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94f8408d-e962-47e4-a6df-db75d8d04164-registry-tls podName:94f8408d-e962-47e4-a6df-db75d8d04164 nodeName:}" failed. No retries permitted until 2026-05-25 14:14:36.060992201 +0000 UTC m=+130.268239362 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/94f8408d-e962-47e4-a6df-db75d8d04164-registry-tls") pod "image-registry-8456cd4ddc-kksfv" (UID: "94f8408d-e962-47e4-a6df-db75d8d04164") : secret "image-registry-tls" not found May 25 14:14:35.784347 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:35.784293 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-l4gxh" event={"ID":"aec84fa8-ab52-471b-87c9-5abb8d795238","Type":"ContainerStarted","Data":"debb02bee926b24d35deccc0bb5f532de3239c9e8b7b93445f77e53ac0d929a1"} May 25 14:14:35.786023 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:35.785963 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-rb4mc" event={"ID":"6cddc246-de40-4ec5-8dd8-25e94b917240","Type":"ContainerStarted","Data":"df5bc7c0da810008424f8c25199935e6fa17570e3b35ba19b4049a212e3a1b08"} May 25 14:14:35.787684 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:35.787651 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-gqf6p" event={"ID":"6ff41224-f404-410d-907d-7b7ee3f12ab7","Type":"ContainerStarted","Data":"1e98acc693a69ecf78aa68a1292fce11e8d09e57b6ecc31dda683a3b528ae03f"} May 25 14:14:35.969052 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:35.968925 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a968cf5d-ba6c-4796-a43d-ff94e55fb20b-samples-operator-tls\") pod \"cluster-samples-operator-697587599-h6vdt\" (UID: \"a968cf5d-ba6c-4796-a43d-ff94e55fb20b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-h6vdt" May 25 14:14:35.969052 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:14:35.969049 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 25 14:14:35.969292 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:14:35.969115 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a968cf5d-ba6c-4796-a43d-ff94e55fb20b-samples-operator-tls podName:a968cf5d-ba6c-4796-a43d-ff94e55fb20b nodeName:}" failed. No retries permitted until 2026-05-25 14:14:37.969097725 +0000 UTC m=+132.176344886 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a968cf5d-ba6c-4796-a43d-ff94e55fb20b-samples-operator-tls") pod "cluster-samples-operator-697587599-h6vdt" (UID: "a968cf5d-ba6c-4796-a43d-ff94e55fb20b") : secret "samples-operator-tls" not found May 25 14:14:36.070251 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:36.070202 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/94f8408d-e962-47e4-a6df-db75d8d04164-registry-tls\") pod \"image-registry-8456cd4ddc-kksfv\" (UID: \"94f8408d-e962-47e4-a6df-db75d8d04164\") " pod="openshift-image-registry/image-registry-8456cd4ddc-kksfv" May 25 14:14:36.070452 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:14:36.070410 2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 25 14:14:36.070452 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:14:36.070426 2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8456cd4ddc-kksfv: secret "image-registry-tls" not found May 25 14:14:36.070646 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:14:36.070481 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94f8408d-e962-47e4-a6df-db75d8d04164-registry-tls podName:94f8408d-e962-47e4-a6df-db75d8d04164 nodeName:}" failed. No retries permitted until 2026-05-25 14:14:38.070462113 +0000 UTC m=+132.277709290 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/94f8408d-e962-47e4-a6df-db75d8d04164-registry-tls") pod "image-registry-8456cd4ddc-kksfv" (UID: "94f8408d-e962-47e4-a6df-db75d8d04164") : secret "image-registry-tls" not found May 25 14:14:36.171504 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:36.171474 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b48e369-ae21-483b-897e-fb9b4ecd1818-metrics-certs\") pod \"network-metrics-daemon-p6784\" (UID: \"7b48e369-ae21-483b-897e-fb9b4ecd1818\") " pod="openshift-multus/network-metrics-daemon-p6784" May 25 14:14:36.171632 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:14:36.171610 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 25 14:14:36.171688 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:14:36.171674 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b48e369-ae21-483b-897e-fb9b4ecd1818-metrics-certs podName:7b48e369-ae21-483b-897e-fb9b4ecd1818 nodeName:}" failed. No retries permitted until 2026-05-25 14:16:38.171653792 +0000 UTC m=+252.378900987 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b48e369-ae21-483b-897e-fb9b4ecd1818-metrics-certs") pod "network-metrics-daemon-p6784" (UID: "7b48e369-ae21-483b-897e-fb9b4ecd1818") : secret "metrics-daemon-secret" not found May 25 14:14:36.791486 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:36.791438 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-hvwbq" event={"ID":"98dabd97-cedd-48fb-ae54-c674d14d50bf","Type":"ContainerStarted","Data":"448049a8b10a425108cd76c9cf894da761f4160714216aa9b595f8c87884ef2f"} May 25 14:14:36.808694 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:36.807960 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-hvwbq" podStartSLOduration=1.362814675 podStartE2EDuration="2.807941625s" podCreationTimestamp="2026-05-25 14:14:34 +0000 UTC" firstStartedPulling="2026-05-25 14:14:34.716454041 +0000 UTC m=+128.923701203" lastFinishedPulling="2026-05-25 14:14:36.161580988 +0000 UTC m=+130.368828153" observedRunningTime="2026-05-25 14:14:36.806325212 +0000 UTC m=+131.013572410" watchObservedRunningTime="2026-05-25 14:14:36.807941625 +0000 UTC m=+131.015188811" May 25 14:14:37.795008 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:37.794920 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-l4gxh" event={"ID":"aec84fa8-ab52-471b-87c9-5abb8d795238","Type":"ContainerStarted","Data":"ffbda9adec478c9569f59e70f946242dd3d1f5f1359889fd9f34672b57d80eb6"} May 25 14:14:37.796277 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:37.796248 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-rb4mc" event={"ID":"6cddc246-de40-4ec5-8dd8-25e94b917240","Type":"ContainerStarted","Data":"1a9745e6cac3010a22c1b1304d9e0bebdee5d31fde2078af2737a375e290e308"} May 25 14:14:37.827226 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:37.827174 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-rb4mc" podStartSLOduration=1.377575534 podStartE2EDuration="3.827156311s" podCreationTimestamp="2026-05-25 14:14:34 +0000 UTC" firstStartedPulling="2026-05-25 14:14:34.94014769 +0000 UTC m=+129.147394852" lastFinishedPulling="2026-05-25 14:14:37.389728464 +0000 UTC m=+131.596975629" observedRunningTime="2026-05-25 14:14:37.827143513 +0000 UTC m=+132.034390698" watchObservedRunningTime="2026-05-25 14:14:37.827156311 +0000 UTC m=+132.034403560" May 25 14:14:37.827448 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:37.827411 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-l4gxh" podStartSLOduration=1.2652735609999999 podStartE2EDuration="3.827403923s" podCreationTimestamp="2026-05-25 14:14:34 +0000 UTC" firstStartedPulling="2026-05-25 14:14:34.826068765 +0000 UTC m=+129.033315927" lastFinishedPulling="2026-05-25 14:14:37.388199124 +0000 UTC m=+131.595446289" observedRunningTime="2026-05-25 14:14:37.811242922 +0000 UTC m=+132.018490105" watchObservedRunningTime="2026-05-25 14:14:37.827403923 +0000 UTC m=+132.034651106" May 25 14:14:37.989323 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:37.989269 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a968cf5d-ba6c-4796-a43d-ff94e55fb20b-samples-operator-tls\") pod \"cluster-samples-operator-697587599-h6vdt\" (UID: \"a968cf5d-ba6c-4796-a43d-ff94e55fb20b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-h6vdt" May 25 14:14:37.989486 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:14:37.989472 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 25 14:14:37.989559 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:14:37.989549 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a968cf5d-ba6c-4796-a43d-ff94e55fb20b-samples-operator-tls podName:a968cf5d-ba6c-4796-a43d-ff94e55fb20b nodeName:}" failed. No retries permitted until 2026-05-25 14:14:41.989531518 +0000 UTC m=+136.196778679 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a968cf5d-ba6c-4796-a43d-ff94e55fb20b-samples-operator-tls") pod "cluster-samples-operator-697587599-h6vdt" (UID: "a968cf5d-ba6c-4796-a43d-ff94e55fb20b") : secret "samples-operator-tls" not found May 25 14:14:38.090429 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:38.090387 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/94f8408d-e962-47e4-a6df-db75d8d04164-registry-tls\") pod \"image-registry-8456cd4ddc-kksfv\" (UID: \"94f8408d-e962-47e4-a6df-db75d8d04164\") " pod="openshift-image-registry/image-registry-8456cd4ddc-kksfv" May 25 14:14:38.090604 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:14:38.090560 2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 25 14:14:38.090604 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:14:38.090586 2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8456cd4ddc-kksfv: secret "image-registry-tls" not found May 25 14:14:38.090670 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:14:38.090655 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94f8408d-e962-47e4-a6df-db75d8d04164-registry-tls podName:94f8408d-e962-47e4-a6df-db75d8d04164 nodeName:}" failed. No retries permitted until 2026-05-25 14:14:42.090634099 +0000 UTC m=+136.297881267 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/94f8408d-e962-47e4-a6df-db75d8d04164-registry-tls") pod "image-registry-8456cd4ddc-kksfv" (UID: "94f8408d-e962-47e4-a6df-db75d8d04164") : secret "image-registry-tls" not found May 25 14:14:39.802424 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:39.802363 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-gqf6p" event={"ID":"6ff41224-f404-410d-907d-7b7ee3f12ab7","Type":"ContainerStarted","Data":"04cf683a808caf30e29c49612f0eb55f16deb217de9cdd12a125d1934ac87744"} May 25 14:14:39.819029 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:39.818977 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-gqf6p" podStartSLOduration=1.8116961 podStartE2EDuration="5.818963187s" podCreationTimestamp="2026-05-25 14:14:34 +0000 UTC" firstStartedPulling="2026-05-25 14:14:34.959852465 +0000 UTC m=+129.167099627" lastFinishedPulling="2026-05-25 14:14:38.967119549 +0000 UTC m=+133.174366714" observedRunningTime="2026-05-25 14:14:39.818195448 +0000 UTC m=+134.025442644" watchObservedRunningTime="2026-05-25 14:14:39.818963187 +0000 UTC m=+134.026210370" May 25 14:14:40.413014 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:40.412988 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-td67w_251e865d-d65c-4abf-b045-ac55fee054da/dns-node-resolver/0.log" May 25 14:14:41.215757 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:41.215731 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wmrkq_5da677c4-73fb-4b42-be1a-c7fb68aa56d0/node-ca/0.log" May 25 14:14:42.021424 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:42.021363 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a968cf5d-ba6c-4796-a43d-ff94e55fb20b-samples-operator-tls\") pod \"cluster-samples-operator-697587599-h6vdt\" (UID: \"a968cf5d-ba6c-4796-a43d-ff94e55fb20b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-h6vdt" May 25 14:14:42.021593 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:14:42.021524 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 25 14:14:42.021593 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:14:42.021589 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a968cf5d-ba6c-4796-a43d-ff94e55fb20b-samples-operator-tls podName:a968cf5d-ba6c-4796-a43d-ff94e55fb20b nodeName:}" failed. No retries permitted until 2026-05-25 14:14:50.021572904 +0000 UTC m=+144.228820075 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a968cf5d-ba6c-4796-a43d-ff94e55fb20b-samples-operator-tls") pod "cluster-samples-operator-697587599-h6vdt" (UID: "a968cf5d-ba6c-4796-a43d-ff94e55fb20b") : secret "samples-operator-tls" not found May 25 14:14:42.122048 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:42.122009 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/94f8408d-e962-47e4-a6df-db75d8d04164-registry-tls\") pod \"image-registry-8456cd4ddc-kksfv\" (UID: \"94f8408d-e962-47e4-a6df-db75d8d04164\") " pod="openshift-image-registry/image-registry-8456cd4ddc-kksfv" May 25 14:14:42.122413 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:14:42.122162 2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 25 14:14:42.122413 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:14:42.122185 2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8456cd4ddc-kksfv: secret "image-registry-tls" not found May 25 14:14:42.122413 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:14:42.122245 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94f8408d-e962-47e4-a6df-db75d8d04164-registry-tls podName:94f8408d-e962-47e4-a6df-db75d8d04164 nodeName:}" failed. No retries permitted until 2026-05-25 14:14:50.122227469 +0000 UTC m=+144.329474636 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/94f8408d-e962-47e4-a6df-db75d8d04164-registry-tls") pod "image-registry-8456cd4ddc-kksfv" (UID: "94f8408d-e962-47e4-a6df-db75d8d04164") : secret "image-registry-tls" not found May 25 14:14:42.436524 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:42.436490 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-s47vt"] May 25 14:14:42.438535 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:42.438515 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-s47vt" May 25 14:14:42.441502 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:42.441477 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" May 25 14:14:42.441628 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:42.441517 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" May 25 14:14:42.442657 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:42.442632 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-q74nm\"" May 25 14:14:42.442784 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:42.442644 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" May 25 14:14:42.442784 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:42.442696 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" May 25 14:14:42.446716 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:42.446690 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-s47vt"] May 25 14:14:42.525237 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:42.525190 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/aba7ff51-4dda-4056-8cd4-55def5b4e307-signing-key\") pod \"service-ca-67d667c7d-s47vt\" (UID: \"aba7ff51-4dda-4056-8cd4-55def5b4e307\") " pod="openshift-service-ca/service-ca-67d667c7d-s47vt" May 25 14:14:42.525458 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:42.525342 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpdw5\" (UniqueName: \"kubernetes.io/projected/aba7ff51-4dda-4056-8cd4-55def5b4e307-kube-api-access-wpdw5\") pod \"service-ca-67d667c7d-s47vt\" (UID: \"aba7ff51-4dda-4056-8cd4-55def5b4e307\") " pod="openshift-service-ca/service-ca-67d667c7d-s47vt" May 25 14:14:42.525458 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:42.525444 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/aba7ff51-4dda-4056-8cd4-55def5b4e307-signing-cabundle\") pod \"service-ca-67d667c7d-s47vt\" (UID: \"aba7ff51-4dda-4056-8cd4-55def5b4e307\") " pod="openshift-service-ca/service-ca-67d667c7d-s47vt" May 25 14:14:42.626556 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:42.626513 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/aba7ff51-4dda-4056-8cd4-55def5b4e307-signing-cabundle\") pod \"service-ca-67d667c7d-s47vt\" (UID: \"aba7ff51-4dda-4056-8cd4-55def5b4e307\") " pod="openshift-service-ca/service-ca-67d667c7d-s47vt" May 25 14:14:42.626753 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:42.626576 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/aba7ff51-4dda-4056-8cd4-55def5b4e307-signing-key\") pod \"service-ca-67d667c7d-s47vt\" (UID: \"aba7ff51-4dda-4056-8cd4-55def5b4e307\") " pod="openshift-service-ca/service-ca-67d667c7d-s47vt" May 25 14:14:42.626753 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:42.626652 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wpdw5\" (UniqueName: \"kubernetes.io/projected/aba7ff51-4dda-4056-8cd4-55def5b4e307-kube-api-access-wpdw5\") pod \"service-ca-67d667c7d-s47vt\" (UID: \"aba7ff51-4dda-4056-8cd4-55def5b4e307\") " pod="openshift-service-ca/service-ca-67d667c7d-s47vt" May 25 14:14:42.627227 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:42.627195 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/aba7ff51-4dda-4056-8cd4-55def5b4e307-signing-cabundle\") pod \"service-ca-67d667c7d-s47vt\" (UID: \"aba7ff51-4dda-4056-8cd4-55def5b4e307\") " pod="openshift-service-ca/service-ca-67d667c7d-s47vt" May 25 14:14:42.629087 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:42.629065 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/aba7ff51-4dda-4056-8cd4-55def5b4e307-signing-key\") pod \"service-ca-67d667c7d-s47vt\" (UID: \"aba7ff51-4dda-4056-8cd4-55def5b4e307\") " pod="openshift-service-ca/service-ca-67d667c7d-s47vt" May 25 14:14:42.640163 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:42.640134 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpdw5\" (UniqueName: \"kubernetes.io/projected/aba7ff51-4dda-4056-8cd4-55def5b4e307-kube-api-access-wpdw5\") pod \"service-ca-67d667c7d-s47vt\" (UID: \"aba7ff51-4dda-4056-8cd4-55def5b4e307\") " pod="openshift-service-ca/service-ca-67d667c7d-s47vt" May 25 14:14:42.747900 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:42.747809 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-s47vt" May 25 14:14:42.872834 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:42.872802 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-s47vt"] May 25 14:14:42.875465 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:14:42.875426 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaba7ff51_4dda_4056_8cd4_55def5b4e307.slice/crio-5374f7008b352d3fb135ab946f0368891571a5130f56ebc0edb4dd661583308c WatchSource:0}: Error finding container 5374f7008b352d3fb135ab946f0368891571a5130f56ebc0edb4dd661583308c: Status 404 returned error can't find the container with id 5374f7008b352d3fb135ab946f0368891571a5130f56ebc0edb4dd661583308c May 25 14:14:43.813525 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:43.813479 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-s47vt" event={"ID":"aba7ff51-4dda-4056-8cd4-55def5b4e307","Type":"ContainerStarted","Data":"9ccbae2f7238d5307196d6511de7336b088cfdb685afef12ac51b5291933dd84"} May 25 14:14:43.813525 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:43.813516 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-s47vt" event={"ID":"aba7ff51-4dda-4056-8cd4-55def5b4e307","Type":"ContainerStarted","Data":"5374f7008b352d3fb135ab946f0368891571a5130f56ebc0edb4dd661583308c"} May 25 14:14:50.085828 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:50.085788 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a968cf5d-ba6c-4796-a43d-ff94e55fb20b-samples-operator-tls\") pod \"cluster-samples-operator-697587599-h6vdt\" (UID: \"a968cf5d-ba6c-4796-a43d-ff94e55fb20b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-h6vdt" May 25 14:14:50.088331 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:50.088300 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a968cf5d-ba6c-4796-a43d-ff94e55fb20b-samples-operator-tls\") pod \"cluster-samples-operator-697587599-h6vdt\" (UID: \"a968cf5d-ba6c-4796-a43d-ff94e55fb20b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-h6vdt" May 25 14:14:50.186763 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:50.186721 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/94f8408d-e962-47e4-a6df-db75d8d04164-registry-tls\") pod \"image-registry-8456cd4ddc-kksfv\" (UID: \"94f8408d-e962-47e4-a6df-db75d8d04164\") " pod="openshift-image-registry/image-registry-8456cd4ddc-kksfv" May 25 14:14:50.189008 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:50.188976 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-h6vdt" May 25 14:14:50.189423 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:50.189402 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/94f8408d-e962-47e4-a6df-db75d8d04164-registry-tls\") pod \"image-registry-8456cd4ddc-kksfv\" (UID: \"94f8408d-e962-47e4-a6df-db75d8d04164\") " pod="openshift-image-registry/image-registry-8456cd4ddc-kksfv" May 25 14:14:50.300758 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:50.300725 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8456cd4ddc-kksfv" May 25 14:14:50.338307 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:50.338207 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-s47vt" podStartSLOduration=8.33819025 podStartE2EDuration="8.33819025s" podCreationTimestamp="2026-05-25 14:14:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 14:14:43.832585583 +0000 UTC m=+138.039832767" watchObservedRunningTime="2026-05-25 14:14:50.33819025 +0000 UTC m=+144.545437434" May 25 14:14:50.338679 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:50.338658 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-h6vdt"] May 25 14:14:50.441514 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:50.441480 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8456cd4ddc-kksfv"] May 25 14:14:50.444411 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:14:50.444360 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94f8408d_e962_47e4_a6df_db75d8d04164.slice/crio-3ef8d526a0fa0ef1e42d9bcedef7d1b8d939389edfbad3acdeb75f34f1a08dc2 WatchSource:0}: Error finding container 3ef8d526a0fa0ef1e42d9bcedef7d1b8d939389edfbad3acdeb75f34f1a08dc2: Status 404 returned error can't find the container with id 3ef8d526a0fa0ef1e42d9bcedef7d1b8d939389edfbad3acdeb75f34f1a08dc2 May 25 14:14:50.830844 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:50.830806 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8456cd4ddc-kksfv" event={"ID":"94f8408d-e962-47e4-a6df-db75d8d04164","Type":"ContainerStarted","Data":"f5e050203d625ff1d62ef8e5065eb7c33d3a3ad3b659da7d404f10bea9d301fe"} May 25 14:14:50.831063 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:50.830849 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8456cd4ddc-kksfv" event={"ID":"94f8408d-e962-47e4-a6df-db75d8d04164","Type":"ContainerStarted","Data":"3ef8d526a0fa0ef1e42d9bcedef7d1b8d939389edfbad3acdeb75f34f1a08dc2"} May 25 14:14:50.831063 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:50.830947 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8456cd4ddc-kksfv" May 25 14:14:50.831954 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:50.831923 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-h6vdt" event={"ID":"a968cf5d-ba6c-4796-a43d-ff94e55fb20b","Type":"ContainerStarted","Data":"b6b3c518c1ec541d27b4d2c9ca68adfa58c6f9cf73e42a5801f39050f8d53f9c"} May 25 14:14:50.848737 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:50.848690 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8456cd4ddc-kksfv" podStartSLOduration=16.848675501 podStartE2EDuration="16.848675501s" podCreationTimestamp="2026-05-25 14:14:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 14:14:50.847312177 +0000 UTC m=+145.054559361" watchObservedRunningTime="2026-05-25 14:14:50.848675501 +0000 UTC m=+145.055922684" May 25 14:14:52.843126 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:52.843087 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-h6vdt" event={"ID":"a968cf5d-ba6c-4796-a43d-ff94e55fb20b","Type":"ContainerStarted","Data":"c6f2022db4086833490c188c65f0f17dc97f68659be263f3faf18784aca51ea8"} May 25 14:14:52.843547 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:52.843133 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-h6vdt" event={"ID":"a968cf5d-ba6c-4796-a43d-ff94e55fb20b","Type":"ContainerStarted","Data":"f8172ea02908ee19d744614feed9dd7a428c085e86ef702f96c87baa6f96c2f2"} May 25 14:14:52.859773 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:14:52.859690 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-h6vdt" podStartSLOduration=17.360484637 podStartE2EDuration="18.859675805s" podCreationTimestamp="2026-05-25 14:14:34 +0000 UTC" firstStartedPulling="2026-05-25 14:14:50.390000492 +0000 UTC m=+144.597247670" lastFinishedPulling="2026-05-25 14:14:51.889191674 +0000 UTC m=+146.096438838" observedRunningTime="2026-05-25 14:14:52.858866379 +0000 UTC m=+147.066113564" watchObservedRunningTime="2026-05-25 14:14:52.859675805 +0000 UTC m=+147.066923061" May 25 14:15:02.702808 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:15:02.702755 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-k4lxb" podUID="261f5fa7-41fd-46aa-a56b-7042da67b7bc" May 25 14:15:02.718304 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:15:02.718258 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-2pcq6" podUID="009111ca-e828-4238-accf-5381fbdf7799" May 25 14:15:02.866706 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:02.866671 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2pcq6" May 25 14:15:02.866879 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:02.866683 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k4lxb" May 25 14:15:03.017043 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:03.016957 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8456cd4ddc-kksfv"] May 25 14:15:03.020058 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:03.020030 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zl8wx"] May 25 14:15:03.023203 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:03.023180 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zl8wx" May 25 14:15:03.026100 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:03.026075 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 25 14:15:03.026402 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:03.026361 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 25 14:15:03.026742 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:03.026726 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-s6zhr\"" May 25 14:15:03.033855 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:03.033828 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zl8wx"] May 25 14:15:03.194663 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:03.194623 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/448645b2-eafe-4a90-8bb6-62d04df143b4-data-volume\") pod \"insights-runtime-extractor-zl8wx\" (UID: \"448645b2-eafe-4a90-8bb6-62d04df143b4\") " pod="openshift-insights/insights-runtime-extractor-zl8wx" May 25 14:15:03.194862 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:03.194668 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/448645b2-eafe-4a90-8bb6-62d04df143b4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zl8wx\" (UID: \"448645b2-eafe-4a90-8bb6-62d04df143b4\") " pod="openshift-insights/insights-runtime-extractor-zl8wx" May 25 14:15:03.194862 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:03.194746 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/448645b2-eafe-4a90-8bb6-62d04df143b4-crio-socket\") pod \"insights-runtime-extractor-zl8wx\" (UID: \"448645b2-eafe-4a90-8bb6-62d04df143b4\") " pod="openshift-insights/insights-runtime-extractor-zl8wx" May 25 14:15:03.194862 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:03.194788 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr795\" (UniqueName: \"kubernetes.io/projected/448645b2-eafe-4a90-8bb6-62d04df143b4-kube-api-access-wr795\") pod \"insights-runtime-extractor-zl8wx\" (UID: \"448645b2-eafe-4a90-8bb6-62d04df143b4\") " pod="openshift-insights/insights-runtime-extractor-zl8wx" May 25 14:15:03.194862 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:03.194836 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/448645b2-eafe-4a90-8bb6-62d04df143b4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zl8wx\" (UID: \"448645b2-eafe-4a90-8bb6-62d04df143b4\") " pod="openshift-insights/insights-runtime-extractor-zl8wx" May 25 14:15:03.274206 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:03.274112 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-lr7c5"] May 25 14:15:03.277306 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:03.277282 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-lr7c5" May 25 14:15:03.280000 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:03.279973 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 25 14:15:03.280127 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:03.279973 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-4dgkg\"" May 25 14:15:03.280127 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:03.280011 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 25 14:15:03.287654 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:03.287630 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-lr7c5"] May 25 14:15:03.295851 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:03.295809 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/448645b2-eafe-4a90-8bb6-62d04df143b4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zl8wx\" (UID: \"448645b2-eafe-4a90-8bb6-62d04df143b4\") " pod="openshift-insights/insights-runtime-extractor-zl8wx" May 25 14:15:03.296038 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:03.295896 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/448645b2-eafe-4a90-8bb6-62d04df143b4-data-volume\") pod \"insights-runtime-extractor-zl8wx\" (UID: \"448645b2-eafe-4a90-8bb6-62d04df143b4\") " pod="openshift-insights/insights-runtime-extractor-zl8wx" May 25 14:15:03.296038 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:03.295921 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/448645b2-eafe-4a90-8bb6-62d04df143b4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zl8wx\" (UID: \"448645b2-eafe-4a90-8bb6-62d04df143b4\") " pod="openshift-insights/insights-runtime-extractor-zl8wx" May 25 14:15:03.296038 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:03.295945 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/448645b2-eafe-4a90-8bb6-62d04df143b4-crio-socket\") pod \"insights-runtime-extractor-zl8wx\" (UID: \"448645b2-eafe-4a90-8bb6-62d04df143b4\") " pod="openshift-insights/insights-runtime-extractor-zl8wx" May 25 14:15:03.296038 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:03.295967 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wr795\" (UniqueName: \"kubernetes.io/projected/448645b2-eafe-4a90-8bb6-62d04df143b4-kube-api-access-wr795\") pod \"insights-runtime-extractor-zl8wx\" (UID: \"448645b2-eafe-4a90-8bb6-62d04df143b4\") " pod="openshift-insights/insights-runtime-extractor-zl8wx" May 25 14:15:03.296311 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:03.296054 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/448645b2-eafe-4a90-8bb6-62d04df143b4-crio-socket\") pod \"insights-runtime-extractor-zl8wx\" (UID: \"448645b2-eafe-4a90-8bb6-62d04df143b4\") " pod="openshift-insights/insights-runtime-extractor-zl8wx" May 25 14:15:03.296420 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:03.296400 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/448645b2-eafe-4a90-8bb6-62d04df143b4-data-volume\") pod \"insights-runtime-extractor-zl8wx\" (UID: \"448645b2-eafe-4a90-8bb6-62d04df143b4\") " pod="openshift-insights/insights-runtime-extractor-zl8wx" May 25 14:15:03.296639 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:03.296620 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/448645b2-eafe-4a90-8bb6-62d04df143b4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zl8wx\" (UID: \"448645b2-eafe-4a90-8bb6-62d04df143b4\") " pod="openshift-insights/insights-runtime-extractor-zl8wx" May 25 14:15:03.298499 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:03.298467 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/448645b2-eafe-4a90-8bb6-62d04df143b4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zl8wx\" (UID: \"448645b2-eafe-4a90-8bb6-62d04df143b4\") " pod="openshift-insights/insights-runtime-extractor-zl8wx" May 25 14:15:03.308032 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:03.308006 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr795\" (UniqueName: \"kubernetes.io/projected/448645b2-eafe-4a90-8bb6-62d04df143b4-kube-api-access-wr795\") pod \"insights-runtime-extractor-zl8wx\" (UID: \"448645b2-eafe-4a90-8bb6-62d04df143b4\") " pod="openshift-insights/insights-runtime-extractor-zl8wx" May 25 14:15:03.333355 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:03.333320 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zl8wx" May 25 14:15:03.373013 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:15:03.372973 2562 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-p6784" podUID="7b48e369-ae21-483b-897e-fb9b4ecd1818" May 25 14:15:03.397695 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:03.397528 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47pbc\" (UniqueName: \"kubernetes.io/projected/02bfa411-fef2-4aa3-9901-b092c646a450-kube-api-access-47pbc\") pod \"downloads-57bd96b888-lr7c5\" (UID: \"02bfa411-fef2-4aa3-9901-b092c646a450\") " pod="openshift-console/downloads-57bd96b888-lr7c5" May 25 14:15:03.465754 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:03.465720 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zl8wx"] May 25 14:15:03.468627 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:15:03.468582 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod448645b2_eafe_4a90_8bb6_62d04df143b4.slice/crio-7bd7a5a5bc5e397e2d45d541aaa1ee1504a31ad342ddbaf79e28ede9ffdeabf2 WatchSource:0}: Error finding container 7bd7a5a5bc5e397e2d45d541aaa1ee1504a31ad342ddbaf79e28ede9ffdeabf2: Status 404 returned error can't find the container with id 7bd7a5a5bc5e397e2d45d541aaa1ee1504a31ad342ddbaf79e28ede9ffdeabf2 May 25 14:15:03.498535 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:03.498496 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-47pbc\" (UniqueName: \"kubernetes.io/projected/02bfa411-fef2-4aa3-9901-b092c646a450-kube-api-access-47pbc\") pod \"downloads-57bd96b888-lr7c5\" (UID: \"02bfa411-fef2-4aa3-9901-b092c646a450\") " pod="openshift-console/downloads-57bd96b888-lr7c5" May 25 14:15:03.506788 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:03.506754 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47pbc\" (UniqueName: \"kubernetes.io/projected/02bfa411-fef2-4aa3-9901-b092c646a450-kube-api-access-47pbc\") pod \"downloads-57bd96b888-lr7c5\" (UID: \"02bfa411-fef2-4aa3-9901-b092c646a450\") " pod="openshift-console/downloads-57bd96b888-lr7c5" May 25 14:15:03.586507 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:03.586475 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-lr7c5" May 25 14:15:03.714545 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:03.714515 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-lr7c5"] May 25 14:15:03.717729 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:15:03.717698 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02bfa411_fef2_4aa3_9901_b092c646a450.slice/crio-be2474c92f838674b5d9379b297ab513d63105db905ddcd5acdfcc5708a8c2b9 WatchSource:0}: Error finding container be2474c92f838674b5d9379b297ab513d63105db905ddcd5acdfcc5708a8c2b9: Status 404 returned error can't find the container with id be2474c92f838674b5d9379b297ab513d63105db905ddcd5acdfcc5708a8c2b9 May 25 14:15:03.870182 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:03.870146 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zl8wx" event={"ID":"448645b2-eafe-4a90-8bb6-62d04df143b4","Type":"ContainerStarted","Data":"147e275ec9c66b208a57f6061aeb8939432fbad87e343f18ee565cb4ce3e3c94"} May 25 14:15:03.870393 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:03.870190 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zl8wx" event={"ID":"448645b2-eafe-4a90-8bb6-62d04df143b4","Type":"ContainerStarted","Data":"7bd7a5a5bc5e397e2d45d541aaa1ee1504a31ad342ddbaf79e28ede9ffdeabf2"} May 25 14:15:03.871052 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:03.871029 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-lr7c5" event={"ID":"02bfa411-fef2-4aa3-9901-b092c646a450","Type":"ContainerStarted","Data":"be2474c92f838674b5d9379b297ab513d63105db905ddcd5acdfcc5708a8c2b9"} May 25 14:15:04.876096 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:04.876061 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zl8wx" event={"ID":"448645b2-eafe-4a90-8bb6-62d04df143b4","Type":"ContainerStarted","Data":"d8b38ae41fbc38379d8c3a2cb1bd9e713ccf9c865c77a0d37a94975329bc5f74"} May 25 14:15:06.883749 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:06.883704 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zl8wx" event={"ID":"448645b2-eafe-4a90-8bb6-62d04df143b4","Type":"ContainerStarted","Data":"70e6fff08128ea5ecfc3f526a34711cd96299b4aecc6eb6626ad87f2b24b879c"} May 25 14:15:06.903026 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:06.902977 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zl8wx" podStartSLOduration=2.538946041 podStartE2EDuration="4.902957783s" podCreationTimestamp="2026-05-25 14:15:02 +0000 UTC" firstStartedPulling="2026-05-25 14:15:03.529858497 +0000 UTC m=+157.737105659" lastFinishedPulling="2026-05-25 14:15:05.893870235 +0000 UTC m=+160.101117401" observedRunningTime="2026-05-25 14:15:06.901472566 +0000 UTC m=+161.108719752" watchObservedRunningTime="2026-05-25 14:15:06.902957783 +0000 UTC m=+161.110204966" May 25 14:15:07.633269 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:07.633222 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/261f5fa7-41fd-46aa-a56b-7042da67b7bc-metrics-tls\") pod \"dns-default-k4lxb\" (UID: \"261f5fa7-41fd-46aa-a56b-7042da67b7bc\") " pod="openshift-dns/dns-default-k4lxb" May 25 14:15:07.633269 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:07.633268 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/009111ca-e828-4238-accf-5381fbdf7799-cert\") pod \"ingress-canary-2pcq6\" (UID: \"009111ca-e828-4238-accf-5381fbdf7799\") " pod="openshift-ingress-canary/ingress-canary-2pcq6" May 25 14:15:07.635771 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:07.635735 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/261f5fa7-41fd-46aa-a56b-7042da67b7bc-metrics-tls\") pod \"dns-default-k4lxb\" (UID: \"261f5fa7-41fd-46aa-a56b-7042da67b7bc\") " pod="openshift-dns/dns-default-k4lxb" May 25 14:15:07.635771 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:07.635756 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/009111ca-e828-4238-accf-5381fbdf7799-cert\") pod \"ingress-canary-2pcq6\" (UID: \"009111ca-e828-4238-accf-5381fbdf7799\") " pod="openshift-ingress-canary/ingress-canary-2pcq6" May 25 14:15:07.671021 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:07.670987 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bh6nj\"" May 25 14:15:07.671939 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:07.671910 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hfq77\"" May 25 14:15:07.678860 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:07.678831 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k4lxb" May 25 14:15:07.678860 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:07.678851 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2pcq6" May 25 14:15:07.838190 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:07.838153 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2pcq6"] May 25 14:15:07.843073 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:15:07.843040 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod009111ca_e828_4238_accf_5381fbdf7799.slice/crio-00808dc9080dcd2f553408b3064e143bef4b3c26fa31ed1cfd1666d86d7e6d0b WatchSource:0}: Error finding container 00808dc9080dcd2f553408b3064e143bef4b3c26fa31ed1cfd1666d86d7e6d0b: Status 404 returned error can't find the container with id 00808dc9080dcd2f553408b3064e143bef4b3c26fa31ed1cfd1666d86d7e6d0b May 25 14:15:07.854803 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:07.854768 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-k4lxb"] May 25 14:15:07.857897 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:15:07.857854 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod261f5fa7_41fd_46aa_a56b_7042da67b7bc.slice/crio-291b36388f462158c33f7bda762d81d96a1abdf078019539607ff6a37278aca5 WatchSource:0}: Error finding container 291b36388f462158c33f7bda762d81d96a1abdf078019539607ff6a37278aca5: Status 404 returned error can't find the container with id 291b36388f462158c33f7bda762d81d96a1abdf078019539607ff6a37278aca5 May 25 14:15:07.888659 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:07.888559 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k4lxb" event={"ID":"261f5fa7-41fd-46aa-a56b-7042da67b7bc","Type":"ContainerStarted","Data":"291b36388f462158c33f7bda762d81d96a1abdf078019539607ff6a37278aca5"} May 25 14:15:07.889779 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:07.889753 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2pcq6" event={"ID":"009111ca-e828-4238-accf-5381fbdf7799","Type":"ContainerStarted","Data":"00808dc9080dcd2f553408b3064e143bef4b3c26fa31ed1cfd1666d86d7e6d0b"} May 25 14:15:08.946038 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:08.945717 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-sk82r"] May 25 14:15:08.949953 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:08.949510 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-sk82r" May 25 14:15:08.954012 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:08.953624 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" May 25 14:15:08.954012 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:08.953629 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-9cltp\"" May 25 14:15:08.957512 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:08.957458 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-sk82r"] May 25 14:15:09.147221 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:09.147176 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4f280e16-18cd-490c-8c57-4e2a1b58bb51-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-sk82r\" (UID: \"4f280e16-18cd-490c-8c57-4e2a1b58bb51\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-sk82r" May 25 14:15:09.248033 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:09.247926 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4f280e16-18cd-490c-8c57-4e2a1b58bb51-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-sk82r\" (UID: \"4f280e16-18cd-490c-8c57-4e2a1b58bb51\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-sk82r" May 25 14:15:09.251316 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:09.251284 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4f280e16-18cd-490c-8c57-4e2a1b58bb51-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-sk82r\" (UID: \"4f280e16-18cd-490c-8c57-4e2a1b58bb51\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-sk82r" May 25 14:15:09.264066 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:09.264027 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-sk82r" May 25 14:15:10.057559 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:10.057003 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-sk82r"] May 25 14:15:10.064552 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:15:10.064513 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f280e16_18cd_490c_8c57_4e2a1b58bb51.slice/crio-29596ea310555d8d198c45e3b13f3cd0b38c9fa4ca92cd1295dd357cbbd11ccb WatchSource:0}: Error finding container 29596ea310555d8d198c45e3b13f3cd0b38c9fa4ca92cd1295dd357cbbd11ccb: Status 404 returned error can't find the container with id 29596ea310555d8d198c45e3b13f3cd0b38c9fa4ca92cd1295dd357cbbd11ccb May 25 14:15:10.902987 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:10.902951 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2pcq6" event={"ID":"009111ca-e828-4238-accf-5381fbdf7799","Type":"ContainerStarted","Data":"20e49fb7de78e5f2883153e67f91dff0a00c1928814b27f723a4521beab90aa5"} May 25 14:15:10.904431 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:10.904338 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-sk82r" event={"ID":"4f280e16-18cd-490c-8c57-4e2a1b58bb51","Type":"ContainerStarted","Data":"29596ea310555d8d198c45e3b13f3cd0b38c9fa4ca92cd1295dd357cbbd11ccb"} May 25 14:15:10.906662 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:10.906616 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k4lxb" event={"ID":"261f5fa7-41fd-46aa-a56b-7042da67b7bc","Type":"ContainerStarted","Data":"105ea27040bde00aeae0a1b63c9646d5086000efb6c66f47d1988d87e8ba2585"} May 25 14:15:10.906901 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:10.906841 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k4lxb" event={"ID":"261f5fa7-41fd-46aa-a56b-7042da67b7bc","Type":"ContainerStarted","Data":"a7beed4e5db43ad76a201417ee31aa5f7b95d0174b902ad814100805d0c780d0"} May 25 14:15:10.906901 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:10.906873 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-k4lxb" May 25 14:15:10.920475 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:10.920411 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2pcq6" podStartSLOduration=129.857652718 podStartE2EDuration="2m11.920390005s" podCreationTimestamp="2026-05-25 14:12:59 +0000 UTC" firstStartedPulling="2026-05-25 14:15:07.845567574 +0000 UTC m=+162.052814736" lastFinishedPulling="2026-05-25 14:15:09.908304844 +0000 UTC m=+164.115552023" observedRunningTime="2026-05-25 14:15:10.918447806 +0000 UTC m=+165.125694998" watchObservedRunningTime="2026-05-25 14:15:10.920390005 +0000 UTC m=+165.127637185" May 25 14:15:10.935526 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:10.935442 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-k4lxb" podStartSLOduration=129.896298983 podStartE2EDuration="2m11.935421554s" podCreationTimestamp="2026-05-25 14:12:59 +0000 UTC" firstStartedPulling="2026-05-25 14:15:07.860054767 +0000 UTC m=+162.067301932" lastFinishedPulling="2026-05-25 14:15:09.899177332 +0000 UTC m=+164.106424503" observedRunningTime="2026-05-25 14:15:10.935242087 +0000 UTC m=+165.142489274" watchObservedRunningTime="2026-05-25 14:15:10.935421554 +0000 UTC m=+165.142668738" May 25 14:15:11.911324 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:11.911285 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-sk82r" event={"ID":"4f280e16-18cd-490c-8c57-4e2a1b58bb51","Type":"ContainerStarted","Data":"4e1176fa3e39fa6134c793b0452f3990e16c553a39fcf356215b7a51b23c2a2f"} May 25 14:15:11.911850 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:11.911661 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-sk82r" May 25 14:15:11.916935 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:11.916905 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-sk82r" May 25 14:15:11.931445 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:11.931366 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-sk82r" podStartSLOduration=2.708536316 podStartE2EDuration="3.931350229s" podCreationTimestamp="2026-05-25 14:15:08 +0000 UTC" firstStartedPulling="2026-05-25 14:15:10.067307515 +0000 UTC m=+164.274554689" lastFinishedPulling="2026-05-25 14:15:11.29012143 +0000 UTC m=+165.497368602" observedRunningTime="2026-05-25 14:15:11.931168577 +0000 UTC m=+166.138415762" watchObservedRunningTime="2026-05-25 14:15:11.931350229 +0000 UTC m=+166.138597412" May 25 14:15:13.023416 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:13.023385 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8456cd4ddc-kksfv" May 25 14:15:13.107347 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:13.107314 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-c66qm"] May 25 14:15:13.110945 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:13.110904 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-c66qm" May 25 14:15:13.119815 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:13.119785 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" May 25 14:15:13.120152 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:13.120093 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" May 25 14:15:13.120323 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:13.120304 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 25 14:15:13.120770 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:13.120752 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 25 14:15:13.120884 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:13.120861 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-qcmgg\"" May 25 14:15:13.120998 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:13.120982 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 25 14:15:13.127755 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:13.127721 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-c66qm"] May 25 14:15:13.187088 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:13.187050 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1988c8b4-1380-4381-9d33-4a9ede090c02-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-c66qm\" (UID: \"1988c8b4-1380-4381-9d33-4a9ede090c02\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-c66qm" May 25 14:15:13.187271 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:13.187106 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5lfl\" (UniqueName: \"kubernetes.io/projected/1988c8b4-1380-4381-9d33-4a9ede090c02-kube-api-access-l5lfl\") pod \"prometheus-operator-7779bbdd78-c66qm\" (UID: \"1988c8b4-1380-4381-9d33-4a9ede090c02\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-c66qm" May 25 14:15:13.187271 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:13.187149 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1988c8b4-1380-4381-9d33-4a9ede090c02-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-c66qm\" (UID: \"1988c8b4-1380-4381-9d33-4a9ede090c02\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-c66qm" May 25 14:15:13.187271 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:13.187185 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1988c8b4-1380-4381-9d33-4a9ede090c02-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-c66qm\" (UID: \"1988c8b4-1380-4381-9d33-4a9ede090c02\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-c66qm" May 25 14:15:13.288520 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:13.288413 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l5lfl\" (UniqueName: \"kubernetes.io/projected/1988c8b4-1380-4381-9d33-4a9ede090c02-kube-api-access-l5lfl\") pod \"prometheus-operator-7779bbdd78-c66qm\" (UID: \"1988c8b4-1380-4381-9d33-4a9ede090c02\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-c66qm" May 25 14:15:13.288520 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:13.288465 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1988c8b4-1380-4381-9d33-4a9ede090c02-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-c66qm\" (UID: \"1988c8b4-1380-4381-9d33-4a9ede090c02\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-c66qm" May 25 14:15:13.288520 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:13.288501 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1988c8b4-1380-4381-9d33-4a9ede090c02-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-c66qm\" (UID: \"1988c8b4-1380-4381-9d33-4a9ede090c02\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-c66qm" May 25 14:15:13.288819 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:13.288552 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1988c8b4-1380-4381-9d33-4a9ede090c02-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-c66qm\" (UID: \"1988c8b4-1380-4381-9d33-4a9ede090c02\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-c66qm" May 25 14:15:13.288819 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:15:13.288642 2562 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found May 25 14:15:13.288819 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:15:13.288710 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1988c8b4-1380-4381-9d33-4a9ede090c02-prometheus-operator-tls podName:1988c8b4-1380-4381-9d33-4a9ede090c02 nodeName:}" failed. No retries permitted until 2026-05-25 14:15:13.78869529 +0000 UTC m=+167.995942457 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/1988c8b4-1380-4381-9d33-4a9ede090c02-prometheus-operator-tls") pod "prometheus-operator-7779bbdd78-c66qm" (UID: "1988c8b4-1380-4381-9d33-4a9ede090c02") : secret "prometheus-operator-tls" not found May 25 14:15:13.289351 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:13.289328 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1988c8b4-1380-4381-9d33-4a9ede090c02-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-c66qm\" (UID: \"1988c8b4-1380-4381-9d33-4a9ede090c02\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-c66qm" May 25 14:15:13.291036 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:13.291016 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1988c8b4-1380-4381-9d33-4a9ede090c02-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-c66qm\" (UID: \"1988c8b4-1380-4381-9d33-4a9ede090c02\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-c66qm" May 25 14:15:13.301950 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:13.301918 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5lfl\" (UniqueName: \"kubernetes.io/projected/1988c8b4-1380-4381-9d33-4a9ede090c02-kube-api-access-l5lfl\") pod \"prometheus-operator-7779bbdd78-c66qm\" (UID: \"1988c8b4-1380-4381-9d33-4a9ede090c02\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-c66qm" May 25 14:15:13.791986 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:13.791942 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1988c8b4-1380-4381-9d33-4a9ede090c02-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-c66qm\" (UID: \"1988c8b4-1380-4381-9d33-4a9ede090c02\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-c66qm" May 25 14:15:13.792187 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:15:13.792074 2562 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found May 25 14:15:13.792187 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:15:13.792134 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1988c8b4-1380-4381-9d33-4a9ede090c02-prometheus-operator-tls podName:1988c8b4-1380-4381-9d33-4a9ede090c02 nodeName:}" failed. No retries permitted until 2026-05-25 14:15:14.792117914 +0000 UTC m=+168.999365076 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/1988c8b4-1380-4381-9d33-4a9ede090c02-prometheus-operator-tls") pod "prometheus-operator-7779bbdd78-c66qm" (UID: "1988c8b4-1380-4381-9d33-4a9ede090c02") : secret "prometheus-operator-tls" not found May 25 14:15:14.802908 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:14.802870 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1988c8b4-1380-4381-9d33-4a9ede090c02-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-c66qm\" (UID: \"1988c8b4-1380-4381-9d33-4a9ede090c02\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-c66qm" May 25 14:15:14.805653 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:14.805599 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1988c8b4-1380-4381-9d33-4a9ede090c02-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-c66qm\" (UID: \"1988c8b4-1380-4381-9d33-4a9ede090c02\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-c66qm" May 25 14:15:14.921766 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:14.921736 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-c66qm" May 25 14:15:16.365859 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:16.365825 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p6784" May 25 14:15:20.914065 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:20.914037 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-k4lxb" May 25 14:15:20.985669 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:20.985636 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-c66qm"] May 25 14:15:20.994722 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:15:20.994694 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1988c8b4_1380_4381_9d33_4a9ede090c02.slice/crio-16405b717fa21519bb285af2a85b4e7a94e3ddfa4d828317c4cf034543c6974e WatchSource:0}: Error finding container 16405b717fa21519bb285af2a85b4e7a94e3ddfa4d828317c4cf034543c6974e: Status 404 returned error can't find the container with id 16405b717fa21519bb285af2a85b4e7a94e3ddfa4d828317c4cf034543c6974e May 25 14:15:21.944589 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:21.944539 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-lr7c5" event={"ID":"02bfa411-fef2-4aa3-9901-b092c646a450","Type":"ContainerStarted","Data":"0eedc9b9faa746507ca4beb2a2f249ab282257181f98680f2f42bca8499bdb60"} May 25 14:15:21.945652 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:21.945124 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-lr7c5" May 25 14:15:21.946414 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:21.946275 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-c66qm" event={"ID":"1988c8b4-1380-4381-9d33-4a9ede090c02","Type":"ContainerStarted","Data":"16405b717fa21519bb285af2a85b4e7a94e3ddfa4d828317c4cf034543c6974e"} May 25 14:15:21.960766 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:21.960679 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-lr7c5" May 25 14:15:21.970688 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:21.966523 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-lr7c5" podStartSLOduration=1.745922551 podStartE2EDuration="18.966499918s" podCreationTimestamp="2026-05-25 14:15:03 +0000 UTC" firstStartedPulling="2026-05-25 14:15:03.719489493 +0000 UTC m=+157.926736658" lastFinishedPulling="2026-05-25 14:15:20.940066859 +0000 UTC m=+175.147314025" observedRunningTime="2026-05-25 14:15:21.964766764 +0000 UTC m=+176.172013950" watchObservedRunningTime="2026-05-25 14:15:21.966499918 +0000 UTC m=+176.173747103" May 25 14:15:22.952457 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:22.952348 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-c66qm" event={"ID":"1988c8b4-1380-4381-9d33-4a9ede090c02","Type":"ContainerStarted","Data":"9834d50d510edab015ef8bbf621f5963422f19bcecd6b30df48332ed8e69739a"} May 25 14:15:22.952457 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:22.952422 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-c66qm" event={"ID":"1988c8b4-1380-4381-9d33-4a9ede090c02","Type":"ContainerStarted","Data":"a71e3f4b4a48f01e4ae40329d303a9d4ee431985721342aabfe6e53342d7a43e"} May 25 14:15:22.971218 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:22.971160 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-c66qm" podStartSLOduration=8.276713369 podStartE2EDuration="9.971140244s" podCreationTimestamp="2026-05-25 14:15:13 +0000 UTC" firstStartedPulling="2026-05-25 14:15:20.996971184 +0000 UTC m=+175.204218348" lastFinishedPulling="2026-05-25 14:15:22.691398049 +0000 UTC m=+176.898645223" observedRunningTime="2026-05-25 14:15:22.969391934 +0000 UTC m=+177.176639118" watchObservedRunningTime="2026-05-25 14:15:22.971140244 +0000 UTC m=+177.178387429" May 25 14:15:24.526621 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.526572 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-4n8ft"] May 25 14:15:24.562917 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.562818 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-4n8ft"] May 25 14:15:24.562917 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.562860 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qpc4t"] May 25 14:15:24.563671 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.563461 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4n8ft" May 25 14:15:24.566515 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.566463 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" May 25 14:15:24.568632 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.568612 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" May 25 14:15:24.569114 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.568871 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" May 25 14:15:24.569114 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.569102 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-56nmw\"" May 25 14:15:24.588507 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.588478 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qpc4t" May 25 14:15:24.592533 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.592497 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 25 14:15:24.592738 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.592586 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-s2lf7\"" May 25 14:15:24.592738 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.592498 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 25 14:15:24.592917 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.592900 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 25 14:15:24.701410 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.701345 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfz67\" (UniqueName: \"kubernetes.io/projected/fa1d118f-539c-4f71-b704-1f7e734e8882-kube-api-access-tfz67\") pod \"kube-state-metrics-54fd6bc5c4-4n8ft\" (UID: \"fa1d118f-539c-4f71-b704-1f7e734e8882\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4n8ft" May 25 14:15:24.701593 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.701479 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa1d118f-539c-4f71-b704-1f7e734e8882-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-4n8ft\" (UID: \"fa1d118f-539c-4f71-b704-1f7e734e8882\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4n8ft" May 25 14:15:24.701593 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.701533 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4336480c-183b-42b7-9e54-4f835abaf49b-node-exporter-wtmp\") pod \"node-exporter-qpc4t\" (UID: \"4336480c-183b-42b7-9e54-4f835abaf49b\") " pod="openshift-monitoring/node-exporter-qpc4t" May 25 14:15:24.701593 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.701571 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4336480c-183b-42b7-9e54-4f835abaf49b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qpc4t\" (UID: \"4336480c-183b-42b7-9e54-4f835abaf49b\") " pod="openshift-monitoring/node-exporter-qpc4t" May 25 14:15:24.701803 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.701604 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fa1d118f-539c-4f71-b704-1f7e734e8882-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-4n8ft\" (UID: \"fa1d118f-539c-4f71-b704-1f7e734e8882\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4n8ft" May 25 14:15:24.701803 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.701634 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fa1d118f-539c-4f71-b704-1f7e734e8882-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-4n8ft\" (UID: \"fa1d118f-539c-4f71-b704-1f7e734e8882\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4n8ft" May 25 14:15:24.701803 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.701658 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4336480c-183b-42b7-9e54-4f835abaf49b-metrics-client-ca\") pod \"node-exporter-qpc4t\" (UID: \"4336480c-183b-42b7-9e54-4f835abaf49b\") " pod="openshift-monitoring/node-exporter-qpc4t" May 25 14:15:24.701803 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.701689 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4336480c-183b-42b7-9e54-4f835abaf49b-node-exporter-accelerators-collector-config\") pod \"node-exporter-qpc4t\" (UID: \"4336480c-183b-42b7-9e54-4f835abaf49b\") " pod="openshift-monitoring/node-exporter-qpc4t" May 25 14:15:24.701803 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.701736 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2d4k\" (UniqueName: \"kubernetes.io/projected/4336480c-183b-42b7-9e54-4f835abaf49b-kube-api-access-n2d4k\") pod \"node-exporter-qpc4t\" (UID: \"4336480c-183b-42b7-9e54-4f835abaf49b\") " pod="openshift-monitoring/node-exporter-qpc4t" May 25 14:15:24.701803 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.701761 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4336480c-183b-42b7-9e54-4f835abaf49b-sys\") pod \"node-exporter-qpc4t\" (UID: \"4336480c-183b-42b7-9e54-4f835abaf49b\") " pod="openshift-monitoring/node-exporter-qpc4t" May 25 14:15:24.702094 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.701818 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa1d118f-539c-4f71-b704-1f7e734e8882-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-4n8ft\" (UID: \"fa1d118f-539c-4f71-b704-1f7e734e8882\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4n8ft" May 25 14:15:24.702094 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.701866 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4336480c-183b-42b7-9e54-4f835abaf49b-node-exporter-textfile\") pod \"node-exporter-qpc4t\" (UID: \"4336480c-183b-42b7-9e54-4f835abaf49b\") " pod="openshift-monitoring/node-exporter-qpc4t" May 25 14:15:24.702094 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.701893 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4336480c-183b-42b7-9e54-4f835abaf49b-root\") pod \"node-exporter-qpc4t\" (UID: \"4336480c-183b-42b7-9e54-4f835abaf49b\") " pod="openshift-monitoring/node-exporter-qpc4t" May 25 14:15:24.702094 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.701920 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fa1d118f-539c-4f71-b704-1f7e734e8882-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-4n8ft\" (UID: \"fa1d118f-539c-4f71-b704-1f7e734e8882\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4n8ft" May 25 14:15:24.702094 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.701960 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4336480c-183b-42b7-9e54-4f835abaf49b-node-exporter-tls\") pod \"node-exporter-qpc4t\" (UID: \"4336480c-183b-42b7-9e54-4f835abaf49b\") " pod="openshift-monitoring/node-exporter-qpc4t" May 25 14:15:24.802494 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.802405 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4336480c-183b-42b7-9e54-4f835abaf49b-node-exporter-accelerators-collector-config\") pod \"node-exporter-qpc4t\" (UID: \"4336480c-183b-42b7-9e54-4f835abaf49b\") " pod="openshift-monitoring/node-exporter-qpc4t" May 25 14:15:24.802494 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.802474 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n2d4k\" (UniqueName: \"kubernetes.io/projected/4336480c-183b-42b7-9e54-4f835abaf49b-kube-api-access-n2d4k\") pod \"node-exporter-qpc4t\" (UID: \"4336480c-183b-42b7-9e54-4f835abaf49b\") " pod="openshift-monitoring/node-exporter-qpc4t" May 25 14:15:24.802746 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.802504 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4336480c-183b-42b7-9e54-4f835abaf49b-sys\") pod \"node-exporter-qpc4t\" (UID: \"4336480c-183b-42b7-9e54-4f835abaf49b\") " pod="openshift-monitoring/node-exporter-qpc4t" May 25 14:15:24.802746 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.802553 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa1d118f-539c-4f71-b704-1f7e734e8882-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-4n8ft\" (UID: \"fa1d118f-539c-4f71-b704-1f7e734e8882\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4n8ft" May 25 14:15:24.802746 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.802581 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4336480c-183b-42b7-9e54-4f835abaf49b-node-exporter-textfile\") pod \"node-exporter-qpc4t\" (UID: \"4336480c-183b-42b7-9e54-4f835abaf49b\") " pod="openshift-monitoring/node-exporter-qpc4t" May 25 14:15:24.802746 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.802606 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4336480c-183b-42b7-9e54-4f835abaf49b-root\") pod \"node-exporter-qpc4t\" (UID: \"4336480c-183b-42b7-9e54-4f835abaf49b\") " pod="openshift-monitoring/node-exporter-qpc4t" May 25 14:15:24.802746 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.802634 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fa1d118f-539c-4f71-b704-1f7e734e8882-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-4n8ft\" (UID: \"fa1d118f-539c-4f71-b704-1f7e734e8882\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4n8ft" May 25 14:15:24.802746 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.802673 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4336480c-183b-42b7-9e54-4f835abaf49b-node-exporter-tls\") pod \"node-exporter-qpc4t\" (UID: \"4336480c-183b-42b7-9e54-4f835abaf49b\") " pod="openshift-monitoring/node-exporter-qpc4t" May 25 14:15:24.802746 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.802705 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tfz67\" (UniqueName: \"kubernetes.io/projected/fa1d118f-539c-4f71-b704-1f7e734e8882-kube-api-access-tfz67\") pod \"kube-state-metrics-54fd6bc5c4-4n8ft\" (UID: \"fa1d118f-539c-4f71-b704-1f7e734e8882\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4n8ft" May 25 14:15:24.802746 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.802735 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa1d118f-539c-4f71-b704-1f7e734e8882-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-4n8ft\" (UID: \"fa1d118f-539c-4f71-b704-1f7e734e8882\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4n8ft" May 25 14:15:24.803137 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.802774 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4336480c-183b-42b7-9e54-4f835abaf49b-node-exporter-wtmp\") pod \"node-exporter-qpc4t\" (UID: \"4336480c-183b-42b7-9e54-4f835abaf49b\") " pod="openshift-monitoring/node-exporter-qpc4t" May 25 14:15:24.803137 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.802802 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4336480c-183b-42b7-9e54-4f835abaf49b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qpc4t\" (UID: \"4336480c-183b-42b7-9e54-4f835abaf49b\") " pod="openshift-monitoring/node-exporter-qpc4t" May 25 14:15:24.803137 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.802835 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fa1d118f-539c-4f71-b704-1f7e734e8882-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-4n8ft\" (UID: \"fa1d118f-539c-4f71-b704-1f7e734e8882\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4n8ft" May 25 14:15:24.803137 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.802863 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fa1d118f-539c-4f71-b704-1f7e734e8882-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-4n8ft\" (UID: \"fa1d118f-539c-4f71-b704-1f7e734e8882\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4n8ft" May 25 14:15:24.803137 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.802890 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4336480c-183b-42b7-9e54-4f835abaf49b-metrics-client-ca\") pod \"node-exporter-qpc4t\" (UID: \"4336480c-183b-42b7-9e54-4f835abaf49b\") " pod="openshift-monitoring/node-exporter-qpc4t" May 25 14:15:24.803365 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.803228 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fa1d118f-539c-4f71-b704-1f7e734e8882-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-4n8ft\" (UID: \"fa1d118f-539c-4f71-b704-1f7e734e8882\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4n8ft" May 25 14:15:24.803365 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.803298 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4336480c-183b-42b7-9e54-4f835abaf49b-sys\") pod \"node-exporter-qpc4t\" (UID: \"4336480c-183b-42b7-9e54-4f835abaf49b\") " pod="openshift-monitoring/node-exporter-qpc4t" May 25 14:15:24.803510 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.803477 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4336480c-183b-42b7-9e54-4f835abaf49b-metrics-client-ca\") pod \"node-exporter-qpc4t\" (UID: \"4336480c-183b-42b7-9e54-4f835abaf49b\") " pod="openshift-monitoring/node-exporter-qpc4t" May 25 14:15:24.803612 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:15:24.803591 2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found May 25 14:15:24.803743 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:15:24.803648 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4336480c-183b-42b7-9e54-4f835abaf49b-node-exporter-tls podName:4336480c-183b-42b7-9e54-4f835abaf49b nodeName:}" failed. No retries permitted until 2026-05-25 14:15:25.303630964 +0000 UTC m=+179.510878135 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/4336480c-183b-42b7-9e54-4f835abaf49b-node-exporter-tls") pod "node-exporter-qpc4t" (UID: "4336480c-183b-42b7-9e54-4f835abaf49b") : secret "node-exporter-tls" not found May 25 14:15:24.803930 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.803904 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa1d118f-539c-4f71-b704-1f7e734e8882-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-4n8ft\" (UID: \"fa1d118f-539c-4f71-b704-1f7e734e8882\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4n8ft" May 25 14:15:24.804077 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:15:24.804059 2562 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found May 25 14:15:24.804220 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.804198 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4336480c-183b-42b7-9e54-4f835abaf49b-root\") pod \"node-exporter-qpc4t\" (UID: \"4336480c-183b-42b7-9e54-4f835abaf49b\") " pod="openshift-monitoring/node-exporter-qpc4t" May 25 14:15:24.804304 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:15:24.804294 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa1d118f-539c-4f71-b704-1f7e734e8882-kube-state-metrics-tls podName:fa1d118f-539c-4f71-b704-1f7e734e8882 nodeName:}" failed. No retries permitted until 2026-05-25 14:15:25.304204745 +0000 UTC m=+179.511451922 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/fa1d118f-539c-4f71-b704-1f7e734e8882-kube-state-metrics-tls") pod "kube-state-metrics-54fd6bc5c4-4n8ft" (UID: "fa1d118f-539c-4f71-b704-1f7e734e8882") : secret "kube-state-metrics-tls" not found May 25 14:15:24.804710 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.804154 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4336480c-183b-42b7-9e54-4f835abaf49b-node-exporter-textfile\") pod \"node-exporter-qpc4t\" (UID: \"4336480c-183b-42b7-9e54-4f835abaf49b\") " pod="openshift-monitoring/node-exporter-qpc4t" May 25 14:15:24.804710 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.804682 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4336480c-183b-42b7-9e54-4f835abaf49b-node-exporter-wtmp\") pod \"node-exporter-qpc4t\" (UID: \"4336480c-183b-42b7-9e54-4f835abaf49b\") " pod="openshift-monitoring/node-exporter-qpc4t" May 25 14:15:24.805445 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.805422 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fa1d118f-539c-4f71-b704-1f7e734e8882-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-4n8ft\" (UID: \"fa1d118f-539c-4f71-b704-1f7e734e8882\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4n8ft" May 25 14:15:24.805659 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.805438 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4336480c-183b-42b7-9e54-4f835abaf49b-node-exporter-accelerators-collector-config\") pod \"node-exporter-qpc4t\" (UID: \"4336480c-183b-42b7-9e54-4f835abaf49b\") " pod="openshift-monitoring/node-exporter-qpc4t" May 25 14:15:24.808798 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.808779 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4336480c-183b-42b7-9e54-4f835abaf49b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qpc4t\" (UID: \"4336480c-183b-42b7-9e54-4f835abaf49b\") " pod="openshift-monitoring/node-exporter-qpc4t" May 25 14:15:24.824020 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.823989 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2d4k\" (UniqueName: \"kubernetes.io/projected/4336480c-183b-42b7-9e54-4f835abaf49b-kube-api-access-n2d4k\") pod \"node-exporter-qpc4t\" (UID: \"4336480c-183b-42b7-9e54-4f835abaf49b\") " pod="openshift-monitoring/node-exporter-qpc4t" May 25 14:15:24.824219 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.824165 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfz67\" (UniqueName: \"kubernetes.io/projected/fa1d118f-539c-4f71-b704-1f7e734e8882-kube-api-access-tfz67\") pod \"kube-state-metrics-54fd6bc5c4-4n8ft\" (UID: \"fa1d118f-539c-4f71-b704-1f7e734e8882\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4n8ft" May 25 14:15:24.825495 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:24.825444 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fa1d118f-539c-4f71-b704-1f7e734e8882-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-4n8ft\" (UID: \"fa1d118f-539c-4f71-b704-1f7e734e8882\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4n8ft" May 25 14:15:25.309265 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.309222 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4336480c-183b-42b7-9e54-4f835abaf49b-node-exporter-tls\") pod \"node-exporter-qpc4t\" (UID: \"4336480c-183b-42b7-9e54-4f835abaf49b\") " pod="openshift-monitoring/node-exporter-qpc4t" May 25 14:15:25.309496 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.309288 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa1d118f-539c-4f71-b704-1f7e734e8882-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-4n8ft\" (UID: \"fa1d118f-539c-4f71-b704-1f7e734e8882\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4n8ft" May 25 14:15:25.312326 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.312294 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4336480c-183b-42b7-9e54-4f835abaf49b-node-exporter-tls\") pod \"node-exporter-qpc4t\" (UID: \"4336480c-183b-42b7-9e54-4f835abaf49b\") " pod="openshift-monitoring/node-exporter-qpc4t" May 25 14:15:25.312491 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.312428 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa1d118f-539c-4f71-b704-1f7e734e8882-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-4n8ft\" (UID: \"fa1d118f-539c-4f71-b704-1f7e734e8882\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4n8ft" May 25 14:15:25.477900 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.477865 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4n8ft" May 25 14:15:25.502586 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.502555 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qpc4t" May 25 14:15:25.602532 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.598728 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 25 14:15:25.652582 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.652477 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 25 14:15:25.652788 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.652678 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 25 14:15:25.656310 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.656283 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 25 14:15:25.657794 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.657271 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 25 14:15:25.657794 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.657282 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 25 14:15:25.657794 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.657355 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 25 14:15:25.657794 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.657271 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 25 14:15:25.657794 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.657424 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ngsb2\"" May 25 14:15:25.657794 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.657617 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 25 14:15:25.658078 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.657839 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 25 14:15:25.658685 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.658511 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 25 14:15:25.658685 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.658594 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 25 14:15:25.714837 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.714797 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ec0bdee-59a1-4438-b994-0e63c1dc8049-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:15:25.715049 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.714859 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ec0bdee-59a1-4438-b994-0e63c1dc8049-config-out\") pod \"alertmanager-main-0\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:15:25.715049 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.714958 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ec0bdee-59a1-4438-b994-0e63c1dc8049-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:15:25.715049 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.715005 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0ec0bdee-59a1-4438-b994-0e63c1dc8049-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:15:25.715049 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.715038 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0ec0bdee-59a1-4438-b994-0e63c1dc8049-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:15:25.715265 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.715062 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ec0bdee-59a1-4438-b994-0e63c1dc8049-web-config\") pod \"alertmanager-main-0\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:15:25.715265 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.715093 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0ec0bdee-59a1-4438-b994-0e63c1dc8049-config-volume\") pod \"alertmanager-main-0\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:15:25.715265 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.715182 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sp5zs\" (UniqueName: \"kubernetes.io/projected/0ec0bdee-59a1-4438-b994-0e63c1dc8049-kube-api-access-sp5zs\") pod \"alertmanager-main-0\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:15:25.715265 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.715232 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ec0bdee-59a1-4438-b994-0e63c1dc8049-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:15:25.715265 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.715250 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0ec0bdee-59a1-4438-b994-0e63c1dc8049-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:15:25.715533 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.715284 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ec0bdee-59a1-4438-b994-0e63c1dc8049-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:15:25.715533 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.715332 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ec0bdee-59a1-4438-b994-0e63c1dc8049-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:15:25.715533 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.715434 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0ec0bdee-59a1-4438-b994-0e63c1dc8049-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:15:25.738188 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.738137 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-4n8ft"] May 25 14:15:25.741815 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:15:25.741751 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa1d118f_539c_4f71_b704_1f7e734e8882.slice/crio-8ac04032bbdc7f07f00cd19a94ad44d109c94395a4c6521702de22e5faeb732c WatchSource:0}: Error finding container 8ac04032bbdc7f07f00cd19a94ad44d109c94395a4c6521702de22e5faeb732c: Status 404 returned error can't find the container with id 8ac04032bbdc7f07f00cd19a94ad44d109c94395a4c6521702de22e5faeb732c May 25 14:15:25.816221 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.816172 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0ec0bdee-59a1-4438-b994-0e63c1dc8049-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:15:25.816450 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.816253 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ec0bdee-59a1-4438-b994-0e63c1dc8049-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:15:25.816450 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.816298 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ec0bdee-59a1-4438-b994-0e63c1dc8049-config-out\") pod \"alertmanager-main-0\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:15:25.816450 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.816351 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ec0bdee-59a1-4438-b994-0e63c1dc8049-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:15:25.816450 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.816395 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0ec0bdee-59a1-4438-b994-0e63c1dc8049-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:15:25.816696 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.816529 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0ec0bdee-59a1-4438-b994-0e63c1dc8049-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:15:25.816696 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.816578 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ec0bdee-59a1-4438-b994-0e63c1dc8049-web-config\") pod \"alertmanager-main-0\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:15:25.816696 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.816615 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0ec0bdee-59a1-4438-b994-0e63c1dc8049-config-volume\") pod \"alertmanager-main-0\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:15:25.816696 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.816648 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sp5zs\" (UniqueName: \"kubernetes.io/projected/0ec0bdee-59a1-4438-b994-0e63c1dc8049-kube-api-access-sp5zs\") pod \"alertmanager-main-0\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:15:25.816895 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.816706 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ec0bdee-59a1-4438-b994-0e63c1dc8049-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:15:25.816895 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.816734 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0ec0bdee-59a1-4438-b994-0e63c1dc8049-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:15:25.816895 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.816757 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ec0bdee-59a1-4438-b994-0e63c1dc8049-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:15:25.816895 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.816783 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ec0bdee-59a1-4438-b994-0e63c1dc8049-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:15:25.818144 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.818115 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ec0bdee-59a1-4438-b994-0e63c1dc8049-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:15:25.819901 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.819836 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ec0bdee-59a1-4438-b994-0e63c1dc8049-web-config\") pod \"alertmanager-main-0\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:15:25.819901 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.819836 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ec0bdee-59a1-4438-b994-0e63c1dc8049-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:15:25.820080 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.819978 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0ec0bdee-59a1-4438-b994-0e63c1dc8049-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:15:25.821129 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.820964 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0ec0bdee-59a1-4438-b994-0e63c1dc8049-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:15:25.822051 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.822025 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ec0bdee-59a1-4438-b994-0e63c1dc8049-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:15:25.823201 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.822827 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0ec0bdee-59a1-4438-b994-0e63c1dc8049-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:15:25.823302 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.823195 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ec0bdee-59a1-4438-b994-0e63c1dc8049-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:15:25.824251 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.824232 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0ec0bdee-59a1-4438-b994-0e63c1dc8049-config-volume\") pod \"alertmanager-main-0\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:15:25.828133 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.827919 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0ec0bdee-59a1-4438-b994-0e63c1dc8049-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:15:25.828133 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.828010 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ec0bdee-59a1-4438-b994-0e63c1dc8049-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:15:25.828133 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.828142 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sp5zs\" (UniqueName: \"kubernetes.io/projected/0ec0bdee-59a1-4438-b994-0e63c1dc8049-kube-api-access-sp5zs\") pod \"alertmanager-main-0\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:15:25.829386 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.829352 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ec0bdee-59a1-4438-b994-0e63c1dc8049-config-out\") pod \"alertmanager-main-0\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:15:25.961425 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.961311 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qpc4t" event={"ID":"4336480c-183b-42b7-9e54-4f835abaf49b","Type":"ContainerStarted","Data":"6bd7d297e824bc4d4be9ed81516cb1ee3f046f2a719656995a663feb0ef7fd0d"} May 25 14:15:25.962619 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.962590 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4n8ft" event={"ID":"fa1d118f-539c-4f71-b704-1f7e734e8882","Type":"ContainerStarted","Data":"8ac04032bbdc7f07f00cd19a94ad44d109c94395a4c6521702de22e5faeb732c"} May 25 14:15:25.968991 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:25.968962 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 25 14:15:26.155011 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:26.154974 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 25 14:15:26.159582 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:15:26.159550 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ec0bdee_59a1_4438_b994_0e63c1dc8049.slice/crio-211b8e6e63248cfa1ec59cbab6be862e04177c6fcff9190ed4d93bc3f0f5d541 WatchSource:0}: Error finding container 211b8e6e63248cfa1ec59cbab6be862e04177c6fcff9190ed4d93bc3f0f5d541: Status 404 returned error can't find the container with id 211b8e6e63248cfa1ec59cbab6be862e04177c6fcff9190ed4d93bc3f0f5d541 May 25 14:15:26.672541 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:26.671235 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-79bc96554b-nnrtp"] May 25 14:15:26.717344 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:26.714668 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-79bc96554b-nnrtp"] May 25 14:15:26.717344 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:26.714868 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-79bc96554b-nnrtp" May 25 14:15:26.733169 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:26.733042 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" May 25 14:15:26.733169 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:26.733087 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" May 25 14:15:26.733660 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:26.733390 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" May 25 14:15:26.733660 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:26.733453 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" May 25 14:15:26.733777 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:26.733759 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-tpf7l\"" May 25 14:15:26.733835 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:26.733783 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-f9c2j1rdvufg4\"" May 25 14:15:26.733969 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:26.733953 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" May 25 14:15:26.825687 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:26.825634 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a9a3016-87ae-46ea-b4de-8f038167f4ea-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-79bc96554b-nnrtp\" (UID: \"1a9a3016-87ae-46ea-b4de-8f038167f4ea\") " pod="openshift-monitoring/thanos-querier-79bc96554b-nnrtp" May 25 14:15:26.825859 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:26.825691 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1a9a3016-87ae-46ea-b4de-8f038167f4ea-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-79bc96554b-nnrtp\" (UID: \"1a9a3016-87ae-46ea-b4de-8f038167f4ea\") " pod="openshift-monitoring/thanos-querier-79bc96554b-nnrtp" May 25 14:15:26.825859 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:26.825758 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1a9a3016-87ae-46ea-b4de-8f038167f4ea-secret-grpc-tls\") pod \"thanos-querier-79bc96554b-nnrtp\" (UID: \"1a9a3016-87ae-46ea-b4de-8f038167f4ea\") " pod="openshift-monitoring/thanos-querier-79bc96554b-nnrtp" May 25 14:15:26.825859 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:26.825791 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1a9a3016-87ae-46ea-b4de-8f038167f4ea-secret-thanos-querier-tls\") pod \"thanos-querier-79bc96554b-nnrtp\" (UID: \"1a9a3016-87ae-46ea-b4de-8f038167f4ea\") " pod="openshift-monitoring/thanos-querier-79bc96554b-nnrtp" May 25 14:15:26.826008 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:26.825889 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a9a3016-87ae-46ea-b4de-8f038167f4ea-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-79bc96554b-nnrtp\" (UID: \"1a9a3016-87ae-46ea-b4de-8f038167f4ea\") " pod="openshift-monitoring/thanos-querier-79bc96554b-nnrtp" May 25 14:15:26.826008 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:26.825924 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1a9a3016-87ae-46ea-b4de-8f038167f4ea-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-79bc96554b-nnrtp\" (UID: \"1a9a3016-87ae-46ea-b4de-8f038167f4ea\") " pod="openshift-monitoring/thanos-querier-79bc96554b-nnrtp" May 25 14:15:26.826008 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:26.825999 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a9a3016-87ae-46ea-b4de-8f038167f4ea-metrics-client-ca\") pod \"thanos-querier-79bc96554b-nnrtp\" (UID: \"1a9a3016-87ae-46ea-b4de-8f038167f4ea\") " pod="openshift-monitoring/thanos-querier-79bc96554b-nnrtp" May 25 14:15:26.826132 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:26.826037 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq42b\" (UniqueName: \"kubernetes.io/projected/1a9a3016-87ae-46ea-b4de-8f038167f4ea-kube-api-access-jq42b\") pod \"thanos-querier-79bc96554b-nnrtp\" (UID: \"1a9a3016-87ae-46ea-b4de-8f038167f4ea\") " pod="openshift-monitoring/thanos-querier-79bc96554b-nnrtp" May 25 14:15:26.927036 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:26.926948 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a9a3016-87ae-46ea-b4de-8f038167f4ea-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-79bc96554b-nnrtp\" (UID: \"1a9a3016-87ae-46ea-b4de-8f038167f4ea\") " pod="openshift-monitoring/thanos-querier-79bc96554b-nnrtp" May 25 14:15:26.927036 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:26.926997 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1a9a3016-87ae-46ea-b4de-8f038167f4ea-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-79bc96554b-nnrtp\" (UID: \"1a9a3016-87ae-46ea-b4de-8f038167f4ea\") " pod="openshift-monitoring/thanos-querier-79bc96554b-nnrtp" May 25 14:15:26.927249 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:26.927060 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a9a3016-87ae-46ea-b4de-8f038167f4ea-metrics-client-ca\") pod \"thanos-querier-79bc96554b-nnrtp\" (UID: \"1a9a3016-87ae-46ea-b4de-8f038167f4ea\") " pod="openshift-monitoring/thanos-querier-79bc96554b-nnrtp" May 25 14:15:26.927249 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:26.927094 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jq42b\" (UniqueName: \"kubernetes.io/projected/1a9a3016-87ae-46ea-b4de-8f038167f4ea-kube-api-access-jq42b\") pod \"thanos-querier-79bc96554b-nnrtp\" (UID: \"1a9a3016-87ae-46ea-b4de-8f038167f4ea\") " pod="openshift-monitoring/thanos-querier-79bc96554b-nnrtp" May 25 14:15:26.927249 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:26.927140 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a9a3016-87ae-46ea-b4de-8f038167f4ea-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-79bc96554b-nnrtp\" (UID: \"1a9a3016-87ae-46ea-b4de-8f038167f4ea\") " pod="openshift-monitoring/thanos-querier-79bc96554b-nnrtp" May 25 14:15:26.927249 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:26.927162 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1a9a3016-87ae-46ea-b4de-8f038167f4ea-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-79bc96554b-nnrtp\" (UID: \"1a9a3016-87ae-46ea-b4de-8f038167f4ea\") " pod="openshift-monitoring/thanos-querier-79bc96554b-nnrtp" May 25 14:15:26.927249 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:26.927202 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1a9a3016-87ae-46ea-b4de-8f038167f4ea-secret-grpc-tls\") pod \"thanos-querier-79bc96554b-nnrtp\" (UID: \"1a9a3016-87ae-46ea-b4de-8f038167f4ea\") " pod="openshift-monitoring/thanos-querier-79bc96554b-nnrtp" May 25 14:15:26.927249 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:26.927225 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1a9a3016-87ae-46ea-b4de-8f038167f4ea-secret-thanos-querier-tls\") pod \"thanos-querier-79bc96554b-nnrtp\" (UID: \"1a9a3016-87ae-46ea-b4de-8f038167f4ea\") " pod="openshift-monitoring/thanos-querier-79bc96554b-nnrtp" May 25 14:15:26.930240 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:26.929835 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a9a3016-87ae-46ea-b4de-8f038167f4ea-metrics-client-ca\") pod \"thanos-querier-79bc96554b-nnrtp\" (UID: \"1a9a3016-87ae-46ea-b4de-8f038167f4ea\") " pod="openshift-monitoring/thanos-querier-79bc96554b-nnrtp" May 25 14:15:26.930777 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:26.930749 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1a9a3016-87ae-46ea-b4de-8f038167f4ea-secret-thanos-querier-tls\") pod \"thanos-querier-79bc96554b-nnrtp\" (UID: \"1a9a3016-87ae-46ea-b4de-8f038167f4ea\") " pod="openshift-monitoring/thanos-querier-79bc96554b-nnrtp" May 25 14:15:26.932486 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:26.932458 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a9a3016-87ae-46ea-b4de-8f038167f4ea-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-79bc96554b-nnrtp\" (UID: \"1a9a3016-87ae-46ea-b4de-8f038167f4ea\") " pod="openshift-monitoring/thanos-querier-79bc96554b-nnrtp" May 25 14:15:26.932752 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:26.932729 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1a9a3016-87ae-46ea-b4de-8f038167f4ea-secret-grpc-tls\") pod \"thanos-querier-79bc96554b-nnrtp\" (UID: \"1a9a3016-87ae-46ea-b4de-8f038167f4ea\") " pod="openshift-monitoring/thanos-querier-79bc96554b-nnrtp" May 25 14:15:26.933740 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:26.933691 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1a9a3016-87ae-46ea-b4de-8f038167f4ea-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-79bc96554b-nnrtp\" (UID: \"1a9a3016-87ae-46ea-b4de-8f038167f4ea\") " pod="openshift-monitoring/thanos-querier-79bc96554b-nnrtp" May 25 14:15:26.935416 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:26.935363 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1a9a3016-87ae-46ea-b4de-8f038167f4ea-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-79bc96554b-nnrtp\" (UID: \"1a9a3016-87ae-46ea-b4de-8f038167f4ea\") " pod="openshift-monitoring/thanos-querier-79bc96554b-nnrtp" May 25 14:15:26.935603 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:26.935583 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a9a3016-87ae-46ea-b4de-8f038167f4ea-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-79bc96554b-nnrtp\" (UID: \"1a9a3016-87ae-46ea-b4de-8f038167f4ea\") " pod="openshift-monitoring/thanos-querier-79bc96554b-nnrtp" May 25 14:15:26.949585 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:26.949556 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq42b\" (UniqueName: \"kubernetes.io/projected/1a9a3016-87ae-46ea-b4de-8f038167f4ea-kube-api-access-jq42b\") pod \"thanos-querier-79bc96554b-nnrtp\" (UID: \"1a9a3016-87ae-46ea-b4de-8f038167f4ea\") " pod="openshift-monitoring/thanos-querier-79bc96554b-nnrtp" May 25 14:15:26.968220 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:26.968178 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ec0bdee-59a1-4438-b994-0e63c1dc8049","Type":"ContainerStarted","Data":"211b8e6e63248cfa1ec59cbab6be862e04177c6fcff9190ed4d93bc3f0f5d541"} May 25 14:15:27.030847 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:27.030780 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-79bc96554b-nnrtp" May 25 14:15:28.003499 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.003460 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-79bc96554b-nnrtp"] May 25 14:15:28.006429 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:15:28.006401 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a9a3016_87ae_46ea_b4de_8f038167f4ea.slice/crio-2e4d4a5d34b7f9833d59665ec32e1adc773010de7ba5e6a4830ebdab106fb3ac WatchSource:0}: Error finding container 2e4d4a5d34b7f9833d59665ec32e1adc773010de7ba5e6a4830ebdab106fb3ac: Status 404 returned error can't find the container with id 2e4d4a5d34b7f9833d59665ec32e1adc773010de7ba5e6a4830ebdab106fb3ac May 25 14:15:28.040787 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.040745 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-8456cd4ddc-kksfv" podUID="94f8408d-e962-47e4-a6df-db75d8d04164" containerName="registry" containerID="cri-o://f5e050203d625ff1d62ef8e5065eb7c33d3a3ad3b659da7d404f10bea9d301fe" gracePeriod=30 May 25 14:15:28.712125 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.712100 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8456cd4ddc-kksfv" May 25 14:15:28.847225 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.847188 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/94f8408d-e962-47e4-a6df-db75d8d04164-registry-tls\") pod \"94f8408d-e962-47e4-a6df-db75d8d04164\" (UID: \"94f8408d-e962-47e4-a6df-db75d8d04164\") " May 25 14:15:28.847419 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.847272 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/94f8408d-e962-47e4-a6df-db75d8d04164-installation-pull-secrets\") pod \"94f8408d-e962-47e4-a6df-db75d8d04164\" (UID: \"94f8408d-e962-47e4-a6df-db75d8d04164\") " May 25 14:15:28.847419 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.847298 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7xw8\" (UniqueName: \"kubernetes.io/projected/94f8408d-e962-47e4-a6df-db75d8d04164-kube-api-access-z7xw8\") pod \"94f8408d-e962-47e4-a6df-db75d8d04164\" (UID: \"94f8408d-e962-47e4-a6df-db75d8d04164\") " May 25 14:15:28.847419 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.847342 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/94f8408d-e962-47e4-a6df-db75d8d04164-ca-trust-extracted\") pod \"94f8408d-e962-47e4-a6df-db75d8d04164\" (UID: \"94f8408d-e962-47e4-a6df-db75d8d04164\") " May 25 14:15:28.850221 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.850164 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94f8408d-e962-47e4-a6df-db75d8d04164-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "94f8408d-e962-47e4-a6df-db75d8d04164" (UID: "94f8408d-e962-47e4-a6df-db75d8d04164"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 14:15:28.850556 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.850505 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94f8408d-e962-47e4-a6df-db75d8d04164-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "94f8408d-e962-47e4-a6df-db75d8d04164" (UID: "94f8408d-e962-47e4-a6df-db75d8d04164"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 14:15:28.850556 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.850505 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94f8408d-e962-47e4-a6df-db75d8d04164-kube-api-access-z7xw8" (OuterVolumeSpecName: "kube-api-access-z7xw8") pod "94f8408d-e962-47e4-a6df-db75d8d04164" (UID: "94f8408d-e962-47e4-a6df-db75d8d04164"). InnerVolumeSpecName "kube-api-access-z7xw8". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 14:15:28.851508 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.851475 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/94f8408d-e962-47e4-a6df-db75d8d04164-bound-sa-token\") pod \"94f8408d-e962-47e4-a6df-db75d8d04164\" (UID: \"94f8408d-e962-47e4-a6df-db75d8d04164\") " May 25 14:15:28.851607 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.851565 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/94f8408d-e962-47e4-a6df-db75d8d04164-image-registry-private-configuration\") pod \"94f8408d-e962-47e4-a6df-db75d8d04164\" (UID: \"94f8408d-e962-47e4-a6df-db75d8d04164\") " May 25 14:15:28.851607 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.851595 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/94f8408d-e962-47e4-a6df-db75d8d04164-registry-certificates\") pod \"94f8408d-e962-47e4-a6df-db75d8d04164\" (UID: \"94f8408d-e962-47e4-a6df-db75d8d04164\") " May 25 14:15:28.851698 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.851639 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/94f8408d-e962-47e4-a6df-db75d8d04164-trusted-ca\") pod \"94f8408d-e962-47e4-a6df-db75d8d04164\" (UID: \"94f8408d-e962-47e4-a6df-db75d8d04164\") " May 25 14:15:28.851914 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.851889 2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/94f8408d-e962-47e4-a6df-db75d8d04164-registry-tls\") on node \"ip-10-0-140-29.ec2.internal\" DevicePath \"\"" May 25 14:15:28.851914 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.851913 2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/94f8408d-e962-47e4-a6df-db75d8d04164-installation-pull-secrets\") on node \"ip-10-0-140-29.ec2.internal\" DevicePath \"\"" May 25 14:15:28.852075 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.851928 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7xw8\" (UniqueName: \"kubernetes.io/projected/94f8408d-e962-47e4-a6df-db75d8d04164-kube-api-access-z7xw8\") on node \"ip-10-0-140-29.ec2.internal\" DevicePath \"\"" May 25 14:15:28.852337 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.852316 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94f8408d-e962-47e4-a6df-db75d8d04164-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "94f8408d-e962-47e4-a6df-db75d8d04164" (UID: "94f8408d-e962-47e4-a6df-db75d8d04164"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 14:15:28.852568 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.852528 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94f8408d-e962-47e4-a6df-db75d8d04164-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "94f8408d-e962-47e4-a6df-db75d8d04164" (UID: "94f8408d-e962-47e4-a6df-db75d8d04164"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 14:15:28.854793 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.854764 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94f8408d-e962-47e4-a6df-db75d8d04164-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "94f8408d-e962-47e4-a6df-db75d8d04164" (UID: "94f8408d-e962-47e4-a6df-db75d8d04164"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 14:15:28.855516 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.855361 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94f8408d-e962-47e4-a6df-db75d8d04164-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "94f8408d-e962-47e4-a6df-db75d8d04164" (UID: "94f8408d-e962-47e4-a6df-db75d8d04164"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 14:15:28.858911 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.858887 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94f8408d-e962-47e4-a6df-db75d8d04164-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "94f8408d-e962-47e4-a6df-db75d8d04164" (UID: "94f8408d-e962-47e4-a6df-db75d8d04164"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 25 14:15:28.929790 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.929750 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-66fb98b9d7-2nlzc"] May 25 14:15:28.930217 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.930192 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94f8408d-e962-47e4-a6df-db75d8d04164" containerName="registry" May 25 14:15:28.930217 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.930218 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="94f8408d-e962-47e4-a6df-db75d8d04164" containerName="registry" May 25 14:15:28.930471 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.930293 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="94f8408d-e962-47e4-a6df-db75d8d04164" containerName="registry" May 25 14:15:28.945279 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.945238 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-66fb98b9d7-2nlzc" May 25 14:15:28.950008 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.949976 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-66fb98b9d7-2nlzc"] May 25 14:15:28.953050 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.953026 2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/94f8408d-e962-47e4-a6df-db75d8d04164-bound-sa-token\") on node \"ip-10-0-140-29.ec2.internal\" DevicePath \"\"" May 25 14:15:28.953183 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.953057 2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/94f8408d-e962-47e4-a6df-db75d8d04164-image-registry-private-configuration\") on node \"ip-10-0-140-29.ec2.internal\" DevicePath \"\"" May 25 14:15:28.953183 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.953073 2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/94f8408d-e962-47e4-a6df-db75d8d04164-registry-certificates\") on node \"ip-10-0-140-29.ec2.internal\" DevicePath \"\"" May 25 14:15:28.953183 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.953089 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/94f8408d-e962-47e4-a6df-db75d8d04164-trusted-ca\") on node \"ip-10-0-140-29.ec2.internal\" DevicePath \"\"" May 25 14:15:28.953183 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.953103 2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/94f8408d-e962-47e4-a6df-db75d8d04164-ca-trust-extracted\") on node \"ip-10-0-140-29.ec2.internal\" DevicePath \"\"" May 25 14:15:28.954825 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.954801 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-b1q8d46hdu8v5\"" May 25 14:15:28.955575 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.955553 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" May 25 14:15:28.955675 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.955614 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" May 25 14:15:28.957997 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.957978 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" May 25 14:15:28.958579 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.958548 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 25 14:15:28.961917 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.961892 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-b7h7j\"" May 25 14:15:28.979068 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.978977 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79bc96554b-nnrtp" event={"ID":"1a9a3016-87ae-46ea-b4de-8f038167f4ea","Type":"ContainerStarted","Data":"2e4d4a5d34b7f9833d59665ec32e1adc773010de7ba5e6a4830ebdab106fb3ac"} May 25 14:15:28.980855 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.980818 2562 generic.go:358] "Generic (PLEG): container finished" podID="4336480c-183b-42b7-9e54-4f835abaf49b" containerID="680d7759bb882692eab1ef549d5763ae9e32cad6021d2621317efdeec205c5ec" exitCode=0 May 25 14:15:28.980999 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.980899 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qpc4t" event={"ID":"4336480c-183b-42b7-9e54-4f835abaf49b","Type":"ContainerDied","Data":"680d7759bb882692eab1ef549d5763ae9e32cad6021d2621317efdeec205c5ec"} May 25 14:15:28.982732 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.982598 2562 generic.go:358] "Generic (PLEG): container finished" podID="94f8408d-e962-47e4-a6df-db75d8d04164" containerID="f5e050203d625ff1d62ef8e5065eb7c33d3a3ad3b659da7d404f10bea9d301fe" exitCode=0 May 25 14:15:28.982732 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.982635 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8456cd4ddc-kksfv" event={"ID":"94f8408d-e962-47e4-a6df-db75d8d04164","Type":"ContainerDied","Data":"f5e050203d625ff1d62ef8e5065eb7c33d3a3ad3b659da7d404f10bea9d301fe"} May 25 14:15:28.982732 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.982670 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8456cd4ddc-kksfv" event={"ID":"94f8408d-e962-47e4-a6df-db75d8d04164","Type":"ContainerDied","Data":"3ef8d526a0fa0ef1e42d9bcedef7d1b8d939389edfbad3acdeb75f34f1a08dc2"} May 25 14:15:28.982732 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.982679 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8456cd4ddc-kksfv" May 25 14:15:28.982732 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.982691 2562 scope.go:117] "RemoveContainer" containerID="f5e050203d625ff1d62ef8e5065eb7c33d3a3ad3b659da7d404f10bea9d301fe" May 25 14:15:28.985924 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.985226 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4n8ft" event={"ID":"fa1d118f-539c-4f71-b704-1f7e734e8882","Type":"ContainerStarted","Data":"83fa0db1e9fb6f75ada069c76ab03d99bba853f82d8edd5bc22430a1df14266b"} May 25 14:15:28.985924 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.985262 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4n8ft" event={"ID":"fa1d118f-539c-4f71-b704-1f7e734e8882","Type":"ContainerStarted","Data":"cd2978ec05395fd2ad7da82ff52cf96f7630e320f410d576087008afaa17119a"} May 25 14:15:28.985924 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:28.985276 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4n8ft" event={"ID":"fa1d118f-539c-4f71-b704-1f7e734e8882","Type":"ContainerStarted","Data":"51205759dff48f7ff59f2af6213b4cc65d144521cee9d91694d64e8c17fdaacf"} May 25 14:15:29.000599 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:29.000501 2562 scope.go:117] "RemoveContainer" containerID="f5e050203d625ff1d62ef8e5065eb7c33d3a3ad3b659da7d404f10bea9d301fe" May 25 14:15:29.003235 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:15:29.003147 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5e050203d625ff1d62ef8e5065eb7c33d3a3ad3b659da7d404f10bea9d301fe\": container with ID starting with f5e050203d625ff1d62ef8e5065eb7c33d3a3ad3b659da7d404f10bea9d301fe not found: ID does not exist" containerID="f5e050203d625ff1d62ef8e5065eb7c33d3a3ad3b659da7d404f10bea9d301fe" May 25 14:15:29.003235 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:29.003188 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5e050203d625ff1d62ef8e5065eb7c33d3a3ad3b659da7d404f10bea9d301fe"} err="failed to get container status \"f5e050203d625ff1d62ef8e5065eb7c33d3a3ad3b659da7d404f10bea9d301fe\": rpc error: code = NotFound desc = could not find container \"f5e050203d625ff1d62ef8e5065eb7c33d3a3ad3b659da7d404f10bea9d301fe\": container with ID starting with f5e050203d625ff1d62ef8e5065eb7c33d3a3ad3b659da7d404f10bea9d301fe not found: ID does not exist" May 25 14:15:29.020155 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:29.020122 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8456cd4ddc-kksfv"] May 25 14:15:29.023945 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:29.023919 2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-8456cd4ddc-kksfv"] May 25 14:15:29.042232 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:29.042180 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-4n8ft" podStartSLOduration=2.976859007 podStartE2EDuration="5.042159437s" podCreationTimestamp="2026-05-25 14:15:24 +0000 UTC" firstStartedPulling="2026-05-25 14:15:25.747171291 +0000 UTC m=+179.954418461" lastFinishedPulling="2026-05-25 14:15:27.812471716 +0000 UTC m=+182.019718891" observedRunningTime="2026-05-25 14:15:29.040178948 +0000 UTC m=+183.247426133" watchObservedRunningTime="2026-05-25 14:15:29.042159437 +0000 UTC m=+183.249406623" May 25 14:15:29.053611 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:29.053574 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c5ef2618-3b13-401e-a133-b1b3113e2b39-secret-metrics-server-tls\") pod \"metrics-server-66fb98b9d7-2nlzc\" (UID: \"c5ef2618-3b13-401e-a133-b1b3113e2b39\") " pod="openshift-monitoring/metrics-server-66fb98b9d7-2nlzc" May 25 14:15:29.053805 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:29.053702 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c5ef2618-3b13-401e-a133-b1b3113e2b39-client-ca-bundle\") pod \"metrics-server-66fb98b9d7-2nlzc\" (UID: \"c5ef2618-3b13-401e-a133-b1b3113e2b39\") " pod="openshift-monitoring/metrics-server-66fb98b9d7-2nlzc" May 25 14:15:29.053805 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:29.053786 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c5ef2618-3b13-401e-a133-b1b3113e2b39-secret-metrics-server-client-certs\") pod \"metrics-server-66fb98b9d7-2nlzc\" (UID: \"c5ef2618-3b13-401e-a133-b1b3113e2b39\") " pod="openshift-monitoring/metrics-server-66fb98b9d7-2nlzc" May 25 14:15:29.053940 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:29.053849 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5ef2618-3b13-401e-a133-b1b3113e2b39-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-66fb98b9d7-2nlzc\" (UID: \"c5ef2618-3b13-401e-a133-b1b3113e2b39\") " pod="openshift-monitoring/metrics-server-66fb98b9d7-2nlzc" May 25 14:15:29.053940 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:29.053892 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c5ef2618-3b13-401e-a133-b1b3113e2b39-audit-log\") pod \"metrics-server-66fb98b9d7-2nlzc\" (UID: \"c5ef2618-3b13-401e-a133-b1b3113e2b39\") " pod="openshift-monitoring/metrics-server-66fb98b9d7-2nlzc" May 25 14:15:29.053940 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:29.053917 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cld6\" (UniqueName: \"kubernetes.io/projected/c5ef2618-3b13-401e-a133-b1b3113e2b39-kube-api-access-7cld6\") pod \"metrics-server-66fb98b9d7-2nlzc\" (UID: \"c5ef2618-3b13-401e-a133-b1b3113e2b39\") " pod="openshift-monitoring/metrics-server-66fb98b9d7-2nlzc" May 25 14:15:29.054088 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:29.054032 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c5ef2618-3b13-401e-a133-b1b3113e2b39-metrics-server-audit-profiles\") pod \"metrics-server-66fb98b9d7-2nlzc\" (UID: \"c5ef2618-3b13-401e-a133-b1b3113e2b39\") " pod="openshift-monitoring/metrics-server-66fb98b9d7-2nlzc" May 25 14:15:29.155005 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:29.154967 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c5ef2618-3b13-401e-a133-b1b3113e2b39-metrics-server-audit-profiles\") pod \"metrics-server-66fb98b9d7-2nlzc\" (UID: \"c5ef2618-3b13-401e-a133-b1b3113e2b39\") " pod="openshift-monitoring/metrics-server-66fb98b9d7-2nlzc" May 25 14:15:29.155161 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:29.155025 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c5ef2618-3b13-401e-a133-b1b3113e2b39-secret-metrics-server-tls\") pod \"metrics-server-66fb98b9d7-2nlzc\" (UID: \"c5ef2618-3b13-401e-a133-b1b3113e2b39\") " pod="openshift-monitoring/metrics-server-66fb98b9d7-2nlzc" May 25 14:15:29.155161 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:29.155051 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c5ef2618-3b13-401e-a133-b1b3113e2b39-client-ca-bundle\") pod \"metrics-server-66fb98b9d7-2nlzc\" (UID: \"c5ef2618-3b13-401e-a133-b1b3113e2b39\") " pod="openshift-monitoring/metrics-server-66fb98b9d7-2nlzc" May 25 14:15:29.157045 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:29.156058 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c5ef2618-3b13-401e-a133-b1b3113e2b39-metrics-server-audit-profiles\") pod \"metrics-server-66fb98b9d7-2nlzc\" (UID: \"c5ef2618-3b13-401e-a133-b1b3113e2b39\") " pod="openshift-monitoring/metrics-server-66fb98b9d7-2nlzc" May 25 14:15:29.157045 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:29.156225 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c5ef2618-3b13-401e-a133-b1b3113e2b39-secret-metrics-server-client-certs\") pod \"metrics-server-66fb98b9d7-2nlzc\" (UID: \"c5ef2618-3b13-401e-a133-b1b3113e2b39\") " pod="openshift-monitoring/metrics-server-66fb98b9d7-2nlzc" May 25 14:15:29.157045 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:29.156281 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5ef2618-3b13-401e-a133-b1b3113e2b39-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-66fb98b9d7-2nlzc\" (UID: \"c5ef2618-3b13-401e-a133-b1b3113e2b39\") " pod="openshift-monitoring/metrics-server-66fb98b9d7-2nlzc" May 25 14:15:29.157045 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:29.156312 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c5ef2618-3b13-401e-a133-b1b3113e2b39-audit-log\") pod \"metrics-server-66fb98b9d7-2nlzc\" (UID: \"c5ef2618-3b13-401e-a133-b1b3113e2b39\") " pod="openshift-monitoring/metrics-server-66fb98b9d7-2nlzc" May 25 14:15:29.157045 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:29.156338 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7cld6\" (UniqueName: \"kubernetes.io/projected/c5ef2618-3b13-401e-a133-b1b3113e2b39-kube-api-access-7cld6\") pod \"metrics-server-66fb98b9d7-2nlzc\" (UID: \"c5ef2618-3b13-401e-a133-b1b3113e2b39\") " pod="openshift-monitoring/metrics-server-66fb98b9d7-2nlzc" May 25 14:15:29.157045 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:29.156991 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c5ef2618-3b13-401e-a133-b1b3113e2b39-audit-log\") pod \"metrics-server-66fb98b9d7-2nlzc\" (UID: \"c5ef2618-3b13-401e-a133-b1b3113e2b39\") " pod="openshift-monitoring/metrics-server-66fb98b9d7-2nlzc" May 25 14:15:29.157045 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:29.157011 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5ef2618-3b13-401e-a133-b1b3113e2b39-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-66fb98b9d7-2nlzc\" (UID: \"c5ef2618-3b13-401e-a133-b1b3113e2b39\") " pod="openshift-monitoring/metrics-server-66fb98b9d7-2nlzc" May 25 14:15:29.159121 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:29.158996 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c5ef2618-3b13-401e-a133-b1b3113e2b39-secret-metrics-server-tls\") pod \"metrics-server-66fb98b9d7-2nlzc\" (UID: \"c5ef2618-3b13-401e-a133-b1b3113e2b39\") " pod="openshift-monitoring/metrics-server-66fb98b9d7-2nlzc" May 25 14:15:29.159470 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:29.159153 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c5ef2618-3b13-401e-a133-b1b3113e2b39-client-ca-bundle\") pod \"metrics-server-66fb98b9d7-2nlzc\" (UID: \"c5ef2618-3b13-401e-a133-b1b3113e2b39\") " pod="openshift-monitoring/metrics-server-66fb98b9d7-2nlzc" May 25 14:15:29.161684 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:29.161666 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c5ef2618-3b13-401e-a133-b1b3113e2b39-secret-metrics-server-client-certs\") pod \"metrics-server-66fb98b9d7-2nlzc\" (UID: \"c5ef2618-3b13-401e-a133-b1b3113e2b39\") " pod="openshift-monitoring/metrics-server-66fb98b9d7-2nlzc" May 25 14:15:29.167503 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:29.167470 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cld6\" (UniqueName: \"kubernetes.io/projected/c5ef2618-3b13-401e-a133-b1b3113e2b39-kube-api-access-7cld6\") pod \"metrics-server-66fb98b9d7-2nlzc\" (UID: \"c5ef2618-3b13-401e-a133-b1b3113e2b39\") " pod="openshift-monitoring/metrics-server-66fb98b9d7-2nlzc" May 25 14:15:29.254365 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:29.254330 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-qg57n"] May 25 14:15:29.257946 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:29.257921 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-66fb98b9d7-2nlzc" May 25 14:15:29.299038 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:29.299000 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-qg57n"] May 25 14:15:29.299181 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:29.299153 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-qg57n" May 25 14:15:29.305888 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:29.305859 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" May 25 14:15:29.306148 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:29.306129 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-tbvf2\"" May 25 14:15:29.454922 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:29.454861 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-66fb98b9d7-2nlzc"] May 25 14:15:29.458586 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:29.458503 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/27a0deb6-6d9d-48e8-8420-9e6756280059-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-qg57n\" (UID: \"27a0deb6-6d9d-48e8-8420-9e6756280059\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-qg57n" May 25 14:15:29.458717 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:15:29.458626 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5ef2618_3b13_401e_a133_b1b3113e2b39.slice/crio-3ee5dd6c4528a097be5ba8b384fb705d1d63d558ee9757b1678832450e59e89b WatchSource:0}: Error finding container 3ee5dd6c4528a097be5ba8b384fb705d1d63d558ee9757b1678832450e59e89b: Status 404 returned error can't find the container with id 3ee5dd6c4528a097be5ba8b384fb705d1d63d558ee9757b1678832450e59e89b May 25 14:15:29.559165 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:29.559122 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/27a0deb6-6d9d-48e8-8420-9e6756280059-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-qg57n\" (UID: \"27a0deb6-6d9d-48e8-8420-9e6756280059\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-qg57n" May 25 14:15:29.562726 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:29.562664 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/27a0deb6-6d9d-48e8-8420-9e6756280059-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-qg57n\" (UID: \"27a0deb6-6d9d-48e8-8420-9e6756280059\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-qg57n" May 25 14:15:29.620886 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:29.620767 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-qg57n" May 25 14:15:29.800583 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:29.800539 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-qg57n"] May 25 14:15:29.804769 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:15:29.804736 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27a0deb6_6d9d_48e8_8420_9e6756280059.slice/crio-c910c95fced1d04f97bdf17ae2d6ac6e62ab968751e9987a21612e8254286c89 WatchSource:0}: Error finding container c910c95fced1d04f97bdf17ae2d6ac6e62ab968751e9987a21612e8254286c89: Status 404 returned error can't find the container with id c910c95fced1d04f97bdf17ae2d6ac6e62ab968751e9987a21612e8254286c89 May 25 14:15:29.992981 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:29.992885 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qpc4t" event={"ID":"4336480c-183b-42b7-9e54-4f835abaf49b","Type":"ContainerStarted","Data":"34c499f3876e0c147f49c789455d2c489719f794915317dcc18cb76c651a13b7"} May 25 14:15:29.992981 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:29.992924 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qpc4t" event={"ID":"4336480c-183b-42b7-9e54-4f835abaf49b","Type":"ContainerStarted","Data":"940ff53880533f1a23a3e869e7223642230931cebde8a8a41816a24a9ed2a0a8"} May 25 14:15:29.993935 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:29.993910 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-qg57n" event={"ID":"27a0deb6-6d9d-48e8-8420-9e6756280059","Type":"ContainerStarted","Data":"c910c95fced1d04f97bdf17ae2d6ac6e62ab968751e9987a21612e8254286c89"} May 25 14:15:29.995721 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:29.995698 2562 generic.go:358] "Generic (PLEG): container finished" podID="0ec0bdee-59a1-4438-b994-0e63c1dc8049" containerID="817d43aa4a3b022338bfc606510a1b128070c4117a9a3a8eba9aef91e6559eae" exitCode=0 May 25 14:15:29.995853 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:29.995758 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ec0bdee-59a1-4438-b994-0e63c1dc8049","Type":"ContainerDied","Data":"817d43aa4a3b022338bfc606510a1b128070c4117a9a3a8eba9aef91e6559eae"} May 25 14:15:29.996887 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:29.996865 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-66fb98b9d7-2nlzc" event={"ID":"c5ef2618-3b13-401e-a133-b1b3113e2b39","Type":"ContainerStarted","Data":"3ee5dd6c4528a097be5ba8b384fb705d1d63d558ee9757b1678832450e59e89b"} May 25 14:15:30.014733 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:30.014688 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qpc4t" podStartSLOduration=3.734667477 podStartE2EDuration="6.014672066s" podCreationTimestamp="2026-05-25 14:15:24 +0000 UTC" firstStartedPulling="2026-05-25 14:15:25.52690779 +0000 UTC m=+179.734154954" lastFinishedPulling="2026-05-25 14:15:27.806912367 +0000 UTC m=+182.014159543" observedRunningTime="2026-05-25 14:15:30.013630328 +0000 UTC m=+184.220877513" watchObservedRunningTime="2026-05-25 14:15:30.014672066 +0000 UTC m=+184.221919244" May 25 14:15:30.366496 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:30.366462 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94f8408d-e962-47e4-a6df-db75d8d04164" path="/var/lib/kubelet/pods/94f8408d-e962-47e4-a6df-db75d8d04164/volumes" May 25 14:15:30.972700 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:30.972590 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 14:15:30.987391 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:30.987336 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:30.994858 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:30.994636 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 25 14:15:30.994858 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:30.994635 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 25 14:15:30.995084 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:30.995025 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 25 14:15:30.995188 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:30.995131 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 25 14:15:30.995335 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:30.995319 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 25 14:15:30.995433 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:30.995336 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xs6sh\"" May 25 14:15:30.995433 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:30.995423 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 25 14:15:30.995556 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:30.995539 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 25 14:15:30.995671 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:30.995653 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 25 14:15:30.995728 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:30.995657 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6i7bmnri6389o\"" May 25 14:15:30.996446 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:30.996196 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 25 14:15:30.996560 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:30.996505 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 25 14:15:30.997007 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:30.996988 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 25 14:15:30.998827 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:30.998271 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 25 14:15:31.026395 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.026329 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 14:15:31.076102 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.076065 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.076301 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.076148 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f6f6cded-64b6-4d21-9003-2a2c27de3898-config-out\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.076301 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.076185 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.076301 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.076214 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f6f6cded-64b6-4d21-9003-2a2c27de3898-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.076301 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.076275 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.076577 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.076308 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.076577 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.076362 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6f6cded-64b6-4d21-9003-2a2c27de3898-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.076577 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.076409 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-config\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.076577 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.076446 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f6f6cded-64b6-4d21-9003-2a2c27de3898-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.076577 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.076473 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dswdn\" (UniqueName: \"kubernetes.io/projected/f6f6cded-64b6-4d21-9003-2a2c27de3898-kube-api-access-dswdn\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.076577 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.076517 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6f6cded-64b6-4d21-9003-2a2c27de3898-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.076577 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.076546 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.076965 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.076584 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.076965 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.076628 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.076965 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.076646 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f6f6cded-64b6-4d21-9003-2a2c27de3898-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.076965 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.076683 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6f6cded-64b6-4d21-9003-2a2c27de3898-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.076965 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.076707 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6f6cded-64b6-4d21-9003-2a2c27de3898-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.076965 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.076723 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-web-config\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.177733 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.177696 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.177733 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.177741 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.178003 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.177778 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6f6cded-64b6-4d21-9003-2a2c27de3898-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.178003 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.177809 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-config\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.178003 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.177838 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f6f6cded-64b6-4d21-9003-2a2c27de3898-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.178003 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.177865 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dswdn\" (UniqueName: \"kubernetes.io/projected/f6f6cded-64b6-4d21-9003-2a2c27de3898-kube-api-access-dswdn\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.178003 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.177908 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6f6cded-64b6-4d21-9003-2a2c27de3898-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.178003 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.177938 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.178003 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.177967 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.178003 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.177999 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.178474 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.178020 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f6f6cded-64b6-4d21-9003-2a2c27de3898-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.178474 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.178058 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6f6cded-64b6-4d21-9003-2a2c27de3898-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.178474 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.178096 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6f6cded-64b6-4d21-9003-2a2c27de3898-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.178474 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.178121 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-web-config\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.178474 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.178154 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.178474 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.178210 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f6f6cded-64b6-4d21-9003-2a2c27de3898-config-out\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.178474 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.178243 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.178474 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.178273 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f6f6cded-64b6-4d21-9003-2a2c27de3898-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.178834 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.178632 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6f6cded-64b6-4d21-9003-2a2c27de3898-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.181835 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.181787 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6f6cded-64b6-4d21-9003-2a2c27de3898-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.182497 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.182466 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-web-config\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.183055 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.182943 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f6f6cded-64b6-4d21-9003-2a2c27de3898-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.183811 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.183469 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6f6cded-64b6-4d21-9003-2a2c27de3898-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.185882 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.185484 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f6f6cded-64b6-4d21-9003-2a2c27de3898-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.186699 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.186009 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-config\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.186699 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.186361 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.186699 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.186524 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.186926 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.186903 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.192944 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.190997 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6f6cded-64b6-4d21-9003-2a2c27de3898-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.192944 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.191514 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.195112 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.195090 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.199691 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.199667 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f6f6cded-64b6-4d21-9003-2a2c27de3898-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.201116 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.201050 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.201322 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.201276 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f6f6cded-64b6-4d21-9003-2a2c27de3898-config-out\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.202168 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.202127 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.203258 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.203231 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dswdn\" (UniqueName: \"kubernetes.io/projected/f6f6cded-64b6-4d21-9003-2a2c27de3898-kube-api-access-dswdn\") pod \"prometheus-k8s-0\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:31.302484 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:31.302316 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:32.384452 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:32.384421 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 14:15:32.804152 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:15:32.804029 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6f6cded_64b6_4d21_9003_2a2c27de3898.slice/crio-e4a47df95942261c5ef8279cf23e449c8ff0217998ef0a731815e6056c805fc9 WatchSource:0}: Error finding container e4a47df95942261c5ef8279cf23e449c8ff0217998ef0a731815e6056c805fc9: Status 404 returned error can't find the container with id e4a47df95942261c5ef8279cf23e449c8ff0217998ef0a731815e6056c805fc9 May 25 14:15:33.011476 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:33.011437 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f6f6cded-64b6-4d21-9003-2a2c27de3898","Type":"ContainerStarted","Data":"e4a47df95942261c5ef8279cf23e449c8ff0217998ef0a731815e6056c805fc9"} May 25 14:15:34.015634 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:34.015545 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-66fb98b9d7-2nlzc" event={"ID":"c5ef2618-3b13-401e-a133-b1b3113e2b39","Type":"ContainerStarted","Data":"7a0594da45935697fa33165abd5439d8dbf69f42b7936f5a564113c4e33ed15a"} May 25 14:15:34.017012 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:34.016983 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-qg57n" event={"ID":"27a0deb6-6d9d-48e8-8420-9e6756280059","Type":"ContainerStarted","Data":"c7d3c3e8eb3b90d1f9d7109d7afda3ac2aa973607ed724900cafb5ef7ec5db3a"} May 25 14:15:34.017166 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:34.017142 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-qg57n" May 25 14:15:34.018335 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:34.018308 2562 generic.go:358] "Generic (PLEG): container finished" podID="f6f6cded-64b6-4d21-9003-2a2c27de3898" containerID="68421249ce14624246678309eddbdbab777f0feda20f81d17cd9681ac3dad612" exitCode=0 May 25 14:15:34.018473 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:34.018402 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f6f6cded-64b6-4d21-9003-2a2c27de3898","Type":"ContainerDied","Data":"68421249ce14624246678309eddbdbab777f0feda20f81d17cd9681ac3dad612"} May 25 14:15:34.025029 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:34.024172 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-qg57n" May 25 14:15:34.026904 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:34.026879 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ec0bdee-59a1-4438-b994-0e63c1dc8049","Type":"ContainerStarted","Data":"0800702cf4424fb69092e3f27a227a614eaf8d6baf2db72eb2967bb4384d24a3"} May 25 14:15:34.026990 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:34.026912 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ec0bdee-59a1-4438-b994-0e63c1dc8049","Type":"ContainerStarted","Data":"7799da9f8ca5a2f65c117e6336c9461047f117d5a68b7ac7a7eca83d7d0b868d"} May 25 14:15:34.026990 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:34.026924 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ec0bdee-59a1-4438-b994-0e63c1dc8049","Type":"ContainerStarted","Data":"25667aac986c37a5a04982fe3e42422d8f544fba4a78feac0ecfbd528b14cce6"} May 25 14:15:34.026990 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:34.026936 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ec0bdee-59a1-4438-b994-0e63c1dc8049","Type":"ContainerStarted","Data":"edde676e378d855a576ece0c2a9205135b73df8b7816c7a17f678cd39da2e392"} May 25 14:15:34.026990 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:34.026948 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ec0bdee-59a1-4438-b994-0e63c1dc8049","Type":"ContainerStarted","Data":"8ca2b9c5a5ecdf4813d993da3f6d4d65f537c974e05855978b95246d664c22b6"} May 25 14:15:34.028649 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:34.028626 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79bc96554b-nnrtp" event={"ID":"1a9a3016-87ae-46ea-b4de-8f038167f4ea","Type":"ContainerStarted","Data":"12958589da4548d1e7de8d4a5df8ba566370f1b1978fd228b7edeaa34ecbc25c"} May 25 14:15:34.028731 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:34.028657 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79bc96554b-nnrtp" event={"ID":"1a9a3016-87ae-46ea-b4de-8f038167f4ea","Type":"ContainerStarted","Data":"b96076583c9338f1d6269195ef62db6a2bbd235db83a04bbcad6423bff75f619"} May 25 14:15:34.028731 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:34.028671 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79bc96554b-nnrtp" event={"ID":"1a9a3016-87ae-46ea-b4de-8f038167f4ea","Type":"ContainerStarted","Data":"fba4f351bf83bde303b6846102157af24b2dbfa4a1418ace3dd4657fd5675785"} May 25 14:15:34.034131 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:34.034077 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-66fb98b9d7-2nlzc" podStartSLOduration=2.691992423 podStartE2EDuration="6.034062692s" podCreationTimestamp="2026-05-25 14:15:28 +0000 UTC" firstStartedPulling="2026-05-25 14:15:29.461135401 +0000 UTC m=+183.668382575" lastFinishedPulling="2026-05-25 14:15:32.80320568 +0000 UTC m=+187.010452844" observedRunningTime="2026-05-25 14:15:34.033757024 +0000 UTC m=+188.241004209" watchObservedRunningTime="2026-05-25 14:15:34.034062692 +0000 UTC m=+188.241309876" May 25 14:15:34.048392 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:34.048317 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-qg57n" podStartSLOduration=1.893597535 podStartE2EDuration="5.048301492s" podCreationTimestamp="2026-05-25 14:15:29 +0000 UTC" firstStartedPulling="2026-05-25 14:15:29.807040362 +0000 UTC m=+184.014287524" lastFinishedPulling="2026-05-25 14:15:32.961744315 +0000 UTC m=+187.168991481" observedRunningTime="2026-05-25 14:15:34.047447178 +0000 UTC m=+188.254694362" watchObservedRunningTime="2026-05-25 14:15:34.048301492 +0000 UTC m=+188.255548675" May 25 14:15:35.036664 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:35.036629 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ec0bdee-59a1-4438-b994-0e63c1dc8049","Type":"ContainerStarted","Data":"e82602853ec929194cd9798ce880068a8579a09395749fcb1f20ad833ac70bd5"} May 25 14:15:35.039575 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:35.039511 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79bc96554b-nnrtp" event={"ID":"1a9a3016-87ae-46ea-b4de-8f038167f4ea","Type":"ContainerStarted","Data":"4ce59f5f6c92bc829bebf791ae860dd5cb7105ce8d4852f826ad1756b51ca362"} May 25 14:15:35.065281 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:35.065227 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.405225042 podStartE2EDuration="10.065208452s" podCreationTimestamp="2026-05-25 14:15:25 +0000 UTC" firstStartedPulling="2026-05-25 14:15:26.162427985 +0000 UTC m=+180.369675159" lastFinishedPulling="2026-05-25 14:15:34.822411407 +0000 UTC m=+189.029658569" observedRunningTime="2026-05-25 14:15:35.064355963 +0000 UTC m=+189.271603149" watchObservedRunningTime="2026-05-25 14:15:35.065208452 +0000 UTC m=+189.272455637" May 25 14:15:36.045460 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:36.045418 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79bc96554b-nnrtp" event={"ID":"1a9a3016-87ae-46ea-b4de-8f038167f4ea","Type":"ContainerStarted","Data":"78ffd57f33551c8436bac4f0b7d2b4ea7523a806c579f557b5a8025154445259"} May 25 14:15:36.045884 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:36.045466 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79bc96554b-nnrtp" event={"ID":"1a9a3016-87ae-46ea-b4de-8f038167f4ea","Type":"ContainerStarted","Data":"bb98f69bf5da67cc5b7f10c4f887bb61b227848487e97f6032ae3b9ccb9f1b1e"} May 25 14:15:36.046442 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:36.046411 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-79bc96554b-nnrtp" May 25 14:15:36.066809 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:36.066752 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-79bc96554b-nnrtp" podStartSLOduration=3.254881735 podStartE2EDuration="10.06673279s" podCreationTimestamp="2026-05-25 14:15:26 +0000 UTC" firstStartedPulling="2026-05-25 14:15:28.00978706 +0000 UTC m=+182.217034246" lastFinishedPulling="2026-05-25 14:15:34.821638136 +0000 UTC m=+189.028885301" observedRunningTime="2026-05-25 14:15:36.066586539 +0000 UTC m=+190.273833714" watchObservedRunningTime="2026-05-25 14:15:36.06673279 +0000 UTC m=+190.273979974" May 25 14:15:38.053501 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:38.053467 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f6f6cded-64b6-4d21-9003-2a2c27de3898","Type":"ContainerStarted","Data":"a486e8c7ff3bf978a30f90d3c8775963bd97590d586d449d50dce8792a0929e7"} May 25 14:15:38.053821 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:38.053507 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f6f6cded-64b6-4d21-9003-2a2c27de3898","Type":"ContainerStarted","Data":"91226935600c7a70bad79bb2493705d335040d1d0e4b6cdf3751bb21b663be94"} May 25 14:15:38.053821 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:38.053516 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f6f6cded-64b6-4d21-9003-2a2c27de3898","Type":"ContainerStarted","Data":"56a8053cdc56c078a2380f204403a7ee68e398bf9a5b05fc7f1d4e9ec9f21c83"} May 25 14:15:38.053821 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:38.053525 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f6f6cded-64b6-4d21-9003-2a2c27de3898","Type":"ContainerStarted","Data":"d9daeedc8b870a197aa5ba14ed5c7c6a81bdd2a4a3b45f07dd8ba0bb0838f5c8"} May 25 14:15:38.059355 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:38.059334 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-79bc96554b-nnrtp" May 25 14:15:39.059953 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:39.059915 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f6f6cded-64b6-4d21-9003-2a2c27de3898","Type":"ContainerStarted","Data":"7a907fadf5c9bf85435669c44c53641df0d2080c799a6c8d37542d1549f628d0"} May 25 14:15:39.060608 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:39.060582 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f6f6cded-64b6-4d21-9003-2a2c27de3898","Type":"ContainerStarted","Data":"2698013a52eeea06d918383a087b7c8d81048c5aee4ff5b26b8208144561e5e1"} May 25 14:15:39.091858 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:39.091803 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=5.603269835 podStartE2EDuration="9.091780596s" podCreationTimestamp="2026-05-25 14:15:30 +0000 UTC" firstStartedPulling="2026-05-25 14:15:34.019643149 +0000 UTC m=+188.226890314" lastFinishedPulling="2026-05-25 14:15:37.50815391 +0000 UTC m=+191.715401075" observedRunningTime="2026-05-25 14:15:39.090443994 +0000 UTC m=+193.297691181" watchObservedRunningTime="2026-05-25 14:15:39.091780596 +0000 UTC m=+193.299027795" May 25 14:15:41.303342 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:41.303306 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 25 14:15:49.258767 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:49.258730 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-66fb98b9d7-2nlzc" May 25 14:15:49.258767 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:49.258771 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-66fb98b9d7-2nlzc" May 25 14:15:58.123117 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:58.123081 2562 generic.go:358] "Generic (PLEG): container finished" podID="aec84fa8-ab52-471b-87c9-5abb8d795238" containerID="ffbda9adec478c9569f59e70f946242dd3d1f5f1359889fd9f34672b57d80eb6" exitCode=0 May 25 14:15:58.123536 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:58.123158 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-l4gxh" event={"ID":"aec84fa8-ab52-471b-87c9-5abb8d795238","Type":"ContainerDied","Data":"ffbda9adec478c9569f59e70f946242dd3d1f5f1359889fd9f34672b57d80eb6"} May 25 14:15:58.123577 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:58.123534 2562 scope.go:117] "RemoveContainer" containerID="ffbda9adec478c9569f59e70f946242dd3d1f5f1359889fd9f34672b57d80eb6" May 25 14:15:58.801512 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:58.801482 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2pcq6_009111ca-e828-4238-accf-5381fbdf7799/serve-healthcheck-canary/0.log" May 25 14:15:59.127557 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:15:59.127521 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-l4gxh" event={"ID":"aec84fa8-ab52-471b-87c9-5abb8d795238","Type":"ContainerStarted","Data":"6187b9c583184144e612d6d9286cc330f2dc51a756817d3db4822c5391428776"} May 25 14:16:05.147040 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:05.147000 2562 generic.go:358] "Generic (PLEG): container finished" podID="6ff41224-f404-410d-907d-7b7ee3f12ab7" containerID="04cf683a808caf30e29c49612f0eb55f16deb217de9cdd12a125d1934ac87744" exitCode=0 May 25 14:16:05.147621 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:05.147084 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-gqf6p" event={"ID":"6ff41224-f404-410d-907d-7b7ee3f12ab7","Type":"ContainerDied","Data":"04cf683a808caf30e29c49612f0eb55f16deb217de9cdd12a125d1934ac87744"} May 25 14:16:05.147621 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:05.147494 2562 scope.go:117] "RemoveContainer" containerID="04cf683a808caf30e29c49612f0eb55f16deb217de9cdd12a125d1934ac87744" May 25 14:16:06.152688 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:06.152653 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-gqf6p" event={"ID":"6ff41224-f404-410d-907d-7b7ee3f12ab7","Type":"ContainerStarted","Data":"b1f956280084310269072f5065494c6d3554c5882a158a316531d14ff41bfb9e"} May 25 14:16:09.164314 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:09.164279 2562 generic.go:358] "Generic (PLEG): container finished" podID="6cddc246-de40-4ec5-8dd8-25e94b917240" containerID="1a9745e6cac3010a22c1b1304d9e0bebdee5d31fde2078af2737a375e290e308" exitCode=0 May 25 14:16:09.164909 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:09.164351 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-rb4mc" event={"ID":"6cddc246-de40-4ec5-8dd8-25e94b917240","Type":"ContainerDied","Data":"1a9745e6cac3010a22c1b1304d9e0bebdee5d31fde2078af2737a375e290e308"} May 25 14:16:09.164909 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:09.164819 2562 scope.go:117] "RemoveContainer" containerID="1a9745e6cac3010a22c1b1304d9e0bebdee5d31fde2078af2737a375e290e308" May 25 14:16:09.265716 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:09.265686 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-66fb98b9d7-2nlzc" May 25 14:16:09.270571 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:09.270545 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-66fb98b9d7-2nlzc" May 25 14:16:10.169486 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:10.169424 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-rb4mc" event={"ID":"6cddc246-de40-4ec5-8dd8-25e94b917240","Type":"ContainerStarted","Data":"a88931a5b3dd0ca9bfbd6d12857ea4dfeb9b1754c5de66da291b590ab201927f"} May 25 14:16:31.302750 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:31.302705 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:31.322624 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:31.322592 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:32.253687 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:32.253657 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:38.189397 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:38.189297 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b48e369-ae21-483b-897e-fb9b4ecd1818-metrics-certs\") pod \"network-metrics-daemon-p6784\" (UID: \"7b48e369-ae21-483b-897e-fb9b4ecd1818\") " pod="openshift-multus/network-metrics-daemon-p6784" May 25 14:16:38.191688 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:38.191669 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b48e369-ae21-483b-897e-fb9b4ecd1818-metrics-certs\") pod \"network-metrics-daemon-p6784\" (UID: \"7b48e369-ae21-483b-897e-fb9b4ecd1818\") " pod="openshift-multus/network-metrics-daemon-p6784" May 25 14:16:38.269598 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:38.269568 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5vlbv\"" May 25 14:16:38.277272 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:38.277252 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p6784" May 25 14:16:38.404214 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:38.404181 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-p6784"] May 25 14:16:38.407026 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:16:38.406993 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b48e369_ae21_483b_897e_fb9b4ecd1818.slice/crio-01456c58a9570870834a255e4786039c65e3354dff9f5ad86c11785881a14cb1 WatchSource:0}: Error finding container 01456c58a9570870834a255e4786039c65e3354dff9f5ad86c11785881a14cb1: Status 404 returned error can't find the container with id 01456c58a9570870834a255e4786039c65e3354dff9f5ad86c11785881a14cb1 May 25 14:16:39.260426 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:39.260388 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p6784" event={"ID":"7b48e369-ae21-483b-897e-fb9b4ecd1818","Type":"ContainerStarted","Data":"01456c58a9570870834a255e4786039c65e3354dff9f5ad86c11785881a14cb1"} May 25 14:16:40.264750 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:40.264705 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p6784" event={"ID":"7b48e369-ae21-483b-897e-fb9b4ecd1818","Type":"ContainerStarted","Data":"16b9cb935bf045392b276d2f863c1439780ea7f15de7b9bb190dfc5e279f58d2"} May 25 14:16:40.265113 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:40.264755 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p6784" event={"ID":"7b48e369-ae21-483b-897e-fb9b4ecd1818","Type":"ContainerStarted","Data":"1635c44a102299c528a71bbdda5b044956cb8cc4d40cb03b7f59c6a6febff5d7"} May 25 14:16:40.282977 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:40.282927 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-p6784" podStartSLOduration=253.130976944 podStartE2EDuration="4m14.282914108s" podCreationTimestamp="2026-05-25 14:12:26 +0000 UTC" firstStartedPulling="2026-05-25 14:16:38.40894563 +0000 UTC m=+252.616192792" lastFinishedPulling="2026-05-25 14:16:39.56088279 +0000 UTC m=+253.768129956" observedRunningTime="2026-05-25 14:16:40.280822784 +0000 UTC m=+254.488069969" watchObservedRunningTime="2026-05-25 14:16:40.282914108 +0000 UTC m=+254.490161292" May 25 14:16:45.017901 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:45.017868 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 25 14:16:45.018343 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:45.018291 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0ec0bdee-59a1-4438-b994-0e63c1dc8049" containerName="alertmanager" containerID="cri-o://8ca2b9c5a5ecdf4813d993da3f6d4d65f537c974e05855978b95246d664c22b6" gracePeriod=120 May 25 14:16:45.018516 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:45.018352 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0ec0bdee-59a1-4438-b994-0e63c1dc8049" containerName="kube-rbac-proxy-metric" containerID="cri-o://0800702cf4424fb69092e3f27a227a614eaf8d6baf2db72eb2967bb4384d24a3" gracePeriod=120 May 25 14:16:45.018516 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:45.018413 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0ec0bdee-59a1-4438-b994-0e63c1dc8049" containerName="kube-rbac-proxy-web" containerID="cri-o://25667aac986c37a5a04982fe3e42422d8f544fba4a78feac0ecfbd528b14cce6" gracePeriod=120 May 25 14:16:45.018516 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:45.018461 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0ec0bdee-59a1-4438-b994-0e63c1dc8049" containerName="prom-label-proxy" containerID="cri-o://e82602853ec929194cd9798ce880068a8579a09395749fcb1f20ad833ac70bd5" gracePeriod=120 May 25 14:16:45.018516 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:45.018475 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0ec0bdee-59a1-4438-b994-0e63c1dc8049" containerName="config-reloader" containerID="cri-o://edde676e378d855a576ece0c2a9205135b73df8b7816c7a17f678cd39da2e392" gracePeriod=120 May 25 14:16:45.019519 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:45.018451 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0ec0bdee-59a1-4438-b994-0e63c1dc8049" containerName="kube-rbac-proxy" containerID="cri-o://7799da9f8ca5a2f65c117e6336c9461047f117d5a68b7ac7a7eca83d7d0b868d" gracePeriod=120 May 25 14:16:45.284341 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:45.284260 2562 generic.go:358] "Generic (PLEG): container finished" podID="0ec0bdee-59a1-4438-b994-0e63c1dc8049" containerID="e82602853ec929194cd9798ce880068a8579a09395749fcb1f20ad833ac70bd5" exitCode=0 May 25 14:16:45.284341 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:45.284285 2562 generic.go:358] "Generic (PLEG): container finished" podID="0ec0bdee-59a1-4438-b994-0e63c1dc8049" containerID="7799da9f8ca5a2f65c117e6336c9461047f117d5a68b7ac7a7eca83d7d0b868d" exitCode=0 May 25 14:16:45.284341 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:45.284292 2562 generic.go:358] "Generic (PLEG): container finished" podID="0ec0bdee-59a1-4438-b994-0e63c1dc8049" containerID="edde676e378d855a576ece0c2a9205135b73df8b7816c7a17f678cd39da2e392" exitCode=0 May 25 14:16:45.284341 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:45.284300 2562 generic.go:358] "Generic (PLEG): container finished" podID="0ec0bdee-59a1-4438-b994-0e63c1dc8049" containerID="8ca2b9c5a5ecdf4813d993da3f6d4d65f537c974e05855978b95246d664c22b6" exitCode=0 May 25 14:16:45.284341 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:45.284327 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ec0bdee-59a1-4438-b994-0e63c1dc8049","Type":"ContainerDied","Data":"e82602853ec929194cd9798ce880068a8579a09395749fcb1f20ad833ac70bd5"} May 25 14:16:45.284631 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:45.284359 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ec0bdee-59a1-4438-b994-0e63c1dc8049","Type":"ContainerDied","Data":"7799da9f8ca5a2f65c117e6336c9461047f117d5a68b7ac7a7eca83d7d0b868d"} May 25 14:16:45.284631 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:45.284395 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ec0bdee-59a1-4438-b994-0e63c1dc8049","Type":"ContainerDied","Data":"edde676e378d855a576ece0c2a9205135b73df8b7816c7a17f678cd39da2e392"} May 25 14:16:45.284631 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:45.284406 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ec0bdee-59a1-4438-b994-0e63c1dc8049","Type":"ContainerDied","Data":"8ca2b9c5a5ecdf4813d993da3f6d4d65f537c974e05855978b95246d664c22b6"} May 25 14:16:46.269214 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.269191 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 25 14:16:46.290211 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.290178 2562 generic.go:358] "Generic (PLEG): container finished" podID="0ec0bdee-59a1-4438-b994-0e63c1dc8049" containerID="0800702cf4424fb69092e3f27a227a614eaf8d6baf2db72eb2967bb4384d24a3" exitCode=0 May 25 14:16:46.290211 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.290208 2562 generic.go:358] "Generic (PLEG): container finished" podID="0ec0bdee-59a1-4438-b994-0e63c1dc8049" containerID="25667aac986c37a5a04982fe3e42422d8f544fba4a78feac0ecfbd528b14cce6" exitCode=0 May 25 14:16:46.290418 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.290256 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ec0bdee-59a1-4438-b994-0e63c1dc8049","Type":"ContainerDied","Data":"0800702cf4424fb69092e3f27a227a614eaf8d6baf2db72eb2967bb4384d24a3"} May 25 14:16:46.290418 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.290301 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ec0bdee-59a1-4438-b994-0e63c1dc8049","Type":"ContainerDied","Data":"25667aac986c37a5a04982fe3e42422d8f544fba4a78feac0ecfbd528b14cce6"} May 25 14:16:46.290418 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.290307 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 25 14:16:46.290418 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.290317 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ec0bdee-59a1-4438-b994-0e63c1dc8049","Type":"ContainerDied","Data":"211b8e6e63248cfa1ec59cbab6be862e04177c6fcff9190ed4d93bc3f0f5d541"} May 25 14:16:46.290418 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.290337 2562 scope.go:117] "RemoveContainer" containerID="e82602853ec929194cd9798ce880068a8579a09395749fcb1f20ad833ac70bd5" May 25 14:16:46.298075 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.298054 2562 scope.go:117] "RemoveContainer" containerID="0800702cf4424fb69092e3f27a227a614eaf8d6baf2db72eb2967bb4384d24a3" May 25 14:16:46.307579 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.307558 2562 scope.go:117] "RemoveContainer" containerID="7799da9f8ca5a2f65c117e6336c9461047f117d5a68b7ac7a7eca83d7d0b868d" May 25 14:16:46.316789 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.316770 2562 scope.go:117] "RemoveContainer" containerID="25667aac986c37a5a04982fe3e42422d8f544fba4a78feac0ecfbd528b14cce6" May 25 14:16:46.324231 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.324206 2562 scope.go:117] "RemoveContainer" containerID="edde676e378d855a576ece0c2a9205135b73df8b7816c7a17f678cd39da2e392" May 25 14:16:46.331440 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.331421 2562 scope.go:117] "RemoveContainer" containerID="8ca2b9c5a5ecdf4813d993da3f6d4d65f537c974e05855978b95246d664c22b6" May 25 14:16:46.338556 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.338533 2562 scope.go:117] "RemoveContainer" containerID="817d43aa4a3b022338bfc606510a1b128070c4117a9a3a8eba9aef91e6559eae" May 25 14:16:46.346697 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.346653 2562 scope.go:117] "RemoveContainer" containerID="e82602853ec929194cd9798ce880068a8579a09395749fcb1f20ad833ac70bd5" May 25 14:16:46.346893 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:16:46.346869 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e82602853ec929194cd9798ce880068a8579a09395749fcb1f20ad833ac70bd5\": container with ID starting with e82602853ec929194cd9798ce880068a8579a09395749fcb1f20ad833ac70bd5 not found: ID does not exist" containerID="e82602853ec929194cd9798ce880068a8579a09395749fcb1f20ad833ac70bd5" May 25 14:16:46.347005 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.346904 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e82602853ec929194cd9798ce880068a8579a09395749fcb1f20ad833ac70bd5"} err="failed to get container status \"e82602853ec929194cd9798ce880068a8579a09395749fcb1f20ad833ac70bd5\": rpc error: code = NotFound desc = could not find container \"e82602853ec929194cd9798ce880068a8579a09395749fcb1f20ad833ac70bd5\": container with ID starting with e82602853ec929194cd9798ce880068a8579a09395749fcb1f20ad833ac70bd5 not found: ID does not exist" May 25 14:16:46.347005 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.346934 2562 scope.go:117] "RemoveContainer" containerID="0800702cf4424fb69092e3f27a227a614eaf8d6baf2db72eb2967bb4384d24a3" May 25 14:16:46.347171 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:16:46.347152 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0800702cf4424fb69092e3f27a227a614eaf8d6baf2db72eb2967bb4384d24a3\": container with ID starting with 0800702cf4424fb69092e3f27a227a614eaf8d6baf2db72eb2967bb4384d24a3 not found: ID does not exist" containerID="0800702cf4424fb69092e3f27a227a614eaf8d6baf2db72eb2967bb4384d24a3" May 25 14:16:46.347236 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.347182 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0800702cf4424fb69092e3f27a227a614eaf8d6baf2db72eb2967bb4384d24a3"} err="failed to get container status \"0800702cf4424fb69092e3f27a227a614eaf8d6baf2db72eb2967bb4384d24a3\": rpc error: code = NotFound desc = could not find container \"0800702cf4424fb69092e3f27a227a614eaf8d6baf2db72eb2967bb4384d24a3\": container with ID starting with 0800702cf4424fb69092e3f27a227a614eaf8d6baf2db72eb2967bb4384d24a3 not found: ID does not exist" May 25 14:16:46.347236 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.347203 2562 scope.go:117] "RemoveContainer" containerID="7799da9f8ca5a2f65c117e6336c9461047f117d5a68b7ac7a7eca83d7d0b868d" May 25 14:16:46.347467 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:16:46.347440 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7799da9f8ca5a2f65c117e6336c9461047f117d5a68b7ac7a7eca83d7d0b868d\": container with ID starting with 7799da9f8ca5a2f65c117e6336c9461047f117d5a68b7ac7a7eca83d7d0b868d not found: ID does not exist" containerID="7799da9f8ca5a2f65c117e6336c9461047f117d5a68b7ac7a7eca83d7d0b868d" May 25 14:16:46.347540 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.347476 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7799da9f8ca5a2f65c117e6336c9461047f117d5a68b7ac7a7eca83d7d0b868d"} err="failed to get container status \"7799da9f8ca5a2f65c117e6336c9461047f117d5a68b7ac7a7eca83d7d0b868d\": rpc error: code = NotFound desc = could not find container \"7799da9f8ca5a2f65c117e6336c9461047f117d5a68b7ac7a7eca83d7d0b868d\": container with ID starting with 7799da9f8ca5a2f65c117e6336c9461047f117d5a68b7ac7a7eca83d7d0b868d not found: ID does not exist" May 25 14:16:46.347540 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.347501 2562 scope.go:117] "RemoveContainer" containerID="25667aac986c37a5a04982fe3e42422d8f544fba4a78feac0ecfbd528b14cce6" May 25 14:16:46.347808 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:16:46.347783 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25667aac986c37a5a04982fe3e42422d8f544fba4a78feac0ecfbd528b14cce6\": container with ID starting with 25667aac986c37a5a04982fe3e42422d8f544fba4a78feac0ecfbd528b14cce6 not found: ID does not exist" containerID="25667aac986c37a5a04982fe3e42422d8f544fba4a78feac0ecfbd528b14cce6" May 25 14:16:46.347897 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.347818 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25667aac986c37a5a04982fe3e42422d8f544fba4a78feac0ecfbd528b14cce6"} err="failed to get container status \"25667aac986c37a5a04982fe3e42422d8f544fba4a78feac0ecfbd528b14cce6\": rpc error: code = NotFound desc = could not find container \"25667aac986c37a5a04982fe3e42422d8f544fba4a78feac0ecfbd528b14cce6\": container with ID starting with 25667aac986c37a5a04982fe3e42422d8f544fba4a78feac0ecfbd528b14cce6 not found: ID does not exist" May 25 14:16:46.347897 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.347841 2562 scope.go:117] "RemoveContainer" containerID="edde676e378d855a576ece0c2a9205135b73df8b7816c7a17f678cd39da2e392" May 25 14:16:46.348057 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:16:46.348037 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edde676e378d855a576ece0c2a9205135b73df8b7816c7a17f678cd39da2e392\": container with ID starting with edde676e378d855a576ece0c2a9205135b73df8b7816c7a17f678cd39da2e392 not found: ID does not exist" containerID="edde676e378d855a576ece0c2a9205135b73df8b7816c7a17f678cd39da2e392" May 25 14:16:46.348112 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.348068 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edde676e378d855a576ece0c2a9205135b73df8b7816c7a17f678cd39da2e392"} err="failed to get container status \"edde676e378d855a576ece0c2a9205135b73df8b7816c7a17f678cd39da2e392\": rpc error: code = NotFound desc = could not find container \"edde676e378d855a576ece0c2a9205135b73df8b7816c7a17f678cd39da2e392\": container with ID starting with edde676e378d855a576ece0c2a9205135b73df8b7816c7a17f678cd39da2e392 not found: ID does not exist" May 25 14:16:46.348112 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.348089 2562 scope.go:117] "RemoveContainer" containerID="8ca2b9c5a5ecdf4813d993da3f6d4d65f537c974e05855978b95246d664c22b6" May 25 14:16:46.348335 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:16:46.348302 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ca2b9c5a5ecdf4813d993da3f6d4d65f537c974e05855978b95246d664c22b6\": container with ID starting with 8ca2b9c5a5ecdf4813d993da3f6d4d65f537c974e05855978b95246d664c22b6 not found: ID does not exist" containerID="8ca2b9c5a5ecdf4813d993da3f6d4d65f537c974e05855978b95246d664c22b6" May 25 14:16:46.348490 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.348332 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ca2b9c5a5ecdf4813d993da3f6d4d65f537c974e05855978b95246d664c22b6"} err="failed to get container status \"8ca2b9c5a5ecdf4813d993da3f6d4d65f537c974e05855978b95246d664c22b6\": rpc error: code = NotFound desc = could not find container \"8ca2b9c5a5ecdf4813d993da3f6d4d65f537c974e05855978b95246d664c22b6\": container with ID starting with 8ca2b9c5a5ecdf4813d993da3f6d4d65f537c974e05855978b95246d664c22b6 not found: ID does not exist" May 25 14:16:46.348490 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.348353 2562 scope.go:117] "RemoveContainer" containerID="817d43aa4a3b022338bfc606510a1b128070c4117a9a3a8eba9aef91e6559eae" May 25 14:16:46.348625 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:16:46.348608 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"817d43aa4a3b022338bfc606510a1b128070c4117a9a3a8eba9aef91e6559eae\": container with ID starting with 817d43aa4a3b022338bfc606510a1b128070c4117a9a3a8eba9aef91e6559eae not found: ID does not exist" containerID="817d43aa4a3b022338bfc606510a1b128070c4117a9a3a8eba9aef91e6559eae" May 25 14:16:46.348686 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.348632 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"817d43aa4a3b022338bfc606510a1b128070c4117a9a3a8eba9aef91e6559eae"} err="failed to get container status \"817d43aa4a3b022338bfc606510a1b128070c4117a9a3a8eba9aef91e6559eae\": rpc error: code = NotFound desc = could not find container \"817d43aa4a3b022338bfc606510a1b128070c4117a9a3a8eba9aef91e6559eae\": container with ID starting with 817d43aa4a3b022338bfc606510a1b128070c4117a9a3a8eba9aef91e6559eae not found: ID does not exist" May 25 14:16:46.348686 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.348649 2562 scope.go:117] "RemoveContainer" containerID="e82602853ec929194cd9798ce880068a8579a09395749fcb1f20ad833ac70bd5" May 25 14:16:46.348906 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.348873 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e82602853ec929194cd9798ce880068a8579a09395749fcb1f20ad833ac70bd5"} err="failed to get container status \"e82602853ec929194cd9798ce880068a8579a09395749fcb1f20ad833ac70bd5\": rpc error: code = NotFound desc = could not find container \"e82602853ec929194cd9798ce880068a8579a09395749fcb1f20ad833ac70bd5\": container with ID starting with e82602853ec929194cd9798ce880068a8579a09395749fcb1f20ad833ac70bd5 not found: ID does not exist" May 25 14:16:46.348906 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.348897 2562 scope.go:117] "RemoveContainer" containerID="0800702cf4424fb69092e3f27a227a614eaf8d6baf2db72eb2967bb4384d24a3" May 25 14:16:46.349141 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.349123 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0800702cf4424fb69092e3f27a227a614eaf8d6baf2db72eb2967bb4384d24a3"} err="failed to get container status \"0800702cf4424fb69092e3f27a227a614eaf8d6baf2db72eb2967bb4384d24a3\": rpc error: code = NotFound desc = could not find container \"0800702cf4424fb69092e3f27a227a614eaf8d6baf2db72eb2967bb4384d24a3\": container with ID starting with 0800702cf4424fb69092e3f27a227a614eaf8d6baf2db72eb2967bb4384d24a3 not found: ID does not exist" May 25 14:16:46.349207 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.349142 2562 scope.go:117] "RemoveContainer" containerID="7799da9f8ca5a2f65c117e6336c9461047f117d5a68b7ac7a7eca83d7d0b868d" May 25 14:16:46.349337 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.349320 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7799da9f8ca5a2f65c117e6336c9461047f117d5a68b7ac7a7eca83d7d0b868d"} err="failed to get container status \"7799da9f8ca5a2f65c117e6336c9461047f117d5a68b7ac7a7eca83d7d0b868d\": rpc error: code = NotFound desc = could not find container \"7799da9f8ca5a2f65c117e6336c9461047f117d5a68b7ac7a7eca83d7d0b868d\": container with ID starting with 7799da9f8ca5a2f65c117e6336c9461047f117d5a68b7ac7a7eca83d7d0b868d not found: ID does not exist" May 25 14:16:46.349434 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.349337 2562 scope.go:117] "RemoveContainer" containerID="25667aac986c37a5a04982fe3e42422d8f544fba4a78feac0ecfbd528b14cce6" May 25 14:16:46.349743 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.349720 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25667aac986c37a5a04982fe3e42422d8f544fba4a78feac0ecfbd528b14cce6"} err="failed to get container status \"25667aac986c37a5a04982fe3e42422d8f544fba4a78feac0ecfbd528b14cce6\": rpc error: code = NotFound desc = could not find container \"25667aac986c37a5a04982fe3e42422d8f544fba4a78feac0ecfbd528b14cce6\": container with ID starting with 25667aac986c37a5a04982fe3e42422d8f544fba4a78feac0ecfbd528b14cce6 not found: ID does not exist" May 25 14:16:46.349815 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.349743 2562 scope.go:117] "RemoveContainer" containerID="edde676e378d855a576ece0c2a9205135b73df8b7816c7a17f678cd39da2e392" May 25 14:16:46.349970 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.349952 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edde676e378d855a576ece0c2a9205135b73df8b7816c7a17f678cd39da2e392"} err="failed to get container status \"edde676e378d855a576ece0c2a9205135b73df8b7816c7a17f678cd39da2e392\": rpc error: code = NotFound desc = could not find container \"edde676e378d855a576ece0c2a9205135b73df8b7816c7a17f678cd39da2e392\": container with ID starting with edde676e378d855a576ece0c2a9205135b73df8b7816c7a17f678cd39da2e392 not found: ID does not exist" May 25 14:16:46.350059 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.349971 2562 scope.go:117] "RemoveContainer" containerID="8ca2b9c5a5ecdf4813d993da3f6d4d65f537c974e05855978b95246d664c22b6" May 25 14:16:46.350188 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.350164 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ca2b9c5a5ecdf4813d993da3f6d4d65f537c974e05855978b95246d664c22b6"} err="failed to get container status \"8ca2b9c5a5ecdf4813d993da3f6d4d65f537c974e05855978b95246d664c22b6\": rpc error: code = NotFound desc = could not find container \"8ca2b9c5a5ecdf4813d993da3f6d4d65f537c974e05855978b95246d664c22b6\": container with ID starting with 8ca2b9c5a5ecdf4813d993da3f6d4d65f537c974e05855978b95246d664c22b6 not found: ID does not exist" May 25 14:16:46.350243 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.350190 2562 scope.go:117] "RemoveContainer" containerID="817d43aa4a3b022338bfc606510a1b128070c4117a9a3a8eba9aef91e6559eae" May 25 14:16:46.350407 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.350347 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"817d43aa4a3b022338bfc606510a1b128070c4117a9a3a8eba9aef91e6559eae"} err="failed to get container status \"817d43aa4a3b022338bfc606510a1b128070c4117a9a3a8eba9aef91e6559eae\": rpc error: code = NotFound desc = could not find container \"817d43aa4a3b022338bfc606510a1b128070c4117a9a3a8eba9aef91e6559eae\": container with ID starting with 817d43aa4a3b022338bfc606510a1b128070c4117a9a3a8eba9aef91e6559eae not found: ID does not exist" May 25 14:16:46.362470 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.362448 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ec0bdee-59a1-4438-b994-0e63c1dc8049-secret-alertmanager-kube-rbac-proxy\") pod \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " May 25 14:16:46.362598 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.362477 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ec0bdee-59a1-4438-b994-0e63c1dc8049-tls-assets\") pod \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " May 25 14:16:46.362598 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.362493 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ec0bdee-59a1-4438-b994-0e63c1dc8049-secret-alertmanager-kube-rbac-proxy-web\") pod \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " May 25 14:16:46.362598 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.362522 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ec0bdee-59a1-4438-b994-0e63c1dc8049-web-config\") pod \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " May 25 14:16:46.362598 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.362577 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0ec0bdee-59a1-4438-b994-0e63c1dc8049-secret-alertmanager-kube-rbac-proxy-metric\") pod \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " May 25 14:16:46.362801 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.362601 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ec0bdee-59a1-4438-b994-0e63c1dc8049-alertmanager-trusted-ca-bundle\") pod \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " May 25 14:16:46.363002 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.362971 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ec0bdee-59a1-4438-b994-0e63c1dc8049-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "0ec0bdee-59a1-4438-b994-0e63c1dc8049" (UID: "0ec0bdee-59a1-4438-b994-0e63c1dc8049"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 14:16:46.363122 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.363102 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0ec0bdee-59a1-4438-b994-0e63c1dc8049-cluster-tls-config\") pod \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " May 25 14:16:46.363182 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.363159 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sp5zs\" (UniqueName: \"kubernetes.io/projected/0ec0bdee-59a1-4438-b994-0e63c1dc8049-kube-api-access-sp5zs\") pod \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " May 25 14:16:46.363238 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.363220 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0ec0bdee-59a1-4438-b994-0e63c1dc8049-alertmanager-main-db\") pod \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " May 25 14:16:46.363387 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.363262 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0ec0bdee-59a1-4438-b994-0e63c1dc8049-config-volume\") pod \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " May 25 14:16:46.363387 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.363311 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0ec0bdee-59a1-4438-b994-0e63c1dc8049-secret-alertmanager-main-tls\") pod \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " May 25 14:16:46.363387 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.363342 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ec0bdee-59a1-4438-b994-0e63c1dc8049-config-out\") pod \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " May 25 14:16:46.363640 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.363476 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ec0bdee-59a1-4438-b994-0e63c1dc8049-metrics-client-ca\") pod \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\" (UID: \"0ec0bdee-59a1-4438-b994-0e63c1dc8049\") " May 25 14:16:46.363877 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.363853 2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ec0bdee-59a1-4438-b994-0e63c1dc8049-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-29.ec2.internal\" DevicePath \"\"" May 25 14:16:46.364546 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.364522 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ec0bdee-59a1-4438-b994-0e63c1dc8049-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "0ec0bdee-59a1-4438-b994-0e63c1dc8049" (UID: "0ec0bdee-59a1-4438-b994-0e63c1dc8049"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 14:16:46.365541 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.365397 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ec0bdee-59a1-4438-b994-0e63c1dc8049-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "0ec0bdee-59a1-4438-b994-0e63c1dc8049" (UID: "0ec0bdee-59a1-4438-b994-0e63c1dc8049"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 25 14:16:46.367136 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.367085 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ec0bdee-59a1-4438-b994-0e63c1dc8049-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "0ec0bdee-59a1-4438-b994-0e63c1dc8049" (UID: "0ec0bdee-59a1-4438-b994-0e63c1dc8049"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 14:16:46.367136 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.367121 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ec0bdee-59a1-4438-b994-0e63c1dc8049-config-volume" (OuterVolumeSpecName: "config-volume") pod "0ec0bdee-59a1-4438-b994-0e63c1dc8049" (UID: "0ec0bdee-59a1-4438-b994-0e63c1dc8049"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 14:16:46.367291 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.367263 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ec0bdee-59a1-4438-b994-0e63c1dc8049-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "0ec0bdee-59a1-4438-b994-0e63c1dc8049" (UID: "0ec0bdee-59a1-4438-b994-0e63c1dc8049"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 14:16:46.367522 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.367437 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ec0bdee-59a1-4438-b994-0e63c1dc8049-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "0ec0bdee-59a1-4438-b994-0e63c1dc8049" (UID: "0ec0bdee-59a1-4438-b994-0e63c1dc8049"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 14:16:46.367522 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.367498 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ec0bdee-59a1-4438-b994-0e63c1dc8049-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "0ec0bdee-59a1-4438-b994-0e63c1dc8049" (UID: "0ec0bdee-59a1-4438-b994-0e63c1dc8049"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 14:16:46.369641 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.369591 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ec0bdee-59a1-4438-b994-0e63c1dc8049-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "0ec0bdee-59a1-4438-b994-0e63c1dc8049" (UID: "0ec0bdee-59a1-4438-b994-0e63c1dc8049"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 14:16:46.369641 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.369595 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ec0bdee-59a1-4438-b994-0e63c1dc8049-kube-api-access-sp5zs" (OuterVolumeSpecName: "kube-api-access-sp5zs") pod "0ec0bdee-59a1-4438-b994-0e63c1dc8049" (UID: "0ec0bdee-59a1-4438-b994-0e63c1dc8049"). InnerVolumeSpecName "kube-api-access-sp5zs". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 14:16:46.370684 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.370658 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ec0bdee-59a1-4438-b994-0e63c1dc8049-config-out" (OuterVolumeSpecName: "config-out") pod "0ec0bdee-59a1-4438-b994-0e63c1dc8049" (UID: "0ec0bdee-59a1-4438-b994-0e63c1dc8049"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 25 14:16:46.374511 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.374448 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ec0bdee-59a1-4438-b994-0e63c1dc8049-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "0ec0bdee-59a1-4438-b994-0e63c1dc8049" (UID: "0ec0bdee-59a1-4438-b994-0e63c1dc8049"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 14:16:46.381039 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.381021 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ec0bdee-59a1-4438-b994-0e63c1dc8049-web-config" (OuterVolumeSpecName: "web-config") pod "0ec0bdee-59a1-4438-b994-0e63c1dc8049" (UID: "0ec0bdee-59a1-4438-b994-0e63c1dc8049"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 14:16:46.464503 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.464469 2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0ec0bdee-59a1-4438-b994-0e63c1dc8049-alertmanager-main-db\") on node \"ip-10-0-140-29.ec2.internal\" DevicePath \"\"" May 25 14:16:46.464503 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.464499 2562 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0ec0bdee-59a1-4438-b994-0e63c1dc8049-config-volume\") on node \"ip-10-0-140-29.ec2.internal\" DevicePath \"\"" May 25 14:16:46.464503 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.464509 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0ec0bdee-59a1-4438-b994-0e63c1dc8049-secret-alertmanager-main-tls\") on node \"ip-10-0-140-29.ec2.internal\" DevicePath \"\"" May 25 14:16:46.464739 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.464520 2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ec0bdee-59a1-4438-b994-0e63c1dc8049-config-out\") on node \"ip-10-0-140-29.ec2.internal\" DevicePath \"\"" May 25 14:16:46.464739 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.464528 2562 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ec0bdee-59a1-4438-b994-0e63c1dc8049-metrics-client-ca\") on node \"ip-10-0-140-29.ec2.internal\" DevicePath \"\"" May 25 14:16:46.464739 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.464537 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ec0bdee-59a1-4438-b994-0e63c1dc8049-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-29.ec2.internal\" DevicePath \"\"" May 25 14:16:46.464739 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.464550 2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ec0bdee-59a1-4438-b994-0e63c1dc8049-tls-assets\") on node \"ip-10-0-140-29.ec2.internal\" DevicePath \"\"" May 25 14:16:46.464739 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.464558 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ec0bdee-59a1-4438-b994-0e63c1dc8049-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-29.ec2.internal\" DevicePath \"\"" May 25 14:16:46.464739 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.464567 2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ec0bdee-59a1-4438-b994-0e63c1dc8049-web-config\") on node \"ip-10-0-140-29.ec2.internal\" DevicePath \"\"" May 25 14:16:46.464739 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.464577 2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0ec0bdee-59a1-4438-b994-0e63c1dc8049-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-29.ec2.internal\" DevicePath \"\"" May 25 14:16:46.464739 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.464585 2562 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0ec0bdee-59a1-4438-b994-0e63c1dc8049-cluster-tls-config\") on node \"ip-10-0-140-29.ec2.internal\" DevicePath \"\"" May 25 14:16:46.464739 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.464605 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sp5zs\" (UniqueName: \"kubernetes.io/projected/0ec0bdee-59a1-4438-b994-0e63c1dc8049-kube-api-access-sp5zs\") on node \"ip-10-0-140-29.ec2.internal\" DevicePath \"\"" May 25 14:16:46.615345 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.615313 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 25 14:16:46.620684 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.620652 2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 25 14:16:46.644656 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.644628 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 25 14:16:46.644987 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.644970 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ec0bdee-59a1-4438-b994-0e63c1dc8049" containerName="init-config-reloader" May 25 14:16:46.645074 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.644989 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ec0bdee-59a1-4438-b994-0e63c1dc8049" containerName="init-config-reloader" May 25 14:16:46.645074 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.645002 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ec0bdee-59a1-4438-b994-0e63c1dc8049" containerName="alertmanager" May 25 14:16:46.645074 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.645010 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ec0bdee-59a1-4438-b994-0e63c1dc8049" containerName="alertmanager" May 25 14:16:46.645074 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.645021 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ec0bdee-59a1-4438-b994-0e63c1dc8049" containerName="kube-rbac-proxy" May 25 14:16:46.645074 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.645029 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ec0bdee-59a1-4438-b994-0e63c1dc8049" containerName="kube-rbac-proxy" May 25 14:16:46.645074 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.645046 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ec0bdee-59a1-4438-b994-0e63c1dc8049" containerName="kube-rbac-proxy-web" May 25 14:16:46.645074 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.645054 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ec0bdee-59a1-4438-b994-0e63c1dc8049" containerName="kube-rbac-proxy-web" May 25 14:16:46.645074 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.645065 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ec0bdee-59a1-4438-b994-0e63c1dc8049" containerName="config-reloader" May 25 14:16:46.645074 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.645074 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ec0bdee-59a1-4438-b994-0e63c1dc8049" containerName="config-reloader" May 25 14:16:46.645529 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.645102 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ec0bdee-59a1-4438-b994-0e63c1dc8049" containerName="prom-label-proxy" May 25 14:16:46.645529 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.645110 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ec0bdee-59a1-4438-b994-0e63c1dc8049" containerName="prom-label-proxy" May 25 14:16:46.645529 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.645126 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ec0bdee-59a1-4438-b994-0e63c1dc8049" containerName="kube-rbac-proxy-metric" May 25 14:16:46.645529 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.645136 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ec0bdee-59a1-4438-b994-0e63c1dc8049" containerName="kube-rbac-proxy-metric" May 25 14:16:46.645529 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.645208 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="0ec0bdee-59a1-4438-b994-0e63c1dc8049" containerName="kube-rbac-proxy-web" May 25 14:16:46.645529 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.645223 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="0ec0bdee-59a1-4438-b994-0e63c1dc8049" containerName="alertmanager" May 25 14:16:46.645529 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.645235 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="0ec0bdee-59a1-4438-b994-0e63c1dc8049" containerName="config-reloader" May 25 14:16:46.645529 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.645244 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="0ec0bdee-59a1-4438-b994-0e63c1dc8049" containerName="kube-rbac-proxy" May 25 14:16:46.645529 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.645254 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="0ec0bdee-59a1-4438-b994-0e63c1dc8049" containerName="prom-label-proxy" May 25 14:16:46.645529 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.645266 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="0ec0bdee-59a1-4438-b994-0e63c1dc8049" containerName="kube-rbac-proxy-metric" May 25 14:16:46.650728 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.650698 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 25 14:16:46.653717 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.653699 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 25 14:16:46.653847 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.653701 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 25 14:16:46.653972 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.653955 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 25 14:16:46.654032 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.653970 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 25 14:16:46.654032 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.653982 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 25 14:16:46.654032 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.654015 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ngsb2\"" May 25 14:16:46.654477 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.654460 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 25 14:16:46.655307 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.655290 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 25 14:16:46.655413 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.655313 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 25 14:16:46.659977 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.659956 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 25 14:16:46.663034 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.663016 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 25 14:16:46.768003 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.767971 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ed5f87c4-d5fa-4f5d-a2bc-453384227716-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ed5f87c4-d5fa-4f5d-a2bc-453384227716\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:16:46.768183 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.768015 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ed5f87c4-d5fa-4f5d-a2bc-453384227716-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ed5f87c4-d5fa-4f5d-a2bc-453384227716\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:16:46.768183 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.768040 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ed5f87c4-d5fa-4f5d-a2bc-453384227716-config-volume\") pod \"alertmanager-main-0\" (UID: \"ed5f87c4-d5fa-4f5d-a2bc-453384227716\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:16:46.768183 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.768063 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ed5f87c4-d5fa-4f5d-a2bc-453384227716-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ed5f87c4-d5fa-4f5d-a2bc-453384227716\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:16:46.768183 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.768085 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed5f87c4-d5fa-4f5d-a2bc-453384227716-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ed5f87c4-d5fa-4f5d-a2bc-453384227716\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:16:46.768183 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.768101 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ed5f87c4-d5fa-4f5d-a2bc-453384227716-config-out\") pod \"alertmanager-main-0\" (UID: \"ed5f87c4-d5fa-4f5d-a2bc-453384227716\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:16:46.768183 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.768125 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s64ft\" (UniqueName: \"kubernetes.io/projected/ed5f87c4-d5fa-4f5d-a2bc-453384227716-kube-api-access-s64ft\") pod \"alertmanager-main-0\" (UID: \"ed5f87c4-d5fa-4f5d-a2bc-453384227716\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:16:46.768408 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.768190 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ed5f87c4-d5fa-4f5d-a2bc-453384227716-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ed5f87c4-d5fa-4f5d-a2bc-453384227716\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:16:46.768408 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.768229 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed5f87c4-d5fa-4f5d-a2bc-453384227716-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ed5f87c4-d5fa-4f5d-a2bc-453384227716\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:16:46.768408 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.768251 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ed5f87c4-d5fa-4f5d-a2bc-453384227716-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ed5f87c4-d5fa-4f5d-a2bc-453384227716\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:16:46.768408 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.768269 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ed5f87c4-d5fa-4f5d-a2bc-453384227716-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ed5f87c4-d5fa-4f5d-a2bc-453384227716\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:16:46.768408 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.768285 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ed5f87c4-d5fa-4f5d-a2bc-453384227716-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ed5f87c4-d5fa-4f5d-a2bc-453384227716\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:16:46.768408 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.768325 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ed5f87c4-d5fa-4f5d-a2bc-453384227716-web-config\") pod \"alertmanager-main-0\" (UID: \"ed5f87c4-d5fa-4f5d-a2bc-453384227716\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:16:46.869545 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.869450 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ed5f87c4-d5fa-4f5d-a2bc-453384227716-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ed5f87c4-d5fa-4f5d-a2bc-453384227716\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:16:46.869545 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.869507 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ed5f87c4-d5fa-4f5d-a2bc-453384227716-config-volume\") pod \"alertmanager-main-0\" (UID: \"ed5f87c4-d5fa-4f5d-a2bc-453384227716\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:16:46.869545 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.869534 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ed5f87c4-d5fa-4f5d-a2bc-453384227716-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ed5f87c4-d5fa-4f5d-a2bc-453384227716\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:16:46.869806 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.869650 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed5f87c4-d5fa-4f5d-a2bc-453384227716-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ed5f87c4-d5fa-4f5d-a2bc-453384227716\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:16:46.869806 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.869692 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ed5f87c4-d5fa-4f5d-a2bc-453384227716-config-out\") pod \"alertmanager-main-0\" (UID: \"ed5f87c4-d5fa-4f5d-a2bc-453384227716\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:16:46.869806 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.869731 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s64ft\" (UniqueName: \"kubernetes.io/projected/ed5f87c4-d5fa-4f5d-a2bc-453384227716-kube-api-access-s64ft\") pod \"alertmanager-main-0\" (UID: \"ed5f87c4-d5fa-4f5d-a2bc-453384227716\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:16:46.869806 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.869765 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ed5f87c4-d5fa-4f5d-a2bc-453384227716-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ed5f87c4-d5fa-4f5d-a2bc-453384227716\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:16:46.870008 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.869808 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed5f87c4-d5fa-4f5d-a2bc-453384227716-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ed5f87c4-d5fa-4f5d-a2bc-453384227716\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:16:46.870008 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.869834 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ed5f87c4-d5fa-4f5d-a2bc-453384227716-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ed5f87c4-d5fa-4f5d-a2bc-453384227716\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:16:46.870008 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.869867 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ed5f87c4-d5fa-4f5d-a2bc-453384227716-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ed5f87c4-d5fa-4f5d-a2bc-453384227716\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:16:46.870008 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.869894 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ed5f87c4-d5fa-4f5d-a2bc-453384227716-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ed5f87c4-d5fa-4f5d-a2bc-453384227716\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:16:46.870008 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.869925 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ed5f87c4-d5fa-4f5d-a2bc-453384227716-web-config\") pod \"alertmanager-main-0\" (UID: \"ed5f87c4-d5fa-4f5d-a2bc-453384227716\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:16:46.870008 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.869974 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ed5f87c4-d5fa-4f5d-a2bc-453384227716-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ed5f87c4-d5fa-4f5d-a2bc-453384227716\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:16:46.870515 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.870491 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed5f87c4-d5fa-4f5d-a2bc-453384227716-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ed5f87c4-d5fa-4f5d-a2bc-453384227716\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:16:46.873182 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.872874 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ed5f87c4-d5fa-4f5d-a2bc-453384227716-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ed5f87c4-d5fa-4f5d-a2bc-453384227716\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:16:46.873182 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.872962 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ed5f87c4-d5fa-4f5d-a2bc-453384227716-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ed5f87c4-d5fa-4f5d-a2bc-453384227716\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:16:46.873182 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.873065 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ed5f87c4-d5fa-4f5d-a2bc-453384227716-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ed5f87c4-d5fa-4f5d-a2bc-453384227716\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:16:46.873182 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.873081 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ed5f87c4-d5fa-4f5d-a2bc-453384227716-config-volume\") pod \"alertmanager-main-0\" (UID: \"ed5f87c4-d5fa-4f5d-a2bc-453384227716\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:16:46.873182 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.873093 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ed5f87c4-d5fa-4f5d-a2bc-453384227716-config-out\") pod \"alertmanager-main-0\" (UID: \"ed5f87c4-d5fa-4f5d-a2bc-453384227716\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:16:46.873182 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.873133 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ed5f87c4-d5fa-4f5d-a2bc-453384227716-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ed5f87c4-d5fa-4f5d-a2bc-453384227716\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:16:46.873506 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.873197 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ed5f87c4-d5fa-4f5d-a2bc-453384227716-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ed5f87c4-d5fa-4f5d-a2bc-453384227716\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:16:46.873506 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.873300 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ed5f87c4-d5fa-4f5d-a2bc-453384227716-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ed5f87c4-d5fa-4f5d-a2bc-453384227716\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:16:46.873506 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.873334 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ed5f87c4-d5fa-4f5d-a2bc-453384227716-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ed5f87c4-d5fa-4f5d-a2bc-453384227716\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:16:46.873914 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.873896 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed5f87c4-d5fa-4f5d-a2bc-453384227716-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ed5f87c4-d5fa-4f5d-a2bc-453384227716\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:16:46.874888 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.874872 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ed5f87c4-d5fa-4f5d-a2bc-453384227716-web-config\") pod \"alertmanager-main-0\" (UID: \"ed5f87c4-d5fa-4f5d-a2bc-453384227716\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:16:46.877871 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.877855 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s64ft\" (UniqueName: \"kubernetes.io/projected/ed5f87c4-d5fa-4f5d-a2bc-453384227716-kube-api-access-s64ft\") pod \"alertmanager-main-0\" (UID: \"ed5f87c4-d5fa-4f5d-a2bc-453384227716\") " pod="openshift-monitoring/alertmanager-main-0" May 25 14:16:46.960974 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:46.960943 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 25 14:16:47.096686 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:47.096663 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 25 14:16:47.099521 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:16:47.099492 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded5f87c4_d5fa_4f5d_a2bc_453384227716.slice/crio-aa4641e10a922e132d8022689ce91f630a4f3bf659ff037ba3c7005746a7f77c WatchSource:0}: Error finding container aa4641e10a922e132d8022689ce91f630a4f3bf659ff037ba3c7005746a7f77c: Status 404 returned error can't find the container with id aa4641e10a922e132d8022689ce91f630a4f3bf659ff037ba3c7005746a7f77c May 25 14:16:47.295056 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:47.295026 2562 generic.go:358] "Generic (PLEG): container finished" podID="ed5f87c4-d5fa-4f5d-a2bc-453384227716" containerID="d2fd69e51c76087b88cca385d8b72ab777a3d1e978c695a323aec08156c59e13" exitCode=0 May 25 14:16:47.295513 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:47.295119 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ed5f87c4-d5fa-4f5d-a2bc-453384227716","Type":"ContainerDied","Data":"d2fd69e51c76087b88cca385d8b72ab777a3d1e978c695a323aec08156c59e13"} May 25 14:16:47.295513 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:47.295156 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ed5f87c4-d5fa-4f5d-a2bc-453384227716","Type":"ContainerStarted","Data":"aa4641e10a922e132d8022689ce91f630a4f3bf659ff037ba3c7005746a7f77c"} May 25 14:16:48.302644 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:48.302609 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ed5f87c4-d5fa-4f5d-a2bc-453384227716","Type":"ContainerStarted","Data":"e079c94e9408e14610857a46acaa5d7589f6e08d2ef2f445d1ab7e508b89c2b4"} May 25 14:16:48.302644 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:48.302644 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ed5f87c4-d5fa-4f5d-a2bc-453384227716","Type":"ContainerStarted","Data":"6434e2673b6280acf841b7af759dde62bbe2492f549851e0107d50f337cdc7a0"} May 25 14:16:48.302644 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:48.302653 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ed5f87c4-d5fa-4f5d-a2bc-453384227716","Type":"ContainerStarted","Data":"36b74c64befa5926612a662ab5d88716da6a91582dbe62e4a0be4fe227b7bcde"} May 25 14:16:48.303198 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:48.302662 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ed5f87c4-d5fa-4f5d-a2bc-453384227716","Type":"ContainerStarted","Data":"4ec50e2c91d0b3aca9123d6bf4a01b11230514e91385a89817d6ecfc4a3ba97b"} May 25 14:16:48.303198 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:48.302670 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ed5f87c4-d5fa-4f5d-a2bc-453384227716","Type":"ContainerStarted","Data":"1735551d54c41151e7cc383766f5e43ce84aa04e71df4fa54f73351bdb0912b9"} May 25 14:16:48.303198 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:48.302680 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ed5f87c4-d5fa-4f5d-a2bc-453384227716","Type":"ContainerStarted","Data":"a2a042149c7b33b26996b66b1bea45dfaf286918f95c3baf98c9c328421cad97"} May 25 14:16:48.330946 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:48.330899 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.330884584 podStartE2EDuration="2.330884584s" podCreationTimestamp="2026-05-25 14:16:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 14:16:48.328062783 +0000 UTC m=+262.535310002" watchObservedRunningTime="2026-05-25 14:16:48.330884584 +0000 UTC m=+262.538131787" May 25 14:16:48.366846 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:48.366810 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ec0bdee-59a1-4438-b994-0e63c1dc8049" path="/var/lib/kubelet/pods/0ec0bdee-59a1-4438-b994-0e63c1dc8049/volumes" May 25 14:16:49.314136 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.314102 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 14:16:49.314620 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.314567 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f6f6cded-64b6-4d21-9003-2a2c27de3898" containerName="prometheus" containerID="cri-o://d9daeedc8b870a197aa5ba14ed5c7c6a81bdd2a4a3b45f07dd8ba0bb0838f5c8" gracePeriod=600 May 25 14:16:49.314773 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.314599 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f6f6cded-64b6-4d21-9003-2a2c27de3898" containerName="kube-rbac-proxy" containerID="cri-o://2698013a52eeea06d918383a087b7c8d81048c5aee4ff5b26b8208144561e5e1" gracePeriod=600 May 25 14:16:49.314865 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.314630 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f6f6cded-64b6-4d21-9003-2a2c27de3898" containerName="kube-rbac-proxy-web" containerID="cri-o://a486e8c7ff3bf978a30f90d3c8775963bd97590d586d449d50dce8792a0929e7" gracePeriod=600 May 25 14:16:49.314954 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.314643 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f6f6cded-64b6-4d21-9003-2a2c27de3898" containerName="config-reloader" containerID="cri-o://56a8053cdc56c078a2380f204403a7ee68e398bf9a5b05fc7f1d4e9ec9f21c83" gracePeriod=600 May 25 14:16:49.315026 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.314632 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f6f6cded-64b6-4d21-9003-2a2c27de3898" containerName="kube-rbac-proxy-thanos" containerID="cri-o://7a907fadf5c9bf85435669c44c53641df0d2080c799a6c8d37542d1549f628d0" gracePeriod=600 May 25 14:16:49.315026 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.314645 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f6f6cded-64b6-4d21-9003-2a2c27de3898" containerName="thanos-sidecar" containerID="cri-o://91226935600c7a70bad79bb2493705d335040d1d0e4b6cdf3751bb21b663be94" gracePeriod=600 May 25 14:16:49.563288 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.563264 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:49.696947 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.696846 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f6f6cded-64b6-4d21-9003-2a2c27de3898-tls-assets\") pod \"f6f6cded-64b6-4d21-9003-2a2c27de3898\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " May 25 14:16:49.696947 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.696914 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6f6cded-64b6-4d21-9003-2a2c27de3898-prometheus-trusted-ca-bundle\") pod \"f6f6cded-64b6-4d21-9003-2a2c27de3898\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " May 25 14:16:49.696947 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.696950 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f6f6cded-64b6-4d21-9003-2a2c27de3898-prometheus-k8s-rulefiles-0\") pod \"f6f6cded-64b6-4d21-9003-2a2c27de3898\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " May 25 14:16:49.697218 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.696968 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f6f6cded-64b6-4d21-9003-2a2c27de3898-prometheus-k8s-db\") pod \"f6f6cded-64b6-4d21-9003-2a2c27de3898\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " May 25 14:16:49.697218 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.697003 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-secret-grpc-tls\") pod \"f6f6cded-64b6-4d21-9003-2a2c27de3898\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " May 25 14:16:49.697218 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.697034 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f6f6cded-64b6-4d21-9003-2a2c27de3898-config-out\") pod \"f6f6cded-64b6-4d21-9003-2a2c27de3898\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " May 25 14:16:49.697218 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.697054 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-config\") pod \"f6f6cded-64b6-4d21-9003-2a2c27de3898\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " May 25 14:16:49.697218 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.697129 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-web-config\") pod \"f6f6cded-64b6-4d21-9003-2a2c27de3898\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " May 25 14:16:49.697218 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.697185 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-thanos-prometheus-http-client-file\") pod \"f6f6cded-64b6-4d21-9003-2a2c27de3898\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " May 25 14:16:49.697218 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.697220 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6f6cded-64b6-4d21-9003-2a2c27de3898-configmap-serving-certs-ca-bundle\") pod \"f6f6cded-64b6-4d21-9003-2a2c27de3898\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " May 25 14:16:49.697616 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.697249 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-secret-metrics-client-certs\") pod \"f6f6cded-64b6-4d21-9003-2a2c27de3898\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " May 25 14:16:49.697616 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.697274 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"f6f6cded-64b6-4d21-9003-2a2c27de3898\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " May 25 14:16:49.697616 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.697301 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dswdn\" (UniqueName: \"kubernetes.io/projected/f6f6cded-64b6-4d21-9003-2a2c27de3898-kube-api-access-dswdn\") pod \"f6f6cded-64b6-4d21-9003-2a2c27de3898\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " May 25 14:16:49.697616 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.697362 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"f6f6cded-64b6-4d21-9003-2a2c27de3898\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " May 25 14:16:49.697616 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.697438 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6f6cded-64b6-4d21-9003-2a2c27de3898-configmap-kubelet-serving-ca-bundle\") pod \"f6f6cded-64b6-4d21-9003-2a2c27de3898\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " May 25 14:16:49.697616 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.697465 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-secret-kube-rbac-proxy\") pod \"f6f6cded-64b6-4d21-9003-2a2c27de3898\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " May 25 14:16:49.697616 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.697499 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-secret-prometheus-k8s-tls\") pod \"f6f6cded-64b6-4d21-9003-2a2c27de3898\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " May 25 14:16:49.697616 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.697557 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6f6cded-64b6-4d21-9003-2a2c27de3898-configmap-metrics-client-ca\") pod \"f6f6cded-64b6-4d21-9003-2a2c27de3898\" (UID: \"f6f6cded-64b6-4d21-9003-2a2c27de3898\") " May 25 14:16:49.700682 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.697491 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6f6cded-64b6-4d21-9003-2a2c27de3898-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "f6f6cded-64b6-4d21-9003-2a2c27de3898" (UID: "f6f6cded-64b6-4d21-9003-2a2c27de3898"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 14:16:49.701028 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.698112 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6f6cded-64b6-4d21-9003-2a2c27de3898-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "f6f6cded-64b6-4d21-9003-2a2c27de3898" (UID: "f6f6cded-64b6-4d21-9003-2a2c27de3898"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 14:16:49.701028 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.698211 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6f6cded-64b6-4d21-9003-2a2c27de3898-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "f6f6cded-64b6-4d21-9003-2a2c27de3898" (UID: "f6f6cded-64b6-4d21-9003-2a2c27de3898"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 25 14:16:49.701028 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.698907 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6f6cded-64b6-4d21-9003-2a2c27de3898-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "f6f6cded-64b6-4d21-9003-2a2c27de3898" (UID: "f6f6cded-64b6-4d21-9003-2a2c27de3898"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 14:16:49.701028 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.699827 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6f6cded-64b6-4d21-9003-2a2c27de3898-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f6f6cded-64b6-4d21-9003-2a2c27de3898" (UID: "f6f6cded-64b6-4d21-9003-2a2c27de3898"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 14:16:49.701028 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.699931 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-config" (OuterVolumeSpecName: "config") pod "f6f6cded-64b6-4d21-9003-2a2c27de3898" (UID: "f6f6cded-64b6-4d21-9003-2a2c27de3898"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 14:16:49.701028 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.700173 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6f6cded-64b6-4d21-9003-2a2c27de3898-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "f6f6cded-64b6-4d21-9003-2a2c27de3898" (UID: "f6f6cded-64b6-4d21-9003-2a2c27de3898"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 14:16:49.701028 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.700235 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "f6f6cded-64b6-4d21-9003-2a2c27de3898" (UID: "f6f6cded-64b6-4d21-9003-2a2c27de3898"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 14:16:49.701028 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.700254 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6f6cded-64b6-4d21-9003-2a2c27de3898-config-out" (OuterVolumeSpecName: "config-out") pod "f6f6cded-64b6-4d21-9003-2a2c27de3898" (UID: "f6f6cded-64b6-4d21-9003-2a2c27de3898"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 25 14:16:49.701028 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.700652 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6f6cded-64b6-4d21-9003-2a2c27de3898-kube-api-access-dswdn" (OuterVolumeSpecName: "kube-api-access-dswdn") pod "f6f6cded-64b6-4d21-9003-2a2c27de3898" (UID: "f6f6cded-64b6-4d21-9003-2a2c27de3898"). InnerVolumeSpecName "kube-api-access-dswdn". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 14:16:49.701551 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.701082 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6f6cded-64b6-4d21-9003-2a2c27de3898-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "f6f6cded-64b6-4d21-9003-2a2c27de3898" (UID: "f6f6cded-64b6-4d21-9003-2a2c27de3898"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 14:16:49.701607 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.701568 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "f6f6cded-64b6-4d21-9003-2a2c27de3898" (UID: "f6f6cded-64b6-4d21-9003-2a2c27de3898"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 14:16:49.701659 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.701608 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "f6f6cded-64b6-4d21-9003-2a2c27de3898" (UID: "f6f6cded-64b6-4d21-9003-2a2c27de3898"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 14:16:49.702314 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.702283 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "f6f6cded-64b6-4d21-9003-2a2c27de3898" (UID: "f6f6cded-64b6-4d21-9003-2a2c27de3898"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 14:16:49.702470 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.702451 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "f6f6cded-64b6-4d21-9003-2a2c27de3898" (UID: "f6f6cded-64b6-4d21-9003-2a2c27de3898"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 14:16:49.702538 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.702520 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "f6f6cded-64b6-4d21-9003-2a2c27de3898" (UID: "f6f6cded-64b6-4d21-9003-2a2c27de3898"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 14:16:49.702651 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.702635 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "f6f6cded-64b6-4d21-9003-2a2c27de3898" (UID: "f6f6cded-64b6-4d21-9003-2a2c27de3898"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 14:16:49.712841 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.712821 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-web-config" (OuterVolumeSpecName: "web-config") pod "f6f6cded-64b6-4d21-9003-2a2c27de3898" (UID: "f6f6cded-64b6-4d21-9003-2a2c27de3898"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 14:16:49.798470 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.798431 2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-140-29.ec2.internal\" DevicePath \"\"" May 25 14:16:49.798470 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.798463 2562 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6f6cded-64b6-4d21-9003-2a2c27de3898-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-140-29.ec2.internal\" DevicePath \"\"" May 25 14:16:49.798470 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.798476 2562 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-secret-kube-rbac-proxy\") on node \"ip-10-0-140-29.ec2.internal\" DevicePath \"\"" May 25 14:16:49.798704 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.798489 2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-secret-prometheus-k8s-tls\") on node \"ip-10-0-140-29.ec2.internal\" DevicePath \"\"" May 25 14:16:49.798704 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.798498 2562 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f6f6cded-64b6-4d21-9003-2a2c27de3898-configmap-metrics-client-ca\") on node \"ip-10-0-140-29.ec2.internal\" DevicePath \"\"" May 25 14:16:49.798704 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.798508 2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f6f6cded-64b6-4d21-9003-2a2c27de3898-tls-assets\") on node \"ip-10-0-140-29.ec2.internal\" DevicePath \"\"" May 25 14:16:49.798704 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.798516 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6f6cded-64b6-4d21-9003-2a2c27de3898-prometheus-trusted-ca-bundle\") on node \"ip-10-0-140-29.ec2.internal\" DevicePath \"\"" May 25 14:16:49.798704 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.798524 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f6f6cded-64b6-4d21-9003-2a2c27de3898-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-140-29.ec2.internal\" DevicePath \"\"" May 25 14:16:49.798704 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.798532 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f6f6cded-64b6-4d21-9003-2a2c27de3898-prometheus-k8s-db\") on node \"ip-10-0-140-29.ec2.internal\" DevicePath \"\"" May 25 14:16:49.798704 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.798541 2562 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-secret-grpc-tls\") on node \"ip-10-0-140-29.ec2.internal\" DevicePath \"\"" May 25 14:16:49.798704 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.798549 2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f6f6cded-64b6-4d21-9003-2a2c27de3898-config-out\") on node \"ip-10-0-140-29.ec2.internal\" DevicePath \"\"" May 25 14:16:49.798704 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.798558 2562 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-config\") on node \"ip-10-0-140-29.ec2.internal\" DevicePath \"\"" May 25 14:16:49.798704 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.798565 2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-web-config\") on node \"ip-10-0-140-29.ec2.internal\" DevicePath \"\"" May 25 14:16:49.798704 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.798573 2562 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-thanos-prometheus-http-client-file\") on node \"ip-10-0-140-29.ec2.internal\" DevicePath \"\"" May 25 14:16:49.798704 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.798581 2562 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6f6cded-64b6-4d21-9003-2a2c27de3898-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-140-29.ec2.internal\" DevicePath \"\"" May 25 14:16:49.798704 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.798590 2562 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-secret-metrics-client-certs\") on node \"ip-10-0-140-29.ec2.internal\" DevicePath \"\"" May 25 14:16:49.798704 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.798599 2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f6f6cded-64b6-4d21-9003-2a2c27de3898-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-140-29.ec2.internal\" DevicePath \"\"" May 25 14:16:49.798704 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:49.798608 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dswdn\" (UniqueName: \"kubernetes.io/projected/f6f6cded-64b6-4d21-9003-2a2c27de3898-kube-api-access-dswdn\") on node \"ip-10-0-140-29.ec2.internal\" DevicePath \"\"" May 25 14:16:50.312460 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.312419 2562 generic.go:358] "Generic (PLEG): container finished" podID="f6f6cded-64b6-4d21-9003-2a2c27de3898" containerID="7a907fadf5c9bf85435669c44c53641df0d2080c799a6c8d37542d1549f628d0" exitCode=0 May 25 14:16:50.312460 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.312450 2562 generic.go:358] "Generic (PLEG): container finished" podID="f6f6cded-64b6-4d21-9003-2a2c27de3898" containerID="2698013a52eeea06d918383a087b7c8d81048c5aee4ff5b26b8208144561e5e1" exitCode=0 May 25 14:16:50.312460 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.312458 2562 generic.go:358] "Generic (PLEG): container finished" podID="f6f6cded-64b6-4d21-9003-2a2c27de3898" containerID="a486e8c7ff3bf978a30f90d3c8775963bd97590d586d449d50dce8792a0929e7" exitCode=0 May 25 14:16:50.312460 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.312466 2562 generic.go:358] "Generic (PLEG): container finished" podID="f6f6cded-64b6-4d21-9003-2a2c27de3898" containerID="91226935600c7a70bad79bb2493705d335040d1d0e4b6cdf3751bb21b663be94" exitCode=0 May 25 14:16:50.312460 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.312472 2562 generic.go:358] "Generic (PLEG): container finished" podID="f6f6cded-64b6-4d21-9003-2a2c27de3898" containerID="56a8053cdc56c078a2380f204403a7ee68e398bf9a5b05fc7f1d4e9ec9f21c83" exitCode=0 May 25 14:16:50.312829 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.312478 2562 generic.go:358] "Generic (PLEG): container finished" podID="f6f6cded-64b6-4d21-9003-2a2c27de3898" containerID="d9daeedc8b870a197aa5ba14ed5c7c6a81bdd2a4a3b45f07dd8ba0bb0838f5c8" exitCode=0 May 25 14:16:50.312829 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.312511 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f6f6cded-64b6-4d21-9003-2a2c27de3898","Type":"ContainerDied","Data":"7a907fadf5c9bf85435669c44c53641df0d2080c799a6c8d37542d1549f628d0"} May 25 14:16:50.312829 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.312549 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f6f6cded-64b6-4d21-9003-2a2c27de3898","Type":"ContainerDied","Data":"2698013a52eeea06d918383a087b7c8d81048c5aee4ff5b26b8208144561e5e1"} May 25 14:16:50.312829 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.312565 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f6f6cded-64b6-4d21-9003-2a2c27de3898","Type":"ContainerDied","Data":"a486e8c7ff3bf978a30f90d3c8775963bd97590d586d449d50dce8792a0929e7"} May 25 14:16:50.312829 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.312580 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f6f6cded-64b6-4d21-9003-2a2c27de3898","Type":"ContainerDied","Data":"91226935600c7a70bad79bb2493705d335040d1d0e4b6cdf3751bb21b663be94"} May 25 14:16:50.312829 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.312602 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f6f6cded-64b6-4d21-9003-2a2c27de3898","Type":"ContainerDied","Data":"56a8053cdc56c078a2380f204403a7ee68e398bf9a5b05fc7f1d4e9ec9f21c83"} May 25 14:16:50.312829 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.312566 2562 scope.go:117] "RemoveContainer" containerID="7a907fadf5c9bf85435669c44c53641df0d2080c799a6c8d37542d1549f628d0" May 25 14:16:50.312829 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.312612 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f6f6cded-64b6-4d21-9003-2a2c27de3898","Type":"ContainerDied","Data":"d9daeedc8b870a197aa5ba14ed5c7c6a81bdd2a4a3b45f07dd8ba0bb0838f5c8"} May 25 14:16:50.312829 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.312697 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f6f6cded-64b6-4d21-9003-2a2c27de3898","Type":"ContainerDied","Data":"e4a47df95942261c5ef8279cf23e449c8ff0217998ef0a731815e6056c805fc9"} May 25 14:16:50.312829 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.312548 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.320677 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.320453 2562 scope.go:117] "RemoveContainer" containerID="2698013a52eeea06d918383a087b7c8d81048c5aee4ff5b26b8208144561e5e1" May 25 14:16:50.327499 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.327480 2562 scope.go:117] "RemoveContainer" containerID="a486e8c7ff3bf978a30f90d3c8775963bd97590d586d449d50dce8792a0929e7" May 25 14:16:50.337271 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.337243 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 14:16:50.341667 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.341642 2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 14:16:50.347343 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.347328 2562 scope.go:117] "RemoveContainer" containerID="91226935600c7a70bad79bb2493705d335040d1d0e4b6cdf3751bb21b663be94" May 25 14:16:50.354147 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.354130 2562 scope.go:117] "RemoveContainer" containerID="56a8053cdc56c078a2380f204403a7ee68e398bf9a5b05fc7f1d4e9ec9f21c83" May 25 14:16:50.361543 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.361520 2562 scope.go:117] "RemoveContainer" containerID="d9daeedc8b870a197aa5ba14ed5c7c6a81bdd2a4a3b45f07dd8ba0bb0838f5c8" May 25 14:16:50.369003 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.368973 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6f6cded-64b6-4d21-9003-2a2c27de3898" path="/var/lib/kubelet/pods/f6f6cded-64b6-4d21-9003-2a2c27de3898/volumes" May 25 14:16:50.371022 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.370976 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 14:16:50.371101 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.371084 2562 scope.go:117] "RemoveContainer" containerID="68421249ce14624246678309eddbdbab777f0feda20f81d17cd9681ac3dad612" May 25 14:16:50.371403 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.371385 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6f6cded-64b6-4d21-9003-2a2c27de3898" containerName="prometheus" May 25 14:16:50.371403 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.371404 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6f6cded-64b6-4d21-9003-2a2c27de3898" containerName="prometheus" May 25 14:16:50.371498 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.371415 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6f6cded-64b6-4d21-9003-2a2c27de3898" containerName="kube-rbac-proxy-web" May 25 14:16:50.371498 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.371424 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6f6cded-64b6-4d21-9003-2a2c27de3898" containerName="kube-rbac-proxy-web" May 25 14:16:50.371498 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.371435 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6f6cded-64b6-4d21-9003-2a2c27de3898" containerName="config-reloader" May 25 14:16:50.371498 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.371444 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6f6cded-64b6-4d21-9003-2a2c27de3898" containerName="config-reloader" May 25 14:16:50.371498 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.371466 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6f6cded-64b6-4d21-9003-2a2c27de3898" containerName="kube-rbac-proxy" May 25 14:16:50.371498 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.371471 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6f6cded-64b6-4d21-9003-2a2c27de3898" containerName="kube-rbac-proxy" May 25 14:16:50.371498 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.371481 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6f6cded-64b6-4d21-9003-2a2c27de3898" containerName="init-config-reloader" May 25 14:16:50.371498 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.371487 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6f6cded-64b6-4d21-9003-2a2c27de3898" containerName="init-config-reloader" May 25 14:16:50.371498 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.371495 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6f6cded-64b6-4d21-9003-2a2c27de3898" containerName="kube-rbac-proxy-thanos" May 25 14:16:50.371498 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.371500 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6f6cded-64b6-4d21-9003-2a2c27de3898" containerName="kube-rbac-proxy-thanos" May 25 14:16:50.371867 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.371513 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6f6cded-64b6-4d21-9003-2a2c27de3898" containerName="thanos-sidecar" May 25 14:16:50.371867 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.371518 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6f6cded-64b6-4d21-9003-2a2c27de3898" containerName="thanos-sidecar" May 25 14:16:50.371867 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.371571 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="f6f6cded-64b6-4d21-9003-2a2c27de3898" containerName="thanos-sidecar" May 25 14:16:50.371867 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.371584 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="f6f6cded-64b6-4d21-9003-2a2c27de3898" containerName="prometheus" May 25 14:16:50.371867 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.371593 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="f6f6cded-64b6-4d21-9003-2a2c27de3898" containerName="kube-rbac-proxy-thanos" May 25 14:16:50.371867 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.371604 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="f6f6cded-64b6-4d21-9003-2a2c27de3898" containerName="kube-rbac-proxy-web" May 25 14:16:50.371867 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.371610 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="f6f6cded-64b6-4d21-9003-2a2c27de3898" containerName="config-reloader" May 25 14:16:50.371867 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.371616 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="f6f6cded-64b6-4d21-9003-2a2c27de3898" containerName="kube-rbac-proxy" May 25 14:16:50.375244 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.375225 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.378479 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.378227 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 25 14:16:50.378479 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.378313 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xs6sh\"" May 25 14:16:50.378479 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.378322 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 25 14:16:50.378479 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.378342 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 25 14:16:50.378479 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.378317 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 25 14:16:50.378725 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.378693 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 25 14:16:50.378725 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.378709 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 25 14:16:50.378817 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.378717 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 25 14:16:50.378817 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.378777 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 25 14:16:50.378917 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.378838 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6i7bmnri6389o\"" May 25 14:16:50.378986 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.378967 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 25 14:16:50.379082 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.379036 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 25 14:16:50.379291 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.379274 2562 scope.go:117] "RemoveContainer" containerID="7a907fadf5c9bf85435669c44c53641df0d2080c799a6c8d37542d1549f628d0" May 25 14:16:50.379665 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:16:50.379641 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a907fadf5c9bf85435669c44c53641df0d2080c799a6c8d37542d1549f628d0\": container with ID starting with 7a907fadf5c9bf85435669c44c53641df0d2080c799a6c8d37542d1549f628d0 not found: ID does not exist" containerID="7a907fadf5c9bf85435669c44c53641df0d2080c799a6c8d37542d1549f628d0" May 25 14:16:50.379750 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.379675 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a907fadf5c9bf85435669c44c53641df0d2080c799a6c8d37542d1549f628d0"} err="failed to get container status \"7a907fadf5c9bf85435669c44c53641df0d2080c799a6c8d37542d1549f628d0\": rpc error: code = NotFound desc = could not find container \"7a907fadf5c9bf85435669c44c53641df0d2080c799a6c8d37542d1549f628d0\": container with ID starting with 7a907fadf5c9bf85435669c44c53641df0d2080c799a6c8d37542d1549f628d0 not found: ID does not exist" May 25 14:16:50.379750 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.379703 2562 scope.go:117] "RemoveContainer" containerID="2698013a52eeea06d918383a087b7c8d81048c5aee4ff5b26b8208144561e5e1" May 25 14:16:50.380022 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:16:50.380003 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2698013a52eeea06d918383a087b7c8d81048c5aee4ff5b26b8208144561e5e1\": container with ID starting with 2698013a52eeea06d918383a087b7c8d81048c5aee4ff5b26b8208144561e5e1 not found: ID does not exist" containerID="2698013a52eeea06d918383a087b7c8d81048c5aee4ff5b26b8208144561e5e1" May 25 14:16:50.380075 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.380028 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2698013a52eeea06d918383a087b7c8d81048c5aee4ff5b26b8208144561e5e1"} err="failed to get container status \"2698013a52eeea06d918383a087b7c8d81048c5aee4ff5b26b8208144561e5e1\": rpc error: code = NotFound desc = could not find container \"2698013a52eeea06d918383a087b7c8d81048c5aee4ff5b26b8208144561e5e1\": container with ID starting with 2698013a52eeea06d918383a087b7c8d81048c5aee4ff5b26b8208144561e5e1 not found: ID does not exist" May 25 14:16:50.380075 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.380046 2562 scope.go:117] "RemoveContainer" containerID="a486e8c7ff3bf978a30f90d3c8775963bd97590d586d449d50dce8792a0929e7" May 25 14:16:50.380345 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:16:50.380316 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a486e8c7ff3bf978a30f90d3c8775963bd97590d586d449d50dce8792a0929e7\": container with ID starting with a486e8c7ff3bf978a30f90d3c8775963bd97590d586d449d50dce8792a0929e7 not found: ID does not exist" containerID="a486e8c7ff3bf978a30f90d3c8775963bd97590d586d449d50dce8792a0929e7" May 25 14:16:50.380425 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.380349 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a486e8c7ff3bf978a30f90d3c8775963bd97590d586d449d50dce8792a0929e7"} err="failed to get container status \"a486e8c7ff3bf978a30f90d3c8775963bd97590d586d449d50dce8792a0929e7\": rpc error: code = NotFound desc = could not find container \"a486e8c7ff3bf978a30f90d3c8775963bd97590d586d449d50dce8792a0929e7\": container with ID starting with a486e8c7ff3bf978a30f90d3c8775963bd97590d586d449d50dce8792a0929e7 not found: ID does not exist" May 25 14:16:50.380510 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.380493 2562 scope.go:117] "RemoveContainer" containerID="91226935600c7a70bad79bb2493705d335040d1d0e4b6cdf3751bb21b663be94" May 25 14:16:50.380810 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:16:50.380780 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91226935600c7a70bad79bb2493705d335040d1d0e4b6cdf3751bb21b663be94\": container with ID starting with 91226935600c7a70bad79bb2493705d335040d1d0e4b6cdf3751bb21b663be94 not found: ID does not exist" containerID="91226935600c7a70bad79bb2493705d335040d1d0e4b6cdf3751bb21b663be94" May 25 14:16:50.380872 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.380815 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91226935600c7a70bad79bb2493705d335040d1d0e4b6cdf3751bb21b663be94"} err="failed to get container status \"91226935600c7a70bad79bb2493705d335040d1d0e4b6cdf3751bb21b663be94\": rpc error: code = NotFound desc = could not find container \"91226935600c7a70bad79bb2493705d335040d1d0e4b6cdf3751bb21b663be94\": container with ID starting with 91226935600c7a70bad79bb2493705d335040d1d0e4b6cdf3751bb21b663be94 not found: ID does not exist" May 25 14:16:50.380872 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.380831 2562 scope.go:117] "RemoveContainer" containerID="56a8053cdc56c078a2380f204403a7ee68e398bf9a5b05fc7f1d4e9ec9f21c83" May 25 14:16:50.381112 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:16:50.381093 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56a8053cdc56c078a2380f204403a7ee68e398bf9a5b05fc7f1d4e9ec9f21c83\": container with ID starting with 56a8053cdc56c078a2380f204403a7ee68e398bf9a5b05fc7f1d4e9ec9f21c83 not found: ID does not exist" containerID="56a8053cdc56c078a2380f204403a7ee68e398bf9a5b05fc7f1d4e9ec9f21c83" May 25 14:16:50.381176 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.381118 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56a8053cdc56c078a2380f204403a7ee68e398bf9a5b05fc7f1d4e9ec9f21c83"} err="failed to get container status \"56a8053cdc56c078a2380f204403a7ee68e398bf9a5b05fc7f1d4e9ec9f21c83\": rpc error: code = NotFound desc = could not find container \"56a8053cdc56c078a2380f204403a7ee68e398bf9a5b05fc7f1d4e9ec9f21c83\": container with ID starting with 56a8053cdc56c078a2380f204403a7ee68e398bf9a5b05fc7f1d4e9ec9f21c83 not found: ID does not exist" May 25 14:16:50.381176 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.381139 2562 scope.go:117] "RemoveContainer" containerID="d9daeedc8b870a197aa5ba14ed5c7c6a81bdd2a4a3b45f07dd8ba0bb0838f5c8" May 25 14:16:50.381782 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:16:50.381485 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9daeedc8b870a197aa5ba14ed5c7c6a81bdd2a4a3b45f07dd8ba0bb0838f5c8\": container with ID starting with d9daeedc8b870a197aa5ba14ed5c7c6a81bdd2a4a3b45f07dd8ba0bb0838f5c8 not found: ID does not exist" containerID="d9daeedc8b870a197aa5ba14ed5c7c6a81bdd2a4a3b45f07dd8ba0bb0838f5c8" May 25 14:16:50.381782 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.381514 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9daeedc8b870a197aa5ba14ed5c7c6a81bdd2a4a3b45f07dd8ba0bb0838f5c8"} err="failed to get container status \"d9daeedc8b870a197aa5ba14ed5c7c6a81bdd2a4a3b45f07dd8ba0bb0838f5c8\": rpc error: code = NotFound desc = could not find container \"d9daeedc8b870a197aa5ba14ed5c7c6a81bdd2a4a3b45f07dd8ba0bb0838f5c8\": container with ID starting with d9daeedc8b870a197aa5ba14ed5c7c6a81bdd2a4a3b45f07dd8ba0bb0838f5c8 not found: ID does not exist" May 25 14:16:50.381782 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.381534 2562 scope.go:117] "RemoveContainer" containerID="68421249ce14624246678309eddbdbab777f0feda20f81d17cd9681ac3dad612" May 25 14:16:50.381782 ip-10-0-140-29 kubenswrapper[2562]: E0525 14:16:50.381779 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68421249ce14624246678309eddbdbab777f0feda20f81d17cd9681ac3dad612\": container with ID starting with 68421249ce14624246678309eddbdbab777f0feda20f81d17cd9681ac3dad612 not found: ID does not exist" containerID="68421249ce14624246678309eddbdbab777f0feda20f81d17cd9681ac3dad612" May 25 14:16:50.382034 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.381800 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68421249ce14624246678309eddbdbab777f0feda20f81d17cd9681ac3dad612"} err="failed to get container status \"68421249ce14624246678309eddbdbab777f0feda20f81d17cd9681ac3dad612\": rpc error: code = NotFound desc = could not find container \"68421249ce14624246678309eddbdbab777f0feda20f81d17cd9681ac3dad612\": container with ID starting with 68421249ce14624246678309eddbdbab777f0feda20f81d17cd9681ac3dad612 not found: ID does not exist" May 25 14:16:50.382034 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.381820 2562 scope.go:117] "RemoveContainer" containerID="7a907fadf5c9bf85435669c44c53641df0d2080c799a6c8d37542d1549f628d0" May 25 14:16:50.382135 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.382076 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a907fadf5c9bf85435669c44c53641df0d2080c799a6c8d37542d1549f628d0"} err="failed to get container status \"7a907fadf5c9bf85435669c44c53641df0d2080c799a6c8d37542d1549f628d0\": rpc error: code = NotFound desc = could not find container \"7a907fadf5c9bf85435669c44c53641df0d2080c799a6c8d37542d1549f628d0\": container with ID starting with 7a907fadf5c9bf85435669c44c53641df0d2080c799a6c8d37542d1549f628d0 not found: ID does not exist" May 25 14:16:50.382135 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.382094 2562 scope.go:117] "RemoveContainer" containerID="2698013a52eeea06d918383a087b7c8d81048c5aee4ff5b26b8208144561e5e1" May 25 14:16:50.382236 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.382163 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 25 14:16:50.382358 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.382340 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2698013a52eeea06d918383a087b7c8d81048c5aee4ff5b26b8208144561e5e1"} err="failed to get container status \"2698013a52eeea06d918383a087b7c8d81048c5aee4ff5b26b8208144561e5e1\": rpc error: code = NotFound desc = could not find container \"2698013a52eeea06d918383a087b7c8d81048c5aee4ff5b26b8208144561e5e1\": container with ID starting with 2698013a52eeea06d918383a087b7c8d81048c5aee4ff5b26b8208144561e5e1 not found: ID does not exist" May 25 14:16:50.382358 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.382358 2562 scope.go:117] "RemoveContainer" containerID="a486e8c7ff3bf978a30f90d3c8775963bd97590d586d449d50dce8792a0929e7" May 25 14:16:50.382633 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.382611 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a486e8c7ff3bf978a30f90d3c8775963bd97590d586d449d50dce8792a0929e7"} err="failed to get container status \"a486e8c7ff3bf978a30f90d3c8775963bd97590d586d449d50dce8792a0929e7\": rpc error: code = NotFound desc = could not find container \"a486e8c7ff3bf978a30f90d3c8775963bd97590d586d449d50dce8792a0929e7\": container with ID starting with a486e8c7ff3bf978a30f90d3c8775963bd97590d586d449d50dce8792a0929e7 not found: ID does not exist" May 25 14:16:50.382633 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.382631 2562 scope.go:117] "RemoveContainer" containerID="91226935600c7a70bad79bb2493705d335040d1d0e4b6cdf3751bb21b663be94" May 25 14:16:50.382885 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.382855 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91226935600c7a70bad79bb2493705d335040d1d0e4b6cdf3751bb21b663be94"} err="failed to get container status \"91226935600c7a70bad79bb2493705d335040d1d0e4b6cdf3751bb21b663be94\": rpc error: code = NotFound desc = could not find container \"91226935600c7a70bad79bb2493705d335040d1d0e4b6cdf3751bb21b663be94\": container with ID starting with 91226935600c7a70bad79bb2493705d335040d1d0e4b6cdf3751bb21b663be94 not found: ID does not exist" May 25 14:16:50.382978 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.382886 2562 scope.go:117] "RemoveContainer" containerID="56a8053cdc56c078a2380f204403a7ee68e398bf9a5b05fc7f1d4e9ec9f21c83" May 25 14:16:50.383218 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.383149 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56a8053cdc56c078a2380f204403a7ee68e398bf9a5b05fc7f1d4e9ec9f21c83"} err="failed to get container status \"56a8053cdc56c078a2380f204403a7ee68e398bf9a5b05fc7f1d4e9ec9f21c83\": rpc error: code = NotFound desc = could not find container \"56a8053cdc56c078a2380f204403a7ee68e398bf9a5b05fc7f1d4e9ec9f21c83\": container with ID starting with 56a8053cdc56c078a2380f204403a7ee68e398bf9a5b05fc7f1d4e9ec9f21c83 not found: ID does not exist" May 25 14:16:50.383218 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.383175 2562 scope.go:117] "RemoveContainer" containerID="d9daeedc8b870a197aa5ba14ed5c7c6a81bdd2a4a3b45f07dd8ba0bb0838f5c8" May 25 14:16:50.383613 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.383571 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9daeedc8b870a197aa5ba14ed5c7c6a81bdd2a4a3b45f07dd8ba0bb0838f5c8"} err="failed to get container status \"d9daeedc8b870a197aa5ba14ed5c7c6a81bdd2a4a3b45f07dd8ba0bb0838f5c8\": rpc error: code = NotFound desc = could not find container \"d9daeedc8b870a197aa5ba14ed5c7c6a81bdd2a4a3b45f07dd8ba0bb0838f5c8\": container with ID starting with d9daeedc8b870a197aa5ba14ed5c7c6a81bdd2a4a3b45f07dd8ba0bb0838f5c8 not found: ID does not exist" May 25 14:16:50.383613 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.383597 2562 scope.go:117] "RemoveContainer" containerID="68421249ce14624246678309eddbdbab777f0feda20f81d17cd9681ac3dad612" May 25 14:16:50.383890 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.383870 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68421249ce14624246678309eddbdbab777f0feda20f81d17cd9681ac3dad612"} err="failed to get container status \"68421249ce14624246678309eddbdbab777f0feda20f81d17cd9681ac3dad612\": rpc error: code = NotFound desc = could not find container \"68421249ce14624246678309eddbdbab777f0feda20f81d17cd9681ac3dad612\": container with ID starting with 68421249ce14624246678309eddbdbab777f0feda20f81d17cd9681ac3dad612 not found: ID does not exist" May 25 14:16:50.383967 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.383891 2562 scope.go:117] "RemoveContainer" containerID="7a907fadf5c9bf85435669c44c53641df0d2080c799a6c8d37542d1549f628d0" May 25 14:16:50.384214 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.384169 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a907fadf5c9bf85435669c44c53641df0d2080c799a6c8d37542d1549f628d0"} err="failed to get container status \"7a907fadf5c9bf85435669c44c53641df0d2080c799a6c8d37542d1549f628d0\": rpc error: code = NotFound desc = could not find container \"7a907fadf5c9bf85435669c44c53641df0d2080c799a6c8d37542d1549f628d0\": container with ID starting with 7a907fadf5c9bf85435669c44c53641df0d2080c799a6c8d37542d1549f628d0 not found: ID does not exist" May 25 14:16:50.384493 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.384276 2562 scope.go:117] "RemoveContainer" containerID="2698013a52eeea06d918383a087b7c8d81048c5aee4ff5b26b8208144561e5e1" May 25 14:16:50.384493 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.384193 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 25 14:16:50.384655 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.384532 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2698013a52eeea06d918383a087b7c8d81048c5aee4ff5b26b8208144561e5e1"} err="failed to get container status \"2698013a52eeea06d918383a087b7c8d81048c5aee4ff5b26b8208144561e5e1\": rpc error: code = NotFound desc = could not find container \"2698013a52eeea06d918383a087b7c8d81048c5aee4ff5b26b8208144561e5e1\": container with ID starting with 2698013a52eeea06d918383a087b7c8d81048c5aee4ff5b26b8208144561e5e1 not found: ID does not exist" May 25 14:16:50.384655 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.384555 2562 scope.go:117] "RemoveContainer" containerID="a486e8c7ff3bf978a30f90d3c8775963bd97590d586d449d50dce8792a0929e7" May 25 14:16:50.385159 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.384846 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a486e8c7ff3bf978a30f90d3c8775963bd97590d586d449d50dce8792a0929e7"} err="failed to get container status \"a486e8c7ff3bf978a30f90d3c8775963bd97590d586d449d50dce8792a0929e7\": rpc error: code = NotFound desc = could not find container \"a486e8c7ff3bf978a30f90d3c8775963bd97590d586d449d50dce8792a0929e7\": container with ID starting with a486e8c7ff3bf978a30f90d3c8775963bd97590d586d449d50dce8792a0929e7 not found: ID does not exist" May 25 14:16:50.385159 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.384897 2562 scope.go:117] "RemoveContainer" containerID="91226935600c7a70bad79bb2493705d335040d1d0e4b6cdf3751bb21b663be94" May 25 14:16:50.385291 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.385259 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91226935600c7a70bad79bb2493705d335040d1d0e4b6cdf3751bb21b663be94"} err="failed to get container status \"91226935600c7a70bad79bb2493705d335040d1d0e4b6cdf3751bb21b663be94\": rpc error: code = NotFound desc = could not find container \"91226935600c7a70bad79bb2493705d335040d1d0e4b6cdf3751bb21b663be94\": container with ID starting with 91226935600c7a70bad79bb2493705d335040d1d0e4b6cdf3751bb21b663be94 not found: ID does not exist" May 25 14:16:50.385341 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.385284 2562 scope.go:117] "RemoveContainer" containerID="56a8053cdc56c078a2380f204403a7ee68e398bf9a5b05fc7f1d4e9ec9f21c83" May 25 14:16:50.385586 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.385560 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56a8053cdc56c078a2380f204403a7ee68e398bf9a5b05fc7f1d4e9ec9f21c83"} err="failed to get container status \"56a8053cdc56c078a2380f204403a7ee68e398bf9a5b05fc7f1d4e9ec9f21c83\": rpc error: code = NotFound desc = could not find container \"56a8053cdc56c078a2380f204403a7ee68e398bf9a5b05fc7f1d4e9ec9f21c83\": container with ID starting with 56a8053cdc56c078a2380f204403a7ee68e398bf9a5b05fc7f1d4e9ec9f21c83 not found: ID does not exist" May 25 14:16:50.385668 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.385587 2562 scope.go:117] "RemoveContainer" containerID="d9daeedc8b870a197aa5ba14ed5c7c6a81bdd2a4a3b45f07dd8ba0bb0838f5c8" May 25 14:16:50.385897 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.385856 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9daeedc8b870a197aa5ba14ed5c7c6a81bdd2a4a3b45f07dd8ba0bb0838f5c8"} err="failed to get container status \"d9daeedc8b870a197aa5ba14ed5c7c6a81bdd2a4a3b45f07dd8ba0bb0838f5c8\": rpc error: code = NotFound desc = could not find container \"d9daeedc8b870a197aa5ba14ed5c7c6a81bdd2a4a3b45f07dd8ba0bb0838f5c8\": container with ID starting with d9daeedc8b870a197aa5ba14ed5c7c6a81bdd2a4a3b45f07dd8ba0bb0838f5c8 not found: ID does not exist" May 25 14:16:50.385897 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.385881 2562 scope.go:117] "RemoveContainer" containerID="68421249ce14624246678309eddbdbab777f0feda20f81d17cd9681ac3dad612" May 25 14:16:50.386188 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.386134 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68421249ce14624246678309eddbdbab777f0feda20f81d17cd9681ac3dad612"} err="failed to get container status \"68421249ce14624246678309eddbdbab777f0feda20f81d17cd9681ac3dad612\": rpc error: code = NotFound desc = could not find container \"68421249ce14624246678309eddbdbab777f0feda20f81d17cd9681ac3dad612\": container with ID starting with 68421249ce14624246678309eddbdbab777f0feda20f81d17cd9681ac3dad612 not found: ID does not exist" May 25 14:16:50.386188 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.386160 2562 scope.go:117] "RemoveContainer" containerID="7a907fadf5c9bf85435669c44c53641df0d2080c799a6c8d37542d1549f628d0" May 25 14:16:50.386575 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.386534 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a907fadf5c9bf85435669c44c53641df0d2080c799a6c8d37542d1549f628d0"} err="failed to get container status \"7a907fadf5c9bf85435669c44c53641df0d2080c799a6c8d37542d1549f628d0\": rpc error: code = NotFound desc = could not find container \"7a907fadf5c9bf85435669c44c53641df0d2080c799a6c8d37542d1549f628d0\": container with ID starting with 7a907fadf5c9bf85435669c44c53641df0d2080c799a6c8d37542d1549f628d0 not found: ID does not exist" May 25 14:16:50.386575 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.386564 2562 scope.go:117] "RemoveContainer" containerID="2698013a52eeea06d918383a087b7c8d81048c5aee4ff5b26b8208144561e5e1" May 25 14:16:50.387525 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.386738 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 14:16:50.387525 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.386837 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2698013a52eeea06d918383a087b7c8d81048c5aee4ff5b26b8208144561e5e1"} err="failed to get container status \"2698013a52eeea06d918383a087b7c8d81048c5aee4ff5b26b8208144561e5e1\": rpc error: code = NotFound desc = could not find container \"2698013a52eeea06d918383a087b7c8d81048c5aee4ff5b26b8208144561e5e1\": container with ID starting with 2698013a52eeea06d918383a087b7c8d81048c5aee4ff5b26b8208144561e5e1 not found: ID does not exist" May 25 14:16:50.387525 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.386859 2562 scope.go:117] "RemoveContainer" containerID="a486e8c7ff3bf978a30f90d3c8775963bd97590d586d449d50dce8792a0929e7" May 25 14:16:50.387747 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.387702 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a486e8c7ff3bf978a30f90d3c8775963bd97590d586d449d50dce8792a0929e7"} err="failed to get container status \"a486e8c7ff3bf978a30f90d3c8775963bd97590d586d449d50dce8792a0929e7\": rpc error: code = NotFound desc = could not find container \"a486e8c7ff3bf978a30f90d3c8775963bd97590d586d449d50dce8792a0929e7\": container with ID starting with a486e8c7ff3bf978a30f90d3c8775963bd97590d586d449d50dce8792a0929e7 not found: ID does not exist" May 25 14:16:50.387858 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.387751 2562 scope.go:117] "RemoveContainer" containerID="91226935600c7a70bad79bb2493705d335040d1d0e4b6cdf3751bb21b663be94" May 25 14:16:50.388093 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.388072 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91226935600c7a70bad79bb2493705d335040d1d0e4b6cdf3751bb21b663be94"} err="failed to get container status \"91226935600c7a70bad79bb2493705d335040d1d0e4b6cdf3751bb21b663be94\": rpc error: code = NotFound desc = could not find container \"91226935600c7a70bad79bb2493705d335040d1d0e4b6cdf3751bb21b663be94\": container with ID starting with 91226935600c7a70bad79bb2493705d335040d1d0e4b6cdf3751bb21b663be94 not found: ID does not exist" May 25 14:16:50.388179 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.388095 2562 scope.go:117] "RemoveContainer" containerID="56a8053cdc56c078a2380f204403a7ee68e398bf9a5b05fc7f1d4e9ec9f21c83" May 25 14:16:50.388462 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.388438 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56a8053cdc56c078a2380f204403a7ee68e398bf9a5b05fc7f1d4e9ec9f21c83"} err="failed to get container status \"56a8053cdc56c078a2380f204403a7ee68e398bf9a5b05fc7f1d4e9ec9f21c83\": rpc error: code = NotFound desc = could not find container \"56a8053cdc56c078a2380f204403a7ee68e398bf9a5b05fc7f1d4e9ec9f21c83\": container with ID starting with 56a8053cdc56c078a2380f204403a7ee68e398bf9a5b05fc7f1d4e9ec9f21c83 not found: ID does not exist" May 25 14:16:50.388640 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.388503 2562 scope.go:117] "RemoveContainer" containerID="d9daeedc8b870a197aa5ba14ed5c7c6a81bdd2a4a3b45f07dd8ba0bb0838f5c8" May 25 14:16:50.388833 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.388804 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9daeedc8b870a197aa5ba14ed5c7c6a81bdd2a4a3b45f07dd8ba0bb0838f5c8"} err="failed to get container status \"d9daeedc8b870a197aa5ba14ed5c7c6a81bdd2a4a3b45f07dd8ba0bb0838f5c8\": rpc error: code = NotFound desc = could not find container \"d9daeedc8b870a197aa5ba14ed5c7c6a81bdd2a4a3b45f07dd8ba0bb0838f5c8\": container with ID starting with d9daeedc8b870a197aa5ba14ed5c7c6a81bdd2a4a3b45f07dd8ba0bb0838f5c8 not found: ID does not exist" May 25 14:16:50.388942 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.388857 2562 scope.go:117] "RemoveContainer" containerID="68421249ce14624246678309eddbdbab777f0feda20f81d17cd9681ac3dad612" May 25 14:16:50.389183 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.389145 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68421249ce14624246678309eddbdbab777f0feda20f81d17cd9681ac3dad612"} err="failed to get container status \"68421249ce14624246678309eddbdbab777f0feda20f81d17cd9681ac3dad612\": rpc error: code = NotFound desc = could not find container \"68421249ce14624246678309eddbdbab777f0feda20f81d17cd9681ac3dad612\": container with ID starting with 68421249ce14624246678309eddbdbab777f0feda20f81d17cd9681ac3dad612 not found: ID does not exist" May 25 14:16:50.389183 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.389173 2562 scope.go:117] "RemoveContainer" containerID="7a907fadf5c9bf85435669c44c53641df0d2080c799a6c8d37542d1549f628d0" May 25 14:16:50.389442 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.389423 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a907fadf5c9bf85435669c44c53641df0d2080c799a6c8d37542d1549f628d0"} err="failed to get container status \"7a907fadf5c9bf85435669c44c53641df0d2080c799a6c8d37542d1549f628d0\": rpc error: code = NotFound desc = could not find container \"7a907fadf5c9bf85435669c44c53641df0d2080c799a6c8d37542d1549f628d0\": container with ID starting with 7a907fadf5c9bf85435669c44c53641df0d2080c799a6c8d37542d1549f628d0 not found: ID does not exist" May 25 14:16:50.389501 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.389444 2562 scope.go:117] "RemoveContainer" containerID="2698013a52eeea06d918383a087b7c8d81048c5aee4ff5b26b8208144561e5e1" May 25 14:16:50.389656 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.389632 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2698013a52eeea06d918383a087b7c8d81048c5aee4ff5b26b8208144561e5e1"} err="failed to get container status \"2698013a52eeea06d918383a087b7c8d81048c5aee4ff5b26b8208144561e5e1\": rpc error: code = NotFound desc = could not find container \"2698013a52eeea06d918383a087b7c8d81048c5aee4ff5b26b8208144561e5e1\": container with ID starting with 2698013a52eeea06d918383a087b7c8d81048c5aee4ff5b26b8208144561e5e1 not found: ID does not exist" May 25 14:16:50.389710 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.389662 2562 scope.go:117] "RemoveContainer" containerID="a486e8c7ff3bf978a30f90d3c8775963bd97590d586d449d50dce8792a0929e7" May 25 14:16:50.389942 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.389922 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a486e8c7ff3bf978a30f90d3c8775963bd97590d586d449d50dce8792a0929e7"} err="failed to get container status \"a486e8c7ff3bf978a30f90d3c8775963bd97590d586d449d50dce8792a0929e7\": rpc error: code = NotFound desc = could not find container \"a486e8c7ff3bf978a30f90d3c8775963bd97590d586d449d50dce8792a0929e7\": container with ID starting with a486e8c7ff3bf978a30f90d3c8775963bd97590d586d449d50dce8792a0929e7 not found: ID does not exist" May 25 14:16:50.390016 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.389943 2562 scope.go:117] "RemoveContainer" containerID="91226935600c7a70bad79bb2493705d335040d1d0e4b6cdf3751bb21b663be94" May 25 14:16:50.390179 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.390150 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91226935600c7a70bad79bb2493705d335040d1d0e4b6cdf3751bb21b663be94"} err="failed to get container status \"91226935600c7a70bad79bb2493705d335040d1d0e4b6cdf3751bb21b663be94\": rpc error: code = NotFound desc = could not find container \"91226935600c7a70bad79bb2493705d335040d1d0e4b6cdf3751bb21b663be94\": container with ID starting with 91226935600c7a70bad79bb2493705d335040d1d0e4b6cdf3751bb21b663be94 not found: ID does not exist" May 25 14:16:50.390273 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.390179 2562 scope.go:117] "RemoveContainer" containerID="56a8053cdc56c078a2380f204403a7ee68e398bf9a5b05fc7f1d4e9ec9f21c83" May 25 14:16:50.390483 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.390463 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56a8053cdc56c078a2380f204403a7ee68e398bf9a5b05fc7f1d4e9ec9f21c83"} err="failed to get container status \"56a8053cdc56c078a2380f204403a7ee68e398bf9a5b05fc7f1d4e9ec9f21c83\": rpc error: code = NotFound desc = could not find container \"56a8053cdc56c078a2380f204403a7ee68e398bf9a5b05fc7f1d4e9ec9f21c83\": container with ID starting with 56a8053cdc56c078a2380f204403a7ee68e398bf9a5b05fc7f1d4e9ec9f21c83 not found: ID does not exist" May 25 14:16:50.390556 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.390486 2562 scope.go:117] "RemoveContainer" containerID="d9daeedc8b870a197aa5ba14ed5c7c6a81bdd2a4a3b45f07dd8ba0bb0838f5c8" May 25 14:16:50.390780 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.390756 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9daeedc8b870a197aa5ba14ed5c7c6a81bdd2a4a3b45f07dd8ba0bb0838f5c8"} err="failed to get container status \"d9daeedc8b870a197aa5ba14ed5c7c6a81bdd2a4a3b45f07dd8ba0bb0838f5c8\": rpc error: code = NotFound desc = could not find container \"d9daeedc8b870a197aa5ba14ed5c7c6a81bdd2a4a3b45f07dd8ba0bb0838f5c8\": container with ID starting with d9daeedc8b870a197aa5ba14ed5c7c6a81bdd2a4a3b45f07dd8ba0bb0838f5c8 not found: ID does not exist" May 25 14:16:50.390780 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.390779 2562 scope.go:117] "RemoveContainer" containerID="68421249ce14624246678309eddbdbab777f0feda20f81d17cd9681ac3dad612" May 25 14:16:50.391015 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.390999 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68421249ce14624246678309eddbdbab777f0feda20f81d17cd9681ac3dad612"} err="failed to get container status \"68421249ce14624246678309eddbdbab777f0feda20f81d17cd9681ac3dad612\": rpc error: code = NotFound desc = could not find container \"68421249ce14624246678309eddbdbab777f0feda20f81d17cd9681ac3dad612\": container with ID starting with 68421249ce14624246678309eddbdbab777f0feda20f81d17cd9681ac3dad612 not found: ID does not exist" May 25 14:16:50.391064 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.391016 2562 scope.go:117] "RemoveContainer" containerID="7a907fadf5c9bf85435669c44c53641df0d2080c799a6c8d37542d1549f628d0" May 25 14:16:50.391221 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.391206 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a907fadf5c9bf85435669c44c53641df0d2080c799a6c8d37542d1549f628d0"} err="failed to get container status \"7a907fadf5c9bf85435669c44c53641df0d2080c799a6c8d37542d1549f628d0\": rpc error: code = NotFound desc = could not find container \"7a907fadf5c9bf85435669c44c53641df0d2080c799a6c8d37542d1549f628d0\": container with ID starting with 7a907fadf5c9bf85435669c44c53641df0d2080c799a6c8d37542d1549f628d0 not found: ID does not exist" May 25 14:16:50.391274 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.391222 2562 scope.go:117] "RemoveContainer" containerID="2698013a52eeea06d918383a087b7c8d81048c5aee4ff5b26b8208144561e5e1" May 25 14:16:50.391441 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.391424 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2698013a52eeea06d918383a087b7c8d81048c5aee4ff5b26b8208144561e5e1"} err="failed to get container status \"2698013a52eeea06d918383a087b7c8d81048c5aee4ff5b26b8208144561e5e1\": rpc error: code = NotFound desc = could not find container \"2698013a52eeea06d918383a087b7c8d81048c5aee4ff5b26b8208144561e5e1\": container with ID starting with 2698013a52eeea06d918383a087b7c8d81048c5aee4ff5b26b8208144561e5e1 not found: ID does not exist" May 25 14:16:50.391493 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.391441 2562 scope.go:117] "RemoveContainer" containerID="a486e8c7ff3bf978a30f90d3c8775963bd97590d586d449d50dce8792a0929e7" May 25 14:16:50.391661 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.391643 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a486e8c7ff3bf978a30f90d3c8775963bd97590d586d449d50dce8792a0929e7"} err="failed to get container status \"a486e8c7ff3bf978a30f90d3c8775963bd97590d586d449d50dce8792a0929e7\": rpc error: code = NotFound desc = could not find container \"a486e8c7ff3bf978a30f90d3c8775963bd97590d586d449d50dce8792a0929e7\": container with ID starting with a486e8c7ff3bf978a30f90d3c8775963bd97590d586d449d50dce8792a0929e7 not found: ID does not exist" May 25 14:16:50.391707 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.391662 2562 scope.go:117] "RemoveContainer" containerID="91226935600c7a70bad79bb2493705d335040d1d0e4b6cdf3751bb21b663be94" May 25 14:16:50.391873 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.391858 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91226935600c7a70bad79bb2493705d335040d1d0e4b6cdf3751bb21b663be94"} err="failed to get container status \"91226935600c7a70bad79bb2493705d335040d1d0e4b6cdf3751bb21b663be94\": rpc error: code = NotFound desc = could not find container \"91226935600c7a70bad79bb2493705d335040d1d0e4b6cdf3751bb21b663be94\": container with ID starting with 91226935600c7a70bad79bb2493705d335040d1d0e4b6cdf3751bb21b663be94 not found: ID does not exist" May 25 14:16:50.391919 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.391873 2562 scope.go:117] "RemoveContainer" containerID="56a8053cdc56c078a2380f204403a7ee68e398bf9a5b05fc7f1d4e9ec9f21c83" May 25 14:16:50.392093 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.392076 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56a8053cdc56c078a2380f204403a7ee68e398bf9a5b05fc7f1d4e9ec9f21c83"} err="failed to get container status \"56a8053cdc56c078a2380f204403a7ee68e398bf9a5b05fc7f1d4e9ec9f21c83\": rpc error: code = NotFound desc = could not find container \"56a8053cdc56c078a2380f204403a7ee68e398bf9a5b05fc7f1d4e9ec9f21c83\": container with ID starting with 56a8053cdc56c078a2380f204403a7ee68e398bf9a5b05fc7f1d4e9ec9f21c83 not found: ID does not exist" May 25 14:16:50.392136 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.392093 2562 scope.go:117] "RemoveContainer" containerID="d9daeedc8b870a197aa5ba14ed5c7c6a81bdd2a4a3b45f07dd8ba0bb0838f5c8" May 25 14:16:50.392322 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.392296 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9daeedc8b870a197aa5ba14ed5c7c6a81bdd2a4a3b45f07dd8ba0bb0838f5c8"} err="failed to get container status \"d9daeedc8b870a197aa5ba14ed5c7c6a81bdd2a4a3b45f07dd8ba0bb0838f5c8\": rpc error: code = NotFound desc = could not find container \"d9daeedc8b870a197aa5ba14ed5c7c6a81bdd2a4a3b45f07dd8ba0bb0838f5c8\": container with ID starting with d9daeedc8b870a197aa5ba14ed5c7c6a81bdd2a4a3b45f07dd8ba0bb0838f5c8 not found: ID does not exist" May 25 14:16:50.392363 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.392325 2562 scope.go:117] "RemoveContainer" containerID="68421249ce14624246678309eddbdbab777f0feda20f81d17cd9681ac3dad612" May 25 14:16:50.392582 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.392565 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68421249ce14624246678309eddbdbab777f0feda20f81d17cd9681ac3dad612"} err="failed to get container status \"68421249ce14624246678309eddbdbab777f0feda20f81d17cd9681ac3dad612\": rpc error: code = NotFound desc = could not find container \"68421249ce14624246678309eddbdbab777f0feda20f81d17cd9681ac3dad612\": container with ID starting with 68421249ce14624246678309eddbdbab777f0feda20f81d17cd9681ac3dad612 not found: ID does not exist" May 25 14:16:50.502980 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.502947 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/41e61d13-0735-4ba3-94ce-9743dfd54379-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.503147 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.502984 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41e61d13-0735-4ba3-94ce-9743dfd54379-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.503147 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.503019 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/41e61d13-0735-4ba3-94ce-9743dfd54379-config-out\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.503147 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.503075 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/41e61d13-0735-4ba3-94ce-9743dfd54379-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.503246 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.503199 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/41e61d13-0735-4ba3-94ce-9743dfd54379-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.503246 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.503226 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41e61d13-0735-4ba3-94ce-9743dfd54379-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.503333 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.503248 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/41e61d13-0735-4ba3-94ce-9743dfd54379-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.503333 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.503275 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/41e61d13-0735-4ba3-94ce-9743dfd54379-config\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.503455 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.503330 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41e61d13-0735-4ba3-94ce-9743dfd54379-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.503496 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.503444 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjc5k\" (UniqueName: \"kubernetes.io/projected/41e61d13-0735-4ba3-94ce-9743dfd54379-kube-api-access-jjc5k\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.503537 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.503494 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/41e61d13-0735-4ba3-94ce-9743dfd54379-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.503568 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.503545 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/41e61d13-0735-4ba3-94ce-9743dfd54379-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.503598 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.503587 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/41e61d13-0735-4ba3-94ce-9743dfd54379-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.503634 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.503611 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/41e61d13-0735-4ba3-94ce-9743dfd54379-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.503673 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.503635 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/41e61d13-0735-4ba3-94ce-9743dfd54379-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.503706 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.503673 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/41e61d13-0735-4ba3-94ce-9743dfd54379-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.503706 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.503696 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41e61d13-0735-4ba3-94ce-9743dfd54379-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.503780 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.503726 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/41e61d13-0735-4ba3-94ce-9743dfd54379-web-config\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.604350 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.604272 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/41e61d13-0735-4ba3-94ce-9743dfd54379-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.604350 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.604308 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41e61d13-0735-4ba3-94ce-9743dfd54379-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.604350 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.604327 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/41e61d13-0735-4ba3-94ce-9743dfd54379-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.604350 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.604344 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/41e61d13-0735-4ba3-94ce-9743dfd54379-config\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.604659 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.604363 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41e61d13-0735-4ba3-94ce-9743dfd54379-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.604659 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.604419 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jjc5k\" (UniqueName: \"kubernetes.io/projected/41e61d13-0735-4ba3-94ce-9743dfd54379-kube-api-access-jjc5k\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.604659 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.604453 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/41e61d13-0735-4ba3-94ce-9743dfd54379-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.604659 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.604479 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/41e61d13-0735-4ba3-94ce-9743dfd54379-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.604659 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.604502 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/41e61d13-0735-4ba3-94ce-9743dfd54379-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.604659 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.604535 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/41e61d13-0735-4ba3-94ce-9743dfd54379-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.604659 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.604566 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/41e61d13-0735-4ba3-94ce-9743dfd54379-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.604659 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.604603 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/41e61d13-0735-4ba3-94ce-9743dfd54379-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.604659 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.604632 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41e61d13-0735-4ba3-94ce-9743dfd54379-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.604659 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.604657 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/41e61d13-0735-4ba3-94ce-9743dfd54379-web-config\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.605109 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.604692 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/41e61d13-0735-4ba3-94ce-9743dfd54379-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.605109 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.604718 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41e61d13-0735-4ba3-94ce-9743dfd54379-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.605109 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.604755 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/41e61d13-0735-4ba3-94ce-9743dfd54379-config-out\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.605109 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.604786 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/41e61d13-0735-4ba3-94ce-9743dfd54379-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.605523 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.605210 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41e61d13-0735-4ba3-94ce-9743dfd54379-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.605523 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.605216 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41e61d13-0735-4ba3-94ce-9743dfd54379-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.607814 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.607782 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/41e61d13-0735-4ba3-94ce-9743dfd54379-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.607926 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.607852 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/41e61d13-0735-4ba3-94ce-9743dfd54379-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.607926 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.607866 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/41e61d13-0735-4ba3-94ce-9743dfd54379-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.608479 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.608127 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/41e61d13-0735-4ba3-94ce-9743dfd54379-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.608479 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.608160 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/41e61d13-0735-4ba3-94ce-9743dfd54379-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.608479 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.608169 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/41e61d13-0735-4ba3-94ce-9743dfd54379-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.608479 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.608248 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/41e61d13-0735-4ba3-94ce-9743dfd54379-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.608479 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.608419 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/41e61d13-0735-4ba3-94ce-9743dfd54379-config\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.608789 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.608487 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41e61d13-0735-4ba3-94ce-9743dfd54379-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.608789 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.608769 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41e61d13-0735-4ba3-94ce-9743dfd54379-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.609197 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.609176 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/41e61d13-0735-4ba3-94ce-9743dfd54379-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.610750 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.610726 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/41e61d13-0735-4ba3-94ce-9743dfd54379-config-out\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.610911 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.610890 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/41e61d13-0735-4ba3-94ce-9743dfd54379-web-config\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.611083 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.611061 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/41e61d13-0735-4ba3-94ce-9743dfd54379-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.611751 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.611733 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/41e61d13-0735-4ba3-94ce-9743dfd54379-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.612729 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.612710 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjc5k\" (UniqueName: \"kubernetes.io/projected/41e61d13-0735-4ba3-94ce-9743dfd54379-kube-api-access-jjc5k\") pod \"prometheus-k8s-0\" (UID: \"41e61d13-0735-4ba3-94ce-9743dfd54379\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.687597 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.687568 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 25 14:16:50.821948 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:50.821922 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 14:16:50.823045 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:16:50.823014 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41e61d13_0735_4ba3_94ce_9743dfd54379.slice/crio-3825861e7531a0e9d8db027203707255669b8df36e43f38736f4bc36af4d4dfc WatchSource:0}: Error finding container 3825861e7531a0e9d8db027203707255669b8df36e43f38736f4bc36af4d4dfc: Status 404 returned error can't find the container with id 3825861e7531a0e9d8db027203707255669b8df36e43f38736f4bc36af4d4dfc May 25 14:16:51.318181 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:51.318151 2562 generic.go:358] "Generic (PLEG): container finished" podID="41e61d13-0735-4ba3-94ce-9743dfd54379" containerID="66f7daeee2332ffb53fba29e4d98105bde1bde502794b61f16018c5d6c906d5d" exitCode=0 May 25 14:16:51.318340 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:51.318208 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"41e61d13-0735-4ba3-94ce-9743dfd54379","Type":"ContainerDied","Data":"66f7daeee2332ffb53fba29e4d98105bde1bde502794b61f16018c5d6c906d5d"} May 25 14:16:51.318340 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:51.318227 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"41e61d13-0735-4ba3-94ce-9743dfd54379","Type":"ContainerStarted","Data":"3825861e7531a0e9d8db027203707255669b8df36e43f38736f4bc36af4d4dfc"} May 25 14:16:52.324685 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:52.324652 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"41e61d13-0735-4ba3-94ce-9743dfd54379","Type":"ContainerStarted","Data":"d55a4dc0cf9ed80a2504675be680b990807958aac0ce87723c45f239ca13969c"} May 25 14:16:52.324685 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:52.324688 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"41e61d13-0735-4ba3-94ce-9743dfd54379","Type":"ContainerStarted","Data":"557491b3bc5357e4770a6ef88fd1554e5e0649b8bcc461bb47e8657660e7dcc5"} May 25 14:16:52.325067 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:52.324699 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"41e61d13-0735-4ba3-94ce-9743dfd54379","Type":"ContainerStarted","Data":"2c613138f3aaeecd36c1c2256b826dd267e88ab7d4d973327de53881a33cbb15"} May 25 14:16:52.325067 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:52.324707 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"41e61d13-0735-4ba3-94ce-9743dfd54379","Type":"ContainerStarted","Data":"8cf70325d9e53e10d43e0fac6d0161e21aaba8b8bf434251e5ec5c336332c0d5"} May 25 14:16:52.325067 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:52.324715 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"41e61d13-0735-4ba3-94ce-9743dfd54379","Type":"ContainerStarted","Data":"46abdbbb5f5106b06e6155f6cb6aa616663cfc5dd5bd145b427125877664965a"} May 25 14:16:52.325067 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:52.324722 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"41e61d13-0735-4ba3-94ce-9743dfd54379","Type":"ContainerStarted","Data":"d5e814a78e76ac6e89e5786d4d1fa0f5579255eaec2e5f6e7c3b7ae3c587987e"} May 25 14:16:52.354851 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:52.354801 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.354785936 podStartE2EDuration="2.354785936s" podCreationTimestamp="2026-05-25 14:16:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 14:16:52.351774523 +0000 UTC m=+266.559021742" watchObservedRunningTime="2026-05-25 14:16:52.354785936 +0000 UTC m=+266.562033120" May 25 14:16:55.687831 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:16:55.687795 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 25 14:17:26.253938 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:17:26.253908 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b2gmj_b5ab1333-fc5e-46eb-a0ee-bd4d08c45527/ovn-acl-logging/0.log" May 25 14:17:26.254616 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:17:26.254591 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b2gmj_b5ab1333-fc5e-46eb-a0ee-bd4d08c45527/ovn-acl-logging/0.log" May 25 14:17:26.257618 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:17:26.257596 2562 kubelet.go:1628] "Image garbage collection succeeded" May 25 14:17:50.688249 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:17:50.688203 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 25 14:17:50.704487 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:17:50.704461 2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 25 14:17:51.527638 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:17:51.527614 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 25 14:18:25.974590 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:18:25.974558 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-b45x2"] May 25 14:18:25.978061 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:18:25.978043 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b45x2" May 25 14:18:25.980702 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:18:25.980679 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 25 14:18:25.985937 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:18:25.985680 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b45x2"] May 25 14:18:26.047763 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:18:26.047725 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c084b3a6-58e9-4dfa-aa56-3b27f01e4a27-original-pull-secret\") pod \"global-pull-secret-syncer-b45x2\" (UID: \"c084b3a6-58e9-4dfa-aa56-3b27f01e4a27\") " pod="kube-system/global-pull-secret-syncer-b45x2" May 25 14:18:26.047932 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:18:26.047814 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c084b3a6-58e9-4dfa-aa56-3b27f01e4a27-kubelet-config\") pod \"global-pull-secret-syncer-b45x2\" (UID: \"c084b3a6-58e9-4dfa-aa56-3b27f01e4a27\") " pod="kube-system/global-pull-secret-syncer-b45x2" May 25 14:18:26.047932 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:18:26.047832 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c084b3a6-58e9-4dfa-aa56-3b27f01e4a27-dbus\") pod \"global-pull-secret-syncer-b45x2\" (UID: \"c084b3a6-58e9-4dfa-aa56-3b27f01e4a27\") " pod="kube-system/global-pull-secret-syncer-b45x2" May 25 14:18:26.148237 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:18:26.148201 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c084b3a6-58e9-4dfa-aa56-3b27f01e4a27-original-pull-secret\") pod \"global-pull-secret-syncer-b45x2\" (UID: \"c084b3a6-58e9-4dfa-aa56-3b27f01e4a27\") " pod="kube-system/global-pull-secret-syncer-b45x2" May 25 14:18:26.148473 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:18:26.148285 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c084b3a6-58e9-4dfa-aa56-3b27f01e4a27-kubelet-config\") pod \"global-pull-secret-syncer-b45x2\" (UID: \"c084b3a6-58e9-4dfa-aa56-3b27f01e4a27\") " pod="kube-system/global-pull-secret-syncer-b45x2" May 25 14:18:26.148473 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:18:26.148305 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c084b3a6-58e9-4dfa-aa56-3b27f01e4a27-dbus\") pod \"global-pull-secret-syncer-b45x2\" (UID: \"c084b3a6-58e9-4dfa-aa56-3b27f01e4a27\") " pod="kube-system/global-pull-secret-syncer-b45x2" May 25 14:18:26.148473 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:18:26.148443 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c084b3a6-58e9-4dfa-aa56-3b27f01e4a27-kubelet-config\") pod \"global-pull-secret-syncer-b45x2\" (UID: \"c084b3a6-58e9-4dfa-aa56-3b27f01e4a27\") " pod="kube-system/global-pull-secret-syncer-b45x2" May 25 14:18:26.148610 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:18:26.148461 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c084b3a6-58e9-4dfa-aa56-3b27f01e4a27-dbus\") pod \"global-pull-secret-syncer-b45x2\" (UID: \"c084b3a6-58e9-4dfa-aa56-3b27f01e4a27\") " pod="kube-system/global-pull-secret-syncer-b45x2" May 25 14:18:26.150694 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:18:26.150676 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c084b3a6-58e9-4dfa-aa56-3b27f01e4a27-original-pull-secret\") pod \"global-pull-secret-syncer-b45x2\" (UID: \"c084b3a6-58e9-4dfa-aa56-3b27f01e4a27\") " pod="kube-system/global-pull-secret-syncer-b45x2" May 25 14:18:26.288100 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:18:26.288026 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b45x2" May 25 14:18:26.422916 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:18:26.422891 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b45x2"] May 25 14:18:26.425102 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:18:26.425075 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc084b3a6_58e9_4dfa_aa56_3b27f01e4a27.slice/crio-42de01b29352f6491f7ed389c8c2e45bff2dd20dd8cd18ccf4b054e29b836f71 WatchSource:0}: Error finding container 42de01b29352f6491f7ed389c8c2e45bff2dd20dd8cd18ccf4b054e29b836f71: Status 404 returned error can't find the container with id 42de01b29352f6491f7ed389c8c2e45bff2dd20dd8cd18ccf4b054e29b836f71 May 25 14:18:26.426610 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:18:26.426591 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 25 14:18:26.617200 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:18:26.617166 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b45x2" event={"ID":"c084b3a6-58e9-4dfa-aa56-3b27f01e4a27","Type":"ContainerStarted","Data":"42de01b29352f6491f7ed389c8c2e45bff2dd20dd8cd18ccf4b054e29b836f71"} May 25 14:18:31.634854 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:18:31.634811 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b45x2" event={"ID":"c084b3a6-58e9-4dfa-aa56-3b27f01e4a27","Type":"ContainerStarted","Data":"51e89d8f193f79152044776f37262f79cbfadc936ccc4fe2f22e3a1c071656b9"} May 25 14:18:31.649992 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:18:31.649940 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-b45x2" podStartSLOduration=2.315923346 podStartE2EDuration="6.649925595s" podCreationTimestamp="2026-05-25 14:18:25 +0000 UTC" firstStartedPulling="2026-05-25 14:18:26.42672636 +0000 UTC m=+360.633973522" lastFinishedPulling="2026-05-25 14:18:30.760728608 +0000 UTC m=+364.967975771" observedRunningTime="2026-05-25 14:18:31.648495826 +0000 UTC m=+365.855743011" watchObservedRunningTime="2026-05-25 14:18:31.649925595 +0000 UTC m=+365.857172835" May 25 14:21:17.683996 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:21:17.683960 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-f5c9m"] May 25 14:21:17.688636 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:21:17.688592 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-f5c9m" May 25 14:21:17.693439 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:21:17.693416 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" May 25 14:21:17.693439 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:21:17.693432 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-mqnwv\"" May 25 14:21:17.694449 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:21:17.694430 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 25 14:21:17.694560 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:21:17.694479 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 25 14:21:17.694560 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:21:17.694494 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" May 25 14:21:17.706564 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:21:17.706541 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-f5c9m"] May 25 14:21:17.756727 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:21:17.756694 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/d2775e9b-e89c-4a56-b854-5db1c085e15a-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-f5c9m\" (UID: \"d2775e9b-e89c-4a56-b854-5db1c085e15a\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-f5c9m" May 25 14:21:17.756885 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:21:17.756780 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rz7p\" (UniqueName: \"kubernetes.io/projected/d2775e9b-e89c-4a56-b854-5db1c085e15a-kube-api-access-8rz7p\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-f5c9m\" (UID: \"d2775e9b-e89c-4a56-b854-5db1c085e15a\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-f5c9m" May 25 14:21:17.756885 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:21:17.756856 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2775e9b-e89c-4a56-b854-5db1c085e15a-cert\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-f5c9m\" (UID: \"d2775e9b-e89c-4a56-b854-5db1c085e15a\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-f5c9m" May 25 14:21:17.857710 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:21:17.857678 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2775e9b-e89c-4a56-b854-5db1c085e15a-cert\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-f5c9m\" (UID: \"d2775e9b-e89c-4a56-b854-5db1c085e15a\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-f5c9m" May 25 14:21:17.857871 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:21:17.857733 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/d2775e9b-e89c-4a56-b854-5db1c085e15a-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-f5c9m\" (UID: \"d2775e9b-e89c-4a56-b854-5db1c085e15a\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-f5c9m" May 25 14:21:17.857871 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:21:17.857760 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8rz7p\" (UniqueName: \"kubernetes.io/projected/d2775e9b-e89c-4a56-b854-5db1c085e15a-kube-api-access-8rz7p\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-f5c9m\" (UID: \"d2775e9b-e89c-4a56-b854-5db1c085e15a\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-f5c9m" May 25 14:21:17.858368 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:21:17.858345 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/d2775e9b-e89c-4a56-b854-5db1c085e15a-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-f5c9m\" (UID: \"d2775e9b-e89c-4a56-b854-5db1c085e15a\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-f5c9m" May 25 14:21:17.860169 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:21:17.860138 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2775e9b-e89c-4a56-b854-5db1c085e15a-cert\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-f5c9m\" (UID: \"d2775e9b-e89c-4a56-b854-5db1c085e15a\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-f5c9m" May 25 14:21:17.869219 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:21:17.869195 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rz7p\" (UniqueName: \"kubernetes.io/projected/d2775e9b-e89c-4a56-b854-5db1c085e15a-kube-api-access-8rz7p\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-f5c9m\" (UID: \"d2775e9b-e89c-4a56-b854-5db1c085e15a\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-f5c9m" May 25 14:21:18.011950 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:21:18.011866 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-f5c9m" May 25 14:21:18.148805 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:21:18.148781 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-f5c9m"] May 25 14:21:18.150248 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:21:18.150214 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd2775e9b_e89c_4a56_b854_5db1c085e15a.slice/crio-88ffb84a580db9454f609986ba4576521e31329474bcf9cc79aaeaf5ad8e0c2e WatchSource:0}: Error finding container 88ffb84a580db9454f609986ba4576521e31329474bcf9cc79aaeaf5ad8e0c2e: Status 404 returned error can't find the container with id 88ffb84a580db9454f609986ba4576521e31329474bcf9cc79aaeaf5ad8e0c2e May 25 14:21:19.149113 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:21:19.149074 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-f5c9m" event={"ID":"d2775e9b-e89c-4a56-b854-5db1c085e15a","Type":"ContainerStarted","Data":"88ffb84a580db9454f609986ba4576521e31329474bcf9cc79aaeaf5ad8e0c2e"} May 25 14:21:21.157946 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:21:21.157902 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-f5c9m" event={"ID":"d2775e9b-e89c-4a56-b854-5db1c085e15a","Type":"ContainerStarted","Data":"5e33a67ef40703ca4a70d20a196c8ed9e59cac41ea3505d6b8a4279610d75acc"} May 25 14:21:21.158436 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:21:21.157960 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-f5c9m" May 25 14:21:21.190847 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:21:21.190792 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-f5c9m" podStartSLOduration=1.971912771 podStartE2EDuration="4.190777005s" podCreationTimestamp="2026-05-25 14:21:17 +0000 UTC" firstStartedPulling="2026-05-25 14:21:18.151977507 +0000 UTC m=+532.359224671" lastFinishedPulling="2026-05-25 14:21:20.37084174 +0000 UTC m=+534.578088905" observedRunningTime="2026-05-25 14:21:21.188118907 +0000 UTC m=+535.395366090" watchObservedRunningTime="2026-05-25 14:21:21.190777005 +0000 UTC m=+535.398024188" May 25 14:21:37.165576 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:21:37.165546 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-f5c9m" May 25 14:22:26.280490 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:22:26.280463 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b2gmj_b5ab1333-fc5e-46eb-a0ee-bd4d08c45527/ovn-acl-logging/0.log" May 25 14:22:26.281046 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:22:26.280810 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b2gmj_b5ab1333-fc5e-46eb-a0ee-bd4d08c45527/ovn-acl-logging/0.log" May 25 14:23:15.646742 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:23:15.646700 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6fdkg/must-gather-746wj"] May 25 14:23:15.649756 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:23:15.649729 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6fdkg/must-gather-746wj" May 25 14:23:15.652797 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:23:15.652774 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6fdkg\"/\"kube-root-ca.crt\"" May 25 14:23:15.652947 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:23:15.652899 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6fdkg\"/\"default-dockercfg-nvbch\"" May 25 14:23:15.653958 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:23:15.653938 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6fdkg\"/\"openshift-service-ca.crt\"" May 25 14:23:15.659406 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:23:15.659360 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6fdkg/must-gather-746wj"] May 25 14:23:15.691735 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:23:15.691699 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/49bd1319-7b3b-4af3-9ad3-282baf375ea8-must-gather-output\") pod \"must-gather-746wj\" (UID: \"49bd1319-7b3b-4af3-9ad3-282baf375ea8\") " pod="openshift-must-gather-6fdkg/must-gather-746wj" May 25 14:23:15.691913 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:23:15.691860 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mccml\" (UniqueName: \"kubernetes.io/projected/49bd1319-7b3b-4af3-9ad3-282baf375ea8-kube-api-access-mccml\") pod \"must-gather-746wj\" (UID: \"49bd1319-7b3b-4af3-9ad3-282baf375ea8\") " pod="openshift-must-gather-6fdkg/must-gather-746wj" May 25 14:23:15.793092 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:23:15.793048 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/49bd1319-7b3b-4af3-9ad3-282baf375ea8-must-gather-output\") pod \"must-gather-746wj\" (UID: \"49bd1319-7b3b-4af3-9ad3-282baf375ea8\") " pod="openshift-must-gather-6fdkg/must-gather-746wj" May 25 14:23:15.793282 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:23:15.793151 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mccml\" (UniqueName: \"kubernetes.io/projected/49bd1319-7b3b-4af3-9ad3-282baf375ea8-kube-api-access-mccml\") pod \"must-gather-746wj\" (UID: \"49bd1319-7b3b-4af3-9ad3-282baf375ea8\") " pod="openshift-must-gather-6fdkg/must-gather-746wj" May 25 14:23:15.793426 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:23:15.793405 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/49bd1319-7b3b-4af3-9ad3-282baf375ea8-must-gather-output\") pod \"must-gather-746wj\" (UID: \"49bd1319-7b3b-4af3-9ad3-282baf375ea8\") " pod="openshift-must-gather-6fdkg/must-gather-746wj" May 25 14:23:15.801289 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:23:15.801261 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mccml\" (UniqueName: \"kubernetes.io/projected/49bd1319-7b3b-4af3-9ad3-282baf375ea8-kube-api-access-mccml\") pod \"must-gather-746wj\" (UID: \"49bd1319-7b3b-4af3-9ad3-282baf375ea8\") " pod="openshift-must-gather-6fdkg/must-gather-746wj" May 25 14:23:15.960516 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:23:15.960420 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6fdkg/must-gather-746wj" May 25 14:23:16.097216 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:23:16.097180 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6fdkg/must-gather-746wj"] May 25 14:23:16.102136 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:23:16.102103 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod49bd1319_7b3b_4af3_9ad3_282baf375ea8.slice/crio-73ed84ecbaae6dc9267279d4e52e4f063df57842530dd7705d13c04fd91edb0c WatchSource:0}: Error finding container 73ed84ecbaae6dc9267279d4e52e4f063df57842530dd7705d13c04fd91edb0c: Status 404 returned error can't find the container with id 73ed84ecbaae6dc9267279d4e52e4f063df57842530dd7705d13c04fd91edb0c May 25 14:23:16.515558 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:23:16.515523 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6fdkg/must-gather-746wj" event={"ID":"49bd1319-7b3b-4af3-9ad3-282baf375ea8","Type":"ContainerStarted","Data":"73ed84ecbaae6dc9267279d4e52e4f063df57842530dd7705d13c04fd91edb0c"} May 25 14:23:22.539489 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:23:22.539457 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6fdkg/must-gather-746wj" event={"ID":"49bd1319-7b3b-4af3-9ad3-282baf375ea8","Type":"ContainerStarted","Data":"534a6ac598df0bd8b6f5d61fe7f4d88e9a0e25244c756f648a28d9d1e219941c"} May 25 14:23:23.545122 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:23:23.545082 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6fdkg/must-gather-746wj" event={"ID":"49bd1319-7b3b-4af3-9ad3-282baf375ea8","Type":"ContainerStarted","Data":"92716253bba9d56ddfca4aac9301c4b95826a5f776835e989e570ec90a56941f"} May 25 14:23:23.561257 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:23:23.561199 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-6fdkg/must-gather-746wj" podStartSLOduration=2.252947249 podStartE2EDuration="8.561180561s" podCreationTimestamp="2026-05-25 14:23:15 +0000 UTC" firstStartedPulling="2026-05-25 14:23:16.104104653 +0000 UTC m=+650.311351816" lastFinishedPulling="2026-05-25 14:23:22.412337967 +0000 UTC m=+656.619585128" observedRunningTime="2026-05-25 14:23:23.559826611 +0000 UTC m=+657.767073795" watchObservedRunningTime="2026-05-25 14:23:23.561180561 +0000 UTC m=+657.768427798" May 25 14:23:32.176340 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:23:32.176304 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-57cfc69d8d-f5c9m_d2775e9b-e89c-4a56-b854-5db1c085e15a/manager/0.log" May 25 14:23:32.614018 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:23:32.613976 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-57cfc69d8d-f5c9m_d2775e9b-e89c-4a56-b854-5db1c085e15a/manager/0.log" May 25 14:23:33.074109 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:23:33.074070 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-57cfc69d8d-f5c9m_d2775e9b-e89c-4a56-b854-5db1c085e15a/manager/0.log" May 25 14:24:08.703408 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:08.698422 2562 generic.go:358] "Generic (PLEG): container finished" podID="49bd1319-7b3b-4af3-9ad3-282baf375ea8" containerID="534a6ac598df0bd8b6f5d61fe7f4d88e9a0e25244c756f648a28d9d1e219941c" exitCode=0 May 25 14:24:08.703408 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:08.698478 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6fdkg/must-gather-746wj" event={"ID":"49bd1319-7b3b-4af3-9ad3-282baf375ea8","Type":"ContainerDied","Data":"534a6ac598df0bd8b6f5d61fe7f4d88e9a0e25244c756f648a28d9d1e219941c"} May 25 14:24:08.703408 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:08.698920 2562 scope.go:117] "RemoveContainer" containerID="534a6ac598df0bd8b6f5d61fe7f4d88e9a0e25244c756f648a28d9d1e219941c" May 25 14:24:09.216831 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:09.216789 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-6fdkg_must-gather-746wj_49bd1319-7b3b-4af3-9ad3-282baf375ea8/gather/0.log" May 25 14:24:12.464196 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:12.464162 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-b45x2_c084b3a6-58e9-4dfa-aa56-3b27f01e4a27/global-pull-secret-syncer/0.log" May 25 14:24:12.611728 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:12.611702 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zrq2g_949098c1-c4c0-401c-8faf-db03fa09d898/konnectivity-agent/0.log" May 25 14:24:12.691135 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:12.691107 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-29.ec2.internal_bcb5c6667f8450704515b5a4ad2ed7fc/haproxy/0.log" May 25 14:24:14.585556 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:14.585527 2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-6fdkg/must-gather-746wj"] May 25 14:24:14.586000 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:14.585745 2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-must-gather-6fdkg/must-gather-746wj" podUID="49bd1319-7b3b-4af3-9ad3-282baf375ea8" containerName="copy" containerID="cri-o://92716253bba9d56ddfca4aac9301c4b95826a5f776835e989e570ec90a56941f" gracePeriod=2 May 25 14:24:14.588101 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:14.588068 2562 status_manager.go:895] "Failed to get status for pod" podUID="49bd1319-7b3b-4af3-9ad3-282baf375ea8" pod="openshift-must-gather-6fdkg/must-gather-746wj" err="pods \"must-gather-746wj\" is forbidden: User \"system:node:ip-10-0-140-29.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-6fdkg\": no relationship found between node 'ip-10-0-140-29.ec2.internal' and this object" May 25 14:24:14.590182 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:14.589947 2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-6fdkg/must-gather-746wj"] May 25 14:24:14.718634 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:14.718613 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-6fdkg_must-gather-746wj_49bd1319-7b3b-4af3-9ad3-282baf375ea8/copy/0.log" May 25 14:24:14.718947 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:14.718925 2562 generic.go:358] "Generic (PLEG): container finished" podID="49bd1319-7b3b-4af3-9ad3-282baf375ea8" containerID="92716253bba9d56ddfca4aac9301c4b95826a5f776835e989e570ec90a56941f" exitCode=143 May 25 14:24:14.820045 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:14.820022 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-6fdkg_must-gather-746wj_49bd1319-7b3b-4af3-9ad3-282baf375ea8/copy/0.log" May 25 14:24:14.820424 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:14.820408 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6fdkg/must-gather-746wj" May 25 14:24:14.822626 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:14.822605 2562 status_manager.go:895] "Failed to get status for pod" podUID="49bd1319-7b3b-4af3-9ad3-282baf375ea8" pod="openshift-must-gather-6fdkg/must-gather-746wj" err="pods \"must-gather-746wj\" is forbidden: User \"system:node:ip-10-0-140-29.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-6fdkg\": no relationship found between node 'ip-10-0-140-29.ec2.internal' and this object" May 25 14:24:14.862975 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:14.862928 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mccml\" (UniqueName: \"kubernetes.io/projected/49bd1319-7b3b-4af3-9ad3-282baf375ea8-kube-api-access-mccml\") pod \"49bd1319-7b3b-4af3-9ad3-282baf375ea8\" (UID: \"49bd1319-7b3b-4af3-9ad3-282baf375ea8\") " May 25 14:24:14.863039 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:14.862973 2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/49bd1319-7b3b-4af3-9ad3-282baf375ea8-must-gather-output\") pod \"49bd1319-7b3b-4af3-9ad3-282baf375ea8\" (UID: \"49bd1319-7b3b-4af3-9ad3-282baf375ea8\") " May 25 14:24:14.865022 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:14.864993 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49bd1319-7b3b-4af3-9ad3-282baf375ea8-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "49bd1319-7b3b-4af3-9ad3-282baf375ea8" (UID: "49bd1319-7b3b-4af3-9ad3-282baf375ea8"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 25 14:24:14.865127 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:14.865081 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49bd1319-7b3b-4af3-9ad3-282baf375ea8-kube-api-access-mccml" (OuterVolumeSpecName: "kube-api-access-mccml") pod "49bd1319-7b3b-4af3-9ad3-282baf375ea8" (UID: "49bd1319-7b3b-4af3-9ad3-282baf375ea8"). InnerVolumeSpecName "kube-api-access-mccml". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 14:24:14.963522 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:14.963492 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mccml\" (UniqueName: \"kubernetes.io/projected/49bd1319-7b3b-4af3-9ad3-282baf375ea8-kube-api-access-mccml\") on node \"ip-10-0-140-29.ec2.internal\" DevicePath \"\"" May 25 14:24:14.963522 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:14.963521 2562 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/49bd1319-7b3b-4af3-9ad3-282baf375ea8-must-gather-output\") on node \"ip-10-0-140-29.ec2.internal\" DevicePath \"\"" May 25 14:24:15.607261 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:15.607234 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ed5f87c4-d5fa-4f5d-a2bc-453384227716/alertmanager/0.log" May 25 14:24:15.635506 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:15.635482 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ed5f87c4-d5fa-4f5d-a2bc-453384227716/config-reloader/0.log" May 25 14:24:15.658222 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:15.658202 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ed5f87c4-d5fa-4f5d-a2bc-453384227716/kube-rbac-proxy-web/0.log" May 25 14:24:15.681595 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:15.681564 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ed5f87c4-d5fa-4f5d-a2bc-453384227716/kube-rbac-proxy/0.log" May 25 14:24:15.704827 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:15.704800 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ed5f87c4-d5fa-4f5d-a2bc-453384227716/kube-rbac-proxy-metric/0.log" May 25 14:24:15.722540 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:15.722523 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-6fdkg_must-gather-746wj_49bd1319-7b3b-4af3-9ad3-282baf375ea8/copy/0.log" May 25 14:24:15.722849 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:15.722836 2562 scope.go:117] "RemoveContainer" containerID="92716253bba9d56ddfca4aac9301c4b95826a5f776835e989e570ec90a56941f" May 25 14:24:15.722910 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:15.722859 2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6fdkg/must-gather-746wj" May 25 14:24:15.725193 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:15.725169 2562 status_manager.go:895] "Failed to get status for pod" podUID="49bd1319-7b3b-4af3-9ad3-282baf375ea8" pod="openshift-must-gather-6fdkg/must-gather-746wj" err="pods \"must-gather-746wj\" is forbidden: User \"system:node:ip-10-0-140-29.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-6fdkg\": no relationship found between node 'ip-10-0-140-29.ec2.internal' and this object" May 25 14:24:15.729900 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:15.729827 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ed5f87c4-d5fa-4f5d-a2bc-453384227716/prom-label-proxy/0.log" May 25 14:24:15.730879 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:15.730518 2562 scope.go:117] "RemoveContainer" containerID="534a6ac598df0bd8b6f5d61fe7f4d88e9a0e25244c756f648a28d9d1e219941c" May 25 14:24:15.733063 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:15.733037 2562 status_manager.go:895] "Failed to get status for pod" podUID="49bd1319-7b3b-4af3-9ad3-282baf375ea8" pod="openshift-must-gather-6fdkg/must-gather-746wj" err="pods \"must-gather-746wj\" is forbidden: User \"system:node:ip-10-0-140-29.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-6fdkg\": no relationship found between node 'ip-10-0-140-29.ec2.internal' and this object" May 25 14:24:15.751034 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:15.751015 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ed5f87c4-d5fa-4f5d-a2bc-453384227716/init-config-reloader/0.log" May 25 14:24:15.817331 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:15.817306 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-4n8ft_fa1d118f-539c-4f71-b704-1f7e734e8882/kube-state-metrics/0.log" May 25 14:24:15.840356 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:15.840331 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-4n8ft_fa1d118f-539c-4f71-b704-1f7e734e8882/kube-rbac-proxy-main/0.log" May 25 14:24:15.862447 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:15.862360 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-4n8ft_fa1d118f-539c-4f71-b704-1f7e734e8882/kube-rbac-proxy-self/0.log" May 25 14:24:15.891147 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:15.891126 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-66fb98b9d7-2nlzc_c5ef2618-3b13-401e-a133-b1b3113e2b39/metrics-server/0.log" May 25 14:24:15.918602 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:15.918583 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-qg57n_27a0deb6-6d9d-48e8-8420-9e6756280059/monitoring-plugin/0.log" May 25 14:24:16.040401 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:16.040364 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qpc4t_4336480c-183b-42b7-9e54-4f835abaf49b/node-exporter/0.log" May 25 14:24:16.061315 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:16.061288 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qpc4t_4336480c-183b-42b7-9e54-4f835abaf49b/kube-rbac-proxy/0.log" May 25 14:24:16.085974 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:16.085949 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qpc4t_4336480c-183b-42b7-9e54-4f835abaf49b/init-textfile/0.log" May 25 14:24:16.297363 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:16.297339 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_41e61d13-0735-4ba3-94ce-9743dfd54379/prometheus/0.log" May 25 14:24:16.325064 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:16.325040 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_41e61d13-0735-4ba3-94ce-9743dfd54379/config-reloader/0.log" May 25 14:24:16.352600 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:16.352577 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_41e61d13-0735-4ba3-94ce-9743dfd54379/thanos-sidecar/0.log" May 25 14:24:16.366566 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:16.366543 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49bd1319-7b3b-4af3-9ad3-282baf375ea8" path="/var/lib/kubelet/pods/49bd1319-7b3b-4af3-9ad3-282baf375ea8/volumes" May 25 14:24:16.366834 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:16.366812 2562 status_manager.go:895] "Failed to get status for pod" podUID="49bd1319-7b3b-4af3-9ad3-282baf375ea8" pod="openshift-must-gather-6fdkg/must-gather-746wj" err="pods \"must-gather-746wj\" is forbidden: User \"system:node:ip-10-0-140-29.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-6fdkg\": no relationship found between node 'ip-10-0-140-29.ec2.internal' and this object" May 25 14:24:16.379104 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:16.379087 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_41e61d13-0735-4ba3-94ce-9743dfd54379/kube-rbac-proxy-web/0.log" May 25 14:24:16.407061 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:16.407040 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_41e61d13-0735-4ba3-94ce-9743dfd54379/kube-rbac-proxy/0.log" May 25 14:24:16.435307 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:16.435280 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_41e61d13-0735-4ba3-94ce-9743dfd54379/kube-rbac-proxy-thanos/0.log" May 25 14:24:16.462187 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:16.462171 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_41e61d13-0735-4ba3-94ce-9743dfd54379/init-config-reloader/0.log" May 25 14:24:16.497242 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:16.497191 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-c66qm_1988c8b4-1380-4381-9d33-4a9ede090c02/prometheus-operator/0.log" May 25 14:24:16.518683 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:16.518660 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-c66qm_1988c8b4-1380-4381-9d33-4a9ede090c02/kube-rbac-proxy/0.log" May 25 14:24:16.545494 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:16.545476 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-sk82r_4f280e16-18cd-490c-8c57-4e2a1b58bb51/prometheus-operator-admission-webhook/0.log" May 25 14:24:16.663433 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:16.663407 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79bc96554b-nnrtp_1a9a3016-87ae-46ea-b4de-8f038167f4ea/thanos-query/0.log" May 25 14:24:16.691039 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:16.691018 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79bc96554b-nnrtp_1a9a3016-87ae-46ea-b4de-8f038167f4ea/kube-rbac-proxy-web/0.log" May 25 14:24:16.716313 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:16.716294 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79bc96554b-nnrtp_1a9a3016-87ae-46ea-b4de-8f038167f4ea/kube-rbac-proxy/0.log" May 25 14:24:16.741012 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:16.740996 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79bc96554b-nnrtp_1a9a3016-87ae-46ea-b4de-8f038167f4ea/prom-label-proxy/0.log" May 25 14:24:16.765545 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:16.765494 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79bc96554b-nnrtp_1a9a3016-87ae-46ea-b4de-8f038167f4ea/kube-rbac-proxy-rules/0.log" May 25 14:24:16.790515 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:16.790497 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79bc96554b-nnrtp_1a9a3016-87ae-46ea-b4de-8f038167f4ea/kube-rbac-proxy-metrics/0.log" May 25 14:24:18.822524 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:18.822495 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-lr7c5_02bfa411-fef2-4aa3-9901-b092c646a450/download-server/0.log" May 25 14:24:19.218114 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:19.218040 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-hvwbq_98dabd97-cedd-48fb-ae54-c674d14d50bf/volume-data-source-validator/0.log" May 25 14:24:19.324756 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:19.324732 2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bxcrt/perf-node-gather-daemonset-7zqwv"] May 25 14:24:19.325142 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:19.325126 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49bd1319-7b3b-4af3-9ad3-282baf375ea8" containerName="gather" May 25 14:24:19.325223 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:19.325145 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="49bd1319-7b3b-4af3-9ad3-282baf375ea8" containerName="gather" May 25 14:24:19.325223 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:19.325190 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49bd1319-7b3b-4af3-9ad3-282baf375ea8" containerName="copy" May 25 14:24:19.325223 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:19.325199 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="49bd1319-7b3b-4af3-9ad3-282baf375ea8" containerName="copy" May 25 14:24:19.325363 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:19.325299 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="49bd1319-7b3b-4af3-9ad3-282baf375ea8" containerName="gather" May 25 14:24:19.325363 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:19.325312 2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="49bd1319-7b3b-4af3-9ad3-282baf375ea8" containerName="copy" May 25 14:24:19.330898 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:19.330877 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bxcrt/perf-node-gather-daemonset-7zqwv" May 25 14:24:19.333560 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:19.333537 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bxcrt\"/\"kube-root-ca.crt\"" May 25 14:24:19.333676 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:19.333540 2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bxcrt\"/\"openshift-service-ca.crt\"" May 25 14:24:19.333946 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:19.333928 2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bxcrt\"/\"default-dockercfg-wj7jt\"" May 25 14:24:19.334493 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:19.334475 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bxcrt/perf-node-gather-daemonset-7zqwv"] May 25 14:24:19.404216 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:19.404191 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b9aa2028-53da-4f97-8f94-935d3cd92061-lib-modules\") pod \"perf-node-gather-daemonset-7zqwv\" (UID: \"b9aa2028-53da-4f97-8f94-935d3cd92061\") " pod="openshift-must-gather-bxcrt/perf-node-gather-daemonset-7zqwv" May 25 14:24:19.404357 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:19.404335 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b9aa2028-53da-4f97-8f94-935d3cd92061-proc\") pod \"perf-node-gather-daemonset-7zqwv\" (UID: \"b9aa2028-53da-4f97-8f94-935d3cd92061\") " pod="openshift-must-gather-bxcrt/perf-node-gather-daemonset-7zqwv" May 25 14:24:19.404457 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:19.404396 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p679j\" (UniqueName: \"kubernetes.io/projected/b9aa2028-53da-4f97-8f94-935d3cd92061-kube-api-access-p679j\") pod \"perf-node-gather-daemonset-7zqwv\" (UID: \"b9aa2028-53da-4f97-8f94-935d3cd92061\") " pod="openshift-must-gather-bxcrt/perf-node-gather-daemonset-7zqwv" May 25 14:24:19.404519 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:19.404490 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b9aa2028-53da-4f97-8f94-935d3cd92061-sys\") pod \"perf-node-gather-daemonset-7zqwv\" (UID: \"b9aa2028-53da-4f97-8f94-935d3cd92061\") " pod="openshift-must-gather-bxcrt/perf-node-gather-daemonset-7zqwv" May 25 14:24:19.404741 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:19.404717 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b9aa2028-53da-4f97-8f94-935d3cd92061-podres\") pod \"perf-node-gather-daemonset-7zqwv\" (UID: \"b9aa2028-53da-4f97-8f94-935d3cd92061\") " pod="openshift-must-gather-bxcrt/perf-node-gather-daemonset-7zqwv" May 25 14:24:19.505592 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:19.505539 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b9aa2028-53da-4f97-8f94-935d3cd92061-sys\") pod \"perf-node-gather-daemonset-7zqwv\" (UID: \"b9aa2028-53da-4f97-8f94-935d3cd92061\") " pod="openshift-must-gather-bxcrt/perf-node-gather-daemonset-7zqwv" May 25 14:24:19.505592 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:19.505578 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b9aa2028-53da-4f97-8f94-935d3cd92061-podres\") pod \"perf-node-gather-daemonset-7zqwv\" (UID: \"b9aa2028-53da-4f97-8f94-935d3cd92061\") " pod="openshift-must-gather-bxcrt/perf-node-gather-daemonset-7zqwv" May 25 14:24:19.505755 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:19.505604 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b9aa2028-53da-4f97-8f94-935d3cd92061-lib-modules\") pod \"perf-node-gather-daemonset-7zqwv\" (UID: \"b9aa2028-53da-4f97-8f94-935d3cd92061\") " pod="openshift-must-gather-bxcrt/perf-node-gather-daemonset-7zqwv" May 25 14:24:19.505755 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:19.505638 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b9aa2028-53da-4f97-8f94-935d3cd92061-proc\") pod \"perf-node-gather-daemonset-7zqwv\" (UID: \"b9aa2028-53da-4f97-8f94-935d3cd92061\") " pod="openshift-must-gather-bxcrt/perf-node-gather-daemonset-7zqwv" May 25 14:24:19.505755 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:19.505662 2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p679j\" (UniqueName: \"kubernetes.io/projected/b9aa2028-53da-4f97-8f94-935d3cd92061-kube-api-access-p679j\") pod \"perf-node-gather-daemonset-7zqwv\" (UID: \"b9aa2028-53da-4f97-8f94-935d3cd92061\") " pod="openshift-must-gather-bxcrt/perf-node-gather-daemonset-7zqwv" May 25 14:24:19.505755 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:19.505677 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b9aa2028-53da-4f97-8f94-935d3cd92061-sys\") pod \"perf-node-gather-daemonset-7zqwv\" (UID: \"b9aa2028-53da-4f97-8f94-935d3cd92061\") " pod="openshift-must-gather-bxcrt/perf-node-gather-daemonset-7zqwv" May 25 14:24:19.505755 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:19.505709 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b9aa2028-53da-4f97-8f94-935d3cd92061-proc\") pod \"perf-node-gather-daemonset-7zqwv\" (UID: \"b9aa2028-53da-4f97-8f94-935d3cd92061\") " pod="openshift-must-gather-bxcrt/perf-node-gather-daemonset-7zqwv" May 25 14:24:19.505755 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:19.505715 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b9aa2028-53da-4f97-8f94-935d3cd92061-podres\") pod \"perf-node-gather-daemonset-7zqwv\" (UID: \"b9aa2028-53da-4f97-8f94-935d3cd92061\") " pod="openshift-must-gather-bxcrt/perf-node-gather-daemonset-7zqwv" May 25 14:24:19.505967 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:19.505753 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b9aa2028-53da-4f97-8f94-935d3cd92061-lib-modules\") pod \"perf-node-gather-daemonset-7zqwv\" (UID: \"b9aa2028-53da-4f97-8f94-935d3cd92061\") " pod="openshift-must-gather-bxcrt/perf-node-gather-daemonset-7zqwv" May 25 14:24:19.513550 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:19.513527 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p679j\" (UniqueName: \"kubernetes.io/projected/b9aa2028-53da-4f97-8f94-935d3cd92061-kube-api-access-p679j\") pod \"perf-node-gather-daemonset-7zqwv\" (UID: \"b9aa2028-53da-4f97-8f94-935d3cd92061\") " pod="openshift-must-gather-bxcrt/perf-node-gather-daemonset-7zqwv" May 25 14:24:19.642724 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:19.642702 2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bxcrt/perf-node-gather-daemonset-7zqwv" May 25 14:24:19.763745 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:19.763721 2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bxcrt/perf-node-gather-daemonset-7zqwv"] May 25 14:24:19.766116 ip-10-0-140-29 kubenswrapper[2562]: W0525 14:24:19.766086 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb9aa2028_53da_4f97_8f94_935d3cd92061.slice/crio-e28dc354eb7e79864beb85e958d4986f63c4d3b4058f1e78787befff91a39621 WatchSource:0}: Error finding container e28dc354eb7e79864beb85e958d4986f63c4d3b4058f1e78787befff91a39621: Status 404 returned error can't find the container with id e28dc354eb7e79864beb85e958d4986f63c4d3b4058f1e78787befff91a39621 May 25 14:24:19.767726 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:19.767706 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 25 14:24:20.006424 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:20.006399 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-k4lxb_261f5fa7-41fd-46aa-a56b-7042da67b7bc/dns/0.log" May 25 14:24:20.027356 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:20.027285 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-k4lxb_261f5fa7-41fd-46aa-a56b-7042da67b7bc/kube-rbac-proxy/0.log" May 25 14:24:20.100140 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:20.100118 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-td67w_251e865d-d65c-4abf-b045-ac55fee054da/dns-node-resolver/0.log" May 25 14:24:20.569631 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:20.569610 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wmrkq_5da677c4-73fb-4b42-be1a-c7fb68aa56d0/node-ca/0.log" May 25 14:24:20.739833 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:20.739804 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bxcrt/perf-node-gather-daemonset-7zqwv" event={"ID":"b9aa2028-53da-4f97-8f94-935d3cd92061","Type":"ContainerStarted","Data":"c4116171750a5a75ac53b02d01bfffcd0de4fd98f7c635a1b416165a7763a5cd"} May 25 14:24:20.739990 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:20.739836 2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bxcrt/perf-node-gather-daemonset-7zqwv" event={"ID":"b9aa2028-53da-4f97-8f94-935d3cd92061","Type":"ContainerStarted","Data":"e28dc354eb7e79864beb85e958d4986f63c4d3b4058f1e78787befff91a39621"} May 25 14:24:20.739990 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:20.739868 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bxcrt/perf-node-gather-daemonset-7zqwv" May 25 14:24:20.755044 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:20.755006 2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-bxcrt/perf-node-gather-daemonset-7zqwv" podStartSLOduration=1.754991824 podStartE2EDuration="1.754991824s" podCreationTimestamp="2026-05-25 14:24:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 14:24:20.753781057 +0000 UTC m=+714.961028252" watchObservedRunningTime="2026-05-25 14:24:20.754991824 +0000 UTC m=+714.962239006" May 25 14:24:21.663242 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:21.663208 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2pcq6_009111ca-e828-4238-accf-5381fbdf7799/serve-healthcheck-canary/0.log" May 25 14:24:22.054354 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:22.054323 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-l4gxh_aec84fa8-ab52-471b-87c9-5abb8d795238/insights-operator/1.log" May 25 14:24:22.054790 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:22.054767 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-l4gxh_aec84fa8-ab52-471b-87c9-5abb8d795238/insights-operator/0.log" May 25 14:24:22.233205 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:22.233179 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zl8wx_448645b2-eafe-4a90-8bb6-62d04df143b4/kube-rbac-proxy/0.log" May 25 14:24:22.260312 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:22.260266 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zl8wx_448645b2-eafe-4a90-8bb6-62d04df143b4/exporter/0.log" May 25 14:24:22.286864 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:22.286838 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zl8wx_448645b2-eafe-4a90-8bb6-62d04df143b4/extractor/0.log" May 25 14:24:26.754145 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:26.754116 2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bxcrt/perf-node-gather-daemonset-7zqwv" May 25 14:24:27.474605 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:27.474577 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-rb4mc_6cddc246-de40-4ec5-8dd8-25e94b917240/kube-storage-version-migrator-operator/1.log" May 25 14:24:27.476030 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:27.476005 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-rb4mc_6cddc246-de40-4ec5-8dd8-25e94b917240/kube-storage-version-migrator-operator/0.log" May 25 14:24:28.653356 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:28.653325 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qdkw4_823e5406-c4ba-45f5-bd46-f82b17b0495c/kube-multus-additional-cni-plugins/0.log" May 25 14:24:28.681243 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:28.681215 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qdkw4_823e5406-c4ba-45f5-bd46-f82b17b0495c/egress-router-binary-copy/0.log" May 25 14:24:28.706662 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:28.706643 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qdkw4_823e5406-c4ba-45f5-bd46-f82b17b0495c/cni-plugins/0.log" May 25 14:24:28.740033 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:28.740015 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qdkw4_823e5406-c4ba-45f5-bd46-f82b17b0495c/bond-cni-plugin/0.log" May 25 14:24:28.762728 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:28.762707 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qdkw4_823e5406-c4ba-45f5-bd46-f82b17b0495c/routeoverride-cni/0.log" May 25 14:24:28.788578 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:28.788559 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qdkw4_823e5406-c4ba-45f5-bd46-f82b17b0495c/whereabouts-cni-bincopy/0.log" May 25 14:24:28.814786 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:28.814765 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qdkw4_823e5406-c4ba-45f5-bd46-f82b17b0495c/whereabouts-cni/0.log" May 25 14:24:29.074563 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:29.074531 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-l5kmt_e081d292-f999-4a5d-8e11-7d2ccac47593/kube-multus/0.log" May 25 14:24:29.157851 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:29.157826 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-p6784_7b48e369-ae21-483b-897e-fb9b4ecd1818/network-metrics-daemon/0.log" May 25 14:24:29.181392 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:29.181345 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-p6784_7b48e369-ae21-483b-897e-fb9b4ecd1818/kube-rbac-proxy/0.log" May 25 14:24:30.009818 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:30.009793 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b2gmj_b5ab1333-fc5e-46eb-a0ee-bd4d08c45527/ovn-controller/0.log" May 25 14:24:30.027808 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:30.027742 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b2gmj_b5ab1333-fc5e-46eb-a0ee-bd4d08c45527/ovn-acl-logging/0.log" May 25 14:24:30.034222 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:30.034203 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b2gmj_b5ab1333-fc5e-46eb-a0ee-bd4d08c45527/ovn-acl-logging/1.log" May 25 14:24:30.058964 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:30.058939 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b2gmj_b5ab1333-fc5e-46eb-a0ee-bd4d08c45527/kube-rbac-proxy-node/0.log" May 25 14:24:30.080828 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:30.080808 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b2gmj_b5ab1333-fc5e-46eb-a0ee-bd4d08c45527/kube-rbac-proxy-ovn-metrics/0.log" May 25 14:24:30.100518 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:30.100496 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b2gmj_b5ab1333-fc5e-46eb-a0ee-bd4d08c45527/northd/0.log" May 25 14:24:30.124581 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:30.124561 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b2gmj_b5ab1333-fc5e-46eb-a0ee-bd4d08c45527/nbdb/0.log" May 25 14:24:30.147549 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:30.147525 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b2gmj_b5ab1333-fc5e-46eb-a0ee-bd4d08c45527/sbdb/0.log" May 25 14:24:30.304204 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:30.304175 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b2gmj_b5ab1333-fc5e-46eb-a0ee-bd4d08c45527/ovnkube-controller/0.log" May 25 14:24:32.026023 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:32.025997 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-wrh74_14bb3377-8d7b-4231-a2c1-cf5a7e7abbea/network-check-target-container/0.log" May 25 14:24:33.062175 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:33.062151 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-bwn7t_9ea1fab0-ccd9-4900-939f-9e7aa433972f/iptables-alerter/0.log" May 25 14:24:33.675136 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:33.675110 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-5bb7j_95eb3cbd-2c41-4d96-af85-a21ad8aaf82b/tuned/0.log" May 25 14:24:35.427998 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:35.427968 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-697587599-h6vdt_a968cf5d-ba6c-4796-a43d-ff94e55fb20b/cluster-samples-operator/0.log" May 25 14:24:35.445178 ip-10-0-140-29 kubenswrapper[2562]: I0525 14:24:35.445154 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-697587599-h6vdt_a968cf5d-ba6c-4796-a43d-ff94e55fb20b/cluster-samples-operator-watch/0.log"