May 26 15:20:49.024073 ip-10-0-129-103 systemd[1]: Starting Kubernetes Kubelet... May 26 15:20:49.525118 ip-10-0-129-103 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 26 15:20:49.525118 ip-10-0-129-103 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 26 15:20:49.525118 ip-10-0-129-103 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 26 15:20:49.525118 ip-10-0-129-103 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 26 15:20:49.525118 ip-10-0-129-103 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 26 15:20:49.529003 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.528825 2566 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 26 15:20:49.532062 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532046 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 15:20:49.532098 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532063 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 15:20:49.532098 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532067 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 15:20:49.532098 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532071 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 15:20:49.532098 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532075 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 15:20:49.532098 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532078 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 15:20:49.532098 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532080 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 15:20:49.532098 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532083 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 15:20:49.532098 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532085 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 15:20:49.532098 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532094 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 15:20:49.532098 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532096 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 15:20:49.532098 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532099 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 15:20:49.532098 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532102 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 15:20:49.532098 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532105 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 15:20:49.532411 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532108 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 15:20:49.532411 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532110 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 15:20:49.532411 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532113 2566 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 15:20:49.532411 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532115 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 15:20:49.532411 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532118 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 15:20:49.532411 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532120 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 15:20:49.532411 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532123 2566 feature_gate.go:328] unrecognized feature gate: Example May 26 15:20:49.532411 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532126 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 15:20:49.532411 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532128 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 15:20:49.532411 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532131 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 15:20:49.532411 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532133 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 15:20:49.532411 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532136 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 15:20:49.532411 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532138 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 15:20:49.532411 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532141 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 15:20:49.532411 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532144 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 15:20:49.532411 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532146 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 15:20:49.532411 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532148 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 15:20:49.532411 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532153 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 15:20:49.532411 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532156 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 15:20:49.532905 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532159 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 15:20:49.532905 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532162 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 15:20:49.532905 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532165 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 15:20:49.532905 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532169 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 15:20:49.532905 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532172 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 15:20:49.532905 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532175 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 15:20:49.532905 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532177 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 15:20:49.532905 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532180 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 15:20:49.532905 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532183 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 15:20:49.532905 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532185 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 15:20:49.532905 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532187 2566 feature_gate.go:328] unrecognized feature gate: Example2 May 26 15:20:49.532905 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532190 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 15:20:49.532905 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532192 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 15:20:49.532905 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532195 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 15:20:49.532905 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532197 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 15:20:49.532905 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532200 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 15:20:49.532905 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532203 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 15:20:49.532905 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532206 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 15:20:49.532905 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532208 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 15:20:49.532905 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532211 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 15:20:49.533400 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532213 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 15:20:49.533400 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532216 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 15:20:49.533400 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532219 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 15:20:49.533400 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532221 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 15:20:49.533400 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532224 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 15:20:49.533400 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532226 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 15:20:49.533400 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532229 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 15:20:49.533400 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532231 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 15:20:49.533400 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532233 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 15:20:49.533400 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532236 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 15:20:49.533400 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532238 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 15:20:49.533400 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532242 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 15:20:49.533400 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532246 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 15:20:49.533400 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532249 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 15:20:49.533400 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532251 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 15:20:49.533400 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532254 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 15:20:49.533400 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532257 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 15:20:49.533400 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532259 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 15:20:49.533400 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532262 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 15:20:49.533872 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532265 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 15:20:49.533872 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532267 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 15:20:49.533872 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532270 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 15:20:49.533872 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532272 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 15:20:49.533872 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532275 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 15:20:49.533872 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532278 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 15:20:49.533872 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532281 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 15:20:49.533872 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532283 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 15:20:49.533872 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532286 2566 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 15:20:49.533872 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532289 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 15:20:49.533872 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532291 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 15:20:49.533872 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532294 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 15:20:49.533872 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532297 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 15:20:49.533872 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532299 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 15:20:49.533872 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532692 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 15:20:49.533872 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532699 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 15:20:49.533872 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532702 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 15:20:49.533872 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532704 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 15:20:49.533872 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532707 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 15:20:49.533872 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532710 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 15:20:49.534357 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532712 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 15:20:49.534357 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532715 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 15:20:49.534357 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532717 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 15:20:49.534357 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532720 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 15:20:49.534357 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532723 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 15:20:49.534357 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532725 2566 feature_gate.go:328] unrecognized feature gate: Example May 26 15:20:49.534357 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532728 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 15:20:49.534357 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532730 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 15:20:49.534357 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532733 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 15:20:49.534357 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532736 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 15:20:49.534357 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532738 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 15:20:49.534357 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532742 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 15:20:49.534357 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532745 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 15:20:49.534357 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532748 2566 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 15:20:49.534357 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532751 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 15:20:49.534357 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532753 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 15:20:49.534357 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532756 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 15:20:49.534357 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532758 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 15:20:49.534357 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532761 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 15:20:49.534357 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532764 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 15:20:49.534868 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532768 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 15:20:49.534868 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532770 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 15:20:49.534868 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532773 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 15:20:49.534868 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532775 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 15:20:49.534868 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532778 2566 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 15:20:49.534868 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532781 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 15:20:49.534868 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532783 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 15:20:49.534868 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532786 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 15:20:49.534868 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532788 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 15:20:49.534868 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532791 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 15:20:49.534868 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532794 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 15:20:49.534868 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532796 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 15:20:49.534868 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532798 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 15:20:49.534868 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532801 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 15:20:49.534868 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532803 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 15:20:49.534868 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532805 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 15:20:49.534868 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532808 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 15:20:49.534868 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532811 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 15:20:49.534868 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532813 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 15:20:49.534868 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532816 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 15:20:49.535369 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532819 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 15:20:49.535369 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532822 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 15:20:49.535369 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532825 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 15:20:49.535369 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532828 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 15:20:49.535369 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532831 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 15:20:49.535369 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532834 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 15:20:49.535369 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532837 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 15:20:49.535369 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532839 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 15:20:49.535369 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532842 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 15:20:49.535369 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532844 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 15:20:49.535369 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532847 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 15:20:49.535369 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532851 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 15:20:49.535369 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532855 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 15:20:49.535369 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532857 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 15:20:49.535369 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532860 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 15:20:49.535369 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532863 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 15:20:49.535369 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532866 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 15:20:49.535369 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532868 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 15:20:49.535369 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532871 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 15:20:49.535852 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532873 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 15:20:49.535852 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532875 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 15:20:49.535852 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532878 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 15:20:49.535852 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532882 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 15:20:49.535852 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532884 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 15:20:49.535852 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532887 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 15:20:49.535852 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532890 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 15:20:49.535852 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532892 2566 feature_gate.go:328] unrecognized feature gate: Example2 May 26 15:20:49.535852 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532895 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 15:20:49.535852 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532898 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 15:20:49.535852 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532900 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 15:20:49.535852 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532903 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 15:20:49.535852 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532905 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 15:20:49.535852 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532908 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 15:20:49.535852 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532911 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 15:20:49.535852 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532914 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 15:20:49.535852 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532917 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 15:20:49.535852 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532920 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 15:20:49.535852 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532923 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 15:20:49.535852 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532925 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 15:20:49.536368 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.532928 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 15:20:49.536368 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534028 2566 flags.go:64] FLAG: --address="0.0.0.0" May 26 15:20:49.536368 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534041 2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 26 15:20:49.536368 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534048 2566 flags.go:64] FLAG: --anonymous-auth="true" May 26 15:20:49.536368 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534053 2566 flags.go:64] FLAG: --application-metrics-count-limit="100" May 26 15:20:49.536368 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534058 2566 flags.go:64] FLAG: --authentication-token-webhook="false" May 26 15:20:49.536368 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534061 2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 26 15:20:49.536368 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534066 2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 26 15:20:49.536368 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534070 2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 26 15:20:49.536368 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534074 2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 26 15:20:49.536368 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534077 2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 26 15:20:49.536368 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534080 2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 26 15:20:49.536368 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534083 2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 26 15:20:49.536368 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534087 2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 26 15:20:49.536368 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534090 2566 flags.go:64] FLAG: --cgroup-root="" May 26 15:20:49.536368 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534093 2566 flags.go:64] FLAG: --cgroups-per-qos="true" May 26 15:20:49.536368 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534096 2566 flags.go:64] FLAG: --client-ca-file="" May 26 15:20:49.536368 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534099 2566 flags.go:64] FLAG: --cloud-config="" May 26 15:20:49.536368 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534102 2566 flags.go:64] FLAG: --cloud-provider="external" May 26 15:20:49.536368 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534105 2566 flags.go:64] FLAG: --cluster-dns="[]" May 26 15:20:49.536368 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534109 2566 flags.go:64] FLAG: --cluster-domain="" May 26 15:20:49.536368 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534112 2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 26 15:20:49.536368 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534115 2566 flags.go:64] FLAG: --config-dir="" May 26 15:20:49.536368 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534118 2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 26 15:20:49.536962 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534121 2566 flags.go:64] FLAG: --container-log-max-files="5" May 26 15:20:49.536962 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534126 2566 flags.go:64] FLAG: --container-log-max-size="10Mi" May 26 15:20:49.536962 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534129 2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 26 15:20:49.536962 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534132 2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 26 15:20:49.536962 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534136 2566 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 26 15:20:49.536962 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534139 2566 flags.go:64] FLAG: --contention-profiling="false" May 26 15:20:49.536962 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534143 2566 flags.go:64] FLAG: --cpu-cfs-quota="true" May 26 15:20:49.536962 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534146 2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 26 15:20:49.536962 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534149 2566 flags.go:64] FLAG: --cpu-manager-policy="none" May 26 15:20:49.536962 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534152 2566 flags.go:64] FLAG: --cpu-manager-policy-options="" May 26 15:20:49.536962 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534156 2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 26 15:20:49.536962 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534159 2566 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 26 15:20:49.536962 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534162 2566 flags.go:64] FLAG: --enable-debugging-handlers="true" May 26 15:20:49.536962 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534164 2566 flags.go:64] FLAG: --enable-load-reader="false" May 26 15:20:49.536962 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534167 2566 flags.go:64] FLAG: --enable-server="true" May 26 15:20:49.536962 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534170 2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 26 15:20:49.536962 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534174 2566 flags.go:64] FLAG: --event-burst="100" May 26 15:20:49.536962 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534178 2566 flags.go:64] FLAG: --event-qps="50" May 26 15:20:49.536962 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534181 2566 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 26 15:20:49.536962 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534184 2566 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 26 15:20:49.536962 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534187 2566 flags.go:64] FLAG: --eviction-hard="" May 26 15:20:49.536962 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534191 2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 26 15:20:49.536962 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534194 2566 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 26 15:20:49.536962 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534197 2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 26 15:20:49.536962 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534201 2566 flags.go:64] FLAG: --eviction-soft="" May 26 15:20:49.537567 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534204 2566 flags.go:64] FLAG: --eviction-soft-grace-period="" May 26 15:20:49.537567 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534207 2566 flags.go:64] FLAG: --exit-on-lock-contention="false" May 26 15:20:49.537567 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534210 2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 26 15:20:49.537567 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534213 2566 flags.go:64] FLAG: --experimental-mounter-path="" May 26 15:20:49.537567 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534216 2566 flags.go:64] FLAG: --fail-cgroupv1="false" May 26 15:20:49.537567 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534219 2566 flags.go:64] FLAG: --fail-swap-on="true" May 26 15:20:49.537567 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534222 2566 flags.go:64] FLAG: --feature-gates="" May 26 15:20:49.537567 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534227 2566 flags.go:64] FLAG: --file-check-frequency="20s" May 26 15:20:49.537567 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534229 2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 26 15:20:49.537567 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534233 2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 26 15:20:49.537567 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534236 2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 26 15:20:49.537567 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534239 2566 flags.go:64] FLAG: --healthz-port="10248" May 26 15:20:49.537567 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534243 2566 flags.go:64] FLAG: --help="false" May 26 15:20:49.537567 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534246 2566 flags.go:64] FLAG: --hostname-override="ip-10-0-129-103.ec2.internal" May 26 15:20:49.537567 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534250 2566 flags.go:64] FLAG: --housekeeping-interval="10s" May 26 15:20:49.537567 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534253 2566 flags.go:64] FLAG: --http-check-frequency="20s" May 26 15:20:49.537567 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534256 2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 26 15:20:49.537567 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534259 2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 26 15:20:49.537567 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534262 2566 flags.go:64] FLAG: --image-gc-high-threshold="85" May 26 15:20:49.537567 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534266 2566 flags.go:64] FLAG: --image-gc-low-threshold="80" May 26 15:20:49.537567 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534269 2566 flags.go:64] FLAG: --image-service-endpoint="" May 26 15:20:49.537567 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534272 2566 flags.go:64] FLAG: --kernel-memcg-notification="false" May 26 15:20:49.537567 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534275 2566 flags.go:64] FLAG: --kube-api-burst="100" May 26 15:20:49.538172 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534278 2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 26 15:20:49.538172 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534281 2566 flags.go:64] FLAG: --kube-api-qps="50" May 26 15:20:49.538172 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534284 2566 flags.go:64] FLAG: --kube-reserved="" May 26 15:20:49.538172 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534287 2566 flags.go:64] FLAG: --kube-reserved-cgroup="" May 26 15:20:49.538172 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534290 2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 26 15:20:49.538172 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534293 2566 flags.go:64] FLAG: --kubelet-cgroups="" May 26 15:20:49.538172 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534297 2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 26 15:20:49.538172 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534300 2566 flags.go:64] FLAG: --lock-file="" May 26 15:20:49.538172 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534302 2566 flags.go:64] FLAG: --log-cadvisor-usage="false" May 26 15:20:49.538172 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534305 2566 flags.go:64] FLAG: --log-flush-frequency="5s" May 26 15:20:49.538172 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534308 2566 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 26 15:20:49.538172 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534314 2566 flags.go:64] FLAG: --log-json-split-stream="false" May 26 15:20:49.538172 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534317 2566 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 26 15:20:49.538172 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534320 2566 flags.go:64] FLAG: --log-text-split-stream="false" May 26 15:20:49.538172 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534323 2566 flags.go:64] FLAG: --logging-format="text" May 26 15:20:49.538172 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534326 2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 26 15:20:49.538172 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534329 2566 flags.go:64] FLAG: --make-iptables-util-chains="true" May 26 15:20:49.538172 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534332 2566 flags.go:64] FLAG: --manifest-url="" May 26 15:20:49.538172 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534334 2566 flags.go:64] FLAG: --manifest-url-header="" May 26 15:20:49.538172 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534339 2566 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 26 15:20:49.538172 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534342 2566 flags.go:64] FLAG: --max-open-files="1000000" May 26 15:20:49.538172 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534346 2566 flags.go:64] FLAG: --max-pods="110" May 26 15:20:49.538172 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534350 2566 flags.go:64] FLAG: --maximum-dead-containers="-1" May 26 15:20:49.538172 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534353 2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 26 15:20:49.538172 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534355 2566 flags.go:64] FLAG: --memory-manager-policy="None" May 26 15:20:49.538789 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534359 2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 26 15:20:49.538789 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534362 2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 26 15:20:49.538789 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534365 2566 flags.go:64] FLAG: --node-ip="0.0.0.0" May 26 15:20:49.538789 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534368 2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 26 15:20:49.538789 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534376 2566 flags.go:64] FLAG: --node-status-max-images="50" May 26 15:20:49.538789 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534380 2566 flags.go:64] FLAG: --node-status-update-frequency="10s" May 26 15:20:49.538789 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534383 2566 flags.go:64] FLAG: --oom-score-adj="-999" May 26 15:20:49.538789 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534386 2566 flags.go:64] FLAG: --pod-cidr="" May 26 15:20:49.538789 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534389 2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 26 15:20:49.538789 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534395 2566 flags.go:64] FLAG: --pod-manifest-path="" May 26 15:20:49.538789 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534398 2566 flags.go:64] FLAG: --pod-max-pids="-1" May 26 15:20:49.538789 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534401 2566 flags.go:64] FLAG: --pods-per-core="0" May 26 15:20:49.538789 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534405 2566 flags.go:64] FLAG: --port="10250" May 26 15:20:49.538789 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534408 2566 flags.go:64] FLAG: --protect-kernel-defaults="false" May 26 15:20:49.538789 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534411 2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0bdc7945339492901" May 26 15:20:49.538789 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534414 2566 flags.go:64] FLAG: --qos-reserved="" May 26 15:20:49.538789 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534417 2566 flags.go:64] FLAG: --read-only-port="10255" May 26 15:20:49.538789 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534421 2566 flags.go:64] FLAG: --register-node="true" May 26 15:20:49.538789 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534424 2566 flags.go:64] FLAG: --register-schedulable="true" May 26 15:20:49.538789 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534427 2566 flags.go:64] FLAG: --register-with-taints="" May 26 15:20:49.538789 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534436 2566 flags.go:64] FLAG: --registry-burst="10" May 26 15:20:49.538789 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534440 2566 flags.go:64] FLAG: --registry-qps="5" May 26 15:20:49.538789 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534442 2566 flags.go:64] FLAG: --reserved-cpus="" May 26 15:20:49.538789 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534445 2566 flags.go:64] FLAG: --reserved-memory="" May 26 15:20:49.538789 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534450 2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 26 15:20:49.539420 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534453 2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 26 15:20:49.539420 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534456 2566 flags.go:64] FLAG: --rotate-certificates="false" May 26 15:20:49.539420 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534459 2566 flags.go:64] FLAG: --rotate-server-certificates="false" May 26 15:20:49.539420 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534462 2566 flags.go:64] FLAG: --runonce="false" May 26 15:20:49.539420 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534465 2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 26 15:20:49.539420 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534469 2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 26 15:20:49.539420 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534472 2566 flags.go:64] FLAG: --seccomp-default="false" May 26 15:20:49.539420 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534475 2566 flags.go:64] FLAG: --serialize-image-pulls="true" May 26 15:20:49.539420 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534478 2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 26 15:20:49.539420 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534481 2566 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 26 15:20:49.539420 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534485 2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 26 15:20:49.539420 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534488 2566 flags.go:64] FLAG: --storage-driver-password="root" May 26 15:20:49.539420 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534491 2566 flags.go:64] FLAG: --storage-driver-secure="false" May 26 15:20:49.539420 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534494 2566 flags.go:64] FLAG: --storage-driver-table="stats" May 26 15:20:49.539420 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534496 2566 flags.go:64] FLAG: --storage-driver-user="root" May 26 15:20:49.539420 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534499 2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 26 15:20:49.539420 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534502 2566 flags.go:64] FLAG: --sync-frequency="1m0s" May 26 15:20:49.539420 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534505 2566 flags.go:64] FLAG: --system-cgroups="" May 26 15:20:49.539420 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534508 2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 26 15:20:49.539420 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534514 2566 flags.go:64] FLAG: --system-reserved-cgroup="" May 26 15:20:49.539420 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534517 2566 flags.go:64] FLAG: --tls-cert-file="" May 26 15:20:49.539420 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534520 2566 flags.go:64] FLAG: --tls-cipher-suites="[]" May 26 15:20:49.539420 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534523 2566 flags.go:64] FLAG: --tls-min-version="" May 26 15:20:49.539420 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534526 2566 flags.go:64] FLAG: --tls-private-key-file="" May 26 15:20:49.539420 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534529 2566 flags.go:64] FLAG: --topology-manager-policy="none" May 26 15:20:49.540030 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534532 2566 flags.go:64] FLAG: --topology-manager-policy-options="" May 26 15:20:49.540030 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534534 2566 flags.go:64] FLAG: --topology-manager-scope="container" May 26 15:20:49.540030 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534537 2566 flags.go:64] FLAG: --v="2" May 26 15:20:49.540030 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534541 2566 flags.go:64] FLAG: --version="false" May 26 15:20:49.540030 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534546 2566 flags.go:64] FLAG: --vmodule="" May 26 15:20:49.540030 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534550 2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 26 15:20:49.540030 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.534553 2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 26 15:20:49.540030 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534683 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 15:20:49.540030 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534688 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 15:20:49.540030 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534691 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 15:20:49.540030 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534695 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 15:20:49.540030 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534697 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 15:20:49.540030 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534701 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 15:20:49.540030 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534704 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 15:20:49.540030 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534707 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 15:20:49.540030 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534710 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 15:20:49.540030 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534713 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 15:20:49.540030 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534715 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 15:20:49.540030 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534718 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 15:20:49.540030 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534720 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 15:20:49.540030 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534723 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 15:20:49.540536 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534727 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 15:20:49.540536 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534731 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 15:20:49.540536 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534734 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 15:20:49.540536 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534737 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 15:20:49.540536 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534739 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 15:20:49.540536 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534741 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 15:20:49.540536 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534744 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 15:20:49.540536 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534747 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 15:20:49.540536 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534749 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 15:20:49.540536 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534752 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 15:20:49.540536 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534756 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 15:20:49.540536 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534760 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 15:20:49.540536 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534764 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 15:20:49.540536 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534767 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 15:20:49.540536 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534769 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 15:20:49.540536 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534772 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 15:20:49.540536 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534774 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 15:20:49.540536 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534777 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 15:20:49.541062 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534779 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 15:20:49.541062 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534782 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 15:20:49.541062 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534785 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 15:20:49.541062 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534787 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 15:20:49.541062 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534790 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 15:20:49.541062 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534792 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 15:20:49.541062 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534795 2566 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 15:20:49.541062 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534798 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 15:20:49.541062 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534800 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 15:20:49.541062 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534803 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 15:20:49.541062 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534805 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 15:20:49.541062 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534808 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 15:20:49.541062 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534811 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 15:20:49.541062 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534813 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 15:20:49.541062 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534816 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 15:20:49.541062 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534819 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 15:20:49.541062 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534822 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 15:20:49.541062 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534824 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 15:20:49.541062 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534827 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 15:20:49.541062 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534829 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 15:20:49.541597 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534832 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 15:20:49.541597 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534839 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 15:20:49.541597 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534842 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 15:20:49.541597 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534844 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 15:20:49.541597 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534847 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 15:20:49.541597 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534850 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 15:20:49.541597 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534853 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 15:20:49.541597 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534855 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 15:20:49.541597 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534858 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 15:20:49.541597 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534860 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 15:20:49.541597 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534863 2566 feature_gate.go:328] unrecognized feature gate: Example2 May 26 15:20:49.541597 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534866 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 15:20:49.541597 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534869 2566 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 15:20:49.541597 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534871 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 15:20:49.541597 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534874 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 15:20:49.541597 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534877 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 15:20:49.541597 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534880 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 15:20:49.541597 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534882 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 15:20:49.541597 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534885 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 15:20:49.541597 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534888 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 15:20:49.542112 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534891 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 15:20:49.542112 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534893 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 15:20:49.542112 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534896 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 15:20:49.542112 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534898 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 15:20:49.542112 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534901 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 15:20:49.542112 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534904 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 15:20:49.542112 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534906 2566 feature_gate.go:328] unrecognized feature gate: Example May 26 15:20:49.542112 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534909 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 15:20:49.542112 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534912 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 15:20:49.542112 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534914 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 15:20:49.542112 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534917 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 15:20:49.542112 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534920 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 15:20:49.542112 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534922 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 15:20:49.542112 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.534926 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 15:20:49.542112 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.535960 2566 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 26 15:20:49.545383 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.545358 2566 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 26 15:20:49.545383 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.545380 2566 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 26 15:20:49.545526 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545433 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 15:20:49.545526 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545438 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 15:20:49.545526 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545441 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 15:20:49.545526 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545445 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 15:20:49.545526 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545448 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 15:20:49.545526 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545450 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 15:20:49.545526 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545453 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 15:20:49.545526 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545456 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 15:20:49.545526 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545459 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 15:20:49.545526 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545461 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 15:20:49.545526 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545464 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 15:20:49.545526 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545467 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 15:20:49.545526 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545469 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 15:20:49.545526 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545472 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 15:20:49.545526 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545475 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 15:20:49.545526 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545477 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 15:20:49.545526 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545480 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 15:20:49.545526 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545482 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 15:20:49.545526 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545485 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 15:20:49.546193 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545487 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 15:20:49.546193 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545490 2566 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 15:20:49.546193 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545492 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 15:20:49.546193 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545495 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 15:20:49.546193 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545497 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 15:20:49.546193 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545500 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 15:20:49.546193 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545503 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 15:20:49.546193 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545506 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 15:20:49.546193 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545508 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 15:20:49.546193 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545510 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 15:20:49.546193 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545513 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 15:20:49.546193 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545516 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 15:20:49.546193 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545518 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 15:20:49.546193 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545521 2566 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 15:20:49.546193 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545524 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 15:20:49.546193 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545527 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 15:20:49.546193 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545530 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 15:20:49.546193 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545533 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 15:20:49.546193 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545538 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 15:20:49.546193 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545542 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 15:20:49.546691 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545545 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 15:20:49.546691 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545548 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 15:20:49.546691 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545551 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 15:20:49.546691 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545554 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 15:20:49.546691 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545557 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 15:20:49.546691 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545559 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 15:20:49.546691 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545562 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 15:20:49.546691 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545565 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 15:20:49.546691 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545569 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 15:20:49.546691 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545573 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 15:20:49.546691 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545576 2566 feature_gate.go:328] unrecognized feature gate: Example2 May 26 15:20:49.546691 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545579 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 15:20:49.546691 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545582 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 15:20:49.546691 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545585 2566 feature_gate.go:328] unrecognized feature gate: Example May 26 15:20:49.546691 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545588 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 15:20:49.546691 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545591 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 15:20:49.546691 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545594 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 15:20:49.546691 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545596 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 15:20:49.546691 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545600 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 15:20:49.546691 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545603 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 15:20:49.547185 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545606 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 15:20:49.547185 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545608 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 15:20:49.547185 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545611 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 15:20:49.547185 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545614 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 15:20:49.547185 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545616 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 15:20:49.547185 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545619 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 15:20:49.547185 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545622 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 15:20:49.547185 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545625 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 15:20:49.547185 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545627 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 15:20:49.547185 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545630 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 15:20:49.547185 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545633 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 15:20:49.547185 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545636 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 15:20:49.547185 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545638 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 15:20:49.547185 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545640 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 15:20:49.547185 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545643 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 15:20:49.547185 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545646 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 15:20:49.547185 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545648 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 15:20:49.547185 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545651 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 15:20:49.547185 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545654 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 15:20:49.547653 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545656 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 15:20:49.547653 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545659 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 15:20:49.547653 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545684 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 15:20:49.547653 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545687 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 15:20:49.547653 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545690 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 15:20:49.547653 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545693 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 15:20:49.547653 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545695 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 15:20:49.547653 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545698 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 15:20:49.547653 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.545703 2566 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 26 15:20:49.547653 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545805 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 15:20:49.547653 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545810 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 15:20:49.547653 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545813 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 15:20:49.547653 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545817 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 15:20:49.547653 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545820 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 15:20:49.547653 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545823 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 15:20:49.547653 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545826 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 15:20:49.548066 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545829 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 15:20:49.548066 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545831 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 15:20:49.548066 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545834 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 15:20:49.548066 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545836 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 15:20:49.548066 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545839 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 15:20:49.548066 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545842 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 15:20:49.548066 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545845 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 15:20:49.548066 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545847 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 15:20:49.548066 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545850 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 15:20:49.548066 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545852 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 15:20:49.548066 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545855 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 15:20:49.548066 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545858 2566 feature_gate.go:328] unrecognized feature gate: Example May 26 15:20:49.548066 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545860 2566 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 15:20:49.548066 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545863 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 15:20:49.548066 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545865 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 15:20:49.548066 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545868 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 15:20:49.548066 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545871 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 15:20:49.548066 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545873 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 15:20:49.548066 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545876 2566 feature_gate.go:328] unrecognized feature gate: Example2 May 26 15:20:49.548066 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545878 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 15:20:49.548570 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545881 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 15:20:49.548570 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545883 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 15:20:49.548570 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545886 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 15:20:49.548570 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545888 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 15:20:49.548570 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545891 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 15:20:49.548570 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545894 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 15:20:49.548570 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545896 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 15:20:49.548570 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545898 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 15:20:49.548570 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545902 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 15:20:49.548570 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545907 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 15:20:49.548570 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545910 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 15:20:49.548570 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545913 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 15:20:49.548570 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545916 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 15:20:49.548570 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545919 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 15:20:49.548570 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545921 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 15:20:49.548570 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545924 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 15:20:49.548570 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545927 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 15:20:49.548570 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545929 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 15:20:49.548570 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545932 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 15:20:49.549048 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545934 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 15:20:49.549048 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545937 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 15:20:49.549048 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545939 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 15:20:49.549048 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545942 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 15:20:49.549048 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545945 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 15:20:49.549048 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545947 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 15:20:49.549048 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545950 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 15:20:49.549048 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545952 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 15:20:49.549048 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545955 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 15:20:49.549048 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545959 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 15:20:49.549048 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545963 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 15:20:49.549048 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545966 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 15:20:49.549048 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545969 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 15:20:49.549048 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545972 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 15:20:49.549048 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545975 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 15:20:49.549048 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545978 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 15:20:49.549048 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545980 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 15:20:49.549048 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545983 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 15:20:49.549048 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545985 2566 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 15:20:49.549498 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545988 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 15:20:49.549498 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545990 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 15:20:49.549498 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545993 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 15:20:49.549498 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545995 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 15:20:49.549498 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.545998 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 15:20:49.549498 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.546001 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 15:20:49.549498 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.546003 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 15:20:49.549498 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.546006 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 15:20:49.549498 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.546008 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 15:20:49.549498 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.546011 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 15:20:49.549498 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.546013 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 15:20:49.549498 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.546016 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 15:20:49.549498 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.546018 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 15:20:49.549498 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.546020 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 15:20:49.549498 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.546023 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 15:20:49.549498 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.546026 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 15:20:49.549498 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.546028 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 15:20:49.549498 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.546030 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 15:20:49.549498 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.546033 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 15:20:49.549498 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.546036 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 15:20:49.550026 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:49.546038 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 15:20:49.550026 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.546043 2566 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 26 15:20:49.550026 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.547088 2566 server.go:962] "Client rotation is on, will bootstrap in background" May 26 15:20:49.550282 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.550268 2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 26 15:20:49.551285 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.551274 2566 server.go:1019] "Starting client certificate rotation" May 26 15:20:49.551399 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.551376 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 26 15:20:49.551432 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.551424 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 26 15:20:49.581563 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.581546 2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 26 15:20:49.585627 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.585583 2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 26 15:20:49.603117 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.603091 2566 log.go:25] "Validated CRI v1 runtime API" May 26 15:20:49.609148 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.609122 2566 log.go:25] "Validated CRI v1 image API" May 26 15:20:49.611397 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.611382 2566 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 26 15:20:49.615309 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.615291 2566 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 26 15:20:49.616345 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.616315 2566 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8ba416c0-42db-45a2-8613-f25afed4f923:/dev/nvme0n1p3 b02c68c8-3598-40ed-b53d-713d97445c82:/dev/nvme0n1p4] May 26 15:20:49.616431 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.616343 2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 26 15:20:49.621584 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.621470 2566 manager.go:217] Machine: {Timestamp:2026-05-26 15:20:49.620577677 +0000 UTC m=+0.444594488 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:2499998 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2682076e8e8e0d1126fe554c78c2d9 SystemUUID:ec268207-6e8e-8e0d-1126-fe554c78c2d9 BootID:03b87310-b989-42c4-b992-9ef35a4cc3bb Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:6c:4d:52:3a:af Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:6c:4d:52:3a:af Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c6:c2:49:8d:10:09 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 26 15:20:49.622391 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.622379 2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 26 15:20:49.622487 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.622476 2566 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 26 15:20:49.624570 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.624536 2566 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 26 15:20:49.624730 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.624572 2566 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-103.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 26 15:20:49.624774 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.624741 2566 topology_manager.go:138] "Creating topology manager with none policy" May 26 15:20:49.624774 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.624750 2566 container_manager_linux.go:306] "Creating device plugin manager" May 26 15:20:49.624774 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.624758 2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 26 15:20:49.626603 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.626593 2566 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 26 15:20:49.628332 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.628322 2566 state_mem.go:36] "Initialized new in-memory state store" May 26 15:20:49.628451 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.628442 2566 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 26 15:20:49.631618 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.631608 2566 kubelet.go:491] "Attempting to sync node with API server" May 26 15:20:49.631657 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.631622 2566 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 26 15:20:49.631657 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.631635 2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 26 15:20:49.631657 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.631644 2566 kubelet.go:397] "Adding apiserver pod source" May 26 15:20:49.631657 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.631654 2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 26 15:20:49.633168 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.633153 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 26 15:20:49.633249 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.633172 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 26 15:20:49.638182 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.638166 2566 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 26 15:20:49.640642 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.640626 2566 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 26 15:20:49.640726 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.640701 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dzfw7" May 26 15:20:49.642796 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.642776 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 26 15:20:49.642848 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.642803 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 26 15:20:49.642848 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.642812 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 26 15:20:49.642848 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.642821 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 26 15:20:49.642848 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.642833 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 26 15:20:49.642848 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.642842 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 26 15:20:49.642991 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.642850 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 26 15:20:49.642991 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.642859 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 26 15:20:49.642991 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.642868 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 26 15:20:49.642991 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.642876 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 26 15:20:49.642991 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.642889 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 26 15:20:49.642991 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.642899 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 26 15:20:49.643936 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.643925 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 26 15:20:49.643974 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.643937 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 26 15:20:49.644844 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:49.644822 2566 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 26 15:20:49.644902 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:49.644889 2566 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-103.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 26 15:20:49.647252 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.647238 2566 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 26 15:20:49.647321 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.647277 2566 server.go:1295] "Started kubelet" May 26 15:20:49.647378 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.647350 2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 26 15:20:49.647454 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.647343 2566 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 26 15:20:49.647506 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.647474 2566 server_v1.go:47] "podresources" method="list" useActivePods=true May 26 15:20:49.648052 ip-10-0-129-103 systemd[1]: Started Kubernetes Kubelet. May 26 15:20:49.649001 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.648911 2566 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 26 15:20:49.649571 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.649553 2566 server.go:317] "Adding debug handlers to kubelet server" May 26 15:20:49.651307 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.651287 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dzfw7" May 26 15:20:49.654493 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.654470 2566 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-103.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 26 15:20:49.655444 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:49.654393 2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-103.ec2.internal.18b326b80b5230a8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-103.ec2.internal,UID:ip-10-0-129-103.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-103.ec2.internal,},FirstTimestamp:2026-05-26 15:20:49.647251624 +0000 UTC m=+0.471268435,LastTimestamp:2026-05-26 15:20:49.647251624 +0000 UTC m=+0.471268435,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-103.ec2.internal,}" May 26 15:20:49.657349 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:49.657321 2566 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 26 15:20:49.659156 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.659142 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 26 15:20:49.659806 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.659789 2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 26 15:20:49.660092 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.660064 2566 volume_manager.go:295] "The desired_state_of_world populator starts" May 26 15:20:49.660092 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.660092 2566 volume_manager.go:297] "Starting Kubelet Volume Manager" May 26 15:20:49.660238 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.660131 2566 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 26 15:20:49.660238 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.660231 2566 reconstruct.go:97] "Volume reconstruction finished" May 26 15:20:49.660331 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.660242 2566 reconciler.go:26] "Reconciler: start to sync state" May 26 15:20:49.660513 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.660498 2566 factory.go:55] Registering systemd factory May 26 15:20:49.660584 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.660516 2566 factory.go:223] Registration of the systemd container factory successfully May 26 15:20:49.660738 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:49.660720 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-103.ec2.internal\" not found" May 26 15:20:49.660805 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.660746 2566 factory.go:153] Registering CRI-O factory May 26 15:20:49.660805 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.660758 2566 factory.go:223] Registration of the crio container factory successfully May 26 15:20:49.660893 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.660812 2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 26 15:20:49.660893 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.660837 2566 factory.go:103] Registering Raw factory May 26 15:20:49.660893 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.660852 2566 manager.go:1196] Started watching for new ooms in manager May 26 15:20:49.661296 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.661279 2566 manager.go:319] Starting recovery of all containers May 26 15:20:49.663051 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.663028 2566 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 26 15:20:49.666250 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:49.666197 2566 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-103.ec2.internal\" not found" node="ip-10-0-129-103.ec2.internal" May 26 15:20:49.673406 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.673390 2566 manager.go:324] Recovery completed May 26 15:20:49.677147 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.677135 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 15:20:49.679244 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.679227 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-103.ec2.internal" event="NodeHasSufficientMemory" May 26 15:20:49.679320 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.679256 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-103.ec2.internal" event="NodeHasNoDiskPressure" May 26 15:20:49.679320 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.679267 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-103.ec2.internal" event="NodeHasSufficientPID" May 26 15:20:49.679712 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.679699 2566 cpu_manager.go:222] "Starting CPU manager" policy="none" May 26 15:20:49.679712 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.679711 2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 26 15:20:49.679813 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.679728 2566 state_mem.go:36] "Initialized new in-memory state store" May 26 15:20:49.683551 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.683538 2566 policy_none.go:49] "None policy: Start" May 26 15:20:49.683595 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.683555 2566 memory_manager.go:186] "Starting memorymanager" policy="None" May 26 15:20:49.683595 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.683566 2566 state_mem.go:35] "Initializing new in-memory state store" May 26 15:20:49.724256 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.724236 2566 manager.go:341] "Starting Device Plugin manager" May 26 15:20:49.746826 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:49.724303 2566 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 26 15:20:49.746826 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.724314 2566 server.go:85] "Starting device plugin registration server" May 26 15:20:49.746826 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.724593 2566 eviction_manager.go:189] "Eviction manager: starting control loop" May 26 15:20:49.746826 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.724609 2566 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 26 15:20:49.746826 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.724707 2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 26 15:20:49.746826 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.725239 2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 26 15:20:49.746826 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.725250 2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 26 15:20:49.746826 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:49.725324 2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 26 15:20:49.746826 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:49.725388 2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-103.ec2.internal\" not found" May 26 15:20:49.764589 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.764546 2566 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 26 15:20:49.765751 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.765733 2566 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 26 15:20:49.765862 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.765757 2566 status_manager.go:230] "Starting to sync pod status with apiserver" May 26 15:20:49.765862 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.765777 2566 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 26 15:20:49.765862 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.765783 2566 kubelet.go:2451] "Starting kubelet main sync loop" May 26 15:20:49.765999 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:49.765878 2566 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 26 15:20:49.767880 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.767859 2566 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 26 15:20:49.825655 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.825577 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 15:20:49.826602 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.826586 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-103.ec2.internal" event="NodeHasSufficientMemory" May 26 15:20:49.826705 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.826616 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-103.ec2.internal" event="NodeHasNoDiskPressure" May 26 15:20:49.826705 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.826628 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-103.ec2.internal" event="NodeHasSufficientPID" May 26 15:20:49.826705 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.826652 2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-103.ec2.internal" May 26 15:20:49.837029 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.837004 2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-103.ec2.internal" May 26 15:20:49.837151 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:49.837033 2566 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-103.ec2.internal\": node \"ip-10-0-129-103.ec2.internal\" not found" May 26 15:20:49.854538 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:49.854518 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-103.ec2.internal\" not found" May 26 15:20:49.866120 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.866074 2566 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-103.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-103.ec2.internal"] May 26 15:20:49.866247 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.866162 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 15:20:49.867502 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.867473 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-103.ec2.internal" event="NodeHasSufficientMemory" May 26 15:20:49.867502 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.867502 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-103.ec2.internal" event="NodeHasNoDiskPressure" May 26 15:20:49.867625 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.867513 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-103.ec2.internal" event="NodeHasSufficientPID" May 26 15:20:49.868602 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.868589 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 15:20:49.868776 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.868760 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-103.ec2.internal" May 26 15:20:49.868818 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.868792 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 15:20:49.869300 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.869285 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-103.ec2.internal" event="NodeHasSufficientMemory" May 26 15:20:49.869300 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.869297 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-103.ec2.internal" event="NodeHasSufficientMemory" May 26 15:20:49.869416 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.869314 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-103.ec2.internal" event="NodeHasNoDiskPressure" May 26 15:20:49.869416 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.869319 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-103.ec2.internal" event="NodeHasNoDiskPressure" May 26 15:20:49.869416 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.869324 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-103.ec2.internal" event="NodeHasSufficientPID" May 26 15:20:49.869416 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.869332 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-103.ec2.internal" event="NodeHasSufficientPID" May 26 15:20:49.870365 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.870352 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-103.ec2.internal" May 26 15:20:49.870423 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.870374 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 15:20:49.871074 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.871051 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-103.ec2.internal" event="NodeHasSufficientMemory" May 26 15:20:49.871074 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.871074 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-103.ec2.internal" event="NodeHasNoDiskPressure" May 26 15:20:49.871188 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.871089 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-103.ec2.internal" event="NodeHasSufficientPID" May 26 15:20:49.900503 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:49.900479 2566 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-103.ec2.internal\" not found" node="ip-10-0-129-103.ec2.internal" May 26 15:20:49.904948 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:49.904928 2566 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-103.ec2.internal\" not found" node="ip-10-0-129-103.ec2.internal" May 26 15:20:49.955223 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:49.955188 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-103.ec2.internal\" not found" May 26 15:20:49.961497 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.961473 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92348745cb162dc4948f1bc29332ec4b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-103.ec2.internal\" (UID: \"92348745cb162dc4948f1bc29332ec4b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-103.ec2.internal" May 26 15:20:49.961594 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.961501 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/30917405c30aa8defd1b7702e54589bd-config\") pod \"kube-apiserver-proxy-ip-10-0-129-103.ec2.internal\" (UID: \"30917405c30aa8defd1b7702e54589bd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-103.ec2.internal" May 26 15:20:49.961594 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:49.961523 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/92348745cb162dc4948f1bc29332ec4b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-103.ec2.internal\" (UID: \"92348745cb162dc4948f1bc29332ec4b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-103.ec2.internal" May 26 15:20:50.055679 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:50.055619 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-103.ec2.internal\" not found" May 26 15:20:50.061955 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:50.061931 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/30917405c30aa8defd1b7702e54589bd-config\") pod \"kube-apiserver-proxy-ip-10-0-129-103.ec2.internal\" (UID: \"30917405c30aa8defd1b7702e54589bd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-103.ec2.internal" May 26 15:20:50.062049 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:50.061978 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/30917405c30aa8defd1b7702e54589bd-config\") pod \"kube-apiserver-proxy-ip-10-0-129-103.ec2.internal\" (UID: \"30917405c30aa8defd1b7702e54589bd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-103.ec2.internal" May 26 15:20:50.062049 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:50.062036 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/92348745cb162dc4948f1bc29332ec4b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-103.ec2.internal\" (UID: \"92348745cb162dc4948f1bc29332ec4b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-103.ec2.internal" May 26 15:20:50.062145 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:50.062064 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92348745cb162dc4948f1bc29332ec4b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-103.ec2.internal\" (UID: \"92348745cb162dc4948f1bc29332ec4b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-103.ec2.internal" May 26 15:20:50.062145 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:50.062100 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92348745cb162dc4948f1bc29332ec4b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-103.ec2.internal\" (UID: \"92348745cb162dc4948f1bc29332ec4b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-103.ec2.internal" May 26 15:20:50.062145 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:50.062115 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/92348745cb162dc4948f1bc29332ec4b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-103.ec2.internal\" (UID: \"92348745cb162dc4948f1bc29332ec4b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-103.ec2.internal" May 26 15:20:50.156279 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:50.156215 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-103.ec2.internal\" not found" May 26 15:20:50.202730 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:50.202709 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-103.ec2.internal" May 26 15:20:50.207215 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:50.207196 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-103.ec2.internal" May 26 15:20:50.256919 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:50.256887 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-103.ec2.internal\" not found" May 26 15:20:50.357390 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:50.357362 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-103.ec2.internal\" not found" May 26 15:20:50.457874 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:50.457847 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-103.ec2.internal\" not found" May 26 15:20:50.551473 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:50.551442 2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 26 15:20:50.552138 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:50.551607 2566 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 26 15:20:50.552138 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:50.551630 2566 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 26 15:20:50.558613 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:50.558592 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-103.ec2.internal\" not found" May 26 15:20:50.654490 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:50.654457 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-25 15:15:49 +0000 UTC" deadline="2027-11-25 04:49:24.147980046 +0000 UTC" May 26 15:20:50.654490 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:50.654490 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13141h28m33.493493582s" May 26 15:20:50.659433 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:50.659240 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-103.ec2.internal\" not found" May 26 15:20:50.659433 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:50.659257 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 26 15:20:50.676073 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:50.676048 2566 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 26 15:20:50.704225 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:50.704185 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-x8j66" May 26 15:20:50.712267 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:50.712203 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-x8j66" May 26 15:20:50.759824 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:50.759796 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-103.ec2.internal\" not found" May 26 15:20:50.787686 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:50.787636 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30917405c30aa8defd1b7702e54589bd.slice/crio-d2c149187eee97b5283a58ab3776c14e6e52b1a3e2bb845d4a6386733f71b4dd WatchSource:0}: Error finding container d2c149187eee97b5283a58ab3776c14e6e52b1a3e2bb845d4a6386733f71b4dd: Status 404 returned error can't find the container with id d2c149187eee97b5283a58ab3776c14e6e52b1a3e2bb845d4a6386733f71b4dd May 26 15:20:50.787893 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:50.787875 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92348745cb162dc4948f1bc29332ec4b.slice/crio-8e87d967f40aa6667328e5b108a2f2b81e435ed99f30117fcf1b42d21157c59e WatchSource:0}: Error finding container 8e87d967f40aa6667328e5b108a2f2b81e435ed99f30117fcf1b42d21157c59e: Status 404 returned error can't find the container with id 8e87d967f40aa6667328e5b108a2f2b81e435ed99f30117fcf1b42d21157c59e May 26 15:20:50.791981 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:50.791965 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 26 15:20:50.860195 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:50.860161 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-103.ec2.internal\" not found" May 26 15:20:50.957976 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:50.957942 2566 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 26 15:20:50.960835 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:50.960814 2566 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-103.ec2.internal" May 26 15:20:50.971525 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:50.971434 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 26 15:20:50.973531 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:50.973518 2566 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-103.ec2.internal" May 26 15:20:50.982835 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:50.982809 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 26 15:20:51.080676 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.080631 2566 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 26 15:20:51.417460 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.417380 2566 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 26 15:20:51.632428 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.632396 2566 apiserver.go:52] "Watching apiserver" May 26 15:20:51.642492 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.642461 2566 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 26 15:20:51.643931 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.643901 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-f6zxq","kube-system/konnectivity-agent-99gbh","kube-system/kube-apiserver-proxy-ip-10-0-129-103.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-65xfw","openshift-image-registry/node-ca-hf95k","openshift-ovn-kubernetes/ovnkube-node-pls4f","openshift-cluster-node-tuning-operator/tuned-w7spm","openshift-dns/node-resolver-sh6pn","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-103.ec2.internal","openshift-multus/multus-additional-cni-plugins-zr86w","openshift-multus/multus-pmrcn","openshift-multus/network-metrics-daemon-7v4tq","openshift-network-diagnostics/network-check-target-49ztl"] May 26 15:20:51.648596 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.648571 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-w7spm" May 26 15:20:51.650757 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.650731 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-99gbh" May 26 15:20:51.651268 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.651247 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 26 15:20:51.651379 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.651252 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 26 15:20:51.651379 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.651257 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mlg7m\"" May 26 15:20:51.653320 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.652841 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-65xfw" May 26 15:20:51.653320 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.652967 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 26 15:20:51.653320 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.652979 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hf95k" May 26 15:20:51.653320 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.653131 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 26 15:20:51.653320 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.653207 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-c624h\"" May 26 15:20:51.654988 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.654969 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 26 15:20:51.655167 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.655146 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 26 15:20:51.655504 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.655453 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.655504 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.655482 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 26 15:20:51.655504 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.655488 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fxxlr\"" May 26 15:20:51.655624 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.655455 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 26 15:20:51.656212 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.656195 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 26 15:20:51.656311 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.656218 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rjffv\"" May 26 15:20:51.656777 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.656231 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 26 15:20:51.659437 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.657781 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zkdbs\"" May 26 15:20:51.659437 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.658919 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 26 15:20:51.659437 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.659142 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 26 15:20:51.659437 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.659357 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 26 15:20:51.659699 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.659469 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 26 15:20:51.659699 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.659487 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 26 15:20:51.659808 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.659756 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 26 15:20:51.660781 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.660316 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f6zxq" May 26 15:20:51.662530 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.662510 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sh6pn" May 26 15:20:51.662636 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.662614 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 26 15:20:51.662889 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.662833 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 26 15:20:51.662889 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.662867 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-z82q5\"" May 26 15:20:51.663031 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.662890 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 26 15:20:51.664797 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.664773 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zr86w" May 26 15:20:51.664903 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.664893 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 26 15:20:51.665183 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.665042 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 26 15:20:51.665183 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.665135 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wdfdj\"" May 26 15:20:51.667137 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.667119 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pmrcn" May 26 15:20:51.667592 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.667535 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 26 15:20:51.667696 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.667650 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 26 15:20:51.667763 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.667696 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 26 15:20:51.667763 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.667754 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 26 15:20:51.667864 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.667777 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gksf6\"" May 26 15:20:51.667918 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.667904 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 26 15:20:51.669481 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.669419 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7v4tq" May 26 15:20:51.669572 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.669509 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 26 15:20:51.669572 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.669526 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5lnzm\"" May 26 15:20:51.669690 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:51.669519 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7v4tq" podUID="3822d872-a967-4800-8e87-c7d73d8f6c36" May 26 15:20:51.670368 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.670351 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f635642a-6974-4f41-adf9-e7ec1fe16090-host-kubelet\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.670457 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.670383 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f635642a-6974-4f41-adf9-e7ec1fe16090-run-systemd\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.670457 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.670400 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f635642a-6974-4f41-adf9-e7ec1fe16090-host-run-ovn-kubernetes\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.670457 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.670420 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f635642a-6974-4f41-adf9-e7ec1fe16090-ovnkube-config\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.670643 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.670456 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f635642a-6974-4f41-adf9-e7ec1fe16090-ovnkube-script-lib\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.670643 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.670495 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6224e4f7-52cd-4679-852d-8fe102d8bb91-host-slash\") pod \"iptables-alerter-f6zxq\" (UID: \"6224e4f7-52cd-4679-852d-8fe102d8bb91\") " pod="openshift-network-operator/iptables-alerter-f6zxq" May 26 15:20:51.670643 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.670520 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5p88\" (UniqueName: \"kubernetes.io/projected/6224e4f7-52cd-4679-852d-8fe102d8bb91-kube-api-access-c5p88\") pod \"iptables-alerter-f6zxq\" (UID: \"6224e4f7-52cd-4679-852d-8fe102d8bb91\") " pod="openshift-network-operator/iptables-alerter-f6zxq" May 26 15:20:51.670643 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.670549 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64-etc-sysconfig\") pod \"tuned-w7spm\" (UID: \"8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64\") " pod="openshift-cluster-node-tuning-operator/tuned-w7spm" May 26 15:20:51.670643 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.670580 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2cf92f21-f6fe-4299-89a9-783c9b8a0433-konnectivity-ca\") pod \"konnectivity-agent-99gbh\" (UID: \"2cf92f21-f6fe-4299-89a9-783c9b8a0433\") " pod="kube-system/konnectivity-agent-99gbh" May 26 15:20:51.670643 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.670601 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/db0ab8ec-7e6f-49ab-a120-bc7424a7a75d-host\") pod \"node-ca-hf95k\" (UID: \"db0ab8ec-7e6f-49ab-a120-bc7424a7a75d\") " pod="openshift-image-registry/node-ca-hf95k" May 26 15:20:51.670643 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.670622 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f635642a-6974-4f41-adf9-e7ec1fe16090-run-openvswitch\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.671005 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.670648 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f635642a-6974-4f41-adf9-e7ec1fe16090-env-overrides\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.671005 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.670687 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64-etc-sysctl-conf\") pod \"tuned-w7spm\" (UID: \"8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64\") " pod="openshift-cluster-node-tuning-operator/tuned-w7spm" May 26 15:20:51.671005 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.670722 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/75269ec5-e31f-4796-ba93-f99f3d3fe816-socket-dir\") pod \"aws-ebs-csi-driver-node-65xfw\" (UID: \"75269ec5-e31f-4796-ba93-f99f3d3fe816\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-65xfw" May 26 15:20:51.671005 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.670766 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f635642a-6974-4f41-adf9-e7ec1fe16090-host-run-netns\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.671005 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.670786 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f635642a-6974-4f41-adf9-e7ec1fe16090-ovn-node-metrics-cert\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.671005 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.670804 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64-etc-kubernetes\") pod \"tuned-w7spm\" (UID: \"8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64\") " pod="openshift-cluster-node-tuning-operator/tuned-w7spm" May 26 15:20:51.671005 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.670825 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64-etc-sysctl-d\") pod \"tuned-w7spm\" (UID: \"8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64\") " pod="openshift-cluster-node-tuning-operator/tuned-w7spm" May 26 15:20:51.671005 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.670845 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64-host\") pod \"tuned-w7spm\" (UID: \"8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64\") " pod="openshift-cluster-node-tuning-operator/tuned-w7spm" May 26 15:20:51.671005 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.670884 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f635642a-6974-4f41-adf9-e7ec1fe16090-systemd-units\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.671005 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.670908 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f635642a-6974-4f41-adf9-e7ec1fe16090-var-lib-openvswitch\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.671005 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.670924 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f635642a-6974-4f41-adf9-e7ec1fe16090-run-ovn\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.671005 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.670954 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f635642a-6974-4f41-adf9-e7ec1fe16090-node-log\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.671005 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.670995 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f635642a-6974-4f41-adf9-e7ec1fe16090-log-socket\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.671629 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.671035 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f635642a-6974-4f41-adf9-e7ec1fe16090-host-cni-bin\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.671629 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.671063 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6224e4f7-52cd-4679-852d-8fe102d8bb91-iptables-alerter-script\") pod \"iptables-alerter-f6zxq\" (UID: \"6224e4f7-52cd-4679-852d-8fe102d8bb91\") " pod="openshift-network-operator/iptables-alerter-f6zxq" May 26 15:20:51.671629 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.671089 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/44a8069f-bc00-4b3d-86da-9e01d0946556-hosts-file\") pod \"node-resolver-sh6pn\" (UID: \"44a8069f-bc00-4b3d-86da-9e01d0946556\") " pod="openshift-dns/node-resolver-sh6pn" May 26 15:20:51.671629 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.671123 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44a8069f-bc00-4b3d-86da-9e01d0946556-tmp-dir\") pod \"node-resolver-sh6pn\" (UID: \"44a8069f-bc00-4b3d-86da-9e01d0946556\") " pod="openshift-dns/node-resolver-sh6pn" May 26 15:20:51.671629 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.671137 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lczwl\" (UniqueName: \"kubernetes.io/projected/44a8069f-bc00-4b3d-86da-9e01d0946556-kube-api-access-lczwl\") pod \"node-resolver-sh6pn\" (UID: \"44a8069f-bc00-4b3d-86da-9e01d0946556\") " pod="openshift-dns/node-resolver-sh6pn" May 26 15:20:51.671629 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.671177 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64-etc-modprobe-d\") pod \"tuned-w7spm\" (UID: \"8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64\") " pod="openshift-cluster-node-tuning-operator/tuned-w7spm" May 26 15:20:51.671629 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.671220 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64-lib-modules\") pod \"tuned-w7spm\" (UID: \"8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64\") " pod="openshift-cluster-node-tuning-operator/tuned-w7spm" May 26 15:20:51.671629 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.671244 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64-var-lib-kubelet\") pod \"tuned-w7spm\" (UID: \"8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64\") " pod="openshift-cluster-node-tuning-operator/tuned-w7spm" May 26 15:20:51.671629 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.671280 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64-tmp\") pod \"tuned-w7spm\" (UID: \"8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64\") " pod="openshift-cluster-node-tuning-operator/tuned-w7spm" May 26 15:20:51.671629 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.671311 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpjf2\" (UniqueName: \"kubernetes.io/projected/8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64-kube-api-access-hpjf2\") pod \"tuned-w7spm\" (UID: \"8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64\") " pod="openshift-cluster-node-tuning-operator/tuned-w7spm" May 26 15:20:51.671629 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.671330 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2cf92f21-f6fe-4299-89a9-783c9b8a0433-agent-certs\") pod \"konnectivity-agent-99gbh\" (UID: \"2cf92f21-f6fe-4299-89a9-783c9b8a0433\") " pod="kube-system/konnectivity-agent-99gbh" May 26 15:20:51.671629 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.671345 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vf97\" (UniqueName: \"kubernetes.io/projected/db0ab8ec-7e6f-49ab-a120-bc7424a7a75d-kube-api-access-6vf97\") pod \"node-ca-hf95k\" (UID: \"db0ab8ec-7e6f-49ab-a120-bc7424a7a75d\") " pod="openshift-image-registry/node-ca-hf95k" May 26 15:20:51.671629 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.671363 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f635642a-6974-4f41-adf9-e7ec1fe16090-host-slash\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.671629 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.671396 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f635642a-6974-4f41-adf9-e7ec1fe16090-etc-openvswitch\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.671629 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.671418 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f635642a-6974-4f41-adf9-e7ec1fe16090-host-cni-netd\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.671629 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.671447 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f635642a-6974-4f41-adf9-e7ec1fe16090-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.672445 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.671464 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2f7m\" (UniqueName: \"kubernetes.io/projected/f635642a-6974-4f41-adf9-e7ec1fe16090-kube-api-access-p2f7m\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.672445 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.671485 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/75269ec5-e31f-4796-ba93-f99f3d3fe816-kubelet-dir\") pod \"aws-ebs-csi-driver-node-65xfw\" (UID: \"75269ec5-e31f-4796-ba93-f99f3d3fe816\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-65xfw" May 26 15:20:51.672445 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.671507 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64-etc-systemd\") pod \"tuned-w7spm\" (UID: \"8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64\") " pod="openshift-cluster-node-tuning-operator/tuned-w7spm" May 26 15:20:51.672445 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.671540 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64-run\") pod \"tuned-w7spm\" (UID: \"8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64\") " pod="openshift-cluster-node-tuning-operator/tuned-w7spm" May 26 15:20:51.672445 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.671574 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/75269ec5-e31f-4796-ba93-f99f3d3fe816-device-dir\") pod \"aws-ebs-csi-driver-node-65xfw\" (UID: \"75269ec5-e31f-4796-ba93-f99f3d3fe816\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-65xfw" May 26 15:20:51.672445 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.671608 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/75269ec5-e31f-4796-ba93-f99f3d3fe816-etc-selinux\") pod \"aws-ebs-csi-driver-node-65xfw\" (UID: \"75269ec5-e31f-4796-ba93-f99f3d3fe816\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-65xfw" May 26 15:20:51.672445 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.671640 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/75269ec5-e31f-4796-ba93-f99f3d3fe816-sys-fs\") pod \"aws-ebs-csi-driver-node-65xfw\" (UID: \"75269ec5-e31f-4796-ba93-f99f3d3fe816\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-65xfw" May 26 15:20:51.672445 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.671682 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkktt\" (UniqueName: \"kubernetes.io/projected/75269ec5-e31f-4796-ba93-f99f3d3fe816-kube-api-access-wkktt\") pod \"aws-ebs-csi-driver-node-65xfw\" (UID: \"75269ec5-e31f-4796-ba93-f99f3d3fe816\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-65xfw" May 26 15:20:51.672445 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.671709 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49ztl" May 26 15:20:51.672445 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:51.671762 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49ztl" podUID="72f4a6a1-504d-47f8-a1e8-82d3a081c6f9" May 26 15:20:51.672445 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.671709 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/db0ab8ec-7e6f-49ab-a120-bc7424a7a75d-serviceca\") pod \"node-ca-hf95k\" (UID: \"db0ab8ec-7e6f-49ab-a120-bc7424a7a75d\") " pod="openshift-image-registry/node-ca-hf95k" May 26 15:20:51.672445 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.671812 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64-sys\") pod \"tuned-w7spm\" (UID: \"8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64\") " pod="openshift-cluster-node-tuning-operator/tuned-w7spm" May 26 15:20:51.672445 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.671828 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64-etc-tuned\") pod \"tuned-w7spm\" (UID: \"8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64\") " pod="openshift-cluster-node-tuning-operator/tuned-w7spm" May 26 15:20:51.672445 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.671844 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/75269ec5-e31f-4796-ba93-f99f3d3fe816-registration-dir\") pod \"aws-ebs-csi-driver-node-65xfw\" (UID: \"75269ec5-e31f-4796-ba93-f99f3d3fe816\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-65xfw" May 26 15:20:51.712868 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.712836 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 15:15:50 +0000 UTC" deadline="2028-02-22 02:13:10.378401314 +0000 UTC" May 26 15:20:51.712955 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.712869 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15274h52m18.665535905s" May 26 15:20:51.761117 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.761089 2566 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 26 15:20:51.769946 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.769891 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-103.ec2.internal" event={"ID":"92348745cb162dc4948f1bc29332ec4b","Type":"ContainerStarted","Data":"8e87d967f40aa6667328e5b108a2f2b81e435ed99f30117fcf1b42d21157c59e"} May 26 15:20:51.770817 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.770794 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-103.ec2.internal" event={"ID":"30917405c30aa8defd1b7702e54589bd","Type":"ContainerStarted","Data":"d2c149187eee97b5283a58ab3776c14e6e52b1a3e2bb845d4a6386733f71b4dd"} May 26 15:20:51.772020 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.772000 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f635642a-6974-4f41-adf9-e7ec1fe16090-run-systemd\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.772098 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.772036 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f635642a-6974-4f41-adf9-e7ec1fe16090-ovnkube-script-lib\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.772098 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.772060 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64-etc-sysconfig\") pod \"tuned-w7spm\" (UID: \"8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64\") " pod="openshift-cluster-node-tuning-operator/tuned-w7spm" May 26 15:20:51.772098 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.772084 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/27d969eb-42bb-4133-b203-406a10027876-os-release\") pod \"multus-additional-cni-plugins-zr86w\" (UID: \"27d969eb-42bb-4133-b203-406a10027876\") " pod="openshift-multus/multus-additional-cni-plugins-zr86w" May 26 15:20:51.772255 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.772119 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f635642a-6974-4f41-adf9-e7ec1fe16090-run-systemd\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.772255 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.772143 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64-etc-sysconfig\") pod \"tuned-w7spm\" (UID: \"8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64\") " pod="openshift-cluster-node-tuning-operator/tuned-w7spm" May 26 15:20:51.772255 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.772176 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab586da9-46af-4ac1-b026-1460a6b36d9b-multus-cni-dir\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.772255 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.772197 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ab586da9-46af-4ac1-b026-1460a6b36d9b-hostroot\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.772255 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.772214 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/db0ab8ec-7e6f-49ab-a120-bc7424a7a75d-host\") pod \"node-ca-hf95k\" (UID: \"db0ab8ec-7e6f-49ab-a120-bc7424a7a75d\") " pod="openshift-image-registry/node-ca-hf95k" May 26 15:20:51.772255 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.772231 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f635642a-6974-4f41-adf9-e7ec1fe16090-env-overrides\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.772255 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.772253 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/75269ec5-e31f-4796-ba93-f99f3d3fe816-socket-dir\") pod \"aws-ebs-csi-driver-node-65xfw\" (UID: \"75269ec5-e31f-4796-ba93-f99f3d3fe816\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-65xfw" May 26 15:20:51.772578 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.772292 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ab586da9-46af-4ac1-b026-1460a6b36d9b-multus-socket-dir-parent\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.772578 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.772326 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f635642a-6974-4f41-adf9-e7ec1fe16090-host-run-netns\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.772578 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.772352 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f635642a-6974-4f41-adf9-e7ec1fe16090-ovn-node-metrics-cert\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.772578 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.772367 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/db0ab8ec-7e6f-49ab-a120-bc7424a7a75d-host\") pod \"node-ca-hf95k\" (UID: \"db0ab8ec-7e6f-49ab-a120-bc7424a7a75d\") " pod="openshift-image-registry/node-ca-hf95k" May 26 15:20:51.772578 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.772382 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64-etc-kubernetes\") pod \"tuned-w7spm\" (UID: \"8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64\") " pod="openshift-cluster-node-tuning-operator/tuned-w7spm" May 26 15:20:51.772578 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.772411 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64-etc-sysctl-d\") pod \"tuned-w7spm\" (UID: \"8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64\") " pod="openshift-cluster-node-tuning-operator/tuned-w7spm" May 26 15:20:51.772578 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.772435 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64-host\") pod \"tuned-w7spm\" (UID: \"8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64\") " pod="openshift-cluster-node-tuning-operator/tuned-w7spm" May 26 15:20:51.772578 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.772466 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/75269ec5-e31f-4796-ba93-f99f3d3fe816-socket-dir\") pod \"aws-ebs-csi-driver-node-65xfw\" (UID: \"75269ec5-e31f-4796-ba93-f99f3d3fe816\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-65xfw" May 26 15:20:51.772578 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.772493 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frfhb\" (UniqueName: \"kubernetes.io/projected/ab586da9-46af-4ac1-b026-1460a6b36d9b-kube-api-access-frfhb\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.772578 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.772522 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f635642a-6974-4f41-adf9-e7ec1fe16090-node-log\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.772578 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.772545 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/44a8069f-bc00-4b3d-86da-9e01d0946556-hosts-file\") pod \"node-resolver-sh6pn\" (UID: \"44a8069f-bc00-4b3d-86da-9e01d0946556\") " pod="openshift-dns/node-resolver-sh6pn" May 26 15:20:51.772578 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.772570 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44a8069f-bc00-4b3d-86da-9e01d0946556-tmp-dir\") pod \"node-resolver-sh6pn\" (UID: \"44a8069f-bc00-4b3d-86da-9e01d0946556\") " pod="openshift-dns/node-resolver-sh6pn" May 26 15:20:51.773149 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.772627 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64-lib-modules\") pod \"tuned-w7spm\" (UID: \"8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64\") " pod="openshift-cluster-node-tuning-operator/tuned-w7spm" May 26 15:20:51.773149 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.772651 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64-var-lib-kubelet\") pod \"tuned-w7spm\" (UID: \"8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64\") " pod="openshift-cluster-node-tuning-operator/tuned-w7spm" May 26 15:20:51.773149 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.772699 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfkxf\" (UniqueName: \"kubernetes.io/projected/27d969eb-42bb-4133-b203-406a10027876-kube-api-access-nfkxf\") pod \"multus-additional-cni-plugins-zr86w\" (UID: \"27d969eb-42bb-4133-b203-406a10027876\") " pod="openshift-multus/multus-additional-cni-plugins-zr86w" May 26 15:20:51.773149 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.772718 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f635642a-6974-4f41-adf9-e7ec1fe16090-env-overrides\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.773149 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.772728 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6vf97\" (UniqueName: \"kubernetes.io/projected/db0ab8ec-7e6f-49ab-a120-bc7424a7a75d-kube-api-access-6vf97\") pod \"node-ca-hf95k\" (UID: \"db0ab8ec-7e6f-49ab-a120-bc7424a7a75d\") " pod="openshift-image-registry/node-ca-hf95k" May 26 15:20:51.773149 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.772756 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f635642a-6974-4f41-adf9-e7ec1fe16090-host-slash\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.773149 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.772754 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/44a8069f-bc00-4b3d-86da-9e01d0946556-hosts-file\") pod \"node-resolver-sh6pn\" (UID: \"44a8069f-bc00-4b3d-86da-9e01d0946556\") " pod="openshift-dns/node-resolver-sh6pn" May 26 15:20:51.773149 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.772801 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f635642a-6974-4f41-adf9-e7ec1fe16090-ovnkube-script-lib\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.773149 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.772816 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64-var-lib-kubelet\") pod \"tuned-w7spm\" (UID: \"8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64\") " pod="openshift-cluster-node-tuning-operator/tuned-w7spm" May 26 15:20:51.773149 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.772804 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f635642a-6974-4f41-adf9-e7ec1fe16090-node-log\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.773149 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.772835 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f635642a-6974-4f41-adf9-e7ec1fe16090-etc-openvswitch\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.773149 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.772834 2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 26 15:20:51.773149 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.772852 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64-host\") pod \"tuned-w7spm\" (UID: \"8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64\") " pod="openshift-cluster-node-tuning-operator/tuned-w7spm" May 26 15:20:51.773149 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.772891 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64-etc-sysctl-d\") pod \"tuned-w7spm\" (UID: \"8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64\") " pod="openshift-cluster-node-tuning-operator/tuned-w7spm" May 26 15:20:51.773149 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.772894 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f635642a-6974-4f41-adf9-e7ec1fe16090-etc-openvswitch\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.773149 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.772896 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f635642a-6974-4f41-adf9-e7ec1fe16090-host-run-netns\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.773149 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.772920 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f635642a-6974-4f41-adf9-e7ec1fe16090-host-cni-netd\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.773149 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.772926 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44a8069f-bc00-4b3d-86da-9e01d0946556-tmp-dir\") pod \"node-resolver-sh6pn\" (UID: \"44a8069f-bc00-4b3d-86da-9e01d0946556\") " pod="openshift-dns/node-resolver-sh6pn" May 26 15:20:51.773963 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.772966 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64-lib-modules\") pod \"tuned-w7spm\" (UID: \"8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64\") " pod="openshift-cluster-node-tuning-operator/tuned-w7spm" May 26 15:20:51.773963 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.772967 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f635642a-6974-4f41-adf9-e7ec1fe16090-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.773963 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.772985 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64-etc-kubernetes\") pod \"tuned-w7spm\" (UID: \"8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64\") " pod="openshift-cluster-node-tuning-operator/tuned-w7spm" May 26 15:20:51.773963 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.773022 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3822d872-a967-4800-8e87-c7d73d8f6c36-metrics-certs\") pod \"network-metrics-daemon-7v4tq\" (UID: \"3822d872-a967-4800-8e87-c7d73d8f6c36\") " pod="openshift-multus/network-metrics-daemon-7v4tq" May 26 15:20:51.773963 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.773053 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/27d969eb-42bb-4133-b203-406a10027876-cni-binary-copy\") pod \"multus-additional-cni-plugins-zr86w\" (UID: \"27d969eb-42bb-4133-b203-406a10027876\") " pod="openshift-multus/multus-additional-cni-plugins-zr86w" May 26 15:20:51.773963 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.773079 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab586da9-46af-4ac1-b026-1460a6b36d9b-system-cni-dir\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.773963 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.773080 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f635642a-6974-4f41-adf9-e7ec1fe16090-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.773963 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.773104 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64-run\") pod \"tuned-w7spm\" (UID: \"8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64\") " pod="openshift-cluster-node-tuning-operator/tuned-w7spm" May 26 15:20:51.773963 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.773113 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f635642a-6974-4f41-adf9-e7ec1fe16090-host-cni-netd\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.773963 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.773125 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f635642a-6974-4f41-adf9-e7ec1fe16090-host-slash\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.773963 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.773148 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wkktt\" (UniqueName: \"kubernetes.io/projected/75269ec5-e31f-4796-ba93-f99f3d3fe816-kube-api-access-wkktt\") pod \"aws-ebs-csi-driver-node-65xfw\" (UID: \"75269ec5-e31f-4796-ba93-f99f3d3fe816\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-65xfw" May 26 15:20:51.773963 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.773185 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64-run\") pod \"tuned-w7spm\" (UID: \"8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64\") " pod="openshift-cluster-node-tuning-operator/tuned-w7spm" May 26 15:20:51.773963 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.773193 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab586da9-46af-4ac1-b026-1460a6b36d9b-host-run-netns\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.773963 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.773218 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab586da9-46af-4ac1-b026-1460a6b36d9b-multus-conf-dir\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.773963 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.773297 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ab586da9-46af-4ac1-b026-1460a6b36d9b-multus-daemon-config\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.773963 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.773343 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab586da9-46af-4ac1-b026-1460a6b36d9b-etc-kubernetes\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.773963 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.773376 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/db0ab8ec-7e6f-49ab-a120-bc7424a7a75d-serviceca\") pod \"node-ca-hf95k\" (UID: \"db0ab8ec-7e6f-49ab-a120-bc7424a7a75d\") " pod="openshift-image-registry/node-ca-hf95k" May 26 15:20:51.774720 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.773423 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64-sys\") pod \"tuned-w7spm\" (UID: \"8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64\") " pod="openshift-cluster-node-tuning-operator/tuned-w7spm" May 26 15:20:51.774720 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.773550 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64-etc-tuned\") pod \"tuned-w7spm\" (UID: \"8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64\") " pod="openshift-cluster-node-tuning-operator/tuned-w7spm" May 26 15:20:51.774720 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.773586 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64-sys\") pod \"tuned-w7spm\" (UID: \"8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64\") " pod="openshift-cluster-node-tuning-operator/tuned-w7spm" May 26 15:20:51.774720 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.773636 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/75269ec5-e31f-4796-ba93-f99f3d3fe816-registration-dir\") pod \"aws-ebs-csi-driver-node-65xfw\" (UID: \"75269ec5-e31f-4796-ba93-f99f3d3fe816\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-65xfw" May 26 15:20:51.774720 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.773686 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/75269ec5-e31f-4796-ba93-f99f3d3fe816-registration-dir\") pod \"aws-ebs-csi-driver-node-65xfw\" (UID: \"75269ec5-e31f-4796-ba93-f99f3d3fe816\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-65xfw" May 26 15:20:51.774720 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.773717 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ab586da9-46af-4ac1-b026-1460a6b36d9b-host-run-multus-certs\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.774720 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.773787 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f635642a-6974-4f41-adf9-e7ec1fe16090-host-kubelet\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.774720 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.773823 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/db0ab8ec-7e6f-49ab-a120-bc7424a7a75d-serviceca\") pod \"node-ca-hf95k\" (UID: \"db0ab8ec-7e6f-49ab-a120-bc7424a7a75d\") " pod="openshift-image-registry/node-ca-hf95k" May 26 15:20:51.774720 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.773848 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f635642a-6974-4f41-adf9-e7ec1fe16090-host-kubelet\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.774720 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.773874 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f635642a-6974-4f41-adf9-e7ec1fe16090-host-run-ovn-kubernetes\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.774720 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.773893 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f635642a-6974-4f41-adf9-e7ec1fe16090-ovnkube-config\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.774720 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.773918 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6224e4f7-52cd-4679-852d-8fe102d8bb91-host-slash\") pod \"iptables-alerter-f6zxq\" (UID: \"6224e4f7-52cd-4679-852d-8fe102d8bb91\") " pod="openshift-network-operator/iptables-alerter-f6zxq" May 26 15:20:51.774720 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.773926 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f635642a-6974-4f41-adf9-e7ec1fe16090-host-run-ovn-kubernetes\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.774720 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.773945 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c5p88\" (UniqueName: \"kubernetes.io/projected/6224e4f7-52cd-4679-852d-8fe102d8bb91-kube-api-access-c5p88\") pod \"iptables-alerter-f6zxq\" (UID: \"6224e4f7-52cd-4679-852d-8fe102d8bb91\") " pod="openshift-network-operator/iptables-alerter-f6zxq" May 26 15:20:51.774720 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.773972 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6224e4f7-52cd-4679-852d-8fe102d8bb91-host-slash\") pod \"iptables-alerter-f6zxq\" (UID: \"6224e4f7-52cd-4679-852d-8fe102d8bb91\") " pod="openshift-network-operator/iptables-alerter-f6zxq" May 26 15:20:51.774720 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.773973 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/27d969eb-42bb-4133-b203-406a10027876-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zr86w\" (UID: \"27d969eb-42bb-4133-b203-406a10027876\") " pod="openshift-multus/multus-additional-cni-plugins-zr86w" May 26 15:20:51.774720 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.774016 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2cf92f21-f6fe-4299-89a9-783c9b8a0433-konnectivity-ca\") pod \"konnectivity-agent-99gbh\" (UID: \"2cf92f21-f6fe-4299-89a9-783c9b8a0433\") " pod="kube-system/konnectivity-agent-99gbh" May 26 15:20:51.775475 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.774090 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f635642a-6974-4f41-adf9-e7ec1fe16090-run-openvswitch\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.775475 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.774116 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64-etc-sysctl-conf\") pod \"tuned-w7spm\" (UID: \"8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64\") " pod="openshift-cluster-node-tuning-operator/tuned-w7spm" May 26 15:20:51.775475 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.774141 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab586da9-46af-4ac1-b026-1460a6b36d9b-cni-binary-copy\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.775475 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.774178 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ab586da9-46af-4ac1-b026-1460a6b36d9b-host-run-k8s-cni-cncf-io\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.775475 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.774188 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f635642a-6974-4f41-adf9-e7ec1fe16090-run-openvswitch\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.775475 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.774228 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f635642a-6974-4f41-adf9-e7ec1fe16090-systemd-units\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.775475 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.774254 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f635642a-6974-4f41-adf9-e7ec1fe16090-var-lib-openvswitch\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.775475 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.774298 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64-etc-sysctl-conf\") pod \"tuned-w7spm\" (UID: \"8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64\") " pod="openshift-cluster-node-tuning-operator/tuned-w7spm" May 26 15:20:51.775475 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.774322 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f635642a-6974-4f41-adf9-e7ec1fe16090-run-ovn\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.775475 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.774338 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f635642a-6974-4f41-adf9-e7ec1fe16090-systemd-units\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.775475 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.774355 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f635642a-6974-4f41-adf9-e7ec1fe16090-log-socket\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.775475 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.774373 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f635642a-6974-4f41-adf9-e7ec1fe16090-run-ovn\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.775475 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.774383 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f635642a-6974-4f41-adf9-e7ec1fe16090-var-lib-openvswitch\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.775475 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.774406 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f635642a-6974-4f41-adf9-e7ec1fe16090-ovnkube-config\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.775475 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.774421 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f635642a-6974-4f41-adf9-e7ec1fe16090-host-cni-bin\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.775475 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.774421 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f635642a-6974-4f41-adf9-e7ec1fe16090-log-socket\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.775475 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.774463 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6224e4f7-52cd-4679-852d-8fe102d8bb91-iptables-alerter-script\") pod \"iptables-alerter-f6zxq\" (UID: \"6224e4f7-52cd-4679-852d-8fe102d8bb91\") " pod="openshift-network-operator/iptables-alerter-f6zxq" May 26 15:20:51.776386 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.774502 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f635642a-6974-4f41-adf9-e7ec1fe16090-host-cni-bin\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.776386 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.774519 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2cf92f21-f6fe-4299-89a9-783c9b8a0433-konnectivity-ca\") pod \"konnectivity-agent-99gbh\" (UID: \"2cf92f21-f6fe-4299-89a9-783c9b8a0433\") " pod="kube-system/konnectivity-agent-99gbh" May 26 15:20:51.776386 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.774545 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lczwl\" (UniqueName: \"kubernetes.io/projected/44a8069f-bc00-4b3d-86da-9e01d0946556-kube-api-access-lczwl\") pod \"node-resolver-sh6pn\" (UID: \"44a8069f-bc00-4b3d-86da-9e01d0946556\") " pod="openshift-dns/node-resolver-sh6pn" May 26 15:20:51.776386 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.774607 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hpjf2\" (UniqueName: \"kubernetes.io/projected/8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64-kube-api-access-hpjf2\") pod \"tuned-w7spm\" (UID: \"8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64\") " pod="openshift-cluster-node-tuning-operator/tuned-w7spm" May 26 15:20:51.776386 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.774634 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64-etc-modprobe-d\") pod \"tuned-w7spm\" (UID: \"8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64\") " pod="openshift-cluster-node-tuning-operator/tuned-w7spm" May 26 15:20:51.776386 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.774660 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64-tmp\") pod \"tuned-w7spm\" (UID: \"8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64\") " pod="openshift-cluster-node-tuning-operator/tuned-w7spm" May 26 15:20:51.776386 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.774713 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/75269ec5-e31f-4796-ba93-f99f3d3fe816-kubelet-dir\") pod \"aws-ebs-csi-driver-node-65xfw\" (UID: \"75269ec5-e31f-4796-ba93-f99f3d3fe816\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-65xfw" May 26 15:20:51.776386 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.774738 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/75269ec5-e31f-4796-ba93-f99f3d3fe816-etc-selinux\") pod \"aws-ebs-csi-driver-node-65xfw\" (UID: \"75269ec5-e31f-4796-ba93-f99f3d3fe816\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-65xfw" May 26 15:20:51.776386 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.774768 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44fk9\" (UniqueName: \"kubernetes.io/projected/3822d872-a967-4800-8e87-c7d73d8f6c36-kube-api-access-44fk9\") pod \"network-metrics-daemon-7v4tq\" (UID: \"3822d872-a967-4800-8e87-c7d73d8f6c36\") " pod="openshift-multus/network-metrics-daemon-7v4tq" May 26 15:20:51.776386 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.774778 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64-etc-modprobe-d\") pod \"tuned-w7spm\" (UID: \"8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64\") " pod="openshift-cluster-node-tuning-operator/tuned-w7spm" May 26 15:20:51.776386 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.774793 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7dkb\" (UniqueName: \"kubernetes.io/projected/72f4a6a1-504d-47f8-a1e8-82d3a081c6f9-kube-api-access-n7dkb\") pod \"network-check-target-49ztl\" (UID: \"72f4a6a1-504d-47f8-a1e8-82d3a081c6f9\") " pod="openshift-network-diagnostics/network-check-target-49ztl" May 26 15:20:51.776386 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.774837 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/75269ec5-e31f-4796-ba93-f99f3d3fe816-etc-selinux\") pod \"aws-ebs-csi-driver-node-65xfw\" (UID: \"75269ec5-e31f-4796-ba93-f99f3d3fe816\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-65xfw" May 26 15:20:51.776386 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.774838 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/27d969eb-42bb-4133-b203-406a10027876-system-cni-dir\") pod \"multus-additional-cni-plugins-zr86w\" (UID: \"27d969eb-42bb-4133-b203-406a10027876\") " pod="openshift-multus/multus-additional-cni-plugins-zr86w" May 26 15:20:51.776386 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.774882 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/27d969eb-42bb-4133-b203-406a10027876-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zr86w\" (UID: \"27d969eb-42bb-4133-b203-406a10027876\") " pod="openshift-multus/multus-additional-cni-plugins-zr86w" May 26 15:20:51.776386 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.774887 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/75269ec5-e31f-4796-ba93-f99f3d3fe816-kubelet-dir\") pod \"aws-ebs-csi-driver-node-65xfw\" (UID: \"75269ec5-e31f-4796-ba93-f99f3d3fe816\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-65xfw" May 26 15:20:51.776386 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.774906 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2cf92f21-f6fe-4299-89a9-783c9b8a0433-agent-certs\") pod \"konnectivity-agent-99gbh\" (UID: \"2cf92f21-f6fe-4299-89a9-783c9b8a0433\") " pod="kube-system/konnectivity-agent-99gbh" May 26 15:20:51.776386 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.774929 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p2f7m\" (UniqueName: \"kubernetes.io/projected/f635642a-6974-4f41-adf9-e7ec1fe16090-kube-api-access-p2f7m\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.777189 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.774969 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/75269ec5-e31f-4796-ba93-f99f3d3fe816-device-dir\") pod \"aws-ebs-csi-driver-node-65xfw\" (UID: \"75269ec5-e31f-4796-ba93-f99f3d3fe816\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-65xfw" May 26 15:20:51.777189 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.774995 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/75269ec5-e31f-4796-ba93-f99f3d3fe816-sys-fs\") pod \"aws-ebs-csi-driver-node-65xfw\" (UID: \"75269ec5-e31f-4796-ba93-f99f3d3fe816\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-65xfw" May 26 15:20:51.777189 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.775021 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/27d969eb-42bb-4133-b203-406a10027876-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zr86w\" (UID: \"27d969eb-42bb-4133-b203-406a10027876\") " pod="openshift-multus/multus-additional-cni-plugins-zr86w" May 26 15:20:51.777189 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.775045 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab586da9-46af-4ac1-b026-1460a6b36d9b-os-release\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.777189 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.775067 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab586da9-46af-4ac1-b026-1460a6b36d9b-host-var-lib-cni-bin\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.777189 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.775095 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ab586da9-46af-4ac1-b026-1460a6b36d9b-host-var-lib-cni-multus\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.777189 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.775122 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64-etc-systemd\") pod \"tuned-w7spm\" (UID: \"8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64\") " pod="openshift-cluster-node-tuning-operator/tuned-w7spm" May 26 15:20:51.777189 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.775148 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/27d969eb-42bb-4133-b203-406a10027876-cnibin\") pod \"multus-additional-cni-plugins-zr86w\" (UID: \"27d969eb-42bb-4133-b203-406a10027876\") " pod="openshift-multus/multus-additional-cni-plugins-zr86w" May 26 15:20:51.777189 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.775173 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab586da9-46af-4ac1-b026-1460a6b36d9b-cnibin\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.777189 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.775195 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab586da9-46af-4ac1-b026-1460a6b36d9b-host-var-lib-kubelet\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.777189 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.775207 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/75269ec5-e31f-4796-ba93-f99f3d3fe816-sys-fs\") pod \"aws-ebs-csi-driver-node-65xfw\" (UID: \"75269ec5-e31f-4796-ba93-f99f3d3fe816\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-65xfw" May 26 15:20:51.777189 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.775322 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64-etc-systemd\") pod \"tuned-w7spm\" (UID: \"8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64\") " pod="openshift-cluster-node-tuning-operator/tuned-w7spm" May 26 15:20:51.777189 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.775366 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/75269ec5-e31f-4796-ba93-f99f3d3fe816-device-dir\") pod \"aws-ebs-csi-driver-node-65xfw\" (UID: \"75269ec5-e31f-4796-ba93-f99f3d3fe816\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-65xfw" May 26 15:20:51.777189 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.776220 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6224e4f7-52cd-4679-852d-8fe102d8bb91-iptables-alerter-script\") pod \"iptables-alerter-f6zxq\" (UID: \"6224e4f7-52cd-4679-852d-8fe102d8bb91\") " pod="openshift-network-operator/iptables-alerter-f6zxq" May 26 15:20:51.777189 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.776734 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64-etc-tuned\") pod \"tuned-w7spm\" (UID: \"8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64\") " pod="openshift-cluster-node-tuning-operator/tuned-w7spm" May 26 15:20:51.777189 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.776897 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f635642a-6974-4f41-adf9-e7ec1fe16090-ovn-node-metrics-cert\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.777694 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.777464 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64-tmp\") pod \"tuned-w7spm\" (UID: \"8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64\") " pod="openshift-cluster-node-tuning-operator/tuned-w7spm" May 26 15:20:51.777694 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.777526 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2cf92f21-f6fe-4299-89a9-783c9b8a0433-agent-certs\") pod \"konnectivity-agent-99gbh\" (UID: \"2cf92f21-f6fe-4299-89a9-783c9b8a0433\") " pod="kube-system/konnectivity-agent-99gbh" May 26 15:20:51.782425 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.782334 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vf97\" (UniqueName: \"kubernetes.io/projected/db0ab8ec-7e6f-49ab-a120-bc7424a7a75d-kube-api-access-6vf97\") pod \"node-ca-hf95k\" (UID: \"db0ab8ec-7e6f-49ab-a120-bc7424a7a75d\") " pod="openshift-image-registry/node-ca-hf95k" May 26 15:20:51.782562 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.782540 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkktt\" (UniqueName: \"kubernetes.io/projected/75269ec5-e31f-4796-ba93-f99f3d3fe816-kube-api-access-wkktt\") pod \"aws-ebs-csi-driver-node-65xfw\" (UID: \"75269ec5-e31f-4796-ba93-f99f3d3fe816\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-65xfw" May 26 15:20:51.782624 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.782542 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5p88\" (UniqueName: \"kubernetes.io/projected/6224e4f7-52cd-4679-852d-8fe102d8bb91-kube-api-access-c5p88\") pod \"iptables-alerter-f6zxq\" (UID: \"6224e4f7-52cd-4679-852d-8fe102d8bb91\") " pod="openshift-network-operator/iptables-alerter-f6zxq" May 26 15:20:51.784175 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.784142 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lczwl\" (UniqueName: \"kubernetes.io/projected/44a8069f-bc00-4b3d-86da-9e01d0946556-kube-api-access-lczwl\") pod \"node-resolver-sh6pn\" (UID: \"44a8069f-bc00-4b3d-86da-9e01d0946556\") " pod="openshift-dns/node-resolver-sh6pn" May 26 15:20:51.784429 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.784411 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpjf2\" (UniqueName: \"kubernetes.io/projected/8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64-kube-api-access-hpjf2\") pod \"tuned-w7spm\" (UID: \"8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64\") " pod="openshift-cluster-node-tuning-operator/tuned-w7spm" May 26 15:20:51.784503 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.784457 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2f7m\" (UniqueName: \"kubernetes.io/projected/f635642a-6974-4f41-adf9-e7ec1fe16090-kube-api-access-p2f7m\") pod \"ovnkube-node-pls4f\" (UID: \"f635642a-6974-4f41-adf9-e7ec1fe16090\") " pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.875517 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.875477 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab586da9-46af-4ac1-b026-1460a6b36d9b-cni-binary-copy\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.875720 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.875627 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ab586da9-46af-4ac1-b026-1460a6b36d9b-host-run-k8s-cni-cncf-io\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.875720 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.875682 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-44fk9\" (UniqueName: \"kubernetes.io/projected/3822d872-a967-4800-8e87-c7d73d8f6c36-kube-api-access-44fk9\") pod \"network-metrics-daemon-7v4tq\" (UID: \"3822d872-a967-4800-8e87-c7d73d8f6c36\") " pod="openshift-multus/network-metrics-daemon-7v4tq" May 26 15:20:51.875720 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.875707 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n7dkb\" (UniqueName: \"kubernetes.io/projected/72f4a6a1-504d-47f8-a1e8-82d3a081c6f9-kube-api-access-n7dkb\") pod \"network-check-target-49ztl\" (UID: \"72f4a6a1-504d-47f8-a1e8-82d3a081c6f9\") " pod="openshift-network-diagnostics/network-check-target-49ztl" May 26 15:20:51.875866 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.875731 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/27d969eb-42bb-4133-b203-406a10027876-system-cni-dir\") pod \"multus-additional-cni-plugins-zr86w\" (UID: \"27d969eb-42bb-4133-b203-406a10027876\") " pod="openshift-multus/multus-additional-cni-plugins-zr86w" May 26 15:20:51.875866 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.875736 2566 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 26 15:20:51.875866 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.875756 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/27d969eb-42bb-4133-b203-406a10027876-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zr86w\" (UID: \"27d969eb-42bb-4133-b203-406a10027876\") " pod="openshift-multus/multus-additional-cni-plugins-zr86w" May 26 15:20:51.875866 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.875786 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/27d969eb-42bb-4133-b203-406a10027876-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zr86w\" (UID: \"27d969eb-42bb-4133-b203-406a10027876\") " pod="openshift-multus/multus-additional-cni-plugins-zr86w" May 26 15:20:51.875866 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.875812 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab586da9-46af-4ac1-b026-1460a6b36d9b-os-release\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.875866 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.875837 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab586da9-46af-4ac1-b026-1460a6b36d9b-host-var-lib-cni-bin\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.876136 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.875875 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ab586da9-46af-4ac1-b026-1460a6b36d9b-host-var-lib-cni-multus\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.876136 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.875901 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/27d969eb-42bb-4133-b203-406a10027876-cnibin\") pod \"multus-additional-cni-plugins-zr86w\" (UID: \"27d969eb-42bb-4133-b203-406a10027876\") " pod="openshift-multus/multus-additional-cni-plugins-zr86w" May 26 15:20:51.876136 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.875924 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab586da9-46af-4ac1-b026-1460a6b36d9b-cnibin\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.876136 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.875948 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab586da9-46af-4ac1-b026-1460a6b36d9b-host-var-lib-kubelet\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.876136 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.876002 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/27d969eb-42bb-4133-b203-406a10027876-os-release\") pod \"multus-additional-cni-plugins-zr86w\" (UID: \"27d969eb-42bb-4133-b203-406a10027876\") " pod="openshift-multus/multus-additional-cni-plugins-zr86w" May 26 15:20:51.876136 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.876052 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab586da9-46af-4ac1-b026-1460a6b36d9b-multus-cni-dir\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.876136 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.876077 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ab586da9-46af-4ac1-b026-1460a6b36d9b-hostroot\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.876136 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.876105 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ab586da9-46af-4ac1-b026-1460a6b36d9b-multus-socket-dir-parent\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.876482 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.876133 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab586da9-46af-4ac1-b026-1460a6b36d9b-cni-binary-copy\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.876482 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.876139 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-frfhb\" (UniqueName: \"kubernetes.io/projected/ab586da9-46af-4ac1-b026-1460a6b36d9b-kube-api-access-frfhb\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.876482 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.876226 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nfkxf\" (UniqueName: \"kubernetes.io/projected/27d969eb-42bb-4133-b203-406a10027876-kube-api-access-nfkxf\") pod \"multus-additional-cni-plugins-zr86w\" (UID: \"27d969eb-42bb-4133-b203-406a10027876\") " pod="openshift-multus/multus-additional-cni-plugins-zr86w" May 26 15:20:51.876482 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.876245 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab586da9-46af-4ac1-b026-1460a6b36d9b-os-release\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.876482 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.876264 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3822d872-a967-4800-8e87-c7d73d8f6c36-metrics-certs\") pod \"network-metrics-daemon-7v4tq\" (UID: \"3822d872-a967-4800-8e87-c7d73d8f6c36\") " pod="openshift-multus/network-metrics-daemon-7v4tq" May 26 15:20:51.876482 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.876289 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/27d969eb-42bb-4133-b203-406a10027876-cni-binary-copy\") pod \"multus-additional-cni-plugins-zr86w\" (UID: \"27d969eb-42bb-4133-b203-406a10027876\") " pod="openshift-multus/multus-additional-cni-plugins-zr86w" May 26 15:20:51.876482 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.876315 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab586da9-46af-4ac1-b026-1460a6b36d9b-system-cni-dir\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.876482 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.876343 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab586da9-46af-4ac1-b026-1460a6b36d9b-host-run-netns\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.876482 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.876367 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab586da9-46af-4ac1-b026-1460a6b36d9b-multus-conf-dir\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.876482 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.876372 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ab586da9-46af-4ac1-b026-1460a6b36d9b-host-run-k8s-cni-cncf-io\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.876482 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.876393 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ab586da9-46af-4ac1-b026-1460a6b36d9b-multus-daemon-config\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.876482 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.876437 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab586da9-46af-4ac1-b026-1460a6b36d9b-etc-kubernetes\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.876482 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.876438 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/27d969eb-42bb-4133-b203-406a10027876-os-release\") pod \"multus-additional-cni-plugins-zr86w\" (UID: \"27d969eb-42bb-4133-b203-406a10027876\") " pod="openshift-multus/multus-additional-cni-plugins-zr86w" May 26 15:20:51.876482 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.876468 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ab586da9-46af-4ac1-b026-1460a6b36d9b-host-run-multus-certs\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.876482 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.876487 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/27d969eb-42bb-4133-b203-406a10027876-cnibin\") pod \"multus-additional-cni-plugins-zr86w\" (UID: \"27d969eb-42bb-4133-b203-406a10027876\") " pod="openshift-multus/multus-additional-cni-plugins-zr86w" May 26 15:20:51.877182 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.876492 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ab586da9-46af-4ac1-b026-1460a6b36d9b-hostroot\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.877182 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.876521 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/27d969eb-42bb-4133-b203-406a10027876-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zr86w\" (UID: \"27d969eb-42bb-4133-b203-406a10027876\") " pod="openshift-multus/multus-additional-cni-plugins-zr86w" May 26 15:20:51.877182 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.876525 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ab586da9-46af-4ac1-b026-1460a6b36d9b-host-var-lib-cni-multus\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.877182 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.876550 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab586da9-46af-4ac1-b026-1460a6b36d9b-cnibin\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.877182 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.876569 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab586da9-46af-4ac1-b026-1460a6b36d9b-host-var-lib-cni-bin\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.877182 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.876597 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab586da9-46af-4ac1-b026-1460a6b36d9b-multus-cni-dir\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.877182 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.876606 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab586da9-46af-4ac1-b026-1460a6b36d9b-etc-kubernetes\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.877182 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.876607 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ab586da9-46af-4ac1-b026-1460a6b36d9b-host-run-multus-certs\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.877182 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.876230 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/27d969eb-42bb-4133-b203-406a10027876-system-cni-dir\") pod \"multus-additional-cni-plugins-zr86w\" (UID: \"27d969eb-42bb-4133-b203-406a10027876\") " pod="openshift-multus/multus-additional-cni-plugins-zr86w" May 26 15:20:51.877182 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.876728 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/27d969eb-42bb-4133-b203-406a10027876-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zr86w\" (UID: \"27d969eb-42bb-4133-b203-406a10027876\") " pod="openshift-multus/multus-additional-cni-plugins-zr86w" May 26 15:20:51.877182 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.876774 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/27d969eb-42bb-4133-b203-406a10027876-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zr86w\" (UID: \"27d969eb-42bb-4133-b203-406a10027876\") " pod="openshift-multus/multus-additional-cni-plugins-zr86w" May 26 15:20:51.877182 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.876820 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab586da9-46af-4ac1-b026-1460a6b36d9b-host-var-lib-kubelet\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.877182 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:51.876822 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 15:20:51.877182 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.876853 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab586da9-46af-4ac1-b026-1460a6b36d9b-host-run-netns\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.877182 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.876855 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab586da9-46af-4ac1-b026-1460a6b36d9b-system-cni-dir\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.877182 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.876860 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/27d969eb-42bb-4133-b203-406a10027876-cni-binary-copy\") pod \"multus-additional-cni-plugins-zr86w\" (UID: \"27d969eb-42bb-4133-b203-406a10027876\") " pod="openshift-multus/multus-additional-cni-plugins-zr86w" May 26 15:20:51.877182 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:51.876902 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3822d872-a967-4800-8e87-c7d73d8f6c36-metrics-certs podName:3822d872-a967-4800-8e87-c7d73d8f6c36 nodeName:}" failed. No retries permitted until 2026-05-26 15:20:52.376881364 +0000 UTC m=+3.200898184 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3822d872-a967-4800-8e87-c7d73d8f6c36-metrics-certs") pod "network-metrics-daemon-7v4tq" (UID: "3822d872-a967-4800-8e87-c7d73d8f6c36") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 15:20:51.877927 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.876908 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ab586da9-46af-4ac1-b026-1460a6b36d9b-multus-socket-dir-parent\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.877927 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.876912 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab586da9-46af-4ac1-b026-1460a6b36d9b-multus-conf-dir\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.877927 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.877049 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/27d969eb-42bb-4133-b203-406a10027876-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zr86w\" (UID: \"27d969eb-42bb-4133-b203-406a10027876\") " pod="openshift-multus/multus-additional-cni-plugins-zr86w" May 26 15:20:51.877927 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.877168 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ab586da9-46af-4ac1-b026-1460a6b36d9b-multus-daemon-config\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.883851 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:51.883826 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 15:20:51.883957 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:51.883863 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 15:20:51.883957 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:51.883879 2566 projected.go:194] Error preparing data for projected volume kube-api-access-n7dkb for pod openshift-network-diagnostics/network-check-target-49ztl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 15:20:51.883957 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:51.883932 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/72f4a6a1-504d-47f8-a1e8-82d3a081c6f9-kube-api-access-n7dkb podName:72f4a6a1-504d-47f8-a1e8-82d3a081c6f9 nodeName:}" failed. No retries permitted until 2026-05-26 15:20:52.38391538 +0000 UTC m=+3.207932200 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-n7dkb" (UniqueName: "kubernetes.io/projected/72f4a6a1-504d-47f8-a1e8-82d3a081c6f9-kube-api-access-n7dkb") pod "network-check-target-49ztl" (UID: "72f4a6a1-504d-47f8-a1e8-82d3a081c6f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 15:20:51.885779 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.885757 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44fk9\" (UniqueName: \"kubernetes.io/projected/3822d872-a967-4800-8e87-c7d73d8f6c36-kube-api-access-44fk9\") pod \"network-metrics-daemon-7v4tq\" (UID: \"3822d872-a967-4800-8e87-c7d73d8f6c36\") " pod="openshift-multus/network-metrics-daemon-7v4tq" May 26 15:20:51.886241 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.886220 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfkxf\" (UniqueName: \"kubernetes.io/projected/27d969eb-42bb-4133-b203-406a10027876-kube-api-access-nfkxf\") pod \"multus-additional-cni-plugins-zr86w\" (UID: \"27d969eb-42bb-4133-b203-406a10027876\") " pod="openshift-multus/multus-additional-cni-plugins-zr86w" May 26 15:20:51.886627 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.886609 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frfhb\" (UniqueName: \"kubernetes.io/projected/ab586da9-46af-4ac1-b026-1460a6b36d9b-kube-api-access-frfhb\") pod \"multus-pmrcn\" (UID: \"ab586da9-46af-4ac1-b026-1460a6b36d9b\") " pod="openshift-multus/multus-pmrcn" May 26 15:20:51.960440 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.960405 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-w7spm" May 26 15:20:51.968307 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.968284 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-99gbh" May 26 15:20:51.977762 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.977730 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-65xfw" May 26 15:20:51.982632 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.982611 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hf95k" May 26 15:20:51.989185 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.989167 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:20:51.996724 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:51.996705 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f6zxq" May 26 15:20:52.003223 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:52.003206 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sh6pn" May 26 15:20:52.009704 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:52.009686 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zr86w" May 26 15:20:52.015198 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:52.015181 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pmrcn" May 26 15:20:52.115762 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:52.115727 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-5lmkt"] May 26 15:20:52.118693 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:52.118660 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5lmkt" May 26 15:20:52.118816 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:52.118746 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5lmkt" podUID="cca6b815-6207-49c3-a510-5c66f4e39f20" May 26 15:20:52.179093 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:52.179044 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cca6b815-6207-49c3-a510-5c66f4e39f20-dbus\") pod \"global-pull-secret-syncer-5lmkt\" (UID: \"cca6b815-6207-49c3-a510-5c66f4e39f20\") " pod="kube-system/global-pull-secret-syncer-5lmkt" May 26 15:20:52.179260 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:52.179101 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cca6b815-6207-49c3-a510-5c66f4e39f20-kubelet-config\") pod \"global-pull-secret-syncer-5lmkt\" (UID: \"cca6b815-6207-49c3-a510-5c66f4e39f20\") " pod="kube-system/global-pull-secret-syncer-5lmkt" May 26 15:20:52.179260 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:52.179163 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cca6b815-6207-49c3-a510-5c66f4e39f20-original-pull-secret\") pod \"global-pull-secret-syncer-5lmkt\" (UID: \"cca6b815-6207-49c3-a510-5c66f4e39f20\") " pod="kube-system/global-pull-secret-syncer-5lmkt" May 26 15:20:52.280611 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:52.280511 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cca6b815-6207-49c3-a510-5c66f4e39f20-dbus\") pod \"global-pull-secret-syncer-5lmkt\" (UID: \"cca6b815-6207-49c3-a510-5c66f4e39f20\") " pod="kube-system/global-pull-secret-syncer-5lmkt" May 26 15:20:52.280611 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:52.280564 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cca6b815-6207-49c3-a510-5c66f4e39f20-kubelet-config\") pod \"global-pull-secret-syncer-5lmkt\" (UID: \"cca6b815-6207-49c3-a510-5c66f4e39f20\") " pod="kube-system/global-pull-secret-syncer-5lmkt" May 26 15:20:52.280611 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:52.280600 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cca6b815-6207-49c3-a510-5c66f4e39f20-original-pull-secret\") pod \"global-pull-secret-syncer-5lmkt\" (UID: \"cca6b815-6207-49c3-a510-5c66f4e39f20\") " pod="kube-system/global-pull-secret-syncer-5lmkt" May 26 15:20:52.280901 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:52.280685 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cca6b815-6207-49c3-a510-5c66f4e39f20-dbus\") pod \"global-pull-secret-syncer-5lmkt\" (UID: \"cca6b815-6207-49c3-a510-5c66f4e39f20\") " pod="kube-system/global-pull-secret-syncer-5lmkt" May 26 15:20:52.280901 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:52.280722 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cca6b815-6207-49c3-a510-5c66f4e39f20-kubelet-config\") pod \"global-pull-secret-syncer-5lmkt\" (UID: \"cca6b815-6207-49c3-a510-5c66f4e39f20\") " pod="kube-system/global-pull-secret-syncer-5lmkt" May 26 15:20:52.280901 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:52.280761 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 26 15:20:52.280901 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:52.280825 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cca6b815-6207-49c3-a510-5c66f4e39f20-original-pull-secret podName:cca6b815-6207-49c3-a510-5c66f4e39f20 nodeName:}" failed. No retries permitted until 2026-05-26 15:20:52.780805828 +0000 UTC m=+3.604822628 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cca6b815-6207-49c3-a510-5c66f4e39f20-original-pull-secret") pod "global-pull-secret-syncer-5lmkt" (UID: "cca6b815-6207-49c3-a510-5c66f4e39f20") : object "kube-system"/"original-pull-secret" not registered May 26 15:20:52.363630 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:52.363606 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab586da9_46af_4ac1_b026_1460a6b36d9b.slice/crio-f9356ee5af1c0f0ebe3ebd6ef2e33e774e4b1c26bd895fcca9de08b3d047ec79 WatchSource:0}: Error finding container f9356ee5af1c0f0ebe3ebd6ef2e33e774e4b1c26bd895fcca9de08b3d047ec79: Status 404 returned error can't find the container with id f9356ee5af1c0f0ebe3ebd6ef2e33e774e4b1c26bd895fcca9de08b3d047ec79 May 26 15:20:52.364821 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:52.364799 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75269ec5_e31f_4796_ba93_f99f3d3fe816.slice/crio-a37f203aaf22189b299046c00643f105eb764e440925f5c11670cd93ab5e5efc WatchSource:0}: Error finding container a37f203aaf22189b299046c00643f105eb764e440925f5c11670cd93ab5e5efc: Status 404 returned error can't find the container with id a37f203aaf22189b299046c00643f105eb764e440925f5c11670cd93ab5e5efc May 26 15:20:52.366486 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:52.366449 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cf92f21_f6fe_4299_89a9_783c9b8a0433.slice/crio-872ecb96ae5997500325f1e45ef6ddcb78b8c83fc6417c4cbfbb377bb0af86f7 WatchSource:0}: Error finding container 872ecb96ae5997500325f1e45ef6ddcb78b8c83fc6417c4cbfbb377bb0af86f7: Status 404 returned error can't find the container with id 872ecb96ae5997500325f1e45ef6ddcb78b8c83fc6417c4cbfbb377bb0af86f7 May 26 15:20:52.367167 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:52.367139 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f3bf1e5_e3c6_48e7_8bf5_0a04c341bc64.slice/crio-f361533a9ab9ff43b3feeafbf610f4a41d0534957de6db75a8cfea30f3671f08 WatchSource:0}: Error finding container f361533a9ab9ff43b3feeafbf610f4a41d0534957de6db75a8cfea30f3671f08: Status 404 returned error can't find the container with id f361533a9ab9ff43b3feeafbf610f4a41d0534957de6db75a8cfea30f3671f08 May 26 15:20:52.370417 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:52.370385 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27d969eb_42bb_4133_b203_406a10027876.slice/crio-b549508a440f87374de1bfaf58b7e27c280e1517ffd5d9b2d0258d1108e9dcd7 WatchSource:0}: Error finding container b549508a440f87374de1bfaf58b7e27c280e1517ffd5d9b2d0258d1108e9dcd7: Status 404 returned error can't find the container with id b549508a440f87374de1bfaf58b7e27c280e1517ffd5d9b2d0258d1108e9dcd7 May 26 15:20:52.372814 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:52.372743 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44a8069f_bc00_4b3d_86da_9e01d0946556.slice/crio-55fd8ce9f3dd24473699d0ab39434874c213aa5a0ea523cf68b308b0e5822a4d WatchSource:0}: Error finding container 55fd8ce9f3dd24473699d0ab39434874c213aa5a0ea523cf68b308b0e5822a4d: Status 404 returned error can't find the container with id 55fd8ce9f3dd24473699d0ab39434874c213aa5a0ea523cf68b308b0e5822a4d May 26 15:20:52.373034 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:52.373014 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb0ab8ec_7e6f_49ab_a120_bc7424a7a75d.slice/crio-0f6339f041038f3e9559ad53aca7f5b3d8e96bcbe8179d9959af8bd35ac6bbef WatchSource:0}: Error finding container 0f6339f041038f3e9559ad53aca7f5b3d8e96bcbe8179d9959af8bd35ac6bbef: Status 404 returned error can't find the container with id 0f6339f041038f3e9559ad53aca7f5b3d8e96bcbe8179d9959af8bd35ac6bbef May 26 15:20:52.377011 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:20:52.376960 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf635642a_6974_4f41_adf9_e7ec1fe16090.slice/crio-ed5c7fd9da3ab0d0d0ab614942887b1af495f1a9b8fafdbbcdc4edaae1f83c23 WatchSource:0}: Error finding container ed5c7fd9da3ab0d0d0ab614942887b1af495f1a9b8fafdbbcdc4edaae1f83c23: Status 404 returned error can't find the container with id ed5c7fd9da3ab0d0d0ab614942887b1af495f1a9b8fafdbbcdc4edaae1f83c23 May 26 15:20:52.381517 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:52.381496 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3822d872-a967-4800-8e87-c7d73d8f6c36-metrics-certs\") pod \"network-metrics-daemon-7v4tq\" (UID: \"3822d872-a967-4800-8e87-c7d73d8f6c36\") " pod="openshift-multus/network-metrics-daemon-7v4tq" May 26 15:20:52.381638 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:52.381600 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 15:20:52.381745 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:52.381649 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3822d872-a967-4800-8e87-c7d73d8f6c36-metrics-certs podName:3822d872-a967-4800-8e87-c7d73d8f6c36 nodeName:}" failed. No retries permitted until 2026-05-26 15:20:53.381632553 +0000 UTC m=+4.205649367 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3822d872-a967-4800-8e87-c7d73d8f6c36-metrics-certs") pod "network-metrics-daemon-7v4tq" (UID: "3822d872-a967-4800-8e87-c7d73d8f6c36") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 15:20:52.482483 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:52.482453 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n7dkb\" (UniqueName: \"kubernetes.io/projected/72f4a6a1-504d-47f8-a1e8-82d3a081c6f9-kube-api-access-n7dkb\") pod \"network-check-target-49ztl\" (UID: \"72f4a6a1-504d-47f8-a1e8-82d3a081c6f9\") " pod="openshift-network-diagnostics/network-check-target-49ztl" May 26 15:20:52.482635 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:52.482572 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 15:20:52.482635 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:52.482585 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 15:20:52.482635 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:52.482597 2566 projected.go:194] Error preparing data for projected volume kube-api-access-n7dkb for pod openshift-network-diagnostics/network-check-target-49ztl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 15:20:52.482828 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:52.482656 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/72f4a6a1-504d-47f8-a1e8-82d3a081c6f9-kube-api-access-n7dkb podName:72f4a6a1-504d-47f8-a1e8-82d3a081c6f9 nodeName:}" failed. No retries permitted until 2026-05-26 15:20:53.482637638 +0000 UTC m=+4.306654436 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-n7dkb" (UniqueName: "kubernetes.io/projected/72f4a6a1-504d-47f8-a1e8-82d3a081c6f9-kube-api-access-n7dkb") pod "network-check-target-49ztl" (UID: "72f4a6a1-504d-47f8-a1e8-82d3a081c6f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 15:20:52.713509 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:52.713446 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 15:15:50 +0000 UTC" deadline="2028-01-21 19:34:00.335846215 +0000 UTC" May 26 15:20:52.713509 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:52.713487 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14524h13m7.622362494s" May 26 15:20:52.766164 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:52.766132 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7v4tq" May 26 15:20:52.766336 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:52.766283 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7v4tq" podUID="3822d872-a967-4800-8e87-c7d73d8f6c36" May 26 15:20:52.781063 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:52.781024 2566 generic.go:358] "Generic (PLEG): container finished" podID="92348745cb162dc4948f1bc29332ec4b" containerID="933a861184543310a45b8384e97e058ddf149b9f96cd62b4464771f68d2c45ef" exitCode=0 May 26 15:20:52.781224 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:52.781123 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-103.ec2.internal" event={"ID":"92348745cb162dc4948f1bc29332ec4b","Type":"ContainerDied","Data":"933a861184543310a45b8384e97e058ddf149b9f96cd62b4464771f68d2c45ef"} May 26 15:20:52.785903 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:52.785501 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cca6b815-6207-49c3-a510-5c66f4e39f20-original-pull-secret\") pod \"global-pull-secret-syncer-5lmkt\" (UID: \"cca6b815-6207-49c3-a510-5c66f4e39f20\") " pod="kube-system/global-pull-secret-syncer-5lmkt" May 26 15:20:52.785903 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:52.785646 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 26 15:20:52.785903 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:52.785721 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cca6b815-6207-49c3-a510-5c66f4e39f20-original-pull-secret podName:cca6b815-6207-49c3-a510-5c66f4e39f20 nodeName:}" failed. No retries permitted until 2026-05-26 15:20:53.785703078 +0000 UTC m=+4.609719895 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cca6b815-6207-49c3-a510-5c66f4e39f20-original-pull-secret") pod "global-pull-secret-syncer-5lmkt" (UID: "cca6b815-6207-49c3-a510-5c66f4e39f20") : object "kube-system"/"original-pull-secret" not registered May 26 15:20:52.789642 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:52.789527 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f6zxq" event={"ID":"6224e4f7-52cd-4679-852d-8fe102d8bb91","Type":"ContainerStarted","Data":"10b802a7bff39a25f317d081c57aae3d600128aaa8a62c8fbacc50ec386853b1"} May 26 15:20:52.799250 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:52.799185 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sh6pn" event={"ID":"44a8069f-bc00-4b3d-86da-9e01d0946556","Type":"ContainerStarted","Data":"55fd8ce9f3dd24473699d0ab39434874c213aa5a0ea523cf68b308b0e5822a4d"} May 26 15:20:52.806475 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:52.806445 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zr86w" event={"ID":"27d969eb-42bb-4133-b203-406a10027876","Type":"ContainerStarted","Data":"b549508a440f87374de1bfaf58b7e27c280e1517ffd5d9b2d0258d1108e9dcd7"} May 26 15:20:52.816486 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:52.816460 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-65xfw" event={"ID":"75269ec5-e31f-4796-ba93-f99f3d3fe816","Type":"ContainerStarted","Data":"a37f203aaf22189b299046c00643f105eb764e440925f5c11670cd93ab5e5efc"} May 26 15:20:52.828702 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:52.828624 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pmrcn" event={"ID":"ab586da9-46af-4ac1-b026-1460a6b36d9b","Type":"ContainerStarted","Data":"f9356ee5af1c0f0ebe3ebd6ef2e33e774e4b1c26bd895fcca9de08b3d047ec79"} May 26 15:20:52.835508 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:52.835480 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-103.ec2.internal" event={"ID":"30917405c30aa8defd1b7702e54589bd","Type":"ContainerStarted","Data":"934304cf2efe113aad86b2ddca18e07e19c8a4b198aa8dee2cfc8a8ecdc4bf78"} May 26 15:20:52.855563 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:52.855528 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" event={"ID":"f635642a-6974-4f41-adf9-e7ec1fe16090","Type":"ContainerStarted","Data":"ed5c7fd9da3ab0d0d0ab614942887b1af495f1a9b8fafdbbcdc4edaae1f83c23"} May 26 15:20:52.877731 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:52.877693 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hf95k" event={"ID":"db0ab8ec-7e6f-49ab-a120-bc7424a7a75d","Type":"ContainerStarted","Data":"0f6339f041038f3e9559ad53aca7f5b3d8e96bcbe8179d9959af8bd35ac6bbef"} May 26 15:20:52.912056 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:52.911965 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-w7spm" event={"ID":"8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64","Type":"ContainerStarted","Data":"f361533a9ab9ff43b3feeafbf610f4a41d0534957de6db75a8cfea30f3671f08"} May 26 15:20:52.914814 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:52.914781 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-99gbh" event={"ID":"2cf92f21-f6fe-4299-89a9-783c9b8a0433","Type":"ContainerStarted","Data":"872ecb96ae5997500325f1e45ef6ddcb78b8c83fc6417c4cbfbb377bb0af86f7"} May 26 15:20:53.390505 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:53.390462 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3822d872-a967-4800-8e87-c7d73d8f6c36-metrics-certs\") pod \"network-metrics-daemon-7v4tq\" (UID: \"3822d872-a967-4800-8e87-c7d73d8f6c36\") " pod="openshift-multus/network-metrics-daemon-7v4tq" May 26 15:20:53.390706 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:53.390615 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 15:20:53.390706 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:53.390697 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3822d872-a967-4800-8e87-c7d73d8f6c36-metrics-certs podName:3822d872-a967-4800-8e87-c7d73d8f6c36 nodeName:}" failed. No retries permitted until 2026-05-26 15:20:55.390677002 +0000 UTC m=+6.214693815 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3822d872-a967-4800-8e87-c7d73d8f6c36-metrics-certs") pod "network-metrics-daemon-7v4tq" (UID: "3822d872-a967-4800-8e87-c7d73d8f6c36") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 15:20:53.491359 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:53.491320 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n7dkb\" (UniqueName: \"kubernetes.io/projected/72f4a6a1-504d-47f8-a1e8-82d3a081c6f9-kube-api-access-n7dkb\") pod \"network-check-target-49ztl\" (UID: \"72f4a6a1-504d-47f8-a1e8-82d3a081c6f9\") " pod="openshift-network-diagnostics/network-check-target-49ztl" May 26 15:20:53.491553 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:53.491532 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 15:20:53.491639 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:53.491558 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 15:20:53.491639 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:53.491571 2566 projected.go:194] Error preparing data for projected volume kube-api-access-n7dkb for pod openshift-network-diagnostics/network-check-target-49ztl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 15:20:53.491639 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:53.491631 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/72f4a6a1-504d-47f8-a1e8-82d3a081c6f9-kube-api-access-n7dkb podName:72f4a6a1-504d-47f8-a1e8-82d3a081c6f9 nodeName:}" failed. No retries permitted until 2026-05-26 15:20:55.491612325 +0000 UTC m=+6.315629147 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-n7dkb" (UniqueName: "kubernetes.io/projected/72f4a6a1-504d-47f8-a1e8-82d3a081c6f9-kube-api-access-n7dkb") pod "network-check-target-49ztl" (UID: "72f4a6a1-504d-47f8-a1e8-82d3a081c6f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 15:20:53.766211 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:53.766177 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49ztl" May 26 15:20:53.766709 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:53.766308 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49ztl" podUID="72f4a6a1-504d-47f8-a1e8-82d3a081c6f9" May 26 15:20:53.766709 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:53.766191 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5lmkt" May 26 15:20:53.766854 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:53.766804 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5lmkt" podUID="cca6b815-6207-49c3-a510-5c66f4e39f20" May 26 15:20:53.794307 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:53.794272 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cca6b815-6207-49c3-a510-5c66f4e39f20-original-pull-secret\") pod \"global-pull-secret-syncer-5lmkt\" (UID: \"cca6b815-6207-49c3-a510-5c66f4e39f20\") " pod="kube-system/global-pull-secret-syncer-5lmkt" May 26 15:20:53.794482 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:53.794433 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 26 15:20:53.794538 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:53.794491 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cca6b815-6207-49c3-a510-5c66f4e39f20-original-pull-secret podName:cca6b815-6207-49c3-a510-5c66f4e39f20 nodeName:}" failed. No retries permitted until 2026-05-26 15:20:55.7944732 +0000 UTC m=+6.618490002 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cca6b815-6207-49c3-a510-5c66f4e39f20-original-pull-secret") pod "global-pull-secret-syncer-5lmkt" (UID: "cca6b815-6207-49c3-a510-5c66f4e39f20") : object "kube-system"/"original-pull-secret" not registered May 26 15:20:53.927364 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:53.927325 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-103.ec2.internal" event={"ID":"92348745cb162dc4948f1bc29332ec4b","Type":"ContainerStarted","Data":"81ac06a39ad10c8a0f96745c24c95057608a5b77c17cc9da74b50a5f0c7e713b"} May 26 15:20:53.941010 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:53.940920 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-103.ec2.internal" podStartSLOduration=3.9409022179999997 podStartE2EDuration="3.940902218s" podCreationTimestamp="2026-05-26 15:20:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 15:20:52.851050872 +0000 UTC m=+3.675067694" watchObservedRunningTime="2026-05-26 15:20:53.940902218 +0000 UTC m=+4.764919039" May 26 15:20:53.941769 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:53.941576 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-103.ec2.internal" podStartSLOduration=3.941562845 podStartE2EDuration="3.941562845s" podCreationTimestamp="2026-05-26 15:20:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 15:20:53.940702515 +0000 UTC m=+4.764719528" watchObservedRunningTime="2026-05-26 15:20:53.941562845 +0000 UTC m=+4.765579667" May 26 15:20:54.766802 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:54.766768 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7v4tq" May 26 15:20:54.767294 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:54.766920 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7v4tq" podUID="3822d872-a967-4800-8e87-c7d73d8f6c36" May 26 15:20:55.409729 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:55.409686 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3822d872-a967-4800-8e87-c7d73d8f6c36-metrics-certs\") pod \"network-metrics-daemon-7v4tq\" (UID: \"3822d872-a967-4800-8e87-c7d73d8f6c36\") " pod="openshift-multus/network-metrics-daemon-7v4tq" May 26 15:20:55.409925 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:55.409807 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 15:20:55.409925 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:55.409893 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3822d872-a967-4800-8e87-c7d73d8f6c36-metrics-certs podName:3822d872-a967-4800-8e87-c7d73d8f6c36 nodeName:}" failed. No retries permitted until 2026-05-26 15:20:59.409871946 +0000 UTC m=+10.233888749 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3822d872-a967-4800-8e87-c7d73d8f6c36-metrics-certs") pod "network-metrics-daemon-7v4tq" (UID: "3822d872-a967-4800-8e87-c7d73d8f6c36") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 15:20:55.511120 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:55.511083 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n7dkb\" (UniqueName: \"kubernetes.io/projected/72f4a6a1-504d-47f8-a1e8-82d3a081c6f9-kube-api-access-n7dkb\") pod \"network-check-target-49ztl\" (UID: \"72f4a6a1-504d-47f8-a1e8-82d3a081c6f9\") " pod="openshift-network-diagnostics/network-check-target-49ztl" May 26 15:20:55.511283 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:55.511259 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 15:20:55.511283 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:55.511280 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 15:20:55.511378 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:55.511294 2566 projected.go:194] Error preparing data for projected volume kube-api-access-n7dkb for pod openshift-network-diagnostics/network-check-target-49ztl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 15:20:55.511378 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:55.511355 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/72f4a6a1-504d-47f8-a1e8-82d3a081c6f9-kube-api-access-n7dkb podName:72f4a6a1-504d-47f8-a1e8-82d3a081c6f9 nodeName:}" failed. No retries permitted until 2026-05-26 15:20:59.511336416 +0000 UTC m=+10.335353237 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-n7dkb" (UniqueName: "kubernetes.io/projected/72f4a6a1-504d-47f8-a1e8-82d3a081c6f9-kube-api-access-n7dkb") pod "network-check-target-49ztl" (UID: "72f4a6a1-504d-47f8-a1e8-82d3a081c6f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 15:20:55.766814 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:55.766777 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49ztl" May 26 15:20:55.767276 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:55.766919 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49ztl" podUID="72f4a6a1-504d-47f8-a1e8-82d3a081c6f9" May 26 15:20:55.767276 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:55.766991 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5lmkt" May 26 15:20:55.767276 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:55.767095 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5lmkt" podUID="cca6b815-6207-49c3-a510-5c66f4e39f20" May 26 15:20:55.813248 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:55.813206 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cca6b815-6207-49c3-a510-5c66f4e39f20-original-pull-secret\") pod \"global-pull-secret-syncer-5lmkt\" (UID: \"cca6b815-6207-49c3-a510-5c66f4e39f20\") " pod="kube-system/global-pull-secret-syncer-5lmkt" May 26 15:20:55.813432 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:55.813340 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 26 15:20:55.813432 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:55.813400 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cca6b815-6207-49c3-a510-5c66f4e39f20-original-pull-secret podName:cca6b815-6207-49c3-a510-5c66f4e39f20 nodeName:}" failed. No retries permitted until 2026-05-26 15:20:59.813385369 +0000 UTC m=+10.637402173 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cca6b815-6207-49c3-a510-5c66f4e39f20-original-pull-secret") pod "global-pull-secret-syncer-5lmkt" (UID: "cca6b815-6207-49c3-a510-5c66f4e39f20") : object "kube-system"/"original-pull-secret" not registered May 26 15:20:56.767031 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:56.766997 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7v4tq" May 26 15:20:56.767393 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:56.767153 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7v4tq" podUID="3822d872-a967-4800-8e87-c7d73d8f6c36" May 26 15:20:57.771029 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:57.770254 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5lmkt" May 26 15:20:57.771029 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:57.770749 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5lmkt" podUID="cca6b815-6207-49c3-a510-5c66f4e39f20" May 26 15:20:57.771029 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:57.770842 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49ztl" May 26 15:20:57.771029 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:57.770935 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49ztl" podUID="72f4a6a1-504d-47f8-a1e8-82d3a081c6f9" May 26 15:20:58.766991 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:58.766951 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7v4tq" May 26 15:20:58.767151 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:58.767099 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7v4tq" podUID="3822d872-a967-4800-8e87-c7d73d8f6c36" May 26 15:20:59.446168 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:59.446065 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3822d872-a967-4800-8e87-c7d73d8f6c36-metrics-certs\") pod \"network-metrics-daemon-7v4tq\" (UID: \"3822d872-a967-4800-8e87-c7d73d8f6c36\") " pod="openshift-multus/network-metrics-daemon-7v4tq" May 26 15:20:59.446649 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:59.446257 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 15:20:59.446649 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:59.446333 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3822d872-a967-4800-8e87-c7d73d8f6c36-metrics-certs podName:3822d872-a967-4800-8e87-c7d73d8f6c36 nodeName:}" failed. No retries permitted until 2026-05-26 15:21:07.446312567 +0000 UTC m=+18.270329368 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3822d872-a967-4800-8e87-c7d73d8f6c36-metrics-certs") pod "network-metrics-daemon-7v4tq" (UID: "3822d872-a967-4800-8e87-c7d73d8f6c36") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 15:20:59.547240 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:59.547200 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n7dkb\" (UniqueName: \"kubernetes.io/projected/72f4a6a1-504d-47f8-a1e8-82d3a081c6f9-kube-api-access-n7dkb\") pod \"network-check-target-49ztl\" (UID: \"72f4a6a1-504d-47f8-a1e8-82d3a081c6f9\") " pod="openshift-network-diagnostics/network-check-target-49ztl" May 26 15:20:59.547406 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:59.547365 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 15:20:59.547406 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:59.547383 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 15:20:59.547406 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:59.547392 2566 projected.go:194] Error preparing data for projected volume kube-api-access-n7dkb for pod openshift-network-diagnostics/network-check-target-49ztl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 15:20:59.547571 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:59.547445 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/72f4a6a1-504d-47f8-a1e8-82d3a081c6f9-kube-api-access-n7dkb podName:72f4a6a1-504d-47f8-a1e8-82d3a081c6f9 nodeName:}" failed. No retries permitted until 2026-05-26 15:21:07.547430513 +0000 UTC m=+18.371447311 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-n7dkb" (UniqueName: "kubernetes.io/projected/72f4a6a1-504d-47f8-a1e8-82d3a081c6f9-kube-api-access-n7dkb") pod "network-check-target-49ztl" (UID: "72f4a6a1-504d-47f8-a1e8-82d3a081c6f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 15:20:59.769909 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:59.769825 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5lmkt" May 26 15:20:59.770070 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:59.769947 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5lmkt" podUID="cca6b815-6207-49c3-a510-5c66f4e39f20" May 26 15:20:59.770491 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:59.770352 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49ztl" May 26 15:20:59.770491 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:59.770443 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49ztl" podUID="72f4a6a1-504d-47f8-a1e8-82d3a081c6f9" May 26 15:20:59.849588 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:20:59.849499 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cca6b815-6207-49c3-a510-5c66f4e39f20-original-pull-secret\") pod \"global-pull-secret-syncer-5lmkt\" (UID: \"cca6b815-6207-49c3-a510-5c66f4e39f20\") " pod="kube-system/global-pull-secret-syncer-5lmkt" May 26 15:20:59.849783 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:59.849640 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 26 15:20:59.849783 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:20:59.849718 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cca6b815-6207-49c3-a510-5c66f4e39f20-original-pull-secret podName:cca6b815-6207-49c3-a510-5c66f4e39f20 nodeName:}" failed. No retries permitted until 2026-05-26 15:21:07.84969907 +0000 UTC m=+18.673715887 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cca6b815-6207-49c3-a510-5c66f4e39f20-original-pull-secret") pod "global-pull-secret-syncer-5lmkt" (UID: "cca6b815-6207-49c3-a510-5c66f4e39f20") : object "kube-system"/"original-pull-secret" not registered May 26 15:21:00.766949 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:00.766904 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7v4tq" May 26 15:21:00.767405 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:00.767053 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7v4tq" podUID="3822d872-a967-4800-8e87-c7d73d8f6c36" May 26 15:21:01.769634 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:01.769605 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49ztl" May 26 15:21:01.770154 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:01.769605 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5lmkt" May 26 15:21:01.770154 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:01.769736 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49ztl" podUID="72f4a6a1-504d-47f8-a1e8-82d3a081c6f9" May 26 15:21:01.770154 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:01.769786 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5lmkt" podUID="cca6b815-6207-49c3-a510-5c66f4e39f20" May 26 15:21:02.766418 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:02.766380 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7v4tq" May 26 15:21:02.766617 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:02.766522 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7v4tq" podUID="3822d872-a967-4800-8e87-c7d73d8f6c36" May 26 15:21:03.766818 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:03.766784 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49ztl" May 26 15:21:03.767252 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:03.766790 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5lmkt" May 26 15:21:03.767252 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:03.766891 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49ztl" podUID="72f4a6a1-504d-47f8-a1e8-82d3a081c6f9" May 26 15:21:03.767252 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:03.767000 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5lmkt" podUID="cca6b815-6207-49c3-a510-5c66f4e39f20" May 26 15:21:04.766258 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:04.766219 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7v4tq" May 26 15:21:04.766432 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:04.766349 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7v4tq" podUID="3822d872-a967-4800-8e87-c7d73d8f6c36" May 26 15:21:05.766269 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:05.766201 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49ztl" May 26 15:21:05.766742 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:05.766337 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49ztl" podUID="72f4a6a1-504d-47f8-a1e8-82d3a081c6f9" May 26 15:21:05.766742 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:05.766397 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5lmkt" May 26 15:21:05.766742 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:05.766539 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5lmkt" podUID="cca6b815-6207-49c3-a510-5c66f4e39f20" May 26 15:21:06.766251 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:06.766214 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7v4tq" May 26 15:21:06.766425 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:06.766379 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7v4tq" podUID="3822d872-a967-4800-8e87-c7d73d8f6c36" May 26 15:21:07.505879 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:07.505832 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3822d872-a967-4800-8e87-c7d73d8f6c36-metrics-certs\") pod \"network-metrics-daemon-7v4tq\" (UID: \"3822d872-a967-4800-8e87-c7d73d8f6c36\") " pod="openshift-multus/network-metrics-daemon-7v4tq" May 26 15:21:07.506081 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:07.506018 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 15:21:07.506151 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:07.506102 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3822d872-a967-4800-8e87-c7d73d8f6c36-metrics-certs podName:3822d872-a967-4800-8e87-c7d73d8f6c36 nodeName:}" failed. No retries permitted until 2026-05-26 15:21:23.506081877 +0000 UTC m=+34.330098686 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3822d872-a967-4800-8e87-c7d73d8f6c36-metrics-certs") pod "network-metrics-daemon-7v4tq" (UID: "3822d872-a967-4800-8e87-c7d73d8f6c36") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 15:21:07.606776 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:07.606726 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n7dkb\" (UniqueName: \"kubernetes.io/projected/72f4a6a1-504d-47f8-a1e8-82d3a081c6f9-kube-api-access-n7dkb\") pod \"network-check-target-49ztl\" (UID: \"72f4a6a1-504d-47f8-a1e8-82d3a081c6f9\") " pod="openshift-network-diagnostics/network-check-target-49ztl" May 26 15:21:07.606950 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:07.606916 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 15:21:07.606950 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:07.606942 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 15:21:07.606950 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:07.606953 2566 projected.go:194] Error preparing data for projected volume kube-api-access-n7dkb for pod openshift-network-diagnostics/network-check-target-49ztl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 15:21:07.607084 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:07.607013 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/72f4a6a1-504d-47f8-a1e8-82d3a081c6f9-kube-api-access-n7dkb podName:72f4a6a1-504d-47f8-a1e8-82d3a081c6f9 nodeName:}" failed. No retries permitted until 2026-05-26 15:21:23.606997526 +0000 UTC m=+34.431014348 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-n7dkb" (UniqueName: "kubernetes.io/projected/72f4a6a1-504d-47f8-a1e8-82d3a081c6f9-kube-api-access-n7dkb") pod "network-check-target-49ztl" (UID: "72f4a6a1-504d-47f8-a1e8-82d3a081c6f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 15:21:07.767067 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:07.766961 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49ztl" May 26 15:21:07.767512 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:07.767112 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49ztl" podUID="72f4a6a1-504d-47f8-a1e8-82d3a081c6f9" May 26 15:21:07.767512 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:07.767141 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5lmkt" May 26 15:21:07.767512 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:07.767268 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5lmkt" podUID="cca6b815-6207-49c3-a510-5c66f4e39f20" May 26 15:21:07.909296 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:07.909262 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cca6b815-6207-49c3-a510-5c66f4e39f20-original-pull-secret\") pod \"global-pull-secret-syncer-5lmkt\" (UID: \"cca6b815-6207-49c3-a510-5c66f4e39f20\") " pod="kube-system/global-pull-secret-syncer-5lmkt" May 26 15:21:07.909495 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:07.909385 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 26 15:21:07.909495 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:07.909462 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cca6b815-6207-49c3-a510-5c66f4e39f20-original-pull-secret podName:cca6b815-6207-49c3-a510-5c66f4e39f20 nodeName:}" failed. No retries permitted until 2026-05-26 15:21:23.909444899 +0000 UTC m=+34.733461720 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cca6b815-6207-49c3-a510-5c66f4e39f20-original-pull-secret") pod "global-pull-secret-syncer-5lmkt" (UID: "cca6b815-6207-49c3-a510-5c66f4e39f20") : object "kube-system"/"original-pull-secret" not registered May 26 15:21:08.766889 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:08.766854 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7v4tq" May 26 15:21:08.767074 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:08.766975 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7v4tq" podUID="3822d872-a967-4800-8e87-c7d73d8f6c36" May 26 15:21:09.767621 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:09.767583 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49ztl" May 26 15:21:09.768095 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:09.767722 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49ztl" podUID="72f4a6a1-504d-47f8-a1e8-82d3a081c6f9" May 26 15:21:09.768095 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:09.767772 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5lmkt" May 26 15:21:09.768600 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:09.768531 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5lmkt" podUID="cca6b815-6207-49c3-a510-5c66f4e39f20" May 26 15:21:10.766853 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:10.766689 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7v4tq" May 26 15:21:10.766976 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:10.766954 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7v4tq" podUID="3822d872-a967-4800-8e87-c7d73d8f6c36" May 26 15:21:10.956591 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:10.956557 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sh6pn" event={"ID":"44a8069f-bc00-4b3d-86da-9e01d0946556","Type":"ContainerStarted","Data":"be67ddec611fb13cf15bc4f78eff862e96162d8fb22f799ee2fa13756f44a89a"} May 26 15:21:10.959773 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:10.959746 2566 generic.go:358] "Generic (PLEG): container finished" podID="27d969eb-42bb-4133-b203-406a10027876" containerID="3fd8cdb8b8b06b2fb43b1db6abb2d71fed78a3b4887fb79f7b8b5e1cf622f2f2" exitCode=0 May 26 15:21:10.959880 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:10.959833 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zr86w" event={"ID":"27d969eb-42bb-4133-b203-406a10027876","Type":"ContainerDied","Data":"3fd8cdb8b8b06b2fb43b1db6abb2d71fed78a3b4887fb79f7b8b5e1cf622f2f2"} May 26 15:21:10.961378 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:10.961349 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-65xfw" event={"ID":"75269ec5-e31f-4796-ba93-f99f3d3fe816","Type":"ContainerStarted","Data":"fe4b42f1ef0a4b36a16c204d2f3cc740c0074d609314f689c5b6b127a43661bf"} May 26 15:21:10.962685 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:10.962648 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pmrcn" event={"ID":"ab586da9-46af-4ac1-b026-1460a6b36d9b","Type":"ContainerStarted","Data":"49d664228d2b7c79cbc786981562a0c84e2e40e1600b6a4d24fee79b6d85751d"} May 26 15:21:10.964535 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:10.964516 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pls4f_f635642a-6974-4f41-adf9-e7ec1fe16090/ovn-acl-logging/0.log" May 26 15:21:10.964863 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:10.964843 2566 generic.go:358] "Generic (PLEG): container finished" podID="f635642a-6974-4f41-adf9-e7ec1fe16090" containerID="cf69f5e6cc8f8f36a7b6ce87169e4c556a04abc915b453a5a15d5d5286346b41" exitCode=1 May 26 15:21:10.964935 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:10.964918 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" event={"ID":"f635642a-6974-4f41-adf9-e7ec1fe16090","Type":"ContainerStarted","Data":"b732ab6b63ab7ed8868ad34debe77a30ba7a9958d870b686e52d1eac6c7cf730"} May 26 15:21:10.964990 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:10.964942 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" event={"ID":"f635642a-6974-4f41-adf9-e7ec1fe16090","Type":"ContainerStarted","Data":"2f4a97ec88c62ecb23ccf3c66a7826713be3b80e8bc725f22d7203c952d0732f"} May 26 15:21:10.964990 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:10.964954 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" event={"ID":"f635642a-6974-4f41-adf9-e7ec1fe16090","Type":"ContainerDied","Data":"cf69f5e6cc8f8f36a7b6ce87169e4c556a04abc915b453a5a15d5d5286346b41"} May 26 15:21:10.964990 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:10.964971 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" event={"ID":"f635642a-6974-4f41-adf9-e7ec1fe16090","Type":"ContainerStarted","Data":"8163e85983da693b4ddf8bb8237ccaa11ecebc3e06b7fbc76b1b925c2d7bca5c"} May 26 15:21:10.966283 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:10.966256 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hf95k" event={"ID":"db0ab8ec-7e6f-49ab-a120-bc7424a7a75d","Type":"ContainerStarted","Data":"3a91533fc2787fff4d52c556b40889a0ea8c5baaabbfddf358b33d9ae9dd9fdb"} May 26 15:21:10.967530 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:10.967511 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-w7spm" event={"ID":"8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64","Type":"ContainerStarted","Data":"e874a674db7d2c732649a39ef8fc6b31f0b24f943cd2844b380ffec4e8290b19"} May 26 15:21:10.968695 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:10.968657 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-99gbh" event={"ID":"2cf92f21-f6fe-4299-89a9-783c9b8a0433","Type":"ContainerStarted","Data":"9550149d503f2acd627ae2992adc68eb371bf6490a7d00711be19c8018ee0dbb"} May 26 15:21:10.974504 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:10.974442 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-sh6pn" podStartSLOduration=3.9956411320000003 podStartE2EDuration="21.974425159s" podCreationTimestamp="2026-05-26 15:20:49 +0000 UTC" firstStartedPulling="2026-05-26 15:20:52.377169081 +0000 UTC m=+3.201185879" lastFinishedPulling="2026-05-26 15:21:10.355953094 +0000 UTC m=+21.179969906" observedRunningTime="2026-05-26 15:21:10.971046546 +0000 UTC m=+21.795063357" watchObservedRunningTime="2026-05-26 15:21:10.974425159 +0000 UTC m=+21.798441981" May 26 15:21:11.002208 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:11.002156 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-99gbh" podStartSLOduration=4.014581086 podStartE2EDuration="22.002137756s" podCreationTimestamp="2026-05-26 15:20:49 +0000 UTC" firstStartedPulling="2026-05-26 15:20:52.368832635 +0000 UTC m=+3.192849434" lastFinishedPulling="2026-05-26 15:21:10.356389307 +0000 UTC m=+21.180406104" observedRunningTime="2026-05-26 15:21:11.001759341 +0000 UTC m=+21.825776161" watchObservedRunningTime="2026-05-26 15:21:11.002137756 +0000 UTC m=+21.826154580" May 26 15:21:11.002598 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:11.002563 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-w7spm" podStartSLOduration=4.014514982 podStartE2EDuration="22.00255377s" podCreationTimestamp="2026-05-26 15:20:49 +0000 UTC" firstStartedPulling="2026-05-26 15:20:52.369306579 +0000 UTC m=+3.193323391" lastFinishedPulling="2026-05-26 15:21:10.357345366 +0000 UTC m=+21.181362179" observedRunningTime="2026-05-26 15:21:10.986973574 +0000 UTC m=+21.810990393" watchObservedRunningTime="2026-05-26 15:21:11.00255377 +0000 UTC m=+21.826570593" May 26 15:21:11.015773 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:11.015642 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hf95k" podStartSLOduration=8.780255186 podStartE2EDuration="22.015628365s" podCreationTimestamp="2026-05-26 15:20:49 +0000 UTC" firstStartedPulling="2026-05-26 15:20:52.377285627 +0000 UTC m=+3.201302435" lastFinishedPulling="2026-05-26 15:21:05.612658815 +0000 UTC m=+16.436675614" observedRunningTime="2026-05-26 15:21:11.015368995 +0000 UTC m=+21.839385816" watchObservedRunningTime="2026-05-26 15:21:11.015628365 +0000 UTC m=+21.839645186" May 26 15:21:11.059189 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:11.059139 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-pmrcn" podStartSLOduration=4.035404712 podStartE2EDuration="22.059122639s" podCreationTimestamp="2026-05-26 15:20:49 +0000 UTC" firstStartedPulling="2026-05-26 15:20:52.365958173 +0000 UTC m=+3.189974988" lastFinishedPulling="2026-05-26 15:21:10.389676112 +0000 UTC m=+21.213692915" observedRunningTime="2026-05-26 15:21:11.058746581 +0000 UTC m=+21.882763400" watchObservedRunningTime="2026-05-26 15:21:11.059122639 +0000 UTC m=+21.883139458" May 26 15:21:11.417280 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:11.417235 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-99gbh" May 26 15:21:11.418011 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:11.417847 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-99gbh" May 26 15:21:11.766630 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:11.766600 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5lmkt" May 26 15:21:11.766793 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:11.766649 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49ztl" May 26 15:21:11.766855 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:11.766808 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5lmkt" podUID="cca6b815-6207-49c3-a510-5c66f4e39f20" May 26 15:21:11.766956 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:11.766927 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49ztl" podUID="72f4a6a1-504d-47f8-a1e8-82d3a081c6f9" May 26 15:21:11.887743 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:11.887709 2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 26 15:21:11.972527 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:11.972420 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f6zxq" event={"ID":"6224e4f7-52cd-4679-852d-8fe102d8bb91","Type":"ContainerStarted","Data":"0052ab692e65e347a7dd33c8304e85b5afd04eebbcfef9521780188a34d64f0b"} May 26 15:21:11.974195 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:11.974164 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-65xfw" event={"ID":"75269ec5-e31f-4796-ba93-f99f3d3fe816","Type":"ContainerStarted","Data":"0eb4f2fc229d32077d82119803bb382c53ede3153c44d26526e6d139ff2ee7f6"} May 26 15:21:11.976919 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:11.976894 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pls4f_f635642a-6974-4f41-adf9-e7ec1fe16090/ovn-acl-logging/0.log" May 26 15:21:11.977352 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:11.977323 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" event={"ID":"f635642a-6974-4f41-adf9-e7ec1fe16090","Type":"ContainerStarted","Data":"0b7235d5e33071aa9796ff50ac10f5c352baa8a91ae6a0b18da8cff337f114a5"} May 26 15:21:11.977448 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:11.977360 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" event={"ID":"f635642a-6974-4f41-adf9-e7ec1fe16090","Type":"ContainerStarted","Data":"14bac0e171f6bdd08bf76b4f27cd143afc0b8a79288a17937f1df43da6759af7"} May 26 15:21:11.978001 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:11.977977 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-99gbh" May 26 15:21:11.980754 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:11.979573 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-99gbh" May 26 15:21:12.737934 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:12.737815 2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-26T15:21:11.887730556Z","UUID":"0456c96b-e1ce-4cef-b85b-ff460b25425e","Handler":null,"Name":"","Endpoint":""} May 26 15:21:12.741046 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:12.740955 2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 26 15:21:12.741046 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:12.740985 2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 26 15:21:12.766829 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:12.766802 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7v4tq" May 26 15:21:12.766993 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:12.766935 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7v4tq" podUID="3822d872-a967-4800-8e87-c7d73d8f6c36" May 26 15:21:12.983051 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:12.982866 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-65xfw" event={"ID":"75269ec5-e31f-4796-ba93-f99f3d3fe816","Type":"ContainerStarted","Data":"6ab0e6c9186ab42835fdb8e8aaa3cfcfe03b7cac93a398ea36b95b140cad69a3"} May 26 15:21:13.000870 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:13.000773 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-65xfw" podStartSLOduration=3.53795796 podStartE2EDuration="24.000759204s" podCreationTimestamp="2026-05-26 15:20:49 +0000 UTC" firstStartedPulling="2026-05-26 15:20:52.367724654 +0000 UTC m=+3.191741452" lastFinishedPulling="2026-05-26 15:21:12.830525893 +0000 UTC m=+23.654542696" observedRunningTime="2026-05-26 15:21:13.000414032 +0000 UTC m=+23.824430880" watchObservedRunningTime="2026-05-26 15:21:13.000759204 +0000 UTC m=+23.824776039" May 26 15:21:13.766468 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:13.766432 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49ztl" May 26 15:21:13.766651 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:13.766430 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5lmkt" May 26 15:21:13.766651 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:13.766545 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49ztl" podUID="72f4a6a1-504d-47f8-a1e8-82d3a081c6f9" May 26 15:21:13.766651 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:13.766607 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5lmkt" podUID="cca6b815-6207-49c3-a510-5c66f4e39f20" May 26 15:21:13.988919 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:13.988892 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pls4f_f635642a-6974-4f41-adf9-e7ec1fe16090/ovn-acl-logging/0.log" May 26 15:21:13.989402 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:13.989161 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" event={"ID":"f635642a-6974-4f41-adf9-e7ec1fe16090","Type":"ContainerStarted","Data":"2af8d6cd3a44ba03bbfe4a9957f667eebf4fb8c93d6806239edc5f9689e82e5e"} May 26 15:21:14.766924 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:14.766892 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7v4tq" May 26 15:21:14.767097 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:14.767019 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7v4tq" podUID="3822d872-a967-4800-8e87-c7d73d8f6c36" May 26 15:21:15.766734 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:15.766519 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49ztl" May 26 15:21:15.767276 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:15.766545 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5lmkt" May 26 15:21:15.767276 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:15.766836 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49ztl" podUID="72f4a6a1-504d-47f8-a1e8-82d3a081c6f9" May 26 15:21:15.767276 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:15.766903 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5lmkt" podUID="cca6b815-6207-49c3-a510-5c66f4e39f20" May 26 15:21:15.994812 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:15.994779 2566 generic.go:358] "Generic (PLEG): container finished" podID="27d969eb-42bb-4133-b203-406a10027876" containerID="2d92426a56f549053326860ee7110430173f2ef2a7b216c7ad36f8fd00a03c00" exitCode=0 May 26 15:21:15.994986 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:15.994864 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zr86w" event={"ID":"27d969eb-42bb-4133-b203-406a10027876","Type":"ContainerDied","Data":"2d92426a56f549053326860ee7110430173f2ef2a7b216c7ad36f8fd00a03c00"} May 26 15:21:15.997894 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:15.997875 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pls4f_f635642a-6974-4f41-adf9-e7ec1fe16090/ovn-acl-logging/0.log" May 26 15:21:15.998254 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:15.998234 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" event={"ID":"f635642a-6974-4f41-adf9-e7ec1fe16090","Type":"ContainerStarted","Data":"360a0e4a63222cc49caa27c73f829d21e5f98fd9131df7a6fb8a6188c099a519"} May 26 15:21:15.998496 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:15.998481 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:21:15.998686 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:15.998658 2566 scope.go:117] "RemoveContainer" containerID="cf69f5e6cc8f8f36a7b6ce87169e4c556a04abc915b453a5a15d5d5286346b41" May 26 15:21:16.014611 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:16.014580 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:21:16.016426 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:16.016388 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-f6zxq" podStartSLOduration=9.038682191 podStartE2EDuration="27.016375812s" podCreationTimestamp="2026-05-26 15:20:49 +0000 UTC" firstStartedPulling="2026-05-26 15:20:52.37823651 +0000 UTC m=+3.202253307" lastFinishedPulling="2026-05-26 15:21:10.355930125 +0000 UTC m=+21.179946928" observedRunningTime="2026-05-26 15:21:13.018517925 +0000 UTC m=+23.842534741" watchObservedRunningTime="2026-05-26 15:21:16.016375812 +0000 UTC m=+26.840392626" May 26 15:21:16.766435 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:16.766396 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7v4tq" May 26 15:21:16.766729 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:16.766530 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7v4tq" podUID="3822d872-a967-4800-8e87-c7d73d8f6c36" May 26 15:21:17.003411 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:17.003384 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pls4f_f635642a-6974-4f41-adf9-e7ec1fe16090/ovn-acl-logging/0.log" May 26 15:21:17.003905 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:17.003784 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" event={"ID":"f635642a-6974-4f41-adf9-e7ec1fe16090","Type":"ContainerStarted","Data":"56cdd3abf04d1172bd68ec77237f7536fe630625ce8468b66411a616a28cfd56"} May 26 15:21:17.003983 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:17.003922 2566 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 26 15:21:17.004245 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:17.004196 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:21:17.022300 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:17.022270 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:21:17.037405 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:17.037360 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" podStartSLOduration=9.996908943 podStartE2EDuration="28.037344916s" podCreationTimestamp="2026-05-26 15:20:49 +0000 UTC" firstStartedPulling="2026-05-26 15:20:52.378864651 +0000 UTC m=+3.202881451" lastFinishedPulling="2026-05-26 15:21:10.419300626 +0000 UTC m=+21.243317424" observedRunningTime="2026-05-26 15:21:17.037010913 +0000 UTC m=+27.861027734" watchObservedRunningTime="2026-05-26 15:21:17.037344916 +0000 UTC m=+27.861361735" May 26 15:21:17.473169 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:17.472967 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5lmkt"] May 26 15:21:17.473329 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:17.473273 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5lmkt" May 26 15:21:17.473380 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:17.473361 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5lmkt" podUID="cca6b815-6207-49c3-a510-5c66f4e39f20" May 26 15:21:17.477779 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:17.477752 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7v4tq"] May 26 15:21:17.477931 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:17.477854 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7v4tq" May 26 15:21:17.477994 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:17.477948 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7v4tq" podUID="3822d872-a967-4800-8e87-c7d73d8f6c36" May 26 15:21:17.478274 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:17.478252 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-49ztl"] May 26 15:21:17.478357 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:17.478345 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49ztl" May 26 15:21:17.478438 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:17.478419 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49ztl" podUID="72f4a6a1-504d-47f8-a1e8-82d3a081c6f9" May 26 15:21:18.010849 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:18.010815 2566 generic.go:358] "Generic (PLEG): container finished" podID="27d969eb-42bb-4133-b203-406a10027876" containerID="59ccbdf661383729a41f72ac1093ea2adf087ac19797d3739756334acde091ad" exitCode=0 May 26 15:21:18.011186 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:18.010892 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zr86w" event={"ID":"27d969eb-42bb-4133-b203-406a10027876","Type":"ContainerDied","Data":"59ccbdf661383729a41f72ac1093ea2adf087ac19797d3739756334acde091ad"} May 26 15:21:18.011186 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:18.011161 2566 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 26 15:21:18.766768 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:18.766737 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7v4tq" May 26 15:21:18.766948 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:18.766737 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49ztl" May 26 15:21:18.766948 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:18.766868 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7v4tq" podUID="3822d872-a967-4800-8e87-c7d73d8f6c36" May 26 15:21:18.766948 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:18.766937 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49ztl" podUID="72f4a6a1-504d-47f8-a1e8-82d3a081c6f9" May 26 15:21:19.015134 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:19.015099 2566 generic.go:358] "Generic (PLEG): container finished" podID="27d969eb-42bb-4133-b203-406a10027876" containerID="af64699976327137e735ff114ef154ff3134126a1fb48c97d44053711e4753b8" exitCode=0 May 26 15:21:19.015646 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:19.015143 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zr86w" event={"ID":"27d969eb-42bb-4133-b203-406a10027876","Type":"ContainerDied","Data":"af64699976327137e735ff114ef154ff3134126a1fb48c97d44053711e4753b8"} May 26 15:21:19.015646 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:19.015452 2566 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 26 15:21:19.766734 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:19.766693 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5lmkt" May 26 15:21:19.766922 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:19.766792 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5lmkt" podUID="cca6b815-6207-49c3-a510-5c66f4e39f20" May 26 15:21:20.766788 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:20.766755 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49ztl" May 26 15:21:20.767358 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:20.766764 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7v4tq" May 26 15:21:20.767358 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:20.766858 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49ztl" podUID="72f4a6a1-504d-47f8-a1e8-82d3a081c6f9" May 26 15:21:20.767358 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:20.766976 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7v4tq" podUID="3822d872-a967-4800-8e87-c7d73d8f6c36" May 26 15:21:20.785876 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:20.785844 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:21:20.786130 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:20.786100 2566 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 26 15:21:20.797526 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:20.797486 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" podUID="f635642a-6974-4f41-adf9-e7ec1fe16090" containerName="ovnkube-controller" probeResult="failure" output="" May 26 15:21:20.807595 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:20.807552 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" podUID="f635642a-6974-4f41-adf9-e7ec1fe16090" containerName="ovnkube-controller" probeResult="failure" output="" May 26 15:21:21.766797 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:21.766764 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5lmkt" May 26 15:21:21.767378 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:21.766879 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5lmkt" podUID="cca6b815-6207-49c3-a510-5c66f4e39f20" May 26 15:21:22.766316 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:22.766273 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7v4tq" May 26 15:21:22.766610 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:22.766273 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49ztl" May 26 15:21:22.766610 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:22.766411 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7v4tq" podUID="3822d872-a967-4800-8e87-c7d73d8f6c36" May 26 15:21:22.766610 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:22.766490 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-49ztl" podUID="72f4a6a1-504d-47f8-a1e8-82d3a081c6f9" May 26 15:21:23.530523 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:23.530483 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3822d872-a967-4800-8e87-c7d73d8f6c36-metrics-certs\") pod \"network-metrics-daemon-7v4tq\" (UID: \"3822d872-a967-4800-8e87-c7d73d8f6c36\") " pod="openshift-multus/network-metrics-daemon-7v4tq" May 26 15:21:23.530949 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:23.530640 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 15:21:23.530949 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:23.530725 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3822d872-a967-4800-8e87-c7d73d8f6c36-metrics-certs podName:3822d872-a967-4800-8e87-c7d73d8f6c36 nodeName:}" failed. No retries permitted until 2026-05-26 15:21:55.530702647 +0000 UTC m=+66.354719454 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3822d872-a967-4800-8e87-c7d73d8f6c36-metrics-certs") pod "network-metrics-daemon-7v4tq" (UID: "3822d872-a967-4800-8e87-c7d73d8f6c36") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 15:21:23.630903 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:23.630859 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n7dkb\" (UniqueName: \"kubernetes.io/projected/72f4a6a1-504d-47f8-a1e8-82d3a081c6f9-kube-api-access-n7dkb\") pod \"network-check-target-49ztl\" (UID: \"72f4a6a1-504d-47f8-a1e8-82d3a081c6f9\") " pod="openshift-network-diagnostics/network-check-target-49ztl" May 26 15:21:23.631088 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:23.631063 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 15:21:23.631150 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:23.631093 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 15:21:23.631150 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:23.631112 2566 projected.go:194] Error preparing data for projected volume kube-api-access-n7dkb for pod openshift-network-diagnostics/network-check-target-49ztl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 15:21:23.631215 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:23.631176 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/72f4a6a1-504d-47f8-a1e8-82d3a081c6f9-kube-api-access-n7dkb podName:72f4a6a1-504d-47f8-a1e8-82d3a081c6f9 nodeName:}" failed. No retries permitted until 2026-05-26 15:21:55.63115921 +0000 UTC m=+66.455176031 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-n7dkb" (UniqueName: "kubernetes.io/projected/72f4a6a1-504d-47f8-a1e8-82d3a081c6f9-kube-api-access-n7dkb") pod "network-check-target-49ztl" (UID: "72f4a6a1-504d-47f8-a1e8-82d3a081c6f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 15:21:23.766805 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:23.766770 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5lmkt" May 26 15:21:23.767019 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:23.766981 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5lmkt" podUID="cca6b815-6207-49c3-a510-5c66f4e39f20" May 26 15:21:23.933284 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:23.933241 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cca6b815-6207-49c3-a510-5c66f4e39f20-original-pull-secret\") pod \"global-pull-secret-syncer-5lmkt\" (UID: \"cca6b815-6207-49c3-a510-5c66f4e39f20\") " pod="kube-system/global-pull-secret-syncer-5lmkt" May 26 15:21:23.933468 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:23.933415 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 26 15:21:23.933529 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:23.933494 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cca6b815-6207-49c3-a510-5c66f4e39f20-original-pull-secret podName:cca6b815-6207-49c3-a510-5c66f4e39f20 nodeName:}" failed. No retries permitted until 2026-05-26 15:21:55.933472335 +0000 UTC m=+66.757489133 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cca6b815-6207-49c3-a510-5c66f4e39f20-original-pull-secret") pod "global-pull-secret-syncer-5lmkt" (UID: "cca6b815-6207-49c3-a510-5c66f4e39f20") : object "kube-system"/"original-pull-secret" not registered May 26 15:21:24.511866 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:24.511834 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-103.ec2.internal" event="NodeReady" May 26 15:21:24.512067 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:24.512015 2566 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 26 15:21:24.574990 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:24.574957 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9zv2j"] May 26 15:21:24.632999 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:24.632962 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qnqmv"] May 26 15:21:24.633187 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:24.633152 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9zv2j" May 26 15:21:24.635712 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:24.635681 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 26 15:21:24.635846 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:24.635777 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 26 15:21:24.635893 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:24.635867 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-smt4m\"" May 26 15:21:24.649193 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:24.648977 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9zv2j"] May 26 15:21:24.649321 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:24.649211 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qnqmv"] May 26 15:21:24.649321 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:24.649129 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qnqmv" May 26 15:21:24.651801 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:24.651781 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 26 15:21:24.651923 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:24.651852 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pt65f\"" May 26 15:21:24.651923 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:24.651888 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 26 15:21:24.651923 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:24.651914 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 26 15:21:24.739467 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:24.739428 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a538280e-ec4c-477b-a61a-cdb23e4f91cb-metrics-tls\") pod \"dns-default-9zv2j\" (UID: \"a538280e-ec4c-477b-a61a-cdb23e4f91cb\") " pod="openshift-dns/dns-default-9zv2j" May 26 15:21:24.739645 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:24.739487 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx4vm\" (UniqueName: \"kubernetes.io/projected/0748d4e5-f906-42ba-8f02-543c7cdde1da-kube-api-access-zx4vm\") pod \"ingress-canary-qnqmv\" (UID: \"0748d4e5-f906-42ba-8f02-543c7cdde1da\") " pod="openshift-ingress-canary/ingress-canary-qnqmv" May 26 15:21:24.739645 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:24.739565 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0748d4e5-f906-42ba-8f02-543c7cdde1da-cert\") pod \"ingress-canary-qnqmv\" (UID: \"0748d4e5-f906-42ba-8f02-543c7cdde1da\") " pod="openshift-ingress-canary/ingress-canary-qnqmv" May 26 15:21:24.739645 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:24.739591 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a538280e-ec4c-477b-a61a-cdb23e4f91cb-config-volume\") pod \"dns-default-9zv2j\" (UID: \"a538280e-ec4c-477b-a61a-cdb23e4f91cb\") " pod="openshift-dns/dns-default-9zv2j" May 26 15:21:24.739645 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:24.739610 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv8t6\" (UniqueName: \"kubernetes.io/projected/a538280e-ec4c-477b-a61a-cdb23e4f91cb-kube-api-access-lv8t6\") pod \"dns-default-9zv2j\" (UID: \"a538280e-ec4c-477b-a61a-cdb23e4f91cb\") " pod="openshift-dns/dns-default-9zv2j" May 26 15:21:24.739645 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:24.739627 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a538280e-ec4c-477b-a61a-cdb23e4f91cb-tmp-dir\") pod \"dns-default-9zv2j\" (UID: \"a538280e-ec4c-477b-a61a-cdb23e4f91cb\") " pod="openshift-dns/dns-default-9zv2j" May 26 15:21:24.766973 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:24.766897 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7v4tq" May 26 15:21:24.767072 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:24.766904 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49ztl" May 26 15:21:24.769624 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:24.769591 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 26 15:21:24.769624 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:24.769594 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 26 15:21:24.769838 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:24.769594 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 26 15:21:24.769838 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:24.769682 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dzb4k\"" May 26 15:21:24.769838 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:24.769714 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pgdkb\"" May 26 15:21:24.840980 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:24.840944 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0748d4e5-f906-42ba-8f02-543c7cdde1da-cert\") pod \"ingress-canary-qnqmv\" (UID: \"0748d4e5-f906-42ba-8f02-543c7cdde1da\") " pod="openshift-ingress-canary/ingress-canary-qnqmv" May 26 15:21:24.840980 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:24.840981 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a538280e-ec4c-477b-a61a-cdb23e4f91cb-config-volume\") pod \"dns-default-9zv2j\" (UID: \"a538280e-ec4c-477b-a61a-cdb23e4f91cb\") " pod="openshift-dns/dns-default-9zv2j" May 26 15:21:24.841198 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:24.841013 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lv8t6\" (UniqueName: \"kubernetes.io/projected/a538280e-ec4c-477b-a61a-cdb23e4f91cb-kube-api-access-lv8t6\") pod \"dns-default-9zv2j\" (UID: \"a538280e-ec4c-477b-a61a-cdb23e4f91cb\") " pod="openshift-dns/dns-default-9zv2j" May 26 15:21:24.841198 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:24.841031 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a538280e-ec4c-477b-a61a-cdb23e4f91cb-tmp-dir\") pod \"dns-default-9zv2j\" (UID: \"a538280e-ec4c-477b-a61a-cdb23e4f91cb\") " pod="openshift-dns/dns-default-9zv2j" May 26 15:21:24.841198 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:24.841076 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a538280e-ec4c-477b-a61a-cdb23e4f91cb-metrics-tls\") pod \"dns-default-9zv2j\" (UID: \"a538280e-ec4c-477b-a61a-cdb23e4f91cb\") " pod="openshift-dns/dns-default-9zv2j" May 26 15:21:24.841198 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:24.841104 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 15:21:24.841198 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:24.841111 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zx4vm\" (UniqueName: \"kubernetes.io/projected/0748d4e5-f906-42ba-8f02-543c7cdde1da-kube-api-access-zx4vm\") pod \"ingress-canary-qnqmv\" (UID: \"0748d4e5-f906-42ba-8f02-543c7cdde1da\") " pod="openshift-ingress-canary/ingress-canary-qnqmv" May 26 15:21:24.841198 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:24.841169 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0748d4e5-f906-42ba-8f02-543c7cdde1da-cert podName:0748d4e5-f906-42ba-8f02-543c7cdde1da nodeName:}" failed. No retries permitted until 2026-05-26 15:21:25.341151307 +0000 UTC m=+36.165168110 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0748d4e5-f906-42ba-8f02-543c7cdde1da-cert") pod "ingress-canary-qnqmv" (UID: "0748d4e5-f906-42ba-8f02-543c7cdde1da") : secret "canary-serving-cert" not found May 26 15:21:24.841449 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:24.841203 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 15:21:24.841449 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:24.841255 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a538280e-ec4c-477b-a61a-cdb23e4f91cb-metrics-tls podName:a538280e-ec4c-477b-a61a-cdb23e4f91cb nodeName:}" failed. No retries permitted until 2026-05-26 15:21:25.341236401 +0000 UTC m=+36.165253213 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a538280e-ec4c-477b-a61a-cdb23e4f91cb-metrics-tls") pod "dns-default-9zv2j" (UID: "a538280e-ec4c-477b-a61a-cdb23e4f91cb") : secret "dns-default-metrics-tls" not found May 26 15:21:24.841449 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:24.841402 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a538280e-ec4c-477b-a61a-cdb23e4f91cb-tmp-dir\") pod \"dns-default-9zv2j\" (UID: \"a538280e-ec4c-477b-a61a-cdb23e4f91cb\") " pod="openshift-dns/dns-default-9zv2j" May 26 15:21:24.841615 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:24.841596 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a538280e-ec4c-477b-a61a-cdb23e4f91cb-config-volume\") pod \"dns-default-9zv2j\" (UID: \"a538280e-ec4c-477b-a61a-cdb23e4f91cb\") " pod="openshift-dns/dns-default-9zv2j" May 26 15:21:24.850886 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:24.850860 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv8t6\" (UniqueName: \"kubernetes.io/projected/a538280e-ec4c-477b-a61a-cdb23e4f91cb-kube-api-access-lv8t6\") pod \"dns-default-9zv2j\" (UID: \"a538280e-ec4c-477b-a61a-cdb23e4f91cb\") " pod="openshift-dns/dns-default-9zv2j" May 26 15:21:24.851014 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:24.850916 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx4vm\" (UniqueName: \"kubernetes.io/projected/0748d4e5-f906-42ba-8f02-543c7cdde1da-kube-api-access-zx4vm\") pod \"ingress-canary-qnqmv\" (UID: \"0748d4e5-f906-42ba-8f02-543c7cdde1da\") " pod="openshift-ingress-canary/ingress-canary-qnqmv" May 26 15:21:25.345547 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:25.345505 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a538280e-ec4c-477b-a61a-cdb23e4f91cb-metrics-tls\") pod \"dns-default-9zv2j\" (UID: \"a538280e-ec4c-477b-a61a-cdb23e4f91cb\") " pod="openshift-dns/dns-default-9zv2j" May 26 15:21:25.345748 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:25.345573 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0748d4e5-f906-42ba-8f02-543c7cdde1da-cert\") pod \"ingress-canary-qnqmv\" (UID: \"0748d4e5-f906-42ba-8f02-543c7cdde1da\") " pod="openshift-ingress-canary/ingress-canary-qnqmv" May 26 15:21:25.345748 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:25.345655 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 15:21:25.345748 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:25.345731 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0748d4e5-f906-42ba-8f02-543c7cdde1da-cert podName:0748d4e5-f906-42ba-8f02-543c7cdde1da nodeName:}" failed. No retries permitted until 2026-05-26 15:21:26.345716967 +0000 UTC m=+37.169733766 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0748d4e5-f906-42ba-8f02-543c7cdde1da-cert") pod "ingress-canary-qnqmv" (UID: "0748d4e5-f906-42ba-8f02-543c7cdde1da") : secret "canary-serving-cert" not found May 26 15:21:25.345914 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:25.345659 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 15:21:25.345914 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:25.345837 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a538280e-ec4c-477b-a61a-cdb23e4f91cb-metrics-tls podName:a538280e-ec4c-477b-a61a-cdb23e4f91cb nodeName:}" failed. No retries permitted until 2026-05-26 15:21:26.34581566 +0000 UTC m=+37.169832476 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a538280e-ec4c-477b-a61a-cdb23e4f91cb-metrics-tls") pod "dns-default-9zv2j" (UID: "a538280e-ec4c-477b-a61a-cdb23e4f91cb") : secret "dns-default-metrics-tls" not found May 26 15:21:25.766609 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:25.766571 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5lmkt" May 26 15:21:25.770462 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:25.769554 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 26 15:21:26.032470 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:26.032380 2566 generic.go:358] "Generic (PLEG): container finished" podID="27d969eb-42bb-4133-b203-406a10027876" containerID="cc8fbc91bea5bdaa52331373bbed7fac17b33b8eb639fa57e80c04265a94b7e4" exitCode=0 May 26 15:21:26.032470 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:26.032442 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zr86w" event={"ID":"27d969eb-42bb-4133-b203-406a10027876","Type":"ContainerDied","Data":"cc8fbc91bea5bdaa52331373bbed7fac17b33b8eb639fa57e80c04265a94b7e4"} May 26 15:21:26.353133 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:26.353039 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0748d4e5-f906-42ba-8f02-543c7cdde1da-cert\") pod \"ingress-canary-qnqmv\" (UID: \"0748d4e5-f906-42ba-8f02-543c7cdde1da\") " pod="openshift-ingress-canary/ingress-canary-qnqmv" May 26 15:21:26.353133 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:26.353106 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a538280e-ec4c-477b-a61a-cdb23e4f91cb-metrics-tls\") pod \"dns-default-9zv2j\" (UID: \"a538280e-ec4c-477b-a61a-cdb23e4f91cb\") " pod="openshift-dns/dns-default-9zv2j" May 26 15:21:26.353302 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:26.353191 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 15:21:26.353302 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:26.353210 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 15:21:26.353302 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:26.353259 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0748d4e5-f906-42ba-8f02-543c7cdde1da-cert podName:0748d4e5-f906-42ba-8f02-543c7cdde1da nodeName:}" failed. No retries permitted until 2026-05-26 15:21:28.353241284 +0000 UTC m=+39.177258082 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0748d4e5-f906-42ba-8f02-543c7cdde1da-cert") pod "ingress-canary-qnqmv" (UID: "0748d4e5-f906-42ba-8f02-543c7cdde1da") : secret "canary-serving-cert" not found May 26 15:21:26.353302 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:26.353279 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a538280e-ec4c-477b-a61a-cdb23e4f91cb-metrics-tls podName:a538280e-ec4c-477b-a61a-cdb23e4f91cb nodeName:}" failed. No retries permitted until 2026-05-26 15:21:28.353272094 +0000 UTC m=+39.177288892 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a538280e-ec4c-477b-a61a-cdb23e4f91cb-metrics-tls") pod "dns-default-9zv2j" (UID: "a538280e-ec4c-477b-a61a-cdb23e4f91cb") : secret "dns-default-metrics-tls" not found May 26 15:21:27.036892 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:27.036865 2566 generic.go:358] "Generic (PLEG): container finished" podID="27d969eb-42bb-4133-b203-406a10027876" containerID="7b1cb8100419c847552057160abe16972ebf391528c6188b6ec12dede53d9284" exitCode=0 May 26 15:21:27.037219 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:27.036927 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zr86w" event={"ID":"27d969eb-42bb-4133-b203-406a10027876","Type":"ContainerDied","Data":"7b1cb8100419c847552057160abe16972ebf391528c6188b6ec12dede53d9284"} May 26 15:21:28.041368 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:28.041331 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zr86w" event={"ID":"27d969eb-42bb-4133-b203-406a10027876","Type":"ContainerStarted","Data":"9e46d4b60f9314fe8ab969ef0e110f9378e2d140eb019ec9694b2b0542a11529"} May 26 15:21:28.066096 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:28.066031 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zr86w" podStartSLOduration=6.319595696 podStartE2EDuration="39.06601117s" podCreationTimestamp="2026-05-26 15:20:49 +0000 UTC" firstStartedPulling="2026-05-26 15:20:52.374388763 +0000 UTC m=+3.198405567" lastFinishedPulling="2026-05-26 15:21:25.120804239 +0000 UTC m=+35.944821041" observedRunningTime="2026-05-26 15:21:28.065889563 +0000 UTC m=+38.889906374" watchObservedRunningTime="2026-05-26 15:21:28.06601117 +0000 UTC m=+38.890027991" May 26 15:21:28.367868 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:28.367779 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a538280e-ec4c-477b-a61a-cdb23e4f91cb-metrics-tls\") pod \"dns-default-9zv2j\" (UID: \"a538280e-ec4c-477b-a61a-cdb23e4f91cb\") " pod="openshift-dns/dns-default-9zv2j" May 26 15:21:28.367868 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:28.367847 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0748d4e5-f906-42ba-8f02-543c7cdde1da-cert\") pod \"ingress-canary-qnqmv\" (UID: \"0748d4e5-f906-42ba-8f02-543c7cdde1da\") " pod="openshift-ingress-canary/ingress-canary-qnqmv" May 26 15:21:28.368066 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:28.367926 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 15:21:28.368066 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:28.368001 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a538280e-ec4c-477b-a61a-cdb23e4f91cb-metrics-tls podName:a538280e-ec4c-477b-a61a-cdb23e4f91cb nodeName:}" failed. No retries permitted until 2026-05-26 15:21:32.367982896 +0000 UTC m=+43.191999694 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a538280e-ec4c-477b-a61a-cdb23e4f91cb-metrics-tls") pod "dns-default-9zv2j" (UID: "a538280e-ec4c-477b-a61a-cdb23e4f91cb") : secret "dns-default-metrics-tls" not found May 26 15:21:28.368066 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:28.367935 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 15:21:28.368157 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:28.368077 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0748d4e5-f906-42ba-8f02-543c7cdde1da-cert podName:0748d4e5-f906-42ba-8f02-543c7cdde1da nodeName:}" failed. No retries permitted until 2026-05-26 15:21:32.368063328 +0000 UTC m=+43.192080129 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0748d4e5-f906-42ba-8f02-543c7cdde1da-cert") pod "ingress-canary-qnqmv" (UID: "0748d4e5-f906-42ba-8f02-543c7cdde1da") : secret "canary-serving-cert" not found May 26 15:21:32.395984 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:32.395919 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a538280e-ec4c-477b-a61a-cdb23e4f91cb-metrics-tls\") pod \"dns-default-9zv2j\" (UID: \"a538280e-ec4c-477b-a61a-cdb23e4f91cb\") " pod="openshift-dns/dns-default-9zv2j" May 26 15:21:32.396435 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:32.396016 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0748d4e5-f906-42ba-8f02-543c7cdde1da-cert\") pod \"ingress-canary-qnqmv\" (UID: \"0748d4e5-f906-42ba-8f02-543c7cdde1da\") " pod="openshift-ingress-canary/ingress-canary-qnqmv" May 26 15:21:32.396435 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:32.396069 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 15:21:32.396435 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:32.396122 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 15:21:32.396435 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:32.396133 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a538280e-ec4c-477b-a61a-cdb23e4f91cb-metrics-tls podName:a538280e-ec4c-477b-a61a-cdb23e4f91cb nodeName:}" failed. No retries permitted until 2026-05-26 15:21:40.396117851 +0000 UTC m=+51.220134649 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a538280e-ec4c-477b-a61a-cdb23e4f91cb-metrics-tls") pod "dns-default-9zv2j" (UID: "a538280e-ec4c-477b-a61a-cdb23e4f91cb") : secret "dns-default-metrics-tls" not found May 26 15:21:32.396435 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:32.396161 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0748d4e5-f906-42ba-8f02-543c7cdde1da-cert podName:0748d4e5-f906-42ba-8f02-543c7cdde1da nodeName:}" failed. No retries permitted until 2026-05-26 15:21:40.396150052 +0000 UTC m=+51.220166850 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0748d4e5-f906-42ba-8f02-543c7cdde1da-cert") pod "ingress-canary-qnqmv" (UID: "0748d4e5-f906-42ba-8f02-543c7cdde1da") : secret "canary-serving-cert" not found May 26 15:21:40.454787 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:40.454743 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a538280e-ec4c-477b-a61a-cdb23e4f91cb-metrics-tls\") pod \"dns-default-9zv2j\" (UID: \"a538280e-ec4c-477b-a61a-cdb23e4f91cb\") " pod="openshift-dns/dns-default-9zv2j" May 26 15:21:40.455306 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:40.454819 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0748d4e5-f906-42ba-8f02-543c7cdde1da-cert\") pod \"ingress-canary-qnqmv\" (UID: \"0748d4e5-f906-42ba-8f02-543c7cdde1da\") " pod="openshift-ingress-canary/ingress-canary-qnqmv" May 26 15:21:40.455306 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:40.454915 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 15:21:40.455306 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:40.454962 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0748d4e5-f906-42ba-8f02-543c7cdde1da-cert podName:0748d4e5-f906-42ba-8f02-543c7cdde1da nodeName:}" failed. No retries permitted until 2026-05-26 15:21:56.454947361 +0000 UTC m=+67.278964159 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0748d4e5-f906-42ba-8f02-543c7cdde1da-cert") pod "ingress-canary-qnqmv" (UID: "0748d4e5-f906-42ba-8f02-543c7cdde1da") : secret "canary-serving-cert" not found May 26 15:21:40.455306 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:40.454910 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 15:21:40.455306 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:40.455056 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a538280e-ec4c-477b-a61a-cdb23e4f91cb-metrics-tls podName:a538280e-ec4c-477b-a61a-cdb23e4f91cb nodeName:}" failed. No retries permitted until 2026-05-26 15:21:56.455038296 +0000 UTC m=+67.279055108 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a538280e-ec4c-477b-a61a-cdb23e4f91cb-metrics-tls") pod "dns-default-9zv2j" (UID: "a538280e-ec4c-477b-a61a-cdb23e4f91cb") : secret "dns-default-metrics-tls" not found May 26 15:21:50.807245 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:50.807214 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pls4f" May 26 15:21:55.562510 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:55.562466 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3822d872-a967-4800-8e87-c7d73d8f6c36-metrics-certs\") pod \"network-metrics-daemon-7v4tq\" (UID: \"3822d872-a967-4800-8e87-c7d73d8f6c36\") " pod="openshift-multus/network-metrics-daemon-7v4tq" May 26 15:21:55.565341 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:55.565319 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 26 15:21:55.573464 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:55.573436 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 26 15:21:55.573538 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:55.573505 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3822d872-a967-4800-8e87-c7d73d8f6c36-metrics-certs podName:3822d872-a967-4800-8e87-c7d73d8f6c36 nodeName:}" failed. No retries permitted until 2026-05-26 15:22:59.573486338 +0000 UTC m=+130.397503136 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3822d872-a967-4800-8e87-c7d73d8f6c36-metrics-certs") pod "network-metrics-daemon-7v4tq" (UID: "3822d872-a967-4800-8e87-c7d73d8f6c36") : secret "metrics-daemon-secret" not found May 26 15:21:55.663448 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:55.663409 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n7dkb\" (UniqueName: \"kubernetes.io/projected/72f4a6a1-504d-47f8-a1e8-82d3a081c6f9-kube-api-access-n7dkb\") pod \"network-check-target-49ztl\" (UID: \"72f4a6a1-504d-47f8-a1e8-82d3a081c6f9\") " pod="openshift-network-diagnostics/network-check-target-49ztl" May 26 15:21:55.666302 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:55.666282 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 26 15:21:55.677080 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:55.677059 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 26 15:21:55.688441 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:55.688415 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7dkb\" (UniqueName: \"kubernetes.io/projected/72f4a6a1-504d-47f8-a1e8-82d3a081c6f9-kube-api-access-n7dkb\") pod \"network-check-target-49ztl\" (UID: \"72f4a6a1-504d-47f8-a1e8-82d3a081c6f9\") " pod="openshift-network-diagnostics/network-check-target-49ztl" May 26 15:21:55.965293 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:55.965258 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cca6b815-6207-49c3-a510-5c66f4e39f20-original-pull-secret\") pod \"global-pull-secret-syncer-5lmkt\" (UID: \"cca6b815-6207-49c3-a510-5c66f4e39f20\") " pod="kube-system/global-pull-secret-syncer-5lmkt" May 26 15:21:55.968228 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:55.968211 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 26 15:21:55.978404 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:55.978386 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cca6b815-6207-49c3-a510-5c66f4e39f20-original-pull-secret\") pod \"global-pull-secret-syncer-5lmkt\" (UID: \"cca6b815-6207-49c3-a510-5c66f4e39f20\") " pod="kube-system/global-pull-secret-syncer-5lmkt" May 26 15:21:55.984232 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:55.984209 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dzb4k\"" May 26 15:21:55.992354 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:55.992330 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-49ztl" May 26 15:21:56.077866 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:56.077830 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5lmkt" May 26 15:21:56.192873 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:21:56.192835 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72f4a6a1_504d_47f8_a1e8_82d3a081c6f9.slice/crio-9af1b5320a89cc9de28b84e4550f8855ae556503206636cf9d6a9f2b91b0cdf5 WatchSource:0}: Error finding container 9af1b5320a89cc9de28b84e4550f8855ae556503206636cf9d6a9f2b91b0cdf5: Status 404 returned error can't find the container with id 9af1b5320a89cc9de28b84e4550f8855ae556503206636cf9d6a9f2b91b0cdf5 May 26 15:21:56.199188 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:56.199161 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-49ztl"] May 26 15:21:56.229459 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:56.229380 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5lmkt"] May 26 15:21:56.232765 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:21:56.232734 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcca6b815_6207_49c3_a510_5c66f4e39f20.slice/crio-acf35ff6f28fad8d41deed91ab9ea0068003dee8ba39c8ba158fb3cfb95530e0 WatchSource:0}: Error finding container acf35ff6f28fad8d41deed91ab9ea0068003dee8ba39c8ba158fb3cfb95530e0: Status 404 returned error can't find the container with id acf35ff6f28fad8d41deed91ab9ea0068003dee8ba39c8ba158fb3cfb95530e0 May 26 15:21:56.471370 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:56.471337 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a538280e-ec4c-477b-a61a-cdb23e4f91cb-metrics-tls\") pod \"dns-default-9zv2j\" (UID: \"a538280e-ec4c-477b-a61a-cdb23e4f91cb\") " pod="openshift-dns/dns-default-9zv2j" May 26 15:21:56.471580 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:56.471423 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0748d4e5-f906-42ba-8f02-543c7cdde1da-cert\") pod \"ingress-canary-qnqmv\" (UID: \"0748d4e5-f906-42ba-8f02-543c7cdde1da\") " pod="openshift-ingress-canary/ingress-canary-qnqmv" May 26 15:21:56.471580 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:56.471506 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 15:21:56.471580 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:56.471562 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 15:21:56.471580 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:56.471582 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a538280e-ec4c-477b-a61a-cdb23e4f91cb-metrics-tls podName:a538280e-ec4c-477b-a61a-cdb23e4f91cb nodeName:}" failed. No retries permitted until 2026-05-26 15:22:28.471564172 +0000 UTC m=+99.295580970 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a538280e-ec4c-477b-a61a-cdb23e4f91cb-metrics-tls") pod "dns-default-9zv2j" (UID: "a538280e-ec4c-477b-a61a-cdb23e4f91cb") : secret "dns-default-metrics-tls" not found May 26 15:21:56.471795 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:21:56.471701 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0748d4e5-f906-42ba-8f02-543c7cdde1da-cert podName:0748d4e5-f906-42ba-8f02-543c7cdde1da nodeName:}" failed. No retries permitted until 2026-05-26 15:22:28.471661573 +0000 UTC m=+99.295678374 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0748d4e5-f906-42ba-8f02-543c7cdde1da-cert") pod "ingress-canary-qnqmv" (UID: "0748d4e5-f906-42ba-8f02-543c7cdde1da") : secret "canary-serving-cert" not found May 26 15:21:57.099122 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:57.099079 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-49ztl" event={"ID":"72f4a6a1-504d-47f8-a1e8-82d3a081c6f9","Type":"ContainerStarted","Data":"9af1b5320a89cc9de28b84e4550f8855ae556503206636cf9d6a9f2b91b0cdf5"} May 26 15:21:57.100802 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:21:57.100769 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5lmkt" event={"ID":"cca6b815-6207-49c3-a510-5c66f4e39f20","Type":"ContainerStarted","Data":"acf35ff6f28fad8d41deed91ab9ea0068003dee8ba39c8ba158fb3cfb95530e0"} May 26 15:22:01.112428 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:22:01.112386 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5lmkt" event={"ID":"cca6b815-6207-49c3-a510-5c66f4e39f20","Type":"ContainerStarted","Data":"f87bc015cf72f37d0b4ec04f737b2884cd23f7afa33ca929f2762bf0b3bb61c4"} May 26 15:22:01.113796 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:22:01.113772 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-49ztl" event={"ID":"72f4a6a1-504d-47f8-a1e8-82d3a081c6f9","Type":"ContainerStarted","Data":"4e2b7a38aba814515c4d385cb6746597e36f6ec5fa628bf0c285267c88ee4610"} May 26 15:22:01.113932 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:22:01.113922 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-49ztl" May 26 15:22:01.128490 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:22:01.128439 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5lmkt" podStartSLOduration=65.008554513 podStartE2EDuration="1m9.128426663s" podCreationTimestamp="2026-05-26 15:20:52 +0000 UTC" firstStartedPulling="2026-05-26 15:21:56.234444495 +0000 UTC m=+67.058461294" lastFinishedPulling="2026-05-26 15:22:00.354316632 +0000 UTC m=+71.178333444" observedRunningTime="2026-05-26 15:22:01.127956535 +0000 UTC m=+71.951973358" watchObservedRunningTime="2026-05-26 15:22:01.128426663 +0000 UTC m=+71.952443483" May 26 15:22:01.145846 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:22:01.145800 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-49ztl" podStartSLOduration=67.988483544 podStartE2EDuration="1m12.145787948s" podCreationTimestamp="2026-05-26 15:20:49 +0000 UTC" firstStartedPulling="2026-05-26 15:21:56.194831892 +0000 UTC m=+67.018848694" lastFinishedPulling="2026-05-26 15:22:00.3521363 +0000 UTC m=+71.176153098" observedRunningTime="2026-05-26 15:22:01.145375617 +0000 UTC m=+71.969392440" watchObservedRunningTime="2026-05-26 15:22:01.145787948 +0000 UTC m=+71.969804761" May 26 15:22:28.497358 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:22:28.497314 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0748d4e5-f906-42ba-8f02-543c7cdde1da-cert\") pod \"ingress-canary-qnqmv\" (UID: \"0748d4e5-f906-42ba-8f02-543c7cdde1da\") " pod="openshift-ingress-canary/ingress-canary-qnqmv" May 26 15:22:28.497769 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:22:28.497370 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a538280e-ec4c-477b-a61a-cdb23e4f91cb-metrics-tls\") pod \"dns-default-9zv2j\" (UID: \"a538280e-ec4c-477b-a61a-cdb23e4f91cb\") " pod="openshift-dns/dns-default-9zv2j" May 26 15:22:28.497769 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:22:28.497463 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 15:22:28.497769 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:22:28.497465 2566 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 15:22:28.497769 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:22:28.497520 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a538280e-ec4c-477b-a61a-cdb23e4f91cb-metrics-tls podName:a538280e-ec4c-477b-a61a-cdb23e4f91cb nodeName:}" failed. No retries permitted until 2026-05-26 15:23:32.49750409 +0000 UTC m=+163.321520887 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a538280e-ec4c-477b-a61a-cdb23e4f91cb-metrics-tls") pod "dns-default-9zv2j" (UID: "a538280e-ec4c-477b-a61a-cdb23e4f91cb") : secret "dns-default-metrics-tls" not found May 26 15:22:28.497769 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:22:28.497537 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0748d4e5-f906-42ba-8f02-543c7cdde1da-cert podName:0748d4e5-f906-42ba-8f02-543c7cdde1da nodeName:}" failed. No retries permitted until 2026-05-26 15:23:32.497531334 +0000 UTC m=+163.321548132 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0748d4e5-f906-42ba-8f02-543c7cdde1da-cert") pod "ingress-canary-qnqmv" (UID: "0748d4e5-f906-42ba-8f02-543c7cdde1da") : secret "canary-serving-cert" not found May 26 15:22:32.118927 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:22:32.118894 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-49ztl" May 26 15:22:59.611757 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:22:59.611715 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3822d872-a967-4800-8e87-c7d73d8f6c36-metrics-certs\") pod \"network-metrics-daemon-7v4tq\" (UID: \"3822d872-a967-4800-8e87-c7d73d8f6c36\") " pod="openshift-multus/network-metrics-daemon-7v4tq" May 26 15:22:59.612159 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:22:59.611829 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 26 15:22:59.612159 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:22:59.611891 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3822d872-a967-4800-8e87-c7d73d8f6c36-metrics-certs podName:3822d872-a967-4800-8e87-c7d73d8f6c36 nodeName:}" failed. No retries permitted until 2026-05-26 15:25:01.611876307 +0000 UTC m=+252.435893106 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3822d872-a967-4800-8e87-c7d73d8f6c36-metrics-certs") pod "network-metrics-daemon-7v4tq" (UID: "3822d872-a967-4800-8e87-c7d73d8f6c36") : secret "metrics-daemon-secret" not found May 26 15:23:13.831209 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:13.831177 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-zl9fs"] May 26 15:23:13.832724 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:13.832706 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zl9fs" May 26 15:23:13.838207 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:13.838169 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 26 15:23:13.838207 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:13.838169 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" May 26 15:23:13.838382 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:13.838216 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" May 26 15:23:13.838382 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:13.838245 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 26 15:23:13.838382 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:13.838280 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-smf6m\"" May 26 15:23:13.844777 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:13.844753 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-zl9fs"] May 26 15:23:13.931075 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:13.931036 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-57tdf"] May 26 15:23:13.932789 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:13.932769 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-57tdf" May 26 15:23:13.934177 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:13.934151 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sttlr"] May 26 15:23:13.935695 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:13.935678 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sttlr" May 26 15:23:13.937061 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:13.937043 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" May 26 15:23:13.937298 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:13.937285 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-bfzx2\"" May 26 15:23:13.939807 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:13.939779 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" May 26 15:23:13.939902 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:13.939841 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" May 26 15:23:13.949519 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:13.949499 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" May 26 15:23:13.949746 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:13.949731 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" May 26 15:23:13.949836 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:13.949822 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" May 26 15:23:13.949885 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:13.949862 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" May 26 15:23:13.950162 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:13.950149 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-8rmt9\"" May 26 15:23:13.951034 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:13.951015 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6696bcccc7-j6z8n"] May 26 15:23:13.952762 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:13.952747 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6696bcccc7-j6z8n" May 26 15:23:13.964643 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:13.964620 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 26 15:23:13.964766 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:13.964649 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 26 15:23:13.964847 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:13.964828 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gj9mv\"" May 26 15:23:13.965259 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:13.965242 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 26 15:23:13.965540 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:13.965518 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-57tdf"] May 26 15:23:13.981576 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:13.981550 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sttlr"] May 26 15:23:13.984164 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:13.984143 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 26 15:23:13.986689 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:13.986650 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6696bcccc7-j6z8n"] May 26 15:23:14.014712 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.014680 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0eed844c-87f5-403c-846c-6a0d177f47db-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-zl9fs\" (UID: \"0eed844c-87f5-403c-846c-6a0d177f47db\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zl9fs" May 26 15:23:14.014864 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.014774 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0eed844c-87f5-403c-846c-6a0d177f47db-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-zl9fs\" (UID: \"0eed844c-87f5-403c-846c-6a0d177f47db\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zl9fs" May 26 15:23:14.014864 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.014797 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5qgm\" (UniqueName: \"kubernetes.io/projected/0eed844c-87f5-403c-846c-6a0d177f47db-kube-api-access-r5qgm\") pod \"cluster-monitoring-operator-6c75959455-zl9fs\" (UID: \"0eed844c-87f5-403c-846c-6a0d177f47db\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zl9fs" May 26 15:23:14.115823 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.115720 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rt5f9\" (UniqueName: \"kubernetes.io/projected/e837500d-b8b7-4216-a212-39b44e868435-kube-api-access-rt5f9\") pod \"kube-storage-version-migrator-operator-565644f49-sttlr\" (UID: \"e837500d-b8b7-4216-a212-39b44e868435\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sttlr" May 26 15:23:14.115823 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.115784 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-trusted-ca\") pod \"image-registry-6696bcccc7-j6z8n\" (UID: \"10b5a2b4-3b74-4691-9c81-0776a28dc0ac\") " pod="openshift-image-registry/image-registry-6696bcccc7-j6z8n" May 26 15:23:14.116029 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.115850 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e837500d-b8b7-4216-a212-39b44e868435-config\") pod \"kube-storage-version-migrator-operator-565644f49-sttlr\" (UID: \"e837500d-b8b7-4216-a212-39b44e868435\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sttlr" May 26 15:23:14.116029 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.115901 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e837500d-b8b7-4216-a212-39b44e868435-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-sttlr\" (UID: \"e837500d-b8b7-4216-a212-39b44e868435\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sttlr" May 26 15:23:14.116029 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.115926 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-image-registry-private-configuration\") pod \"image-registry-6696bcccc7-j6z8n\" (UID: \"10b5a2b4-3b74-4691-9c81-0776a28dc0ac\") " pod="openshift-image-registry/image-registry-6696bcccc7-j6z8n" May 26 15:23:14.116029 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.115948 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-registry-tls\") pod \"image-registry-6696bcccc7-j6z8n\" (UID: \"10b5a2b4-3b74-4691-9c81-0776a28dc0ac\") " pod="openshift-image-registry/image-registry-6696bcccc7-j6z8n" May 26 15:23:14.116029 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.115965 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-installation-pull-secrets\") pod \"image-registry-6696bcccc7-j6z8n\" (UID: \"10b5a2b4-3b74-4691-9c81-0776a28dc0ac\") " pod="openshift-image-registry/image-registry-6696bcccc7-j6z8n" May 26 15:23:14.116029 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.115980 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dptf8\" (UniqueName: \"kubernetes.io/projected/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-kube-api-access-dptf8\") pod \"image-registry-6696bcccc7-j6z8n\" (UID: \"10b5a2b4-3b74-4691-9c81-0776a28dc0ac\") " pod="openshift-image-registry/image-registry-6696bcccc7-j6z8n" May 26 15:23:14.116029 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.116014 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v49t2\" (UniqueName: \"kubernetes.io/projected/f031b6fb-d2d8-40fa-a5b8-8962b62e9f37-kube-api-access-v49t2\") pod \"cluster-samples-operator-697587599-57tdf\" (UID: \"f031b6fb-d2d8-40fa-a5b8-8962b62e9f37\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-57tdf" May 26 15:23:14.116275 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.116040 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-registry-certificates\") pod \"image-registry-6696bcccc7-j6z8n\" (UID: \"10b5a2b4-3b74-4691-9c81-0776a28dc0ac\") " pod="openshift-image-registry/image-registry-6696bcccc7-j6z8n" May 26 15:23:14.116275 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.116071 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0eed844c-87f5-403c-846c-6a0d177f47db-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-zl9fs\" (UID: \"0eed844c-87f5-403c-846c-6a0d177f47db\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zl9fs" May 26 15:23:14.116275 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.116092 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r5qgm\" (UniqueName: \"kubernetes.io/projected/0eed844c-87f5-403c-846c-6a0d177f47db-kube-api-access-r5qgm\") pod \"cluster-monitoring-operator-6c75959455-zl9fs\" (UID: \"0eed844c-87f5-403c-846c-6a0d177f47db\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zl9fs" May 26 15:23:14.116275 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.116111 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f031b6fb-d2d8-40fa-a5b8-8962b62e9f37-samples-operator-tls\") pod \"cluster-samples-operator-697587599-57tdf\" (UID: \"f031b6fb-d2d8-40fa-a5b8-8962b62e9f37\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-57tdf" May 26 15:23:14.116275 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.116177 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0eed844c-87f5-403c-846c-6a0d177f47db-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-zl9fs\" (UID: \"0eed844c-87f5-403c-846c-6a0d177f47db\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zl9fs" May 26 15:23:14.116275 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:23:14.116206 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 26 15:23:14.116275 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.116211 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-ca-trust-extracted\") pod \"image-registry-6696bcccc7-j6z8n\" (UID: \"10b5a2b4-3b74-4691-9c81-0776a28dc0ac\") " pod="openshift-image-registry/image-registry-6696bcccc7-j6z8n" May 26 15:23:14.116275 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:23:14.116271 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0eed844c-87f5-403c-846c-6a0d177f47db-cluster-monitoring-operator-tls podName:0eed844c-87f5-403c-846c-6a0d177f47db nodeName:}" failed. No retries permitted until 2026-05-26 15:23:14.616250508 +0000 UTC m=+145.440267321 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0eed844c-87f5-403c-846c-6a0d177f47db-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-zl9fs" (UID: "0eed844c-87f5-403c-846c-6a0d177f47db") : secret "cluster-monitoring-operator-tls" not found May 26 15:23:14.116614 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.116286 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-bound-sa-token\") pod \"image-registry-6696bcccc7-j6z8n\" (UID: \"10b5a2b4-3b74-4691-9c81-0776a28dc0ac\") " pod="openshift-image-registry/image-registry-6696bcccc7-j6z8n" May 26 15:23:14.116883 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.116865 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0eed844c-87f5-403c-846c-6a0d177f47db-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-zl9fs\" (UID: \"0eed844c-87f5-403c-846c-6a0d177f47db\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zl9fs" May 26 15:23:14.125548 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.125523 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5qgm\" (UniqueName: \"kubernetes.io/projected/0eed844c-87f5-403c-846c-6a0d177f47db-kube-api-access-r5qgm\") pod \"cluster-monitoring-operator-6c75959455-zl9fs\" (UID: \"0eed844c-87f5-403c-846c-6a0d177f47db\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zl9fs" May 26 15:23:14.216999 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.216959 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e837500d-b8b7-4216-a212-39b44e868435-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-sttlr\" (UID: \"e837500d-b8b7-4216-a212-39b44e868435\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sttlr" May 26 15:23:14.216999 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.216998 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-image-registry-private-configuration\") pod \"image-registry-6696bcccc7-j6z8n\" (UID: \"10b5a2b4-3b74-4691-9c81-0776a28dc0ac\") " pod="openshift-image-registry/image-registry-6696bcccc7-j6z8n" May 26 15:23:14.217243 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.217016 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-registry-tls\") pod \"image-registry-6696bcccc7-j6z8n\" (UID: \"10b5a2b4-3b74-4691-9c81-0776a28dc0ac\") " pod="openshift-image-registry/image-registry-6696bcccc7-j6z8n" May 26 15:23:14.217243 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.217037 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-installation-pull-secrets\") pod \"image-registry-6696bcccc7-j6z8n\" (UID: \"10b5a2b4-3b74-4691-9c81-0776a28dc0ac\") " pod="openshift-image-registry/image-registry-6696bcccc7-j6z8n" May 26 15:23:14.217243 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.217052 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dptf8\" (UniqueName: \"kubernetes.io/projected/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-kube-api-access-dptf8\") pod \"image-registry-6696bcccc7-j6z8n\" (UID: \"10b5a2b4-3b74-4691-9c81-0776a28dc0ac\") " pod="openshift-image-registry/image-registry-6696bcccc7-j6z8n" May 26 15:23:14.217243 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.217080 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v49t2\" (UniqueName: \"kubernetes.io/projected/f031b6fb-d2d8-40fa-a5b8-8962b62e9f37-kube-api-access-v49t2\") pod \"cluster-samples-operator-697587599-57tdf\" (UID: \"f031b6fb-d2d8-40fa-a5b8-8962b62e9f37\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-57tdf" May 26 15:23:14.217243 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.217105 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-registry-certificates\") pod \"image-registry-6696bcccc7-j6z8n\" (UID: \"10b5a2b4-3b74-4691-9c81-0776a28dc0ac\") " pod="openshift-image-registry/image-registry-6696bcccc7-j6z8n" May 26 15:23:14.217243 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:23:14.217128 2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 26 15:23:14.217243 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:23:14.217151 2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6696bcccc7-j6z8n: secret "image-registry-tls" not found May 26 15:23:14.217243 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.217164 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f031b6fb-d2d8-40fa-a5b8-8962b62e9f37-samples-operator-tls\") pod \"cluster-samples-operator-697587599-57tdf\" (UID: \"f031b6fb-d2d8-40fa-a5b8-8962b62e9f37\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-57tdf" May 26 15:23:14.217243 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.217202 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-ca-trust-extracted\") pod \"image-registry-6696bcccc7-j6z8n\" (UID: \"10b5a2b4-3b74-4691-9c81-0776a28dc0ac\") " pod="openshift-image-registry/image-registry-6696bcccc7-j6z8n" May 26 15:23:14.217243 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:23:14.217221 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-registry-tls podName:10b5a2b4-3b74-4691-9c81-0776a28dc0ac nodeName:}" failed. No retries permitted until 2026-05-26 15:23:14.717201636 +0000 UTC m=+145.541218438 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-registry-tls") pod "image-registry-6696bcccc7-j6z8n" (UID: "10b5a2b4-3b74-4691-9c81-0776a28dc0ac") : secret "image-registry-tls" not found May 26 15:23:14.217787 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.217279 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-bound-sa-token\") pod \"image-registry-6696bcccc7-j6z8n\" (UID: \"10b5a2b4-3b74-4691-9c81-0776a28dc0ac\") " pod="openshift-image-registry/image-registry-6696bcccc7-j6z8n" May 26 15:23:14.217787 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.217304 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rt5f9\" (UniqueName: \"kubernetes.io/projected/e837500d-b8b7-4216-a212-39b44e868435-kube-api-access-rt5f9\") pod \"kube-storage-version-migrator-operator-565644f49-sttlr\" (UID: \"e837500d-b8b7-4216-a212-39b44e868435\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sttlr" May 26 15:23:14.217787 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.217342 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-trusted-ca\") pod \"image-registry-6696bcccc7-j6z8n\" (UID: \"10b5a2b4-3b74-4691-9c81-0776a28dc0ac\") " pod="openshift-image-registry/image-registry-6696bcccc7-j6z8n" May 26 15:23:14.217787 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.217364 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e837500d-b8b7-4216-a212-39b44e868435-config\") pod \"kube-storage-version-migrator-operator-565644f49-sttlr\" (UID: \"e837500d-b8b7-4216-a212-39b44e868435\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sttlr" May 26 15:23:14.217787 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:23:14.217535 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 26 15:23:14.217787 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:23:14.217585 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f031b6fb-d2d8-40fa-a5b8-8962b62e9f37-samples-operator-tls podName:f031b6fb-d2d8-40fa-a5b8-8962b62e9f37 nodeName:}" failed. No retries permitted until 2026-05-26 15:23:14.717568672 +0000 UTC m=+145.541585492 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f031b6fb-d2d8-40fa-a5b8-8962b62e9f37-samples-operator-tls") pod "cluster-samples-operator-697587599-57tdf" (UID: "f031b6fb-d2d8-40fa-a5b8-8962b62e9f37") : secret "samples-operator-tls" not found May 26 15:23:14.217787 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.217605 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-ca-trust-extracted\") pod \"image-registry-6696bcccc7-j6z8n\" (UID: \"10b5a2b4-3b74-4691-9c81-0776a28dc0ac\") " pod="openshift-image-registry/image-registry-6696bcccc7-j6z8n" May 26 15:23:14.218189 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.217810 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-registry-certificates\") pod \"image-registry-6696bcccc7-j6z8n\" (UID: \"10b5a2b4-3b74-4691-9c81-0776a28dc0ac\") " pod="openshift-image-registry/image-registry-6696bcccc7-j6z8n" May 26 15:23:14.218189 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.218025 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e837500d-b8b7-4216-a212-39b44e868435-config\") pod \"kube-storage-version-migrator-operator-565644f49-sttlr\" (UID: \"e837500d-b8b7-4216-a212-39b44e868435\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sttlr" May 26 15:23:14.218541 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.218517 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-trusted-ca\") pod \"image-registry-6696bcccc7-j6z8n\" (UID: \"10b5a2b4-3b74-4691-9c81-0776a28dc0ac\") " pod="openshift-image-registry/image-registry-6696bcccc7-j6z8n" May 26 15:23:14.219519 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.219491 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-installation-pull-secrets\") pod \"image-registry-6696bcccc7-j6z8n\" (UID: \"10b5a2b4-3b74-4691-9c81-0776a28dc0ac\") " pod="openshift-image-registry/image-registry-6696bcccc7-j6z8n" May 26 15:23:14.219635 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.219530 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-image-registry-private-configuration\") pod \"image-registry-6696bcccc7-j6z8n\" (UID: \"10b5a2b4-3b74-4691-9c81-0776a28dc0ac\") " pod="openshift-image-registry/image-registry-6696bcccc7-j6z8n" May 26 15:23:14.219738 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.219721 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e837500d-b8b7-4216-a212-39b44e868435-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-sttlr\" (UID: \"e837500d-b8b7-4216-a212-39b44e868435\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sttlr" May 26 15:23:14.226097 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.226072 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rt5f9\" (UniqueName: \"kubernetes.io/projected/e837500d-b8b7-4216-a212-39b44e868435-kube-api-access-rt5f9\") pod \"kube-storage-version-migrator-operator-565644f49-sttlr\" (UID: \"e837500d-b8b7-4216-a212-39b44e868435\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sttlr" May 26 15:23:14.226227 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.226182 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-bound-sa-token\") pod \"image-registry-6696bcccc7-j6z8n\" (UID: \"10b5a2b4-3b74-4691-9c81-0776a28dc0ac\") " pod="openshift-image-registry/image-registry-6696bcccc7-j6z8n" May 26 15:23:14.226582 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.226565 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v49t2\" (UniqueName: \"kubernetes.io/projected/f031b6fb-d2d8-40fa-a5b8-8962b62e9f37-kube-api-access-v49t2\") pod \"cluster-samples-operator-697587599-57tdf\" (UID: \"f031b6fb-d2d8-40fa-a5b8-8962b62e9f37\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-57tdf" May 26 15:23:14.226741 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.226726 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dptf8\" (UniqueName: \"kubernetes.io/projected/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-kube-api-access-dptf8\") pod \"image-registry-6696bcccc7-j6z8n\" (UID: \"10b5a2b4-3b74-4691-9c81-0776a28dc0ac\") " pod="openshift-image-registry/image-registry-6696bcccc7-j6z8n" May 26 15:23:14.247407 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.247382 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sttlr" May 26 15:23:14.369477 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.369399 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sttlr"] May 26 15:23:14.372571 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:23:14.372543 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode837500d_b8b7_4216_a212_39b44e868435.slice/crio-6fe68b04459c91575cdff64b7acdd39b1568dd40c8b3e349cc88ba1de0483f3b WatchSource:0}: Error finding container 6fe68b04459c91575cdff64b7acdd39b1568dd40c8b3e349cc88ba1de0483f3b: Status 404 returned error can't find the container with id 6fe68b04459c91575cdff64b7acdd39b1568dd40c8b3e349cc88ba1de0483f3b May 26 15:23:14.620989 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.620870 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0eed844c-87f5-403c-846c-6a0d177f47db-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-zl9fs\" (UID: \"0eed844c-87f5-403c-846c-6a0d177f47db\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zl9fs" May 26 15:23:14.621185 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:23:14.621064 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 26 15:23:14.621185 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:23:14.621166 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0eed844c-87f5-403c-846c-6a0d177f47db-cluster-monitoring-operator-tls podName:0eed844c-87f5-403c-846c-6a0d177f47db nodeName:}" failed. No retries permitted until 2026-05-26 15:23:15.6211431 +0000 UTC m=+146.445159914 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0eed844c-87f5-403c-846c-6a0d177f47db-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-zl9fs" (UID: "0eed844c-87f5-403c-846c-6a0d177f47db") : secret "cluster-monitoring-operator-tls" not found May 26 15:23:14.722320 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.722261 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-registry-tls\") pod \"image-registry-6696bcccc7-j6z8n\" (UID: \"10b5a2b4-3b74-4691-9c81-0776a28dc0ac\") " pod="openshift-image-registry/image-registry-6696bcccc7-j6z8n" May 26 15:23:14.722519 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:14.722359 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f031b6fb-d2d8-40fa-a5b8-8962b62e9f37-samples-operator-tls\") pod \"cluster-samples-operator-697587599-57tdf\" (UID: \"f031b6fb-d2d8-40fa-a5b8-8962b62e9f37\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-57tdf" May 26 15:23:14.722519 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:23:14.722425 2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 26 15:23:14.722519 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:23:14.722453 2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6696bcccc7-j6z8n: secret "image-registry-tls" not found May 26 15:23:14.722519 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:23:14.722515 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 26 15:23:14.722701 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:23:14.722519 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-registry-tls podName:10b5a2b4-3b74-4691-9c81-0776a28dc0ac nodeName:}" failed. No retries permitted until 2026-05-26 15:23:15.722499416 +0000 UTC m=+146.546516229 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-registry-tls") pod "image-registry-6696bcccc7-j6z8n" (UID: "10b5a2b4-3b74-4691-9c81-0776a28dc0ac") : secret "image-registry-tls" not found May 26 15:23:14.722701 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:23:14.722581 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f031b6fb-d2d8-40fa-a5b8-8962b62e9f37-samples-operator-tls podName:f031b6fb-d2d8-40fa-a5b8-8962b62e9f37 nodeName:}" failed. No retries permitted until 2026-05-26 15:23:15.722567994 +0000 UTC m=+146.546584797 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f031b6fb-d2d8-40fa-a5b8-8962b62e9f37-samples-operator-tls") pod "cluster-samples-operator-697587599-57tdf" (UID: "f031b6fb-d2d8-40fa-a5b8-8962b62e9f37") : secret "samples-operator-tls" not found May 26 15:23:15.254963 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:15.254919 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sttlr" event={"ID":"e837500d-b8b7-4216-a212-39b44e868435","Type":"ContainerStarted","Data":"6fe68b04459c91575cdff64b7acdd39b1568dd40c8b3e349cc88ba1de0483f3b"} May 26 15:23:15.631124 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:15.631026 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0eed844c-87f5-403c-846c-6a0d177f47db-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-zl9fs\" (UID: \"0eed844c-87f5-403c-846c-6a0d177f47db\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zl9fs" May 26 15:23:15.631277 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:23:15.631177 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 26 15:23:15.631277 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:23:15.631254 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0eed844c-87f5-403c-846c-6a0d177f47db-cluster-monitoring-operator-tls podName:0eed844c-87f5-403c-846c-6a0d177f47db nodeName:}" failed. No retries permitted until 2026-05-26 15:23:17.631236675 +0000 UTC m=+148.455253478 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0eed844c-87f5-403c-846c-6a0d177f47db-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-zl9fs" (UID: "0eed844c-87f5-403c-846c-6a0d177f47db") : secret "cluster-monitoring-operator-tls" not found May 26 15:23:15.732434 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:15.732391 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-registry-tls\") pod \"image-registry-6696bcccc7-j6z8n\" (UID: \"10b5a2b4-3b74-4691-9c81-0776a28dc0ac\") " pod="openshift-image-registry/image-registry-6696bcccc7-j6z8n" May 26 15:23:15.732609 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:15.732469 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f031b6fb-d2d8-40fa-a5b8-8962b62e9f37-samples-operator-tls\") pod \"cluster-samples-operator-697587599-57tdf\" (UID: \"f031b6fb-d2d8-40fa-a5b8-8962b62e9f37\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-57tdf" May 26 15:23:15.732609 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:23:15.732573 2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 26 15:23:15.732609 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:23:15.732597 2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6696bcccc7-j6z8n: secret "image-registry-tls" not found May 26 15:23:15.732793 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:23:15.732624 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 26 15:23:15.732793 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:23:15.732684 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-registry-tls podName:10b5a2b4-3b74-4691-9c81-0776a28dc0ac nodeName:}" failed. No retries permitted until 2026-05-26 15:23:17.732648393 +0000 UTC m=+148.556665194 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-registry-tls") pod "image-registry-6696bcccc7-j6z8n" (UID: "10b5a2b4-3b74-4691-9c81-0776a28dc0ac") : secret "image-registry-tls" not found May 26 15:23:15.732793 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:23:15.732704 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f031b6fb-d2d8-40fa-a5b8-8962b62e9f37-samples-operator-tls podName:f031b6fb-d2d8-40fa-a5b8-8962b62e9f37 nodeName:}" failed. No retries permitted until 2026-05-26 15:23:17.732694056 +0000 UTC m=+148.556710866 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f031b6fb-d2d8-40fa-a5b8-8962b62e9f37-samples-operator-tls") pod "cluster-samples-operator-697587599-57tdf" (UID: "f031b6fb-d2d8-40fa-a5b8-8962b62e9f37") : secret "samples-operator-tls" not found May 26 15:23:17.260291 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:17.260256 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sttlr" event={"ID":"e837500d-b8b7-4216-a212-39b44e868435","Type":"ContainerStarted","Data":"9bb3245305baa4847da978b777262271ee2e10b1b9ba27ab7ca90a1a2a13d847"} May 26 15:23:17.276747 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:17.276694 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sttlr" podStartSLOduration=2.183320332 podStartE2EDuration="4.276679646s" podCreationTimestamp="2026-05-26 15:23:13 +0000 UTC" firstStartedPulling="2026-05-26 15:23:14.37434126 +0000 UTC m=+145.198358059" lastFinishedPulling="2026-05-26 15:23:16.467700571 +0000 UTC m=+147.291717373" observedRunningTime="2026-05-26 15:23:17.276088534 +0000 UTC m=+148.100105351" watchObservedRunningTime="2026-05-26 15:23:17.276679646 +0000 UTC m=+148.100696460" May 26 15:23:17.646485 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:17.646381 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0eed844c-87f5-403c-846c-6a0d177f47db-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-zl9fs\" (UID: \"0eed844c-87f5-403c-846c-6a0d177f47db\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zl9fs" May 26 15:23:17.646658 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:23:17.646541 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 26 15:23:17.646658 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:23:17.646623 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0eed844c-87f5-403c-846c-6a0d177f47db-cluster-monitoring-operator-tls podName:0eed844c-87f5-403c-846c-6a0d177f47db nodeName:}" failed. No retries permitted until 2026-05-26 15:23:21.646601404 +0000 UTC m=+152.470618221 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0eed844c-87f5-403c-846c-6a0d177f47db-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-zl9fs" (UID: "0eed844c-87f5-403c-846c-6a0d177f47db") : secret "cluster-monitoring-operator-tls" not found May 26 15:23:17.747344 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:17.747296 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-registry-tls\") pod \"image-registry-6696bcccc7-j6z8n\" (UID: \"10b5a2b4-3b74-4691-9c81-0776a28dc0ac\") " pod="openshift-image-registry/image-registry-6696bcccc7-j6z8n" May 26 15:23:17.747506 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:17.747355 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f031b6fb-d2d8-40fa-a5b8-8962b62e9f37-samples-operator-tls\") pod \"cluster-samples-operator-697587599-57tdf\" (UID: \"f031b6fb-d2d8-40fa-a5b8-8962b62e9f37\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-57tdf" May 26 15:23:17.747506 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:23:17.747437 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 26 15:23:17.747506 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:23:17.747437 2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 26 15:23:17.747506 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:23:17.747457 2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6696bcccc7-j6z8n: secret "image-registry-tls" not found May 26 15:23:17.747506 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:23:17.747492 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f031b6fb-d2d8-40fa-a5b8-8962b62e9f37-samples-operator-tls podName:f031b6fb-d2d8-40fa-a5b8-8962b62e9f37 nodeName:}" failed. No retries permitted until 2026-05-26 15:23:21.747477759 +0000 UTC m=+152.571494556 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f031b6fb-d2d8-40fa-a5b8-8962b62e9f37-samples-operator-tls") pod "cluster-samples-operator-697587599-57tdf" (UID: "f031b6fb-d2d8-40fa-a5b8-8962b62e9f37") : secret "samples-operator-tls" not found May 26 15:23:17.747506 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:23:17.747505 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-registry-tls podName:10b5a2b4-3b74-4691-9c81-0776a28dc0ac nodeName:}" failed. No retries permitted until 2026-05-26 15:23:21.747499702 +0000 UTC m=+152.571516500 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-registry-tls") pod "image-registry-6696bcccc7-j6z8n" (UID: "10b5a2b4-3b74-4691-9c81-0776a28dc0ac") : secret "image-registry-tls" not found May 26 15:23:17.851573 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:17.851542 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-n8skw"] May 26 15:23:17.853385 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:17.853368 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-n8skw" May 26 15:23:17.855772 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:17.855745 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" May 26 15:23:17.855888 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:17.855810 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-kd2wj\"" May 26 15:23:17.855888 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:17.855814 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" May 26 15:23:17.863457 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:17.863432 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-n8skw"] May 26 15:23:17.949175 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:17.949141 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f982r\" (UniqueName: \"kubernetes.io/projected/17ea91cc-e67c-4030-b730-3cd958827e92-kube-api-access-f982r\") pod \"migrator-b985f5d89-n8skw\" (UID: \"17ea91cc-e67c-4030-b730-3cd958827e92\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-n8skw" May 26 15:23:18.050237 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:18.050199 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f982r\" (UniqueName: \"kubernetes.io/projected/17ea91cc-e67c-4030-b730-3cd958827e92-kube-api-access-f982r\") pod \"migrator-b985f5d89-n8skw\" (UID: \"17ea91cc-e67c-4030-b730-3cd958827e92\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-n8skw" May 26 15:23:18.059774 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:18.059746 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f982r\" (UniqueName: \"kubernetes.io/projected/17ea91cc-e67c-4030-b730-3cd958827e92-kube-api-access-f982r\") pod \"migrator-b985f5d89-n8skw\" (UID: \"17ea91cc-e67c-4030-b730-3cd958827e92\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-n8skw" May 26 15:23:18.162034 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:18.161983 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-n8skw" May 26 15:23:18.282338 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:18.282305 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-n8skw"] May 26 15:23:18.285872 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:23:18.285846 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17ea91cc_e67c_4030_b730_3cd958827e92.slice/crio-83f2563fb9bdf773bdbb09de8125b77883fbac5610981fff7bb29d41b3da588e WatchSource:0}: Error finding container 83f2563fb9bdf773bdbb09de8125b77883fbac5610981fff7bb29d41b3da588e: Status 404 returned error can't find the container with id 83f2563fb9bdf773bdbb09de8125b77883fbac5610981fff7bb29d41b3da588e May 26 15:23:19.265472 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:19.265434 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-n8skw" event={"ID":"17ea91cc-e67c-4030-b730-3cd958827e92","Type":"ContainerStarted","Data":"83f2563fb9bdf773bdbb09de8125b77883fbac5610981fff7bb29d41b3da588e"} May 26 15:23:20.269339 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:20.269300 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-n8skw" event={"ID":"17ea91cc-e67c-4030-b730-3cd958827e92","Type":"ContainerStarted","Data":"1a2ee0cbcf1e0ba5e8c6a15a9939f04ee9a8ca3eb5c6e9cd926153f2f132894c"} May 26 15:23:20.269339 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:20.269337 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-n8skw" event={"ID":"17ea91cc-e67c-4030-b730-3cd958827e92","Type":"ContainerStarted","Data":"8ec15a3310bbba118e2075f4f3dcc7eea3b268f34eaff918ee9b0c3f4506b1ed"} May 26 15:23:20.284977 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:20.284902 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-n8skw" podStartSLOduration=2.115543479 podStartE2EDuration="3.284888334s" podCreationTimestamp="2026-05-26 15:23:17 +0000 UTC" firstStartedPulling="2026-05-26 15:23:18.287805922 +0000 UTC m=+149.111822719" lastFinishedPulling="2026-05-26 15:23:19.457150772 +0000 UTC m=+150.281167574" observedRunningTime="2026-05-26 15:23:20.283936288 +0000 UTC m=+151.107953108" watchObservedRunningTime="2026-05-26 15:23:20.284888334 +0000 UTC m=+151.108905153" May 26 15:23:21.677180 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:21.677137 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0eed844c-87f5-403c-846c-6a0d177f47db-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-zl9fs\" (UID: \"0eed844c-87f5-403c-846c-6a0d177f47db\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zl9fs" May 26 15:23:21.677604 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:23:21.677288 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 26 15:23:21.677604 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:23:21.677354 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0eed844c-87f5-403c-846c-6a0d177f47db-cluster-monitoring-operator-tls podName:0eed844c-87f5-403c-846c-6a0d177f47db nodeName:}" failed. No retries permitted until 2026-05-26 15:23:29.677337301 +0000 UTC m=+160.501354098 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0eed844c-87f5-403c-846c-6a0d177f47db-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-zl9fs" (UID: "0eed844c-87f5-403c-846c-6a0d177f47db") : secret "cluster-monitoring-operator-tls" not found May 26 15:23:21.777811 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:21.777776 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-registry-tls\") pod \"image-registry-6696bcccc7-j6z8n\" (UID: \"10b5a2b4-3b74-4691-9c81-0776a28dc0ac\") " pod="openshift-image-registry/image-registry-6696bcccc7-j6z8n" May 26 15:23:21.778001 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:21.777831 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f031b6fb-d2d8-40fa-a5b8-8962b62e9f37-samples-operator-tls\") pod \"cluster-samples-operator-697587599-57tdf\" (UID: \"f031b6fb-d2d8-40fa-a5b8-8962b62e9f37\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-57tdf" May 26 15:23:21.778001 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:23:21.777932 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 26 15:23:21.778001 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:23:21.777942 2566 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 26 15:23:21.778001 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:23:21.777961 2566 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6696bcccc7-j6z8n: secret "image-registry-tls" not found May 26 15:23:21.778001 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:23:21.777976 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f031b6fb-d2d8-40fa-a5b8-8962b62e9f37-samples-operator-tls podName:f031b6fb-d2d8-40fa-a5b8-8962b62e9f37 nodeName:}" failed. No retries permitted until 2026-05-26 15:23:29.777963552 +0000 UTC m=+160.601980350 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f031b6fb-d2d8-40fa-a5b8-8962b62e9f37-samples-operator-tls") pod "cluster-samples-operator-697587599-57tdf" (UID: "f031b6fb-d2d8-40fa-a5b8-8962b62e9f37") : secret "samples-operator-tls" not found May 26 15:23:21.778187 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:23:21.778043 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-registry-tls podName:10b5a2b4-3b74-4691-9c81-0776a28dc0ac nodeName:}" failed. No retries permitted until 2026-05-26 15:23:29.778028733 +0000 UTC m=+160.602045531 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-registry-tls") pod "image-registry-6696bcccc7-j6z8n" (UID: "10b5a2b4-3b74-4691-9c81-0776a28dc0ac") : secret "image-registry-tls" not found May 26 15:23:22.111976 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:22.111905 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sh6pn_44a8069f-bc00-4b3d-86da-9e01d0946556/dns-node-resolver/0.log" May 26 15:23:22.910328 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:22.910299 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hf95k_db0ab8ec-7e6f-49ab-a120-bc7424a7a75d/node-ca/0.log" May 26 15:23:24.111071 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:24.111042 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-n8skw_17ea91cc-e67c-4030-b730-3cd958827e92/migrator/0.log" May 26 15:23:24.310217 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:24.310195 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-n8skw_17ea91cc-e67c-4030-b730-3cd958827e92/graceful-termination/0.log" May 26 15:23:24.511285 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:24.511252 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-sttlr_e837500d-b8b7-4216-a212-39b44e868435/kube-storage-version-migrator-operator/0.log" May 26 15:23:27.645925 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:23:27.645869 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-9zv2j" podUID="a538280e-ec4c-477b-a61a-cdb23e4f91cb" May 26 15:23:27.660051 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:23:27.660020 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-qnqmv" podUID="0748d4e5-f906-42ba-8f02-543c7cdde1da" May 26 15:23:27.776587 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:23:27.776552 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-7v4tq" podUID="3822d872-a967-4800-8e87-c7d73d8f6c36" May 26 15:23:28.289866 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:28.289831 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qnqmv" May 26 15:23:28.290016 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:28.290002 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9zv2j" May 26 15:23:29.742356 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:29.742317 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0eed844c-87f5-403c-846c-6a0d177f47db-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-zl9fs\" (UID: \"0eed844c-87f5-403c-846c-6a0d177f47db\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zl9fs" May 26 15:23:29.742910 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:23:29.742502 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 26 15:23:29.742910 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:23:29.742587 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0eed844c-87f5-403c-846c-6a0d177f47db-cluster-monitoring-operator-tls podName:0eed844c-87f5-403c-846c-6a0d177f47db nodeName:}" failed. No retries permitted until 2026-05-26 15:23:45.742567164 +0000 UTC m=+176.566583962 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0eed844c-87f5-403c-846c-6a0d177f47db-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-zl9fs" (UID: "0eed844c-87f5-403c-846c-6a0d177f47db") : secret "cluster-monitoring-operator-tls" not found May 26 15:23:29.843144 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:29.843061 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-registry-tls\") pod \"image-registry-6696bcccc7-j6z8n\" (UID: \"10b5a2b4-3b74-4691-9c81-0776a28dc0ac\") " pod="openshift-image-registry/image-registry-6696bcccc7-j6z8n" May 26 15:23:29.843144 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:29.843119 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f031b6fb-d2d8-40fa-a5b8-8962b62e9f37-samples-operator-tls\") pod \"cluster-samples-operator-697587599-57tdf\" (UID: \"f031b6fb-d2d8-40fa-a5b8-8962b62e9f37\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-57tdf" May 26 15:23:29.845522 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:29.845492 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f031b6fb-d2d8-40fa-a5b8-8962b62e9f37-samples-operator-tls\") pod \"cluster-samples-operator-697587599-57tdf\" (UID: \"f031b6fb-d2d8-40fa-a5b8-8962b62e9f37\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-57tdf" May 26 15:23:29.845631 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:29.845521 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-registry-tls\") pod \"image-registry-6696bcccc7-j6z8n\" (UID: \"10b5a2b4-3b74-4691-9c81-0776a28dc0ac\") " pod="openshift-image-registry/image-registry-6696bcccc7-j6z8n" May 26 15:23:29.860412 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:29.860393 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6696bcccc7-j6z8n" May 26 15:23:29.982351 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:29.982317 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6696bcccc7-j6z8n"] May 26 15:23:29.985694 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:23:29.985644 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10b5a2b4_3b74_4691_9c81_0776a28dc0ac.slice/crio-5e830603ec7984fa24d3d320e9de786e54860e5ddb198bd698bee1b007a37b8c WatchSource:0}: Error finding container 5e830603ec7984fa24d3d320e9de786e54860e5ddb198bd698bee1b007a37b8c: Status 404 returned error can't find the container with id 5e830603ec7984fa24d3d320e9de786e54860e5ddb198bd698bee1b007a37b8c May 26 15:23:30.142767 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:30.142733 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-57tdf" May 26 15:23:30.262609 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:30.262536 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-57tdf"] May 26 15:23:30.295849 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:30.295821 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6696bcccc7-j6z8n" event={"ID":"10b5a2b4-3b74-4691-9c81-0776a28dc0ac","Type":"ContainerStarted","Data":"2998920cde45fcb12d72e84c25dc8fef3d27c135e7084093947ad1aac44d7ca8"} May 26 15:23:30.295993 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:30.295854 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6696bcccc7-j6z8n" event={"ID":"10b5a2b4-3b74-4691-9c81-0776a28dc0ac","Type":"ContainerStarted","Data":"5e830603ec7984fa24d3d320e9de786e54860e5ddb198bd698bee1b007a37b8c"} May 26 15:23:30.295993 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:30.295941 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6696bcccc7-j6z8n" May 26 15:23:30.315408 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:30.315363 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6696bcccc7-j6z8n" podStartSLOduration=17.31534937 podStartE2EDuration="17.31534937s" podCreationTimestamp="2026-05-26 15:23:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 15:23:30.314514593 +0000 UTC m=+161.138531415" watchObservedRunningTime="2026-05-26 15:23:30.31534937 +0000 UTC m=+161.139366229" May 26 15:23:31.299375 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:31.299338 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-57tdf" event={"ID":"f031b6fb-d2d8-40fa-a5b8-8962b62e9f37","Type":"ContainerStarted","Data":"4b7888fadcde9e93bb1317c492c76a29eb0fbf3d2c6fd27303604b57a0172711"} May 26 15:23:32.303592 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:32.303564 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-57tdf" event={"ID":"f031b6fb-d2d8-40fa-a5b8-8962b62e9f37","Type":"ContainerStarted","Data":"85548ae2af0354709cc7d8bb2b1be8b1ee1aa1200757df19d7dc169a5ec5ba72"} May 26 15:23:32.567738 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:32.567609 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0748d4e5-f906-42ba-8f02-543c7cdde1da-cert\") pod \"ingress-canary-qnqmv\" (UID: \"0748d4e5-f906-42ba-8f02-543c7cdde1da\") " pod="openshift-ingress-canary/ingress-canary-qnqmv" May 26 15:23:32.567894 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:32.567788 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a538280e-ec4c-477b-a61a-cdb23e4f91cb-metrics-tls\") pod \"dns-default-9zv2j\" (UID: \"a538280e-ec4c-477b-a61a-cdb23e4f91cb\") " pod="openshift-dns/dns-default-9zv2j" May 26 15:23:32.570094 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:32.570065 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a538280e-ec4c-477b-a61a-cdb23e4f91cb-metrics-tls\") pod \"dns-default-9zv2j\" (UID: \"a538280e-ec4c-477b-a61a-cdb23e4f91cb\") " pod="openshift-dns/dns-default-9zv2j" May 26 15:23:32.570243 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:32.570208 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0748d4e5-f906-42ba-8f02-543c7cdde1da-cert\") pod \"ingress-canary-qnqmv\" (UID: \"0748d4e5-f906-42ba-8f02-543c7cdde1da\") " pod="openshift-ingress-canary/ingress-canary-qnqmv" May 26 15:23:32.793437 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:32.793404 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pt65f\"" May 26 15:23:32.794425 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:32.794410 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-smt4m\"" May 26 15:23:32.801277 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:32.801262 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9zv2j" May 26 15:23:32.801358 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:32.801262 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qnqmv" May 26 15:23:32.936968 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:32.936929 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qnqmv"] May 26 15:23:32.939911 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:23:32.939884 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0748d4e5_f906_42ba_8f02_543c7cdde1da.slice/crio-dd52eadcbf404fa74bda6378539a81b041b71bcce0406f6599bca11e63c18fe9 WatchSource:0}: Error finding container dd52eadcbf404fa74bda6378539a81b041b71bcce0406f6599bca11e63c18fe9: Status 404 returned error can't find the container with id dd52eadcbf404fa74bda6378539a81b041b71bcce0406f6599bca11e63c18fe9 May 26 15:23:32.951458 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:32.951434 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9zv2j"] May 26 15:23:32.955408 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:23:32.955386 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda538280e_ec4c_477b_a61a_cdb23e4f91cb.slice/crio-37fdc5721d517d806729062c797c56972208be6f9c343a11617331dacb704e6f WatchSource:0}: Error finding container 37fdc5721d517d806729062c797c56972208be6f9c343a11617331dacb704e6f: Status 404 returned error can't find the container with id 37fdc5721d517d806729062c797c56972208be6f9c343a11617331dacb704e6f May 26 15:23:33.310118 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:33.310072 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qnqmv" event={"ID":"0748d4e5-f906-42ba-8f02-543c7cdde1da","Type":"ContainerStarted","Data":"dd52eadcbf404fa74bda6378539a81b041b71bcce0406f6599bca11e63c18fe9"} May 26 15:23:33.311743 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:33.311647 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-57tdf" event={"ID":"f031b6fb-d2d8-40fa-a5b8-8962b62e9f37","Type":"ContainerStarted","Data":"956d4fd22ad825bb35eb1aa664c3734c55e783c0b0b57a9c5c09c9ef55fecdb2"} May 26 15:23:33.312998 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:33.312974 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9zv2j" event={"ID":"a538280e-ec4c-477b-a61a-cdb23e4f91cb","Type":"ContainerStarted","Data":"37fdc5721d517d806729062c797c56972208be6f9c343a11617331dacb704e6f"} May 26 15:23:33.328479 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:33.328421 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-57tdf" podStartSLOduration=18.389543647 podStartE2EDuration="20.32840595s" podCreationTimestamp="2026-05-26 15:23:13 +0000 UTC" firstStartedPulling="2026-05-26 15:23:30.298878847 +0000 UTC m=+161.122895644" lastFinishedPulling="2026-05-26 15:23:32.237741147 +0000 UTC m=+163.061757947" observedRunningTime="2026-05-26 15:23:33.327175666 +0000 UTC m=+164.151192487" watchObservedRunningTime="2026-05-26 15:23:33.32840595 +0000 UTC m=+164.152422770" May 26 15:23:35.319648 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:35.319604 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qnqmv" event={"ID":"0748d4e5-f906-42ba-8f02-543c7cdde1da","Type":"ContainerStarted","Data":"8bc2eab5d7b46a3fbab74f606acc4fc8671b2b16ce2aaa47f2aedc613f04b092"} May 26 15:23:35.321131 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:35.321108 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9zv2j" event={"ID":"a538280e-ec4c-477b-a61a-cdb23e4f91cb","Type":"ContainerStarted","Data":"e2400362d1750b94522f43c7a71ad385c1fa10b8c143ef47953fdecd0360f91b"} May 26 15:23:35.321244 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:35.321135 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9zv2j" event={"ID":"a538280e-ec4c-477b-a61a-cdb23e4f91cb","Type":"ContainerStarted","Data":"daa21143448a3579c43da84f5cb7172148993a82145fc370e2091207df92e7d0"} May 26 15:23:35.321282 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:35.321250 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9zv2j" May 26 15:23:35.334615 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:35.334552 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qnqmv" podStartSLOduration=129.544425468 podStartE2EDuration="2m11.334541045s" podCreationTimestamp="2026-05-26 15:21:24 +0000 UTC" firstStartedPulling="2026-05-26 15:23:32.941879153 +0000 UTC m=+163.765895952" lastFinishedPulling="2026-05-26 15:23:34.731994728 +0000 UTC m=+165.556011529" observedRunningTime="2026-05-26 15:23:35.334465906 +0000 UTC m=+166.158482726" watchObservedRunningTime="2026-05-26 15:23:35.334541045 +0000 UTC m=+166.158557864" May 26 15:23:35.350870 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:35.350820 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-9zv2j" podStartSLOduration=129.579692182 podStartE2EDuration="2m11.350806137s" podCreationTimestamp="2026-05-26 15:21:24 +0000 UTC" firstStartedPulling="2026-05-26 15:23:32.957295651 +0000 UTC m=+163.781312448" lastFinishedPulling="2026-05-26 15:23:34.728409601 +0000 UTC m=+165.552426403" observedRunningTime="2026-05-26 15:23:35.350314339 +0000 UTC m=+166.174331159" watchObservedRunningTime="2026-05-26 15:23:35.350806137 +0000 UTC m=+166.174822954" May 26 15:23:38.766529 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:38.766480 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7v4tq" May 26 15:23:41.429959 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:41.429927 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6696bcccc7-j6z8n"] May 26 15:23:41.451970 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:41.451934 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ll9c5"] May 26 15:23:41.456805 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:41.456782 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ll9c5" May 26 15:23:41.459426 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:41.459404 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 26 15:23:41.459551 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:41.459482 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nz49q\"" May 26 15:23:41.459707 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:41.459692 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 26 15:23:41.459784 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:41.459689 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 26 15:23:41.460037 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:41.460024 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 26 15:23:41.466586 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:41.466563 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ll9c5"] May 26 15:23:41.538764 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:41.538729 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nts9c\" (UniqueName: \"kubernetes.io/projected/9d214483-c3b0-4ae3-9a2f-4d8c7d90a881-kube-api-access-nts9c\") pod \"insights-runtime-extractor-ll9c5\" (UID: \"9d214483-c3b0-4ae3-9a2f-4d8c7d90a881\") " pod="openshift-insights/insights-runtime-extractor-ll9c5" May 26 15:23:41.538955 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:41.538785 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9d214483-c3b0-4ae3-9a2f-4d8c7d90a881-crio-socket\") pod \"insights-runtime-extractor-ll9c5\" (UID: \"9d214483-c3b0-4ae3-9a2f-4d8c7d90a881\") " pod="openshift-insights/insights-runtime-extractor-ll9c5" May 26 15:23:41.538955 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:41.538843 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d214483-c3b0-4ae3-9a2f-4d8c7d90a881-data-volume\") pod \"insights-runtime-extractor-ll9c5\" (UID: \"9d214483-c3b0-4ae3-9a2f-4d8c7d90a881\") " pod="openshift-insights/insights-runtime-extractor-ll9c5" May 26 15:23:41.538955 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:41.538870 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9d214483-c3b0-4ae3-9a2f-4d8c7d90a881-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ll9c5\" (UID: \"9d214483-c3b0-4ae3-9a2f-4d8c7d90a881\") " pod="openshift-insights/insights-runtime-extractor-ll9c5" May 26 15:23:41.538955 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:41.538892 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9d214483-c3b0-4ae3-9a2f-4d8c7d90a881-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ll9c5\" (UID: \"9d214483-c3b0-4ae3-9a2f-4d8c7d90a881\") " pod="openshift-insights/insights-runtime-extractor-ll9c5" May 26 15:23:41.639758 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:41.639717 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nts9c\" (UniqueName: \"kubernetes.io/projected/9d214483-c3b0-4ae3-9a2f-4d8c7d90a881-kube-api-access-nts9c\") pod \"insights-runtime-extractor-ll9c5\" (UID: \"9d214483-c3b0-4ae3-9a2f-4d8c7d90a881\") " pod="openshift-insights/insights-runtime-extractor-ll9c5" May 26 15:23:41.639937 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:41.639775 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9d214483-c3b0-4ae3-9a2f-4d8c7d90a881-crio-socket\") pod \"insights-runtime-extractor-ll9c5\" (UID: \"9d214483-c3b0-4ae3-9a2f-4d8c7d90a881\") " pod="openshift-insights/insights-runtime-extractor-ll9c5" May 26 15:23:41.639937 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:41.639805 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d214483-c3b0-4ae3-9a2f-4d8c7d90a881-data-volume\") pod \"insights-runtime-extractor-ll9c5\" (UID: \"9d214483-c3b0-4ae3-9a2f-4d8c7d90a881\") " pod="openshift-insights/insights-runtime-extractor-ll9c5" May 26 15:23:41.639937 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:41.639825 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9d214483-c3b0-4ae3-9a2f-4d8c7d90a881-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ll9c5\" (UID: \"9d214483-c3b0-4ae3-9a2f-4d8c7d90a881\") " pod="openshift-insights/insights-runtime-extractor-ll9c5" May 26 15:23:41.639937 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:41.639846 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9d214483-c3b0-4ae3-9a2f-4d8c7d90a881-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ll9c5\" (UID: \"9d214483-c3b0-4ae3-9a2f-4d8c7d90a881\") " pod="openshift-insights/insights-runtime-extractor-ll9c5" May 26 15:23:41.640081 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:41.639937 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9d214483-c3b0-4ae3-9a2f-4d8c7d90a881-crio-socket\") pod \"insights-runtime-extractor-ll9c5\" (UID: \"9d214483-c3b0-4ae3-9a2f-4d8c7d90a881\") " pod="openshift-insights/insights-runtime-extractor-ll9c5" May 26 15:23:41.640205 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:41.640186 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d214483-c3b0-4ae3-9a2f-4d8c7d90a881-data-volume\") pod \"insights-runtime-extractor-ll9c5\" (UID: \"9d214483-c3b0-4ae3-9a2f-4d8c7d90a881\") " pod="openshift-insights/insights-runtime-extractor-ll9c5" May 26 15:23:41.640360 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:41.640338 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9d214483-c3b0-4ae3-9a2f-4d8c7d90a881-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ll9c5\" (UID: \"9d214483-c3b0-4ae3-9a2f-4d8c7d90a881\") " pod="openshift-insights/insights-runtime-extractor-ll9c5" May 26 15:23:41.642230 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:41.642207 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9d214483-c3b0-4ae3-9a2f-4d8c7d90a881-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ll9c5\" (UID: \"9d214483-c3b0-4ae3-9a2f-4d8c7d90a881\") " pod="openshift-insights/insights-runtime-extractor-ll9c5" May 26 15:23:41.648207 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:41.648182 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nts9c\" (UniqueName: \"kubernetes.io/projected/9d214483-c3b0-4ae3-9a2f-4d8c7d90a881-kube-api-access-nts9c\") pod \"insights-runtime-extractor-ll9c5\" (UID: \"9d214483-c3b0-4ae3-9a2f-4d8c7d90a881\") " pod="openshift-insights/insights-runtime-extractor-ll9c5" May 26 15:23:41.766096 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:41.766003 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ll9c5" May 26 15:23:41.888856 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:41.888800 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ll9c5"] May 26 15:23:41.892369 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:23:41.892342 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d214483_c3b0_4ae3_9a2f_4d8c7d90a881.slice/crio-f3a26599461c1406a3490a777ed0da00a7381041bad5d59efe9596f3663c92f1 WatchSource:0}: Error finding container f3a26599461c1406a3490a777ed0da00a7381041bad5d59efe9596f3663c92f1: Status 404 returned error can't find the container with id f3a26599461c1406a3490a777ed0da00a7381041bad5d59efe9596f3663c92f1 May 26 15:23:42.340291 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:42.340252 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ll9c5" event={"ID":"9d214483-c3b0-4ae3-9a2f-4d8c7d90a881","Type":"ContainerStarted","Data":"564b23018da55f1c376eae8d75db8f7d03aae790e48d75eeaf6422eb3c543335"} May 26 15:23:42.340291 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:42.340296 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ll9c5" event={"ID":"9d214483-c3b0-4ae3-9a2f-4d8c7d90a881","Type":"ContainerStarted","Data":"f3a26599461c1406a3490a777ed0da00a7381041bad5d59efe9596f3663c92f1"} May 26 15:23:43.345144 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:43.345091 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ll9c5" event={"ID":"9d214483-c3b0-4ae3-9a2f-4d8c7d90a881","Type":"ContainerStarted","Data":"70e038ca0130b315958678dd9d9974c691de76ab704caf49b03317c095907c1b"} May 26 15:23:44.349153 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:44.349115 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ll9c5" event={"ID":"9d214483-c3b0-4ae3-9a2f-4d8c7d90a881","Type":"ContainerStarted","Data":"53c2ca9bad310bb69732fed5474dd292d75ae4dbb6f9a235f84d25eef1c4e0db"} May 26 15:23:44.365065 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:44.365004 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ll9c5" podStartSLOduration=1.120654116 podStartE2EDuration="3.364989635s" podCreationTimestamp="2026-05-26 15:23:41 +0000 UTC" firstStartedPulling="2026-05-26 15:23:41.948417937 +0000 UTC m=+172.772434735" lastFinishedPulling="2026-05-26 15:23:44.192753457 +0000 UTC m=+175.016770254" observedRunningTime="2026-05-26 15:23:44.364623929 +0000 UTC m=+175.188640752" watchObservedRunningTime="2026-05-26 15:23:44.364989635 +0000 UTC m=+175.189006456" May 26 15:23:45.326157 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:45.326131 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9zv2j" May 26 15:23:45.774946 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:45.774915 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0eed844c-87f5-403c-846c-6a0d177f47db-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-zl9fs\" (UID: \"0eed844c-87f5-403c-846c-6a0d177f47db\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zl9fs" May 26 15:23:45.777284 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:45.777258 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0eed844c-87f5-403c-846c-6a0d177f47db-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-zl9fs\" (UID: \"0eed844c-87f5-403c-846c-6a0d177f47db\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zl9fs" May 26 15:23:45.944940 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:45.944882 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zl9fs" May 26 15:23:46.066847 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:46.066766 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-zl9fs"] May 26 15:23:46.069862 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:23:46.069833 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eed844c_87f5_403c_846c_6a0d177f47db.slice/crio-03ef61eeb01349063d4050adf65f14dcdf7ffa15703ce4487b847a698d6e178a WatchSource:0}: Error finding container 03ef61eeb01349063d4050adf65f14dcdf7ffa15703ce4487b847a698d6e178a: Status 404 returned error can't find the container with id 03ef61eeb01349063d4050adf65f14dcdf7ffa15703ce4487b847a698d6e178a May 26 15:23:46.355554 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:46.355467 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zl9fs" event={"ID":"0eed844c-87f5-403c-846c-6a0d177f47db","Type":"ContainerStarted","Data":"03ef61eeb01349063d4050adf65f14dcdf7ffa15703ce4487b847a698d6e178a"} May 26 15:23:48.832165 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:48.832133 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-tcxcb"] May 26 15:23:48.835140 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:48.835123 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-tcxcb" May 26 15:23:48.837558 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:48.837535 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" May 26 15:23:48.837708 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:48.837538 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-rbmsr\"" May 26 15:23:48.842009 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:48.841989 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-tcxcb"] May 26 15:23:48.901876 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:48.901830 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/42f03e67-583d-43a7-8b1b-55aa466bc589-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-tcxcb\" (UID: \"42f03e67-583d-43a7-8b1b-55aa466bc589\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-tcxcb" May 26 15:23:49.002876 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:49.002839 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/42f03e67-583d-43a7-8b1b-55aa466bc589-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-tcxcb\" (UID: \"42f03e67-583d-43a7-8b1b-55aa466bc589\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-tcxcb" May 26 15:23:49.003045 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:23:49.002967 2566 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found May 26 15:23:49.003045 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:23:49.003022 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42f03e67-583d-43a7-8b1b-55aa466bc589-tls-certificates podName:42f03e67-583d-43a7-8b1b-55aa466bc589 nodeName:}" failed. No retries permitted until 2026-05-26 15:23:49.503008142 +0000 UTC m=+180.327024940 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/42f03e67-583d-43a7-8b1b-55aa466bc589-tls-certificates") pod "prometheus-operator-admission-webhook-6c4bbc67b7-tcxcb" (UID: "42f03e67-583d-43a7-8b1b-55aa466bc589") : secret "prometheus-operator-admission-webhook-tls" not found May 26 15:23:49.366084 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:49.366045 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zl9fs" event={"ID":"0eed844c-87f5-403c-846c-6a0d177f47db","Type":"ContainerStarted","Data":"0143d28534f2f71d5a9ef924e53ab3a42cbf9735c0442f6d4d370634654a526f"} May 26 15:23:49.382704 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:49.382636 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-zl9fs" podStartSLOduration=34.084449246 podStartE2EDuration="36.382623155s" podCreationTimestamp="2026-05-26 15:23:13 +0000 UTC" firstStartedPulling="2026-05-26 15:23:46.071750003 +0000 UTC m=+176.895766806" lastFinishedPulling="2026-05-26 15:23:48.369923912 +0000 UTC m=+179.193940715" observedRunningTime="2026-05-26 15:23:49.38190946 +0000 UTC m=+180.205926281" watchObservedRunningTime="2026-05-26 15:23:49.382623155 +0000 UTC m=+180.206639974" May 26 15:23:49.506556 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:49.506515 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/42f03e67-583d-43a7-8b1b-55aa466bc589-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-tcxcb\" (UID: \"42f03e67-583d-43a7-8b1b-55aa466bc589\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-tcxcb" May 26 15:23:49.508986 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:49.508964 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/42f03e67-583d-43a7-8b1b-55aa466bc589-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-tcxcb\" (UID: \"42f03e67-583d-43a7-8b1b-55aa466bc589\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-tcxcb" May 26 15:23:49.748205 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:49.748172 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-rbmsr\"" May 26 15:23:49.755816 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:49.755788 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-tcxcb" May 26 15:23:49.878055 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:49.878018 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-tcxcb"] May 26 15:23:49.881235 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:23:49.881210 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42f03e67_583d_43a7_8b1b_55aa466bc589.slice/crio-b6bc3d799c22ba2190c36f9cbb1a2efdfca526fa74405d1082ebb92f8a1d5711 WatchSource:0}: Error finding container b6bc3d799c22ba2190c36f9cbb1a2efdfca526fa74405d1082ebb92f8a1d5711: Status 404 returned error can't find the container with id b6bc3d799c22ba2190c36f9cbb1a2efdfca526fa74405d1082ebb92f8a1d5711 May 26 15:23:50.370144 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:50.370109 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-tcxcb" event={"ID":"42f03e67-583d-43a7-8b1b-55aa466bc589","Type":"ContainerStarted","Data":"b6bc3d799c22ba2190c36f9cbb1a2efdfca526fa74405d1082ebb92f8a1d5711"} May 26 15:23:51.374293 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:51.374253 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-tcxcb" event={"ID":"42f03e67-583d-43a7-8b1b-55aa466bc589","Type":"ContainerStarted","Data":"cb110a3323387c77c136f4577734b819b7019dba9b2c8540d6c6f8f8489cc684"} May 26 15:23:51.374778 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:51.374501 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-tcxcb" May 26 15:23:51.379247 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:51.379222 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-tcxcb" May 26 15:23:51.390204 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:51.390157 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-tcxcb" podStartSLOduration=2.080940627 podStartE2EDuration="3.390145449s" podCreationTimestamp="2026-05-26 15:23:48 +0000 UTC" firstStartedPulling="2026-05-26 15:23:49.883392232 +0000 UTC m=+180.707409030" lastFinishedPulling="2026-05-26 15:23:51.19259704 +0000 UTC m=+182.016613852" observedRunningTime="2026-05-26 15:23:51.388630103 +0000 UTC m=+182.212646923" watchObservedRunningTime="2026-05-26 15:23:51.390145449 +0000 UTC m=+182.214162305" May 26 15:23:51.435537 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:51.435507 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6696bcccc7-j6z8n" May 26 15:23:51.887149 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:51.887116 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-m9rqw"] May 26 15:23:51.890294 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:51.890279 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-m9rqw" May 26 15:23:51.892943 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:51.892923 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" May 26 15:23:51.893055 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:51.892988 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" May 26 15:23:51.893982 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:51.893965 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-w42j6\"" May 26 15:23:51.893982 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:51.893967 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 26 15:23:51.901544 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:51.901522 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-m9rqw"] May 26 15:23:52.025794 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:52.025763 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c13bd2d0-638e-4c4d-910a-74c32387a889-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-m9rqw\" (UID: \"c13bd2d0-638e-4c4d-910a-74c32387a889\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-m9rqw" May 26 15:23:52.025968 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:52.025811 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c13bd2d0-638e-4c4d-910a-74c32387a889-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-m9rqw\" (UID: \"c13bd2d0-638e-4c4d-910a-74c32387a889\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-m9rqw" May 26 15:23:52.025968 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:52.025866 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c13bd2d0-638e-4c4d-910a-74c32387a889-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-m9rqw\" (UID: \"c13bd2d0-638e-4c4d-910a-74c32387a889\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-m9rqw" May 26 15:23:52.025968 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:52.025889 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg8bn\" (UniqueName: \"kubernetes.io/projected/c13bd2d0-638e-4c4d-910a-74c32387a889-kube-api-access-kg8bn\") pod \"prometheus-operator-7779bbdd78-m9rqw\" (UID: \"c13bd2d0-638e-4c4d-910a-74c32387a889\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-m9rqw" May 26 15:23:52.126393 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:52.126356 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c13bd2d0-638e-4c4d-910a-74c32387a889-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-m9rqw\" (UID: \"c13bd2d0-638e-4c4d-910a-74c32387a889\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-m9rqw" May 26 15:23:52.126575 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:52.126404 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c13bd2d0-638e-4c4d-910a-74c32387a889-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-m9rqw\" (UID: \"c13bd2d0-638e-4c4d-910a-74c32387a889\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-m9rqw" May 26 15:23:52.126575 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:52.126428 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kg8bn\" (UniqueName: \"kubernetes.io/projected/c13bd2d0-638e-4c4d-910a-74c32387a889-kube-api-access-kg8bn\") pod \"prometheus-operator-7779bbdd78-m9rqw\" (UID: \"c13bd2d0-638e-4c4d-910a-74c32387a889\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-m9rqw" May 26 15:23:52.126575 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:52.126482 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c13bd2d0-638e-4c4d-910a-74c32387a889-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-m9rqw\" (UID: \"c13bd2d0-638e-4c4d-910a-74c32387a889\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-m9rqw" May 26 15:23:52.127216 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:52.127185 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c13bd2d0-638e-4c4d-910a-74c32387a889-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-m9rqw\" (UID: \"c13bd2d0-638e-4c4d-910a-74c32387a889\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-m9rqw" May 26 15:23:52.128894 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:52.128869 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c13bd2d0-638e-4c4d-910a-74c32387a889-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-m9rqw\" (UID: \"c13bd2d0-638e-4c4d-910a-74c32387a889\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-m9rqw" May 26 15:23:52.128982 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:52.128912 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c13bd2d0-638e-4c4d-910a-74c32387a889-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-m9rqw\" (UID: \"c13bd2d0-638e-4c4d-910a-74c32387a889\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-m9rqw" May 26 15:23:52.134616 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:52.134594 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg8bn\" (UniqueName: \"kubernetes.io/projected/c13bd2d0-638e-4c4d-910a-74c32387a889-kube-api-access-kg8bn\") pod \"prometheus-operator-7779bbdd78-m9rqw\" (UID: \"c13bd2d0-638e-4c4d-910a-74c32387a889\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-m9rqw" May 26 15:23:52.199739 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:52.199707 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-m9rqw" May 26 15:23:52.318238 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:52.318098 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-m9rqw"] May 26 15:23:52.320721 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:23:52.320689 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc13bd2d0_638e_4c4d_910a_74c32387a889.slice/crio-e14c07e51062789ae599fa1b789fb2428a06a3ce6bc3a4e67de2bea2de29029b WatchSource:0}: Error finding container e14c07e51062789ae599fa1b789fb2428a06a3ce6bc3a4e67de2bea2de29029b: Status 404 returned error can't find the container with id e14c07e51062789ae599fa1b789fb2428a06a3ce6bc3a4e67de2bea2de29029b May 26 15:23:52.378450 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:52.378413 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-m9rqw" event={"ID":"c13bd2d0-638e-4c4d-910a-74c32387a889","Type":"ContainerStarted","Data":"e14c07e51062789ae599fa1b789fb2428a06a3ce6bc3a4e67de2bea2de29029b"} May 26 15:23:54.385725 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:54.385607 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-m9rqw" event={"ID":"c13bd2d0-638e-4c4d-910a-74c32387a889","Type":"ContainerStarted","Data":"48e6722c63eb25e35ab0851cccf57b735f6abcfdcfc8ae095c4f521d272108fe"} May 26 15:23:54.385725 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:54.385650 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-m9rqw" event={"ID":"c13bd2d0-638e-4c4d-910a-74c32387a889","Type":"ContainerStarted","Data":"7fcd7f2d6c314a892ff7f99e378f5d11defc40096616aeb07a5422f23d04811e"} May 26 15:23:54.404685 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:54.404626 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-m9rqw" podStartSLOduration=1.609964761 podStartE2EDuration="3.404612824s" podCreationTimestamp="2026-05-26 15:23:51 +0000 UTC" firstStartedPulling="2026-05-26 15:23:52.322564145 +0000 UTC m=+183.146580943" lastFinishedPulling="2026-05-26 15:23:54.117212209 +0000 UTC m=+184.941229006" observedRunningTime="2026-05-26 15:23:54.40306536 +0000 UTC m=+185.227082202" watchObservedRunningTime="2026-05-26 15:23:54.404612824 +0000 UTC m=+185.228629643" May 26 15:23:56.235685 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.235637 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-82bs9"] May 26 15:23:56.238988 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.238967 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-82bs9" May 26 15:23:56.241316 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.241292 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" May 26 15:23:56.241472 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.241456 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" May 26 15:23:56.241511 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.241460 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-kvnbj\"" May 26 15:23:56.250530 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.250505 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-b2qb9"] May 26 15:23:56.253623 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.253601 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-82bs9"] May 26 15:23:56.253776 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.253761 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-b2qb9" May 26 15:23:56.256187 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.256166 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 26 15:23:56.256293 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.256274 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 26 15:23:56.256377 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.256338 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5nr68\"" May 26 15:23:56.256617 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.256602 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 26 15:23:56.359623 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.359587 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64jf7\" (UniqueName: \"kubernetes.io/projected/649403a6-7d72-497d-b6fe-dcbdbd4e8af4-kube-api-access-64jf7\") pod \"openshift-state-metrics-9c959559f-82bs9\" (UID: \"649403a6-7d72-497d-b6fe-dcbdbd4e8af4\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-82bs9" May 26 15:23:56.359805 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.359648 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/656d13a7-2e82-4f26-90d1-7deac8d18093-root\") pod \"node-exporter-b2qb9\" (UID: \"656d13a7-2e82-4f26-90d1-7deac8d18093\") " pod="openshift-monitoring/node-exporter-b2qb9" May 26 15:23:56.359805 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.359701 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/656d13a7-2e82-4f26-90d1-7deac8d18093-node-exporter-accelerators-collector-config\") pod \"node-exporter-b2qb9\" (UID: \"656d13a7-2e82-4f26-90d1-7deac8d18093\") " pod="openshift-monitoring/node-exporter-b2qb9" May 26 15:23:56.359805 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.359725 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/656d13a7-2e82-4f26-90d1-7deac8d18093-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b2qb9\" (UID: \"656d13a7-2e82-4f26-90d1-7deac8d18093\") " pod="openshift-monitoring/node-exporter-b2qb9" May 26 15:23:56.359805 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.359743 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/656d13a7-2e82-4f26-90d1-7deac8d18093-node-exporter-tls\") pod \"node-exporter-b2qb9\" (UID: \"656d13a7-2e82-4f26-90d1-7deac8d18093\") " pod="openshift-monitoring/node-exporter-b2qb9" May 26 15:23:56.359805 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.359775 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/656d13a7-2e82-4f26-90d1-7deac8d18093-node-exporter-textfile\") pod \"node-exporter-b2qb9\" (UID: \"656d13a7-2e82-4f26-90d1-7deac8d18093\") " pod="openshift-monitoring/node-exporter-b2qb9" May 26 15:23:56.359805 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.359798 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/656d13a7-2e82-4f26-90d1-7deac8d18093-sys\") pod \"node-exporter-b2qb9\" (UID: \"656d13a7-2e82-4f26-90d1-7deac8d18093\") " pod="openshift-monitoring/node-exporter-b2qb9" May 26 15:23:56.360059 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.359814 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/656d13a7-2e82-4f26-90d1-7deac8d18093-node-exporter-wtmp\") pod \"node-exporter-b2qb9\" (UID: \"656d13a7-2e82-4f26-90d1-7deac8d18093\") " pod="openshift-monitoring/node-exporter-b2qb9" May 26 15:23:56.360059 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.359833 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/649403a6-7d72-497d-b6fe-dcbdbd4e8af4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-82bs9\" (UID: \"649403a6-7d72-497d-b6fe-dcbdbd4e8af4\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-82bs9" May 26 15:23:56.360059 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.359861 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/656d13a7-2e82-4f26-90d1-7deac8d18093-metrics-client-ca\") pod \"node-exporter-b2qb9\" (UID: \"656d13a7-2e82-4f26-90d1-7deac8d18093\") " pod="openshift-monitoring/node-exporter-b2qb9" May 26 15:23:56.360059 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.359904 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/649403a6-7d72-497d-b6fe-dcbdbd4e8af4-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-82bs9\" (UID: \"649403a6-7d72-497d-b6fe-dcbdbd4e8af4\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-82bs9" May 26 15:23:56.360059 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.359993 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7drwr\" (UniqueName: \"kubernetes.io/projected/656d13a7-2e82-4f26-90d1-7deac8d18093-kube-api-access-7drwr\") pod \"node-exporter-b2qb9\" (UID: \"656d13a7-2e82-4f26-90d1-7deac8d18093\") " pod="openshift-monitoring/node-exporter-b2qb9" May 26 15:23:56.360059 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.360018 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/649403a6-7d72-497d-b6fe-dcbdbd4e8af4-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-82bs9\" (UID: \"649403a6-7d72-497d-b6fe-dcbdbd4e8af4\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-82bs9" May 26 15:23:56.461232 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.461194 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7drwr\" (UniqueName: \"kubernetes.io/projected/656d13a7-2e82-4f26-90d1-7deac8d18093-kube-api-access-7drwr\") pod \"node-exporter-b2qb9\" (UID: \"656d13a7-2e82-4f26-90d1-7deac8d18093\") " pod="openshift-monitoring/node-exporter-b2qb9" May 26 15:23:56.461232 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.461234 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/649403a6-7d72-497d-b6fe-dcbdbd4e8af4-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-82bs9\" (UID: \"649403a6-7d72-497d-b6fe-dcbdbd4e8af4\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-82bs9" May 26 15:23:56.461471 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.461255 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-64jf7\" (UniqueName: \"kubernetes.io/projected/649403a6-7d72-497d-b6fe-dcbdbd4e8af4-kube-api-access-64jf7\") pod \"openshift-state-metrics-9c959559f-82bs9\" (UID: \"649403a6-7d72-497d-b6fe-dcbdbd4e8af4\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-82bs9" May 26 15:23:56.461471 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.461292 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/656d13a7-2e82-4f26-90d1-7deac8d18093-root\") pod \"node-exporter-b2qb9\" (UID: \"656d13a7-2e82-4f26-90d1-7deac8d18093\") " pod="openshift-monitoring/node-exporter-b2qb9" May 26 15:23:56.461471 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.461309 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/656d13a7-2e82-4f26-90d1-7deac8d18093-node-exporter-accelerators-collector-config\") pod \"node-exporter-b2qb9\" (UID: \"656d13a7-2e82-4f26-90d1-7deac8d18093\") " pod="openshift-monitoring/node-exporter-b2qb9" May 26 15:23:56.461471 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.461330 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/656d13a7-2e82-4f26-90d1-7deac8d18093-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b2qb9\" (UID: \"656d13a7-2e82-4f26-90d1-7deac8d18093\") " pod="openshift-monitoring/node-exporter-b2qb9" May 26 15:23:56.461471 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.461352 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/656d13a7-2e82-4f26-90d1-7deac8d18093-node-exporter-tls\") pod \"node-exporter-b2qb9\" (UID: \"656d13a7-2e82-4f26-90d1-7deac8d18093\") " pod="openshift-monitoring/node-exporter-b2qb9" May 26 15:23:56.461471 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.461389 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/656d13a7-2e82-4f26-90d1-7deac8d18093-root\") pod \"node-exporter-b2qb9\" (UID: \"656d13a7-2e82-4f26-90d1-7deac8d18093\") " pod="openshift-monitoring/node-exporter-b2qb9" May 26 15:23:56.461804 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.461507 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/656d13a7-2e82-4f26-90d1-7deac8d18093-node-exporter-textfile\") pod \"node-exporter-b2qb9\" (UID: \"656d13a7-2e82-4f26-90d1-7deac8d18093\") " pod="openshift-monitoring/node-exporter-b2qb9" May 26 15:23:56.461804 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.461548 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/656d13a7-2e82-4f26-90d1-7deac8d18093-sys\") pod \"node-exporter-b2qb9\" (UID: \"656d13a7-2e82-4f26-90d1-7deac8d18093\") " pod="openshift-monitoring/node-exporter-b2qb9" May 26 15:23:56.461804 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.461576 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/656d13a7-2e82-4f26-90d1-7deac8d18093-node-exporter-wtmp\") pod \"node-exporter-b2qb9\" (UID: \"656d13a7-2e82-4f26-90d1-7deac8d18093\") " pod="openshift-monitoring/node-exporter-b2qb9" May 26 15:23:56.461804 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.461612 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/649403a6-7d72-497d-b6fe-dcbdbd4e8af4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-82bs9\" (UID: \"649403a6-7d72-497d-b6fe-dcbdbd4e8af4\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-82bs9" May 26 15:23:56.461804 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.461698 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/656d13a7-2e82-4f26-90d1-7deac8d18093-sys\") pod \"node-exporter-b2qb9\" (UID: \"656d13a7-2e82-4f26-90d1-7deac8d18093\") " pod="openshift-monitoring/node-exporter-b2qb9" May 26 15:23:56.461804 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:23:56.461717 2566 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found May 26 15:23:56.461804 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.461742 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/656d13a7-2e82-4f26-90d1-7deac8d18093-metrics-client-ca\") pod \"node-exporter-b2qb9\" (UID: \"656d13a7-2e82-4f26-90d1-7deac8d18093\") " pod="openshift-monitoring/node-exporter-b2qb9" May 26 15:23:56.461804 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:23:56.461786 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/649403a6-7d72-497d-b6fe-dcbdbd4e8af4-openshift-state-metrics-tls podName:649403a6-7d72-497d-b6fe-dcbdbd4e8af4 nodeName:}" failed. No retries permitted until 2026-05-26 15:23:56.961766964 +0000 UTC m=+187.785783763 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/649403a6-7d72-497d-b6fe-dcbdbd4e8af4-openshift-state-metrics-tls") pod "openshift-state-metrics-9c959559f-82bs9" (UID: "649403a6-7d72-497d-b6fe-dcbdbd4e8af4") : secret "openshift-state-metrics-tls" not found May 26 15:23:56.462194 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.461807 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/649403a6-7d72-497d-b6fe-dcbdbd4e8af4-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-82bs9\" (UID: \"649403a6-7d72-497d-b6fe-dcbdbd4e8af4\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-82bs9" May 26 15:23:56.462194 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.461855 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/656d13a7-2e82-4f26-90d1-7deac8d18093-node-exporter-textfile\") pod \"node-exporter-b2qb9\" (UID: \"656d13a7-2e82-4f26-90d1-7deac8d18093\") " pod="openshift-monitoring/node-exporter-b2qb9" May 26 15:23:56.462194 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.461995 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/649403a6-7d72-497d-b6fe-dcbdbd4e8af4-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-82bs9\" (UID: \"649403a6-7d72-497d-b6fe-dcbdbd4e8af4\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-82bs9" May 26 15:23:56.462194 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.462006 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/656d13a7-2e82-4f26-90d1-7deac8d18093-node-exporter-wtmp\") pod \"node-exporter-b2qb9\" (UID: \"656d13a7-2e82-4f26-90d1-7deac8d18093\") " pod="openshift-monitoring/node-exporter-b2qb9" May 26 15:23:56.462194 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.462060 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/656d13a7-2e82-4f26-90d1-7deac8d18093-node-exporter-accelerators-collector-config\") pod \"node-exporter-b2qb9\" (UID: \"656d13a7-2e82-4f26-90d1-7deac8d18093\") " pod="openshift-monitoring/node-exporter-b2qb9" May 26 15:23:56.462443 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.462419 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/656d13a7-2e82-4f26-90d1-7deac8d18093-metrics-client-ca\") pod \"node-exporter-b2qb9\" (UID: \"656d13a7-2e82-4f26-90d1-7deac8d18093\") " pod="openshift-monitoring/node-exporter-b2qb9" May 26 15:23:56.463861 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.463840 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/656d13a7-2e82-4f26-90d1-7deac8d18093-node-exporter-tls\") pod \"node-exporter-b2qb9\" (UID: \"656d13a7-2e82-4f26-90d1-7deac8d18093\") " pod="openshift-monitoring/node-exporter-b2qb9" May 26 15:23:56.463973 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.463874 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/656d13a7-2e82-4f26-90d1-7deac8d18093-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b2qb9\" (UID: \"656d13a7-2e82-4f26-90d1-7deac8d18093\") " pod="openshift-monitoring/node-exporter-b2qb9" May 26 15:23:56.464034 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.464001 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/649403a6-7d72-497d-b6fe-dcbdbd4e8af4-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-82bs9\" (UID: \"649403a6-7d72-497d-b6fe-dcbdbd4e8af4\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-82bs9" May 26 15:23:56.470205 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.470182 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7drwr\" (UniqueName: \"kubernetes.io/projected/656d13a7-2e82-4f26-90d1-7deac8d18093-kube-api-access-7drwr\") pod \"node-exporter-b2qb9\" (UID: \"656d13a7-2e82-4f26-90d1-7deac8d18093\") " pod="openshift-monitoring/node-exporter-b2qb9" May 26 15:23:56.470332 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.470204 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64jf7\" (UniqueName: \"kubernetes.io/projected/649403a6-7d72-497d-b6fe-dcbdbd4e8af4-kube-api-access-64jf7\") pod \"openshift-state-metrics-9c959559f-82bs9\" (UID: \"649403a6-7d72-497d-b6fe-dcbdbd4e8af4\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-82bs9" May 26 15:23:56.562310 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.562222 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-b2qb9" May 26 15:23:56.571511 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:23:56.571483 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod656d13a7_2e82_4f26_90d1_7deac8d18093.slice/crio-2b765255e0e0136de3a18a81d2b7ae1838ef578e335e97833f9657180c857edb WatchSource:0}: Error finding container 2b765255e0e0136de3a18a81d2b7ae1838ef578e335e97833f9657180c857edb: Status 404 returned error can't find the container with id 2b765255e0e0136de3a18a81d2b7ae1838ef578e335e97833f9657180c857edb May 26 15:23:56.965975 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.965937 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/649403a6-7d72-497d-b6fe-dcbdbd4e8af4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-82bs9\" (UID: \"649403a6-7d72-497d-b6fe-dcbdbd4e8af4\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-82bs9" May 26 15:23:56.968277 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:56.968256 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/649403a6-7d72-497d-b6fe-dcbdbd4e8af4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-82bs9\" (UID: \"649403a6-7d72-497d-b6fe-dcbdbd4e8af4\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-82bs9" May 26 15:23:57.147491 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.147426 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-82bs9" May 26 15:23:57.294248 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.294207 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 26 15:23:57.299043 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:23:57.299011 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod649403a6_7d72_497d_b6fe_dcbdbd4e8af4.slice/crio-c859005a6d8f1eeddd8a0b55acdc2101ff0f446493e65762fa2d15c012aca9e4 WatchSource:0}: Error finding container c859005a6d8f1eeddd8a0b55acdc2101ff0f446493e65762fa2d15c012aca9e4: Status 404 returned error can't find the container with id c859005a6d8f1eeddd8a0b55acdc2101ff0f446493e65762fa2d15c012aca9e4 May 26 15:23:57.299541 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.299520 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-82bs9"] May 26 15:23:57.299733 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.299720 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 26 15:23:57.305023 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.305002 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 26 15:23:57.305168 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.305056 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 26 15:23:57.305168 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.305146 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 26 15:23:57.305312 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.305182 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 26 15:23:57.305312 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.305059 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 26 15:23:57.305312 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.305286 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 26 15:23:57.305545 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.305405 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 26 15:23:57.305545 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.304999 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 26 15:23:57.305545 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.305536 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 26 15:23:57.305705 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.305590 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bcgx2\"" May 26 15:23:57.313128 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.313108 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 26 15:23:57.400510 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.400465 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b2qb9" event={"ID":"656d13a7-2e82-4f26-90d1-7deac8d18093","Type":"ContainerStarted","Data":"2b765255e0e0136de3a18a81d2b7ae1838ef578e335e97833f9657180c857edb"} May 26 15:23:57.404479 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.404447 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-82bs9" event={"ID":"649403a6-7d72-497d-b6fe-dcbdbd4e8af4","Type":"ContainerStarted","Data":"a908e776c114d27f86869a3fe884cb1e0cd3abf15106a7c73fbd963caae739af"} May 26 15:23:57.404588 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.404489 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-82bs9" event={"ID":"649403a6-7d72-497d-b6fe-dcbdbd4e8af4","Type":"ContainerStarted","Data":"c859005a6d8f1eeddd8a0b55acdc2101ff0f446493e65762fa2d15c012aca9e4"} May 26 15:23:57.469756 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.469714 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/86b8017e-839d-46c6-866c-41233bc34634-tls-assets\") pod \"alertmanager-main-0\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:23:57.469930 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.469761 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86b8017e-839d-46c6-866c-41233bc34634-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:23:57.469930 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.469873 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgxqs\" (UniqueName: \"kubernetes.io/projected/86b8017e-839d-46c6-866c-41233bc34634-kube-api-access-tgxqs\") pod \"alertmanager-main-0\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:23:57.469930 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.469921 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/86b8017e-839d-46c6-866c-41233bc34634-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:23:57.470096 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.469982 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/86b8017e-839d-46c6-866c-41233bc34634-config-volume\") pod \"alertmanager-main-0\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:23:57.470096 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.470009 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/86b8017e-839d-46c6-866c-41233bc34634-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:23:57.470096 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.470039 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/86b8017e-839d-46c6-866c-41233bc34634-web-config\") pod \"alertmanager-main-0\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:23:57.470096 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.470070 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/86b8017e-839d-46c6-866c-41233bc34634-config-out\") pod \"alertmanager-main-0\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:23:57.470244 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.470094 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/86b8017e-839d-46c6-866c-41233bc34634-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:23:57.470244 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.470174 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86b8017e-839d-46c6-866c-41233bc34634-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:23:57.470244 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.470213 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/86b8017e-839d-46c6-866c-41233bc34634-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:23:57.470335 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.470245 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/86b8017e-839d-46c6-866c-41233bc34634-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:23:57.470335 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.470273 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/86b8017e-839d-46c6-866c-41233bc34634-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:23:57.573899 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.571541 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/86b8017e-839d-46c6-866c-41233bc34634-tls-assets\") pod \"alertmanager-main-0\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:23:57.573899 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.571598 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86b8017e-839d-46c6-866c-41233bc34634-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:23:57.573899 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.571682 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tgxqs\" (UniqueName: \"kubernetes.io/projected/86b8017e-839d-46c6-866c-41233bc34634-kube-api-access-tgxqs\") pod \"alertmanager-main-0\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:23:57.573899 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.571719 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/86b8017e-839d-46c6-866c-41233bc34634-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:23:57.573899 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.571771 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/86b8017e-839d-46c6-866c-41233bc34634-config-volume\") pod \"alertmanager-main-0\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:23:57.573899 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.571802 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/86b8017e-839d-46c6-866c-41233bc34634-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:23:57.573899 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.571833 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/86b8017e-839d-46c6-866c-41233bc34634-web-config\") pod \"alertmanager-main-0\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:23:57.573899 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.571865 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/86b8017e-839d-46c6-866c-41233bc34634-config-out\") pod \"alertmanager-main-0\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:23:57.573899 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.571899 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/86b8017e-839d-46c6-866c-41233bc34634-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:23:57.573899 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.571946 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86b8017e-839d-46c6-866c-41233bc34634-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:23:57.573899 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.571979 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/86b8017e-839d-46c6-866c-41233bc34634-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:23:57.573899 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.572019 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/86b8017e-839d-46c6-866c-41233bc34634-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:23:57.573899 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.572057 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/86b8017e-839d-46c6-866c-41233bc34634-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:23:57.573899 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.573894 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/86b8017e-839d-46c6-866c-41233bc34634-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:23:57.574751 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.574701 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86b8017e-839d-46c6-866c-41233bc34634-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:23:57.576274 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.576246 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86b8017e-839d-46c6-866c-41233bc34634-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:23:57.579464 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.578898 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/86b8017e-839d-46c6-866c-41233bc34634-config-volume\") pod \"alertmanager-main-0\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:23:57.579464 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.578954 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/86b8017e-839d-46c6-866c-41233bc34634-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:23:57.580386 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.580306 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/86b8017e-839d-46c6-866c-41233bc34634-config-out\") pod \"alertmanager-main-0\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:23:57.580475 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.580386 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/86b8017e-839d-46c6-866c-41233bc34634-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:23:57.580604 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.580584 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/86b8017e-839d-46c6-866c-41233bc34634-tls-assets\") pod \"alertmanager-main-0\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:23:57.581077 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.581038 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/86b8017e-839d-46c6-866c-41233bc34634-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:23:57.581302 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.581280 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/86b8017e-839d-46c6-866c-41233bc34634-web-config\") pod \"alertmanager-main-0\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:23:57.581466 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.581342 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/86b8017e-839d-46c6-866c-41233bc34634-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:23:57.581570 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.581416 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/86b8017e-839d-46c6-866c-41233bc34634-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:23:57.583492 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.583469 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgxqs\" (UniqueName: \"kubernetes.io/projected/86b8017e-839d-46c6-866c-41233bc34634-kube-api-access-tgxqs\") pod \"alertmanager-main-0\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:23:57.612491 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.612448 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 26 15:23:57.774429 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:57.774319 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 26 15:23:58.410656 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:58.409901 2566 generic.go:358] "Generic (PLEG): container finished" podID="656d13a7-2e82-4f26-90d1-7deac8d18093" containerID="6b7ad4f3bf6030fef4b4f3f845daf6d01f2f15aac6fcc337c386de0e3a4d08c0" exitCode=0 May 26 15:23:58.410656 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:58.410088 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b2qb9" event={"ID":"656d13a7-2e82-4f26-90d1-7deac8d18093","Type":"ContainerDied","Data":"6b7ad4f3bf6030fef4b4f3f845daf6d01f2f15aac6fcc337c386de0e3a4d08c0"} May 26 15:23:58.413337 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:58.413303 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-82bs9" event={"ID":"649403a6-7d72-497d-b6fe-dcbdbd4e8af4","Type":"ContainerStarted","Data":"629f8279e91ffceb188c37eebfa4fdffe064cefedab7e61d35d14cb87806a839"} May 26 15:23:58.414781 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:58.414737 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"86b8017e-839d-46c6-866c-41233bc34634","Type":"ContainerStarted","Data":"a2b2c6911744dedbfc8d5c45b2580daf9fe6793c3030552370b92be62487e4e6"} May 26 15:23:59.398302 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:59.398207 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-56484456c8-wbrxm"] May 26 15:23:59.401658 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:59.401633 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-56484456c8-wbrxm" May 26 15:23:59.404319 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:59.404291 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" May 26 15:23:59.404420 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:59.404297 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" May 26 15:23:59.404420 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:59.404302 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-7n2xf\"" May 26 15:23:59.404559 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:59.404537 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-25bij428cl14k\"" May 26 15:23:59.404750 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:59.404724 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" May 26 15:23:59.405339 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:59.405325 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" May 26 15:23:59.405515 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:59.405497 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" May 26 15:23:59.412519 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:59.412499 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-56484456c8-wbrxm"] May 26 15:23:59.420094 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:59.420066 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b2qb9" event={"ID":"656d13a7-2e82-4f26-90d1-7deac8d18093","Type":"ContainerStarted","Data":"880e7bdfa77d57f75f72c7e20222f302b5c73ec32037c444ec0974699315efc6"} May 26 15:23:59.420204 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:59.420100 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b2qb9" event={"ID":"656d13a7-2e82-4f26-90d1-7deac8d18093","Type":"ContainerStarted","Data":"92aab100ca8f78312e1889a2704aaf50b25534a6e7c276b7246597cd7c84c08d"} May 26 15:23:59.421845 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:59.421824 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-82bs9" event={"ID":"649403a6-7d72-497d-b6fe-dcbdbd4e8af4","Type":"ContainerStarted","Data":"ac807c744007ce69116d200a31573030532c177c6a27408a286ad393d32907b2"} May 26 15:23:59.423360 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:59.423333 2566 generic.go:358] "Generic (PLEG): container finished" podID="86b8017e-839d-46c6-866c-41233bc34634" containerID="9ec200b6b42ce9ac27f3b807e2001750226531ddd53f7e68a7d5065d2908f7f1" exitCode=0 May 26 15:23:59.423484 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:59.423372 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"86b8017e-839d-46c6-866c-41233bc34634","Type":"ContainerDied","Data":"9ec200b6b42ce9ac27f3b807e2001750226531ddd53f7e68a7d5065d2908f7f1"} May 26 15:23:59.456036 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:59.455990 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-82bs9" podStartSLOduration=2.400274616 podStartE2EDuration="3.455974051s" podCreationTimestamp="2026-05-26 15:23:56 +0000 UTC" firstStartedPulling="2026-05-26 15:23:57.440503552 +0000 UTC m=+188.264520353" lastFinishedPulling="2026-05-26 15:23:58.496202971 +0000 UTC m=+189.320219788" observedRunningTime="2026-05-26 15:23:59.455263301 +0000 UTC m=+190.279280125" watchObservedRunningTime="2026-05-26 15:23:59.455974051 +0000 UTC m=+190.279990871" May 26 15:23:59.474442 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:59.474392 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-b2qb9" podStartSLOduration=2.368275505 podStartE2EDuration="3.474376037s" podCreationTimestamp="2026-05-26 15:23:56 +0000 UTC" firstStartedPulling="2026-05-26 15:23:56.573519324 +0000 UTC m=+187.397536123" lastFinishedPulling="2026-05-26 15:23:57.679619842 +0000 UTC m=+188.503636655" observedRunningTime="2026-05-26 15:23:59.474112799 +0000 UTC m=+190.298129643" watchObservedRunningTime="2026-05-26 15:23:59.474376037 +0000 UTC m=+190.298392856" May 26 15:23:59.490443 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:59.490414 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f826df4-0674-4665-ba63-4c1ce848275d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-56484456c8-wbrxm\" (UID: \"8f826df4-0674-4665-ba63-4c1ce848275d\") " pod="openshift-monitoring/thanos-querier-56484456c8-wbrxm" May 26 15:23:59.490596 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:59.490447 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f826df4-0674-4665-ba63-4c1ce848275d-metrics-client-ca\") pod \"thanos-querier-56484456c8-wbrxm\" (UID: \"8f826df4-0674-4665-ba63-4c1ce848275d\") " pod="openshift-monitoring/thanos-querier-56484456c8-wbrxm" May 26 15:23:59.490596 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:59.490479 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phd92\" (UniqueName: \"kubernetes.io/projected/8f826df4-0674-4665-ba63-4c1ce848275d-kube-api-access-phd92\") pod \"thanos-querier-56484456c8-wbrxm\" (UID: \"8f826df4-0674-4665-ba63-4c1ce848275d\") " pod="openshift-monitoring/thanos-querier-56484456c8-wbrxm" May 26 15:23:59.490751 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:59.490593 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f826df4-0674-4665-ba63-4c1ce848275d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-56484456c8-wbrxm\" (UID: \"8f826df4-0674-4665-ba63-4c1ce848275d\") " pod="openshift-monitoring/thanos-querier-56484456c8-wbrxm" May 26 15:23:59.490751 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:59.490639 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8f826df4-0674-4665-ba63-4c1ce848275d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-56484456c8-wbrxm\" (UID: \"8f826df4-0674-4665-ba63-4c1ce848275d\") " pod="openshift-monitoring/thanos-querier-56484456c8-wbrxm" May 26 15:23:59.490751 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:59.490687 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8f826df4-0674-4665-ba63-4c1ce848275d-secret-thanos-querier-tls\") pod \"thanos-querier-56484456c8-wbrxm\" (UID: \"8f826df4-0674-4665-ba63-4c1ce848275d\") " pod="openshift-monitoring/thanos-querier-56484456c8-wbrxm" May 26 15:23:59.490751 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:59.490715 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8f826df4-0674-4665-ba63-4c1ce848275d-secret-grpc-tls\") pod \"thanos-querier-56484456c8-wbrxm\" (UID: \"8f826df4-0674-4665-ba63-4c1ce848275d\") " pod="openshift-monitoring/thanos-querier-56484456c8-wbrxm" May 26 15:23:59.490751 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:59.490745 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8f826df4-0674-4665-ba63-4c1ce848275d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-56484456c8-wbrxm\" (UID: \"8f826df4-0674-4665-ba63-4c1ce848275d\") " pod="openshift-monitoring/thanos-querier-56484456c8-wbrxm" May 26 15:23:59.591625 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:59.591591 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f826df4-0674-4665-ba63-4c1ce848275d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-56484456c8-wbrxm\" (UID: \"8f826df4-0674-4665-ba63-4c1ce848275d\") " pod="openshift-monitoring/thanos-querier-56484456c8-wbrxm" May 26 15:23:59.592117 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:59.591838 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8f826df4-0674-4665-ba63-4c1ce848275d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-56484456c8-wbrxm\" (UID: \"8f826df4-0674-4665-ba63-4c1ce848275d\") " pod="openshift-monitoring/thanos-querier-56484456c8-wbrxm" May 26 15:23:59.592117 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:59.591919 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8f826df4-0674-4665-ba63-4c1ce848275d-secret-thanos-querier-tls\") pod \"thanos-querier-56484456c8-wbrxm\" (UID: \"8f826df4-0674-4665-ba63-4c1ce848275d\") " pod="openshift-monitoring/thanos-querier-56484456c8-wbrxm" May 26 15:23:59.592117 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:59.591957 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8f826df4-0674-4665-ba63-4c1ce848275d-secret-grpc-tls\") pod \"thanos-querier-56484456c8-wbrxm\" (UID: \"8f826df4-0674-4665-ba63-4c1ce848275d\") " pod="openshift-monitoring/thanos-querier-56484456c8-wbrxm" May 26 15:23:59.592117 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:59.592102 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8f826df4-0674-4665-ba63-4c1ce848275d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-56484456c8-wbrxm\" (UID: \"8f826df4-0674-4665-ba63-4c1ce848275d\") " pod="openshift-monitoring/thanos-querier-56484456c8-wbrxm" May 26 15:23:59.592421 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:59.592207 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f826df4-0674-4665-ba63-4c1ce848275d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-56484456c8-wbrxm\" (UID: \"8f826df4-0674-4665-ba63-4c1ce848275d\") " pod="openshift-monitoring/thanos-querier-56484456c8-wbrxm" May 26 15:23:59.592421 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:59.592238 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f826df4-0674-4665-ba63-4c1ce848275d-metrics-client-ca\") pod \"thanos-querier-56484456c8-wbrxm\" (UID: \"8f826df4-0674-4665-ba63-4c1ce848275d\") " pod="openshift-monitoring/thanos-querier-56484456c8-wbrxm" May 26 15:23:59.592421 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:59.592378 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-phd92\" (UniqueName: \"kubernetes.io/projected/8f826df4-0674-4665-ba63-4c1ce848275d-kube-api-access-phd92\") pod \"thanos-querier-56484456c8-wbrxm\" (UID: \"8f826df4-0674-4665-ba63-4c1ce848275d\") " pod="openshift-monitoring/thanos-querier-56484456c8-wbrxm" May 26 15:23:59.594041 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:59.593379 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f826df4-0674-4665-ba63-4c1ce848275d-metrics-client-ca\") pod \"thanos-querier-56484456c8-wbrxm\" (UID: \"8f826df4-0674-4665-ba63-4c1ce848275d\") " pod="openshift-monitoring/thanos-querier-56484456c8-wbrxm" May 26 15:23:59.594755 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:59.594730 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f826df4-0674-4665-ba63-4c1ce848275d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-56484456c8-wbrxm\" (UID: \"8f826df4-0674-4665-ba63-4c1ce848275d\") " pod="openshift-monitoring/thanos-querier-56484456c8-wbrxm" May 26 15:23:59.594878 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:59.594826 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8f826df4-0674-4665-ba63-4c1ce848275d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-56484456c8-wbrxm\" (UID: \"8f826df4-0674-4665-ba63-4c1ce848275d\") " pod="openshift-monitoring/thanos-querier-56484456c8-wbrxm" May 26 15:23:59.594925 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:59.594909 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8f826df4-0674-4665-ba63-4c1ce848275d-secret-thanos-querier-tls\") pod \"thanos-querier-56484456c8-wbrxm\" (UID: \"8f826df4-0674-4665-ba63-4c1ce848275d\") " pod="openshift-monitoring/thanos-querier-56484456c8-wbrxm" May 26 15:23:59.595077 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:59.595053 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8f826df4-0674-4665-ba63-4c1ce848275d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-56484456c8-wbrxm\" (UID: \"8f826df4-0674-4665-ba63-4c1ce848275d\") " pod="openshift-monitoring/thanos-querier-56484456c8-wbrxm" May 26 15:23:59.595143 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:59.595127 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f826df4-0674-4665-ba63-4c1ce848275d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-56484456c8-wbrxm\" (UID: \"8f826df4-0674-4665-ba63-4c1ce848275d\") " pod="openshift-monitoring/thanos-querier-56484456c8-wbrxm" May 26 15:23:59.595324 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:59.595308 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8f826df4-0674-4665-ba63-4c1ce848275d-secret-grpc-tls\") pod \"thanos-querier-56484456c8-wbrxm\" (UID: \"8f826df4-0674-4665-ba63-4c1ce848275d\") " pod="openshift-monitoring/thanos-querier-56484456c8-wbrxm" May 26 15:23:59.602947 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:59.602925 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phd92\" (UniqueName: \"kubernetes.io/projected/8f826df4-0674-4665-ba63-4c1ce848275d-kube-api-access-phd92\") pod \"thanos-querier-56484456c8-wbrxm\" (UID: \"8f826df4-0674-4665-ba63-4c1ce848275d\") " pod="openshift-monitoring/thanos-querier-56484456c8-wbrxm" May 26 15:23:59.711282 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:59.711243 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-56484456c8-wbrxm" May 26 15:23:59.845311 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:23:59.845278 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-56484456c8-wbrxm"] May 26 15:23:59.848773 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:23:59.848744 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f826df4_0674_4665_ba63_4c1ce848275d.slice/crio-2476df2b64344060824cb9f5e55787673f43e210beadfb9d0f7fea007d394e44 WatchSource:0}: Error finding container 2476df2b64344060824cb9f5e55787673f43e210beadfb9d0f7fea007d394e44: Status 404 returned error can't find the container with id 2476df2b64344060824cb9f5e55787673f43e210beadfb9d0f7fea007d394e44 May 26 15:24:00.428906 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:00.428830 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56484456c8-wbrxm" event={"ID":"8f826df4-0674-4665-ba63-4c1ce848275d","Type":"ContainerStarted","Data":"2476df2b64344060824cb9f5e55787673f43e210beadfb9d0f7fea007d394e44"} May 26 15:24:01.434183 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:01.434150 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"86b8017e-839d-46c6-866c-41233bc34634","Type":"ContainerStarted","Data":"c13c1c4e372641e64f132f4a7052a527c9df127e6869243ad0f897f7d837cc86"} May 26 15:24:01.434183 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:01.434190 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"86b8017e-839d-46c6-866c-41233bc34634","Type":"ContainerStarted","Data":"d0a37a4599a8554f79050e6ac6514bad1d7f7e989d6d4dbee44479e0de9afa01"} May 26 15:24:01.451740 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:01.451708 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-67696c5675-5tvnt"] May 26 15:24:01.455266 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:01.455246 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-67696c5675-5tvnt" May 26 15:24:01.457745 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:01.457726 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" May 26 15:24:01.457898 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:01.457880 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" May 26 15:24:01.458144 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:01.458124 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" May 26 15:24:01.458230 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:01.458127 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" May 26 15:24:01.458230 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:01.458170 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" May 26 15:24:01.459076 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:01.459056 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-sj2z9\"" May 26 15:24:01.463479 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:01.463457 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" May 26 15:24:01.465284 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:01.465261 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-67696c5675-5tvnt"] May 26 15:24:01.610522 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:01.610477 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5682f4a2-29ce-458d-b7c3-b697301427dd-metrics-client-ca\") pod \"telemeter-client-67696c5675-5tvnt\" (UID: \"5682f4a2-29ce-458d-b7c3-b697301427dd\") " pod="openshift-monitoring/telemeter-client-67696c5675-5tvnt" May 26 15:24:01.610722 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:01.610533 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmhck\" (UniqueName: \"kubernetes.io/projected/5682f4a2-29ce-458d-b7c3-b697301427dd-kube-api-access-pmhck\") pod \"telemeter-client-67696c5675-5tvnt\" (UID: \"5682f4a2-29ce-458d-b7c3-b697301427dd\") " pod="openshift-monitoring/telemeter-client-67696c5675-5tvnt" May 26 15:24:01.610722 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:01.610629 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5682f4a2-29ce-458d-b7c3-b697301427dd-telemeter-client-tls\") pod \"telemeter-client-67696c5675-5tvnt\" (UID: \"5682f4a2-29ce-458d-b7c3-b697301427dd\") " pod="openshift-monitoring/telemeter-client-67696c5675-5tvnt" May 26 15:24:01.610722 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:01.610702 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5682f4a2-29ce-458d-b7c3-b697301427dd-federate-client-tls\") pod \"telemeter-client-67696c5675-5tvnt\" (UID: \"5682f4a2-29ce-458d-b7c3-b697301427dd\") " pod="openshift-monitoring/telemeter-client-67696c5675-5tvnt" May 26 15:24:01.610876 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:01.610776 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5682f4a2-29ce-458d-b7c3-b697301427dd-serving-certs-ca-bundle\") pod \"telemeter-client-67696c5675-5tvnt\" (UID: \"5682f4a2-29ce-458d-b7c3-b697301427dd\") " pod="openshift-monitoring/telemeter-client-67696c5675-5tvnt" May 26 15:24:01.610876 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:01.610798 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5682f4a2-29ce-458d-b7c3-b697301427dd-secret-telemeter-client\") pod \"telemeter-client-67696c5675-5tvnt\" (UID: \"5682f4a2-29ce-458d-b7c3-b697301427dd\") " pod="openshift-monitoring/telemeter-client-67696c5675-5tvnt" May 26 15:24:01.610876 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:01.610830 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5682f4a2-29ce-458d-b7c3-b697301427dd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67696c5675-5tvnt\" (UID: \"5682f4a2-29ce-458d-b7c3-b697301427dd\") " pod="openshift-monitoring/telemeter-client-67696c5675-5tvnt" May 26 15:24:01.611009 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:01.610906 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5682f4a2-29ce-458d-b7c3-b697301427dd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67696c5675-5tvnt\" (UID: \"5682f4a2-29ce-458d-b7c3-b697301427dd\") " pod="openshift-monitoring/telemeter-client-67696c5675-5tvnt" May 26 15:24:01.711634 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:01.711610 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5682f4a2-29ce-458d-b7c3-b697301427dd-metrics-client-ca\") pod \"telemeter-client-67696c5675-5tvnt\" (UID: \"5682f4a2-29ce-458d-b7c3-b697301427dd\") " pod="openshift-monitoring/telemeter-client-67696c5675-5tvnt" May 26 15:24:01.711766 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:01.711642 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pmhck\" (UniqueName: \"kubernetes.io/projected/5682f4a2-29ce-458d-b7c3-b697301427dd-kube-api-access-pmhck\") pod \"telemeter-client-67696c5675-5tvnt\" (UID: \"5682f4a2-29ce-458d-b7c3-b697301427dd\") " pod="openshift-monitoring/telemeter-client-67696c5675-5tvnt" May 26 15:24:01.711766 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:01.711687 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5682f4a2-29ce-458d-b7c3-b697301427dd-telemeter-client-tls\") pod \"telemeter-client-67696c5675-5tvnt\" (UID: \"5682f4a2-29ce-458d-b7c3-b697301427dd\") " pod="openshift-monitoring/telemeter-client-67696c5675-5tvnt" May 26 15:24:01.711877 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:01.711800 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5682f4a2-29ce-458d-b7c3-b697301427dd-federate-client-tls\") pod \"telemeter-client-67696c5675-5tvnt\" (UID: \"5682f4a2-29ce-458d-b7c3-b697301427dd\") " pod="openshift-monitoring/telemeter-client-67696c5675-5tvnt" May 26 15:24:01.711923 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:01.711881 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5682f4a2-29ce-458d-b7c3-b697301427dd-serving-certs-ca-bundle\") pod \"telemeter-client-67696c5675-5tvnt\" (UID: \"5682f4a2-29ce-458d-b7c3-b697301427dd\") " pod="openshift-monitoring/telemeter-client-67696c5675-5tvnt" May 26 15:24:01.711923 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:01.711907 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5682f4a2-29ce-458d-b7c3-b697301427dd-secret-telemeter-client\") pod \"telemeter-client-67696c5675-5tvnt\" (UID: \"5682f4a2-29ce-458d-b7c3-b697301427dd\") " pod="openshift-monitoring/telemeter-client-67696c5675-5tvnt" May 26 15:24:01.712006 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:01.711943 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5682f4a2-29ce-458d-b7c3-b697301427dd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67696c5675-5tvnt\" (UID: \"5682f4a2-29ce-458d-b7c3-b697301427dd\") " pod="openshift-monitoring/telemeter-client-67696c5675-5tvnt" May 26 15:24:01.712006 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:01.711992 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5682f4a2-29ce-458d-b7c3-b697301427dd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67696c5675-5tvnt\" (UID: \"5682f4a2-29ce-458d-b7c3-b697301427dd\") " pod="openshift-monitoring/telemeter-client-67696c5675-5tvnt" May 26 15:24:01.712404 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:01.712359 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5682f4a2-29ce-458d-b7c3-b697301427dd-metrics-client-ca\") pod \"telemeter-client-67696c5675-5tvnt\" (UID: \"5682f4a2-29ce-458d-b7c3-b697301427dd\") " pod="openshift-monitoring/telemeter-client-67696c5675-5tvnt" May 26 15:24:01.712515 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:01.712501 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5682f4a2-29ce-458d-b7c3-b697301427dd-serving-certs-ca-bundle\") pod \"telemeter-client-67696c5675-5tvnt\" (UID: \"5682f4a2-29ce-458d-b7c3-b697301427dd\") " pod="openshift-monitoring/telemeter-client-67696c5675-5tvnt" May 26 15:24:01.712798 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:01.712779 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5682f4a2-29ce-458d-b7c3-b697301427dd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67696c5675-5tvnt\" (UID: \"5682f4a2-29ce-458d-b7c3-b697301427dd\") " pod="openshift-monitoring/telemeter-client-67696c5675-5tvnt" May 26 15:24:01.714542 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:01.714497 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5682f4a2-29ce-458d-b7c3-b697301427dd-telemeter-client-tls\") pod \"telemeter-client-67696c5675-5tvnt\" (UID: \"5682f4a2-29ce-458d-b7c3-b697301427dd\") " pod="openshift-monitoring/telemeter-client-67696c5675-5tvnt" May 26 15:24:01.714542 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:01.714534 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5682f4a2-29ce-458d-b7c3-b697301427dd-federate-client-tls\") pod \"telemeter-client-67696c5675-5tvnt\" (UID: \"5682f4a2-29ce-458d-b7c3-b697301427dd\") " pod="openshift-monitoring/telemeter-client-67696c5675-5tvnt" May 26 15:24:01.714919 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:01.714891 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5682f4a2-29ce-458d-b7c3-b697301427dd-secret-telemeter-client\") pod \"telemeter-client-67696c5675-5tvnt\" (UID: \"5682f4a2-29ce-458d-b7c3-b697301427dd\") " pod="openshift-monitoring/telemeter-client-67696c5675-5tvnt" May 26 15:24:01.715094 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:01.715076 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5682f4a2-29ce-458d-b7c3-b697301427dd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67696c5675-5tvnt\" (UID: \"5682f4a2-29ce-458d-b7c3-b697301427dd\") " pod="openshift-monitoring/telemeter-client-67696c5675-5tvnt" May 26 15:24:01.719772 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:01.719750 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmhck\" (UniqueName: \"kubernetes.io/projected/5682f4a2-29ce-458d-b7c3-b697301427dd-kube-api-access-pmhck\") pod \"telemeter-client-67696c5675-5tvnt\" (UID: \"5682f4a2-29ce-458d-b7c3-b697301427dd\") " pod="openshift-monitoring/telemeter-client-67696c5675-5tvnt" May 26 15:24:01.775512 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:01.774864 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-67696c5675-5tvnt" May 26 15:24:01.934896 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:01.934867 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-67696c5675-5tvnt"] May 26 15:24:01.940851 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:24:01.940804 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5682f4a2_29ce_458d_b7c3_b697301427dd.slice/crio-0fc6cadc7151a06f2c516a70d086eac31c8189eea673c25a8ba8f2c3211ac124 WatchSource:0}: Error finding container 0fc6cadc7151a06f2c516a70d086eac31c8189eea673c25a8ba8f2c3211ac124: Status 404 returned error can't find the container with id 0fc6cadc7151a06f2c516a70d086eac31c8189eea673c25a8ba8f2c3211ac124 May 26 15:24:02.406410 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.406313 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 15:24:02.411326 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.411267 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.416623 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.416556 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2t0j6up3glv31\"" May 26 15:24:02.417137 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.416981 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 26 15:24:02.417137 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.417109 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 26 15:24:02.417486 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.417223 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 26 15:24:02.417486 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.417325 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 26 15:24:02.417887 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.417826 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 26 15:24:02.419914 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.418256 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 26 15:24:02.419914 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.418490 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 26 15:24:02.419914 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.418693 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 26 15:24:02.419914 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.419725 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-ppglb\"" May 26 15:24:02.421321 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.421293 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 26 15:24:02.421462 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.421445 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 26 15:24:02.421777 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.421609 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 15:24:02.421777 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.421620 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 26 15:24:02.421777 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.421709 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 26 15:24:02.424773 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.424575 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 26 15:24:02.446432 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.446393 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67696c5675-5tvnt" event={"ID":"5682f4a2-29ce-458d-b7c3-b697301427dd","Type":"ContainerStarted","Data":"0fc6cadc7151a06f2c516a70d086eac31c8189eea673c25a8ba8f2c3211ac124"} May 26 15:24:02.450908 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.450819 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"86b8017e-839d-46c6-866c-41233bc34634","Type":"ContainerStarted","Data":"0604b561095c0849b4c5406431eab3f2be07143df2e8ea95c7c08e5bf46f2a6f"} May 26 15:24:02.450908 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.450858 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"86b8017e-839d-46c6-866c-41233bc34634","Type":"ContainerStarted","Data":"b56464c65424f7957d0b877fb4d1c55a822319c4836bf6995f80b73607ca29bf"} May 26 15:24:02.450908 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.450874 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"86b8017e-839d-46c6-866c-41233bc34634","Type":"ContainerStarted","Data":"9abe8a8a313e033990e12ac49f671a3bc7543c581c1185d5243e2bc52ec666c4"} May 26 15:24:02.453934 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.453901 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56484456c8-wbrxm" event={"ID":"8f826df4-0674-4665-ba63-4c1ce848275d","Type":"ContainerStarted","Data":"74d6f2c992dc1fd049b0106e5539ce7b5917c75d3981f35dc3c2c7d15b089716"} May 26 15:24:02.454119 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.453939 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56484456c8-wbrxm" event={"ID":"8f826df4-0674-4665-ba63-4c1ce848275d","Type":"ContainerStarted","Data":"612b2249376007178ed2dc1aa7690274a56dc98ed111b31b9ec4f5bf264eb16b"} May 26 15:24:02.454119 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.453953 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56484456c8-wbrxm" event={"ID":"8f826df4-0674-4665-ba63-4c1ce848275d","Type":"ContainerStarted","Data":"723f904a53a033ee327254cd4cd502db1800f44dbb22795b09fe20cdf7c76005"} May 26 15:24:02.527467 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.526699 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.527467 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.526761 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.527467 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.526787 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50e16ebf-245b-4f8c-86ab-1cc04d05656e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.527467 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.526829 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-config\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.527467 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.526852 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.527467 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.526917 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/50e16ebf-245b-4f8c-86ab-1cc04d05656e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.527467 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.526942 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.527467 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.526982 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-web-config\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.527467 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.527025 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.527467 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.527052 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50e16ebf-245b-4f8c-86ab-1cc04d05656e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.527467 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.527074 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/50e16ebf-245b-4f8c-86ab-1cc04d05656e-config-out\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.527467 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.527104 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50e16ebf-245b-4f8c-86ab-1cc04d05656e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.527467 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.527138 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.527467 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.527166 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.527467 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.527187 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/50e16ebf-245b-4f8c-86ab-1cc04d05656e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.527467 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.527212 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/50e16ebf-245b-4f8c-86ab-1cc04d05656e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.528305 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.527233 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g59pl\" (UniqueName: \"kubernetes.io/projected/50e16ebf-245b-4f8c-86ab-1cc04d05656e-kube-api-access-g59pl\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.528305 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.527256 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50e16ebf-245b-4f8c-86ab-1cc04d05656e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.628355 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.628307 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.628355 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.628369 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50e16ebf-245b-4f8c-86ab-1cc04d05656e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.631079 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.628393 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/50e16ebf-245b-4f8c-86ab-1cc04d05656e-config-out\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.631079 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.628426 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50e16ebf-245b-4f8c-86ab-1cc04d05656e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.631079 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.628460 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.631079 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.629534 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50e16ebf-245b-4f8c-86ab-1cc04d05656e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.631079 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.629566 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50e16ebf-245b-4f8c-86ab-1cc04d05656e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.631079 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.629657 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.631079 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.629715 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/50e16ebf-245b-4f8c-86ab-1cc04d05656e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.631079 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.629744 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/50e16ebf-245b-4f8c-86ab-1cc04d05656e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.631079 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.629772 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g59pl\" (UniqueName: \"kubernetes.io/projected/50e16ebf-245b-4f8c-86ab-1cc04d05656e-kube-api-access-g59pl\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.631079 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.629799 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50e16ebf-245b-4f8c-86ab-1cc04d05656e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.631079 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.629826 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.631079 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.629853 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.631079 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.629875 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50e16ebf-245b-4f8c-86ab-1cc04d05656e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.631079 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.629920 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-config\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.631079 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.629945 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.631079 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.630018 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/50e16ebf-245b-4f8c-86ab-1cc04d05656e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.631079 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.630046 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.631896 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.630094 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-web-config\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.631896 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.631243 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/50e16ebf-245b-4f8c-86ab-1cc04d05656e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.632772 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.632515 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50e16ebf-245b-4f8c-86ab-1cc04d05656e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.632772 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.632650 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50e16ebf-245b-4f8c-86ab-1cc04d05656e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.638113 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.638086 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/50e16ebf-245b-4f8c-86ab-1cc04d05656e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.638235 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.638143 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.639335 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.639314 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/50e16ebf-245b-4f8c-86ab-1cc04d05656e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.639990 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.639893 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-web-config\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.640082 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.640065 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-config\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.640359 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.640332 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.640730 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.640710 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.640807 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.640750 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.640861 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.640840 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.641655 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.640931 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/50e16ebf-245b-4f8c-86ab-1cc04d05656e-config-out\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.641655 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.641049 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.643370 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.643329 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g59pl\" (UniqueName: \"kubernetes.io/projected/50e16ebf-245b-4f8c-86ab-1cc04d05656e-kube-api-access-g59pl\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.643892 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.643861 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.739728 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.739588 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:02.967686 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:02.967629 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 15:24:03.463372 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:03.463329 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56484456c8-wbrxm" event={"ID":"8f826df4-0674-4665-ba63-4c1ce848275d","Type":"ContainerStarted","Data":"d68e964f379b281d0c0b97029426b82f686a0be4e733bad229f47b05ea6ebd6c"} May 26 15:24:03.463372 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:03.463375 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56484456c8-wbrxm" event={"ID":"8f826df4-0674-4665-ba63-4c1ce848275d","Type":"ContainerStarted","Data":"d86b99abb194a32bd0607ccd84ca590bd11ef59c348691fea678c372243dbbaf"} May 26 15:24:03.463890 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:03.463390 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56484456c8-wbrxm" event={"ID":"8f826df4-0674-4665-ba63-4c1ce848275d","Type":"ContainerStarted","Data":"c3e75644c4d6ec31f7924f22e75732e4150d952a7a8c2d2bb6fb6a7f4811d3d1"} May 26 15:24:03.463890 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:03.463579 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-56484456c8-wbrxm" May 26 15:24:03.465134 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:03.464992 2566 generic.go:358] "Generic (PLEG): container finished" podID="50e16ebf-245b-4f8c-86ab-1cc04d05656e" containerID="1dc212010cfebf2c841c2b71644ce57ebd25f2a7554299eef70227755d5fa89b" exitCode=0 May 26 15:24:03.465134 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:03.465097 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50e16ebf-245b-4f8c-86ab-1cc04d05656e","Type":"ContainerDied","Data":"1dc212010cfebf2c841c2b71644ce57ebd25f2a7554299eef70227755d5fa89b"} May 26 15:24:03.465134 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:03.465130 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50e16ebf-245b-4f8c-86ab-1cc04d05656e","Type":"ContainerStarted","Data":"958c751ae47164f46f9258b880837b620d9bad02214b16f0fa836f2549692aed"} May 26 15:24:03.468712 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:03.468684 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"86b8017e-839d-46c6-866c-41233bc34634","Type":"ContainerStarted","Data":"f9288d258c612cc129076077bc8deb67122be716e30fa1d7aef4aefbe216670a"} May 26 15:24:03.494699 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:03.494260 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-56484456c8-wbrxm" podStartSLOduration=1.4599655409999999 podStartE2EDuration="4.494231945s" podCreationTimestamp="2026-05-26 15:23:59 +0000 UTC" firstStartedPulling="2026-05-26 15:23:59.850613888 +0000 UTC m=+190.674630700" lastFinishedPulling="2026-05-26 15:24:02.884880296 +0000 UTC m=+193.708897104" observedRunningTime="2026-05-26 15:24:03.491304107 +0000 UTC m=+194.315320964" watchObservedRunningTime="2026-05-26 15:24:03.494231945 +0000 UTC m=+194.318248765" May 26 15:24:03.550162 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:03.550111 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.436985054 podStartE2EDuration="6.550095775s" podCreationTimestamp="2026-05-26 15:23:57 +0000 UTC" firstStartedPulling="2026-05-26 15:23:57.774644463 +0000 UTC m=+188.598661262" lastFinishedPulling="2026-05-26 15:24:02.887755171 +0000 UTC m=+193.711771983" observedRunningTime="2026-05-26 15:24:03.548133522 +0000 UTC m=+194.372150351" watchObservedRunningTime="2026-05-26 15:24:03.550095775 +0000 UTC m=+194.374112649" May 26 15:24:04.473704 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:04.473637 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67696c5675-5tvnt" event={"ID":"5682f4a2-29ce-458d-b7c3-b697301427dd","Type":"ContainerStarted","Data":"1150bf5ee2a942c02ec6e4f583103db2ae65f1ca3ea1ad0fc8373d3f4046ed10"} May 26 15:24:04.473704 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:04.473706 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67696c5675-5tvnt" event={"ID":"5682f4a2-29ce-458d-b7c3-b697301427dd","Type":"ContainerStarted","Data":"94e842c80cdd7f197cd154b3639df4295f7a42674184b02d2955c4d5e066cfd2"} May 26 15:24:04.474236 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:04.473721 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67696c5675-5tvnt" event={"ID":"5682f4a2-29ce-458d-b7c3-b697301427dd","Type":"ContainerStarted","Data":"1f10ad85c1a9d3808fd80532ccdc7522019ee8a0f38e6375bc71b7ad3445a41b"} May 26 15:24:04.501698 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:04.501623 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-67696c5675-5tvnt" podStartSLOduration=1.661065415 podStartE2EDuration="3.501606177s" podCreationTimestamp="2026-05-26 15:24:01 +0000 UTC" firstStartedPulling="2026-05-26 15:24:01.942810879 +0000 UTC m=+192.766827684" lastFinishedPulling="2026-05-26 15:24:03.783351648 +0000 UTC m=+194.607368446" observedRunningTime="2026-05-26 15:24:04.499940723 +0000 UTC m=+195.323957544" watchObservedRunningTime="2026-05-26 15:24:04.501606177 +0000 UTC m=+195.325622998" May 26 15:24:06.450735 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:06.450563 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6696bcccc7-j6z8n" podUID="10b5a2b4-3b74-4691-9c81-0776a28dc0ac" containerName="registry" containerID="cri-o://2998920cde45fcb12d72e84c25dc8fef3d27c135e7084093947ad1aac44d7ca8" gracePeriod=30 May 26 15:24:06.486580 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:06.486531 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50e16ebf-245b-4f8c-86ab-1cc04d05656e","Type":"ContainerStarted","Data":"22eb560b0f4141c539d2e764f803f3a139a40ffb1a5981bd053114cb709ca6c9"} May 26 15:24:06.486739 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:06.486592 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50e16ebf-245b-4f8c-86ab-1cc04d05656e","Type":"ContainerStarted","Data":"73645e881b8b3acb11ea0807bafc3f2d7a5618eebd048267c440363b5977aba1"} May 26 15:24:06.486739 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:06.486608 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50e16ebf-245b-4f8c-86ab-1cc04d05656e","Type":"ContainerStarted","Data":"e2228b264b7ebf5d1464de31c4fd6bf1ce7659e1fc86d3058b3471f3c77b08bb"} May 26 15:24:06.701818 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:06.701795 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6696bcccc7-j6z8n" May 26 15:24:06.775835 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:06.775814 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dptf8\" (UniqueName: \"kubernetes.io/projected/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-kube-api-access-dptf8\") pod \"10b5a2b4-3b74-4691-9c81-0776a28dc0ac\" (UID: \"10b5a2b4-3b74-4691-9c81-0776a28dc0ac\") " May 26 15:24:06.775968 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:06.775865 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-image-registry-private-configuration\") pod \"10b5a2b4-3b74-4691-9c81-0776a28dc0ac\" (UID: \"10b5a2b4-3b74-4691-9c81-0776a28dc0ac\") " May 26 15:24:06.776027 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:06.775980 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-bound-sa-token\") pod \"10b5a2b4-3b74-4691-9c81-0776a28dc0ac\" (UID: \"10b5a2b4-3b74-4691-9c81-0776a28dc0ac\") " May 26 15:24:06.776027 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:06.776021 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-registry-tls\") pod \"10b5a2b4-3b74-4691-9c81-0776a28dc0ac\" (UID: \"10b5a2b4-3b74-4691-9c81-0776a28dc0ac\") " May 26 15:24:06.776138 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:06.776038 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-registry-certificates\") pod \"10b5a2b4-3b74-4691-9c81-0776a28dc0ac\" (UID: \"10b5a2b4-3b74-4691-9c81-0776a28dc0ac\") " May 26 15:24:06.776138 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:06.776067 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-ca-trust-extracted\") pod \"10b5a2b4-3b74-4691-9c81-0776a28dc0ac\" (UID: \"10b5a2b4-3b74-4691-9c81-0776a28dc0ac\") " May 26 15:24:06.776138 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:06.776122 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-installation-pull-secrets\") pod \"10b5a2b4-3b74-4691-9c81-0776a28dc0ac\" (UID: \"10b5a2b4-3b74-4691-9c81-0776a28dc0ac\") " May 26 15:24:06.776341 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:06.776167 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-trusted-ca\") pod \"10b5a2b4-3b74-4691-9c81-0776a28dc0ac\" (UID: \"10b5a2b4-3b74-4691-9c81-0776a28dc0ac\") " May 26 15:24:06.776549 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:06.776463 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "10b5a2b4-3b74-4691-9c81-0776a28dc0ac" (UID: "10b5a2b4-3b74-4691-9c81-0776a28dc0ac"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 15:24:06.776980 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:06.776816 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "10b5a2b4-3b74-4691-9c81-0776a28dc0ac" (UID: "10b5a2b4-3b74-4691-9c81-0776a28dc0ac"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 15:24:06.778527 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:06.778483 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "10b5a2b4-3b74-4691-9c81-0776a28dc0ac" (UID: "10b5a2b4-3b74-4691-9c81-0776a28dc0ac"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 15:24:06.778527 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:06.778494 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-kube-api-access-dptf8" (OuterVolumeSpecName: "kube-api-access-dptf8") pod "10b5a2b4-3b74-4691-9c81-0776a28dc0ac" (UID: "10b5a2b4-3b74-4691-9c81-0776a28dc0ac"). InnerVolumeSpecName "kube-api-access-dptf8". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 15:24:06.778702 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:06.778541 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "10b5a2b4-3b74-4691-9c81-0776a28dc0ac" (UID: "10b5a2b4-3b74-4691-9c81-0776a28dc0ac"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 15:24:06.778702 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:06.778548 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "10b5a2b4-3b74-4691-9c81-0776a28dc0ac" (UID: "10b5a2b4-3b74-4691-9c81-0776a28dc0ac"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 15:24:06.778838 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:06.778823 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "10b5a2b4-3b74-4691-9c81-0776a28dc0ac" (UID: "10b5a2b4-3b74-4691-9c81-0776a28dc0ac"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 15:24:06.784612 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:06.784590 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "10b5a2b4-3b74-4691-9c81-0776a28dc0ac" (UID: "10b5a2b4-3b74-4691-9c81-0776a28dc0ac"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 15:24:06.877185 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:06.877148 2566 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-installation-pull-secrets\") on node \"ip-10-0-129-103.ec2.internal\" DevicePath \"\"" May 26 15:24:06.877185 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:06.877178 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-trusted-ca\") on node \"ip-10-0-129-103.ec2.internal\" DevicePath \"\"" May 26 15:24:06.877185 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:06.877187 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dptf8\" (UniqueName: \"kubernetes.io/projected/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-kube-api-access-dptf8\") on node \"ip-10-0-129-103.ec2.internal\" DevicePath \"\"" May 26 15:24:06.877399 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:06.877197 2566 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-image-registry-private-configuration\") on node \"ip-10-0-129-103.ec2.internal\" DevicePath \"\"" May 26 15:24:06.877399 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:06.877208 2566 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-bound-sa-token\") on node \"ip-10-0-129-103.ec2.internal\" DevicePath \"\"" May 26 15:24:06.877399 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:06.877219 2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-registry-tls\") on node \"ip-10-0-129-103.ec2.internal\" DevicePath \"\"" May 26 15:24:06.877399 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:06.877226 2566 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-registry-certificates\") on node \"ip-10-0-129-103.ec2.internal\" DevicePath \"\"" May 26 15:24:06.877399 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:06.877234 2566 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/10b5a2b4-3b74-4691-9c81-0776a28dc0ac-ca-trust-extracted\") on node \"ip-10-0-129-103.ec2.internal\" DevicePath \"\"" May 26 15:24:07.493621 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:07.493522 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50e16ebf-245b-4f8c-86ab-1cc04d05656e","Type":"ContainerStarted","Data":"11c5cca0796985fdcf2fa78de1cbdaa1a57cd240ac9dad9f415c3acae629d3e4"} May 26 15:24:07.493621 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:07.493574 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50e16ebf-245b-4f8c-86ab-1cc04d05656e","Type":"ContainerStarted","Data":"d0b5cf6e3bd066a0fe909896bd8c0e053834a8c2a1b7ad4585f0c81ddb94ef4d"} May 26 15:24:07.493621 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:07.493589 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50e16ebf-245b-4f8c-86ab-1cc04d05656e","Type":"ContainerStarted","Data":"5fe6dd08345155b2a25358cfaf2953d9dac72070ecc22e8e63178c51432a269c"} May 26 15:24:07.494802 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:07.494773 2566 generic.go:358] "Generic (PLEG): container finished" podID="10b5a2b4-3b74-4691-9c81-0776a28dc0ac" containerID="2998920cde45fcb12d72e84c25dc8fef3d27c135e7084093947ad1aac44d7ca8" exitCode=0 May 26 15:24:07.495076 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:07.494943 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6696bcccc7-j6z8n" event={"ID":"10b5a2b4-3b74-4691-9c81-0776a28dc0ac","Type":"ContainerDied","Data":"2998920cde45fcb12d72e84c25dc8fef3d27c135e7084093947ad1aac44d7ca8"} May 26 15:24:07.495191 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:07.495177 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6696bcccc7-j6z8n" event={"ID":"10b5a2b4-3b74-4691-9c81-0776a28dc0ac","Type":"ContainerDied","Data":"5e830603ec7984fa24d3d320e9de786e54860e5ddb198bd698bee1b007a37b8c"} May 26 15:24:07.495302 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:07.495266 2566 scope.go:117] "RemoveContainer" containerID="2998920cde45fcb12d72e84c25dc8fef3d27c135e7084093947ad1aac44d7ca8" May 26 15:24:07.495453 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:07.495010 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6696bcccc7-j6z8n" May 26 15:24:07.505734 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:07.505714 2566 scope.go:117] "RemoveContainer" containerID="2998920cde45fcb12d72e84c25dc8fef3d27c135e7084093947ad1aac44d7ca8" May 26 15:24:07.506039 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:24:07.506020 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2998920cde45fcb12d72e84c25dc8fef3d27c135e7084093947ad1aac44d7ca8\": container with ID starting with 2998920cde45fcb12d72e84c25dc8fef3d27c135e7084093947ad1aac44d7ca8 not found: ID does not exist" containerID="2998920cde45fcb12d72e84c25dc8fef3d27c135e7084093947ad1aac44d7ca8" May 26 15:24:07.506102 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:07.506049 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2998920cde45fcb12d72e84c25dc8fef3d27c135e7084093947ad1aac44d7ca8"} err="failed to get container status \"2998920cde45fcb12d72e84c25dc8fef3d27c135e7084093947ad1aac44d7ca8\": rpc error: code = NotFound desc = could not find container \"2998920cde45fcb12d72e84c25dc8fef3d27c135e7084093947ad1aac44d7ca8\": container with ID starting with 2998920cde45fcb12d72e84c25dc8fef3d27c135e7084093947ad1aac44d7ca8 not found: ID does not exist" May 26 15:24:07.524489 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:07.523649 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.7686851199999998 podStartE2EDuration="5.523629054s" podCreationTimestamp="2026-05-26 15:24:02 +0000 UTC" firstStartedPulling="2026-05-26 15:24:03.466557971 +0000 UTC m=+194.290574768" lastFinishedPulling="2026-05-26 15:24:06.221501899 +0000 UTC m=+197.045518702" observedRunningTime="2026-05-26 15:24:07.521098322 +0000 UTC m=+198.345115149" watchObservedRunningTime="2026-05-26 15:24:07.523629054 +0000 UTC m=+198.347645876" May 26 15:24:07.533681 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:07.533642 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6696bcccc7-j6z8n"] May 26 15:24:07.543945 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:07.543913 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6696bcccc7-j6z8n"] May 26 15:24:07.740099 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:07.740058 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 26 15:24:07.770393 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:07.770297 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10b5a2b4-3b74-4691-9c81-0776a28dc0ac" path="/var/lib/kubelet/pods/10b5a2b4-3b74-4691-9c81-0776a28dc0ac/volumes" May 26 15:24:09.481055 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:09.481025 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-56484456c8-wbrxm" May 26 15:24:22.541866 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:22.541830 2566 generic.go:358] "Generic (PLEG): container finished" podID="e837500d-b8b7-4216-a212-39b44e868435" containerID="9bb3245305baa4847da978b777262271ee2e10b1b9ba27ab7ca90a1a2a13d847" exitCode=0 May 26 15:24:22.542262 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:22.541904 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sttlr" event={"ID":"e837500d-b8b7-4216-a212-39b44e868435","Type":"ContainerDied","Data":"9bb3245305baa4847da978b777262271ee2e10b1b9ba27ab7ca90a1a2a13d847"} May 26 15:24:22.542262 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:22.542242 2566 scope.go:117] "RemoveContainer" containerID="9bb3245305baa4847da978b777262271ee2e10b1b9ba27ab7ca90a1a2a13d847" May 26 15:24:23.546777 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:24:23.546734 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sttlr" event={"ID":"e837500d-b8b7-4216-a212-39b44e868435","Type":"ContainerStarted","Data":"085fc41ad88375948e3bc858909f9d8e852ef09881509a346fbd7721cde82d51"} May 26 15:25:01.689967 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:01.689879 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3822d872-a967-4800-8e87-c7d73d8f6c36-metrics-certs\") pod \"network-metrics-daemon-7v4tq\" (UID: \"3822d872-a967-4800-8e87-c7d73d8f6c36\") " pod="openshift-multus/network-metrics-daemon-7v4tq" May 26 15:25:01.692142 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:01.692108 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3822d872-a967-4800-8e87-c7d73d8f6c36-metrics-certs\") pod \"network-metrics-daemon-7v4tq\" (UID: \"3822d872-a967-4800-8e87-c7d73d8f6c36\") " pod="openshift-multus/network-metrics-daemon-7v4tq" May 26 15:25:01.870398 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:01.870366 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pgdkb\"" May 26 15:25:01.878558 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:01.878538 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7v4tq" May 26 15:25:02.005901 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:02.005866 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7v4tq"] May 26 15:25:02.018371 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:25:02.018339 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3822d872_a967_4800_8e87_c7d73d8f6c36.slice/crio-6d789ac277873e296a99687fce8c03770c27c5c577ef03971e64a8c01a24230c WatchSource:0}: Error finding container 6d789ac277873e296a99687fce8c03770c27c5c577ef03971e64a8c01a24230c: Status 404 returned error can't find the container with id 6d789ac277873e296a99687fce8c03770c27c5c577ef03971e64a8c01a24230c May 26 15:25:02.660547 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:02.660508 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7v4tq" event={"ID":"3822d872-a967-4800-8e87-c7d73d8f6c36","Type":"ContainerStarted","Data":"6d789ac277873e296a99687fce8c03770c27c5c577ef03971e64a8c01a24230c"} May 26 15:25:02.740497 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:02.740464 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:02.764252 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:02.764220 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:03.665084 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:03.665044 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7v4tq" event={"ID":"3822d872-a967-4800-8e87-c7d73d8f6c36","Type":"ContainerStarted","Data":"d0a9301aa3f4093a05ad705c9f442c1022ea1b2b78c59a2ff3aa2f583c0d76ce"} May 26 15:25:03.665268 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:03.665089 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7v4tq" event={"ID":"3822d872-a967-4800-8e87-c7d73d8f6c36","Type":"ContainerStarted","Data":"8dbd7569ccd0119bdd2d46ee6a5385da0b3fc3506d855919ab5eca22d6d1773d"} May 26 15:25:03.682119 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:03.682077 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:03.683886 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:03.683843 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7v4tq" podStartSLOduration=253.796598728 podStartE2EDuration="4m14.683829177s" podCreationTimestamp="2026-05-26 15:20:49 +0000 UTC" firstStartedPulling="2026-05-26 15:25:02.020308458 +0000 UTC m=+252.844325256" lastFinishedPulling="2026-05-26 15:25:02.907538907 +0000 UTC m=+253.731555705" observedRunningTime="2026-05-26 15:25:03.682583762 +0000 UTC m=+254.506600576" watchObservedRunningTime="2026-05-26 15:25:03.683829177 +0000 UTC m=+254.507845996" May 26 15:25:16.488657 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:16.488617 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 26 15:25:16.489222 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:16.489148 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="86b8017e-839d-46c6-866c-41233bc34634" containerName="alertmanager" containerID="cri-o://d0a37a4599a8554f79050e6ac6514bad1d7f7e989d6d4dbee44479e0de9afa01" gracePeriod=120 May 26 15:25:16.489222 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:16.489192 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="86b8017e-839d-46c6-866c-41233bc34634" containerName="kube-rbac-proxy-web" containerID="cri-o://9abe8a8a313e033990e12ac49f671a3bc7543c581c1185d5243e2bc52ec666c4" gracePeriod=120 May 26 15:25:16.489406 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:16.489198 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="86b8017e-839d-46c6-866c-41233bc34634" containerName="kube-rbac-proxy-metric" containerID="cri-o://0604b561095c0849b4c5406431eab3f2be07143df2e8ea95c7c08e5bf46f2a6f" gracePeriod=120 May 26 15:25:16.489406 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:16.489228 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="86b8017e-839d-46c6-866c-41233bc34634" containerName="config-reloader" containerID="cri-o://c13c1c4e372641e64f132f4a7052a527c9df127e6869243ad0f897f7d837cc86" gracePeriod=120 May 26 15:25:16.489406 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:16.489271 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="86b8017e-839d-46c6-866c-41233bc34634" containerName="prom-label-proxy" containerID="cri-o://f9288d258c612cc129076077bc8deb67122be716e30fa1d7aef4aefbe216670a" gracePeriod=120 May 26 15:25:16.489406 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:16.489229 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="86b8017e-839d-46c6-866c-41233bc34634" containerName="kube-rbac-proxy" containerID="cri-o://b56464c65424f7957d0b877fb4d1c55a822319c4836bf6995f80b73607ca29bf" gracePeriod=120 May 26 15:25:16.712110 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:16.712078 2566 generic.go:358] "Generic (PLEG): container finished" podID="86b8017e-839d-46c6-866c-41233bc34634" containerID="f9288d258c612cc129076077bc8deb67122be716e30fa1d7aef4aefbe216670a" exitCode=0 May 26 15:25:16.712110 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:16.712103 2566 generic.go:358] "Generic (PLEG): container finished" podID="86b8017e-839d-46c6-866c-41233bc34634" containerID="b56464c65424f7957d0b877fb4d1c55a822319c4836bf6995f80b73607ca29bf" exitCode=0 May 26 15:25:16.712110 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:16.712109 2566 generic.go:358] "Generic (PLEG): container finished" podID="86b8017e-839d-46c6-866c-41233bc34634" containerID="c13c1c4e372641e64f132f4a7052a527c9df127e6869243ad0f897f7d837cc86" exitCode=0 May 26 15:25:16.712110 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:16.712122 2566 generic.go:358] "Generic (PLEG): container finished" podID="86b8017e-839d-46c6-866c-41233bc34634" containerID="d0a37a4599a8554f79050e6ac6514bad1d7f7e989d6d4dbee44479e0de9afa01" exitCode=0 May 26 15:25:16.712384 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:16.712148 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"86b8017e-839d-46c6-866c-41233bc34634","Type":"ContainerDied","Data":"f9288d258c612cc129076077bc8deb67122be716e30fa1d7aef4aefbe216670a"} May 26 15:25:16.712384 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:16.712182 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"86b8017e-839d-46c6-866c-41233bc34634","Type":"ContainerDied","Data":"b56464c65424f7957d0b877fb4d1c55a822319c4836bf6995f80b73607ca29bf"} May 26 15:25:16.712384 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:16.712191 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"86b8017e-839d-46c6-866c-41233bc34634","Type":"ContainerDied","Data":"c13c1c4e372641e64f132f4a7052a527c9df127e6869243ad0f897f7d837cc86"} May 26 15:25:16.712384 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:16.712201 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"86b8017e-839d-46c6-866c-41233bc34634","Type":"ContainerDied","Data":"d0a37a4599a8554f79050e6ac6514bad1d7f7e989d6d4dbee44479e0de9afa01"} May 26 15:25:17.718197 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:17.718164 2566 generic.go:358] "Generic (PLEG): container finished" podID="86b8017e-839d-46c6-866c-41233bc34634" containerID="0604b561095c0849b4c5406431eab3f2be07143df2e8ea95c7c08e5bf46f2a6f" exitCode=0 May 26 15:25:17.718197 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:17.718187 2566 generic.go:358] "Generic (PLEG): container finished" podID="86b8017e-839d-46c6-866c-41233bc34634" containerID="9abe8a8a313e033990e12ac49f671a3bc7543c581c1185d5243e2bc52ec666c4" exitCode=0 May 26 15:25:17.718653 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:17.718220 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"86b8017e-839d-46c6-866c-41233bc34634","Type":"ContainerDied","Data":"0604b561095c0849b4c5406431eab3f2be07143df2e8ea95c7c08e5bf46f2a6f"} May 26 15:25:17.718653 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:17.718241 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"86b8017e-839d-46c6-866c-41233bc34634","Type":"ContainerDied","Data":"9abe8a8a313e033990e12ac49f671a3bc7543c581c1185d5243e2bc52ec666c4"} May 26 15:25:17.733572 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:17.733552 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 26 15:25:17.836922 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:17.836840 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/86b8017e-839d-46c6-866c-41233bc34634-secret-alertmanager-main-tls\") pod \"86b8017e-839d-46c6-866c-41233bc34634\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " May 26 15:25:17.836922 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:17.836878 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/86b8017e-839d-46c6-866c-41233bc34634-secret-alertmanager-kube-rbac-proxy\") pod \"86b8017e-839d-46c6-866c-41233bc34634\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " May 26 15:25:17.836922 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:17.836907 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86b8017e-839d-46c6-866c-41233bc34634-metrics-client-ca\") pod \"86b8017e-839d-46c6-866c-41233bc34634\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " May 26 15:25:17.836922 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:17.836925 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/86b8017e-839d-46c6-866c-41233bc34634-config-out\") pod \"86b8017e-839d-46c6-866c-41233bc34634\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " May 26 15:25:17.837204 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:17.837003 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/86b8017e-839d-46c6-866c-41233bc34634-alertmanager-main-db\") pod \"86b8017e-839d-46c6-866c-41233bc34634\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " May 26 15:25:17.837204 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:17.837047 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/86b8017e-839d-46c6-866c-41233bc34634-tls-assets\") pod \"86b8017e-839d-46c6-866c-41233bc34634\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " May 26 15:25:17.837204 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:17.837097 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/86b8017e-839d-46c6-866c-41233bc34634-secret-alertmanager-kube-rbac-proxy-web\") pod \"86b8017e-839d-46c6-866c-41233bc34634\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " May 26 15:25:17.837204 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:17.837138 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/86b8017e-839d-46c6-866c-41233bc34634-secret-alertmanager-kube-rbac-proxy-metric\") pod \"86b8017e-839d-46c6-866c-41233bc34634\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " May 26 15:25:17.837204 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:17.837172 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/86b8017e-839d-46c6-866c-41233bc34634-config-volume\") pod \"86b8017e-839d-46c6-866c-41233bc34634\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " May 26 15:25:17.837459 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:17.837216 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86b8017e-839d-46c6-866c-41233bc34634-alertmanager-trusted-ca-bundle\") pod \"86b8017e-839d-46c6-866c-41233bc34634\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " May 26 15:25:17.837459 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:17.837253 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tgxqs\" (UniqueName: \"kubernetes.io/projected/86b8017e-839d-46c6-866c-41233bc34634-kube-api-access-tgxqs\") pod \"86b8017e-839d-46c6-866c-41233bc34634\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " May 26 15:25:17.837459 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:17.837289 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/86b8017e-839d-46c6-866c-41233bc34634-web-config\") pod \"86b8017e-839d-46c6-866c-41233bc34634\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " May 26 15:25:17.837459 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:17.837308 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86b8017e-839d-46c6-866c-41233bc34634-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "86b8017e-839d-46c6-866c-41233bc34634" (UID: "86b8017e-839d-46c6-866c-41233bc34634"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 15:25:17.837459 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:17.837310 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86b8017e-839d-46c6-866c-41233bc34634-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "86b8017e-839d-46c6-866c-41233bc34634" (UID: "86b8017e-839d-46c6-866c-41233bc34634"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 15:25:17.837459 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:17.837341 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/86b8017e-839d-46c6-866c-41233bc34634-cluster-tls-config\") pod \"86b8017e-839d-46c6-866c-41233bc34634\" (UID: \"86b8017e-839d-46c6-866c-41233bc34634\") " May 26 15:25:17.837797 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:17.837593 2566 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86b8017e-839d-46c6-866c-41233bc34634-metrics-client-ca\") on node \"ip-10-0-129-103.ec2.internal\" DevicePath \"\"" May 26 15:25:17.837797 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:17.837611 2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/86b8017e-839d-46c6-866c-41233bc34634-alertmanager-main-db\") on node \"ip-10-0-129-103.ec2.internal\" DevicePath \"\"" May 26 15:25:17.838563 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:17.838230 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86b8017e-839d-46c6-866c-41233bc34634-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "86b8017e-839d-46c6-866c-41233bc34634" (UID: "86b8017e-839d-46c6-866c-41233bc34634"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 15:25:17.839891 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:17.839864 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86b8017e-839d-46c6-866c-41233bc34634-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "86b8017e-839d-46c6-866c-41233bc34634" (UID: "86b8017e-839d-46c6-866c-41233bc34634"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 15:25:17.839891 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:17.839866 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86b8017e-839d-46c6-866c-41233bc34634-kube-api-access-tgxqs" (OuterVolumeSpecName: "kube-api-access-tgxqs") pod "86b8017e-839d-46c6-866c-41233bc34634" (UID: "86b8017e-839d-46c6-866c-41233bc34634"). InnerVolumeSpecName "kube-api-access-tgxqs". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 15:25:17.840058 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:17.840009 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86b8017e-839d-46c6-866c-41233bc34634-config-volume" (OuterVolumeSpecName: "config-volume") pod "86b8017e-839d-46c6-866c-41233bc34634" (UID: "86b8017e-839d-46c6-866c-41233bc34634"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 15:25:17.840837 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:17.840814 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86b8017e-839d-46c6-866c-41233bc34634-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "86b8017e-839d-46c6-866c-41233bc34634" (UID: "86b8017e-839d-46c6-866c-41233bc34634"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 15:25:17.840837 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:17.840826 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86b8017e-839d-46c6-866c-41233bc34634-config-out" (OuterVolumeSpecName: "config-out") pod "86b8017e-839d-46c6-866c-41233bc34634" (UID: "86b8017e-839d-46c6-866c-41233bc34634"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 15:25:17.841294 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:17.841277 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86b8017e-839d-46c6-866c-41233bc34634-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "86b8017e-839d-46c6-866c-41233bc34634" (UID: "86b8017e-839d-46c6-866c-41233bc34634"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 15:25:17.841498 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:17.841465 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86b8017e-839d-46c6-866c-41233bc34634-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "86b8017e-839d-46c6-866c-41233bc34634" (UID: "86b8017e-839d-46c6-866c-41233bc34634"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 15:25:17.841639 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:17.841621 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86b8017e-839d-46c6-866c-41233bc34634-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "86b8017e-839d-46c6-866c-41233bc34634" (UID: "86b8017e-839d-46c6-866c-41233bc34634"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 15:25:17.844988 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:17.844774 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86b8017e-839d-46c6-866c-41233bc34634-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "86b8017e-839d-46c6-866c-41233bc34634" (UID: "86b8017e-839d-46c6-866c-41233bc34634"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 15:25:17.851624 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:17.851599 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86b8017e-839d-46c6-866c-41233bc34634-web-config" (OuterVolumeSpecName: "web-config") pod "86b8017e-839d-46c6-866c-41233bc34634" (UID: "86b8017e-839d-46c6-866c-41233bc34634"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 15:25:17.938388 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:17.938351 2566 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/86b8017e-839d-46c6-866c-41233bc34634-tls-assets\") on node \"ip-10-0-129-103.ec2.internal\" DevicePath \"\"" May 26 15:25:17.938388 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:17.938390 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/86b8017e-839d-46c6-866c-41233bc34634-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-129-103.ec2.internal\" DevicePath \"\"" May 26 15:25:17.938587 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:17.938406 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/86b8017e-839d-46c6-866c-41233bc34634-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-129-103.ec2.internal\" DevicePath \"\"" May 26 15:25:17.938587 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:17.938421 2566 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/86b8017e-839d-46c6-866c-41233bc34634-config-volume\") on node \"ip-10-0-129-103.ec2.internal\" DevicePath \"\"" May 26 15:25:17.938587 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:17.938434 2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86b8017e-839d-46c6-866c-41233bc34634-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-129-103.ec2.internal\" DevicePath \"\"" May 26 15:25:17.938587 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:17.938447 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgxqs\" (UniqueName: \"kubernetes.io/projected/86b8017e-839d-46c6-866c-41233bc34634-kube-api-access-tgxqs\") on node \"ip-10-0-129-103.ec2.internal\" DevicePath \"\"" May 26 15:25:17.938587 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:17.938459 2566 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/86b8017e-839d-46c6-866c-41233bc34634-web-config\") on node \"ip-10-0-129-103.ec2.internal\" DevicePath \"\"" May 26 15:25:17.938587 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:17.938470 2566 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/86b8017e-839d-46c6-866c-41233bc34634-cluster-tls-config\") on node \"ip-10-0-129-103.ec2.internal\" DevicePath \"\"" May 26 15:25:17.938587 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:17.938483 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/86b8017e-839d-46c6-866c-41233bc34634-secret-alertmanager-main-tls\") on node \"ip-10-0-129-103.ec2.internal\" DevicePath \"\"" May 26 15:25:17.938587 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:17.938497 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/86b8017e-839d-46c6-866c-41233bc34634-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-129-103.ec2.internal\" DevicePath \"\"" May 26 15:25:17.938587 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:17.938511 2566 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/86b8017e-839d-46c6-866c-41233bc34634-config-out\") on node \"ip-10-0-129-103.ec2.internal\" DevicePath \"\"" May 26 15:25:18.726050 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.726017 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"86b8017e-839d-46c6-866c-41233bc34634","Type":"ContainerDied","Data":"a2b2c6911744dedbfc8d5c45b2580daf9fe6793c3030552370b92be62487e4e6"} May 26 15:25:18.726464 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.726066 2566 scope.go:117] "RemoveContainer" containerID="f9288d258c612cc129076077bc8deb67122be716e30fa1d7aef4aefbe216670a" May 26 15:25:18.726464 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.726076 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 26 15:25:18.736329 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.736307 2566 scope.go:117] "RemoveContainer" containerID="0604b561095c0849b4c5406431eab3f2be07143df2e8ea95c7c08e5bf46f2a6f" May 26 15:25:18.743350 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.743330 2566 scope.go:117] "RemoveContainer" containerID="b56464c65424f7957d0b877fb4d1c55a822319c4836bf6995f80b73607ca29bf" May 26 15:25:18.749659 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.749635 2566 scope.go:117] "RemoveContainer" containerID="9abe8a8a313e033990e12ac49f671a3bc7543c581c1185d5243e2bc52ec666c4" May 26 15:25:18.752580 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.752557 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 26 15:25:18.756329 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.756307 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 26 15:25:18.758754 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.758723 2566 scope.go:117] "RemoveContainer" containerID="c13c1c4e372641e64f132f4a7052a527c9df127e6869243ad0f897f7d837cc86" May 26 15:25:18.765388 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.765369 2566 scope.go:117] "RemoveContainer" containerID="d0a37a4599a8554f79050e6ac6514bad1d7f7e989d6d4dbee44479e0de9afa01" May 26 15:25:18.772893 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.772871 2566 scope.go:117] "RemoveContainer" containerID="9ec200b6b42ce9ac27f3b807e2001750226531ddd53f7e68a7d5065d2908f7f1" May 26 15:25:18.782740 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.782715 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 26 15:25:18.783191 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.783176 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10b5a2b4-3b74-4691-9c81-0776a28dc0ac" containerName="registry" May 26 15:25:18.783245 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.783193 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="10b5a2b4-3b74-4691-9c81-0776a28dc0ac" containerName="registry" May 26 15:25:18.783245 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.783205 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86b8017e-839d-46c6-866c-41233bc34634" containerName="kube-rbac-proxy-web" May 26 15:25:18.783245 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.783211 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="86b8017e-839d-46c6-866c-41233bc34634" containerName="kube-rbac-proxy-web" May 26 15:25:18.783245 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.783220 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86b8017e-839d-46c6-866c-41233bc34634" containerName="alertmanager" May 26 15:25:18.783245 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.783225 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="86b8017e-839d-46c6-866c-41233bc34634" containerName="alertmanager" May 26 15:25:18.783245 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.783235 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86b8017e-839d-46c6-866c-41233bc34634" containerName="init-config-reloader" May 26 15:25:18.783245 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.783240 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="86b8017e-839d-46c6-866c-41233bc34634" containerName="init-config-reloader" May 26 15:25:18.783245 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.783246 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86b8017e-839d-46c6-866c-41233bc34634" containerName="kube-rbac-proxy" May 26 15:25:18.783471 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.783252 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="86b8017e-839d-46c6-866c-41233bc34634" containerName="kube-rbac-proxy" May 26 15:25:18.783471 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.783264 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86b8017e-839d-46c6-866c-41233bc34634" containerName="kube-rbac-proxy-metric" May 26 15:25:18.783471 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.783269 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="86b8017e-839d-46c6-866c-41233bc34634" containerName="kube-rbac-proxy-metric" May 26 15:25:18.783471 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.783276 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86b8017e-839d-46c6-866c-41233bc34634" containerName="config-reloader" May 26 15:25:18.783471 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.783282 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="86b8017e-839d-46c6-866c-41233bc34634" containerName="config-reloader" May 26 15:25:18.783471 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.783292 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86b8017e-839d-46c6-866c-41233bc34634" containerName="prom-label-proxy" May 26 15:25:18.783471 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.783297 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="86b8017e-839d-46c6-866c-41233bc34634" containerName="prom-label-proxy" May 26 15:25:18.783471 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.783340 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="86b8017e-839d-46c6-866c-41233bc34634" containerName="prom-label-proxy" May 26 15:25:18.783471 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.783348 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="86b8017e-839d-46c6-866c-41233bc34634" containerName="kube-rbac-proxy-metric" May 26 15:25:18.783471 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.783354 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="86b8017e-839d-46c6-866c-41233bc34634" containerName="alertmanager" May 26 15:25:18.783471 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.783360 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="10b5a2b4-3b74-4691-9c81-0776a28dc0ac" containerName="registry" May 26 15:25:18.783471 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.783366 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="86b8017e-839d-46c6-866c-41233bc34634" containerName="kube-rbac-proxy-web" May 26 15:25:18.783471 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.783373 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="86b8017e-839d-46c6-866c-41233bc34634" containerName="config-reloader" May 26 15:25:18.783471 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.783378 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="86b8017e-839d-46c6-866c-41233bc34634" containerName="kube-rbac-proxy" May 26 15:25:18.789120 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.789101 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 26 15:25:18.791698 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.791675 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 26 15:25:18.791698 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.791687 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 26 15:25:18.791860 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.791685 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 26 15:25:18.791860 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.791846 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 26 15:25:18.792204 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.792183 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 26 15:25:18.792302 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.792234 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 26 15:25:18.792302 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.792250 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 26 15:25:18.792718 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.792696 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 26 15:25:18.792837 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.792822 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bcgx2\"" May 26 15:25:18.796927 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.796902 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 26 15:25:18.798628 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.798608 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 26 15:25:18.845494 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.845412 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/06ca37fc-54d0-463c-9ac1-3a64cf8f2f00-config-volume\") pod \"alertmanager-main-0\" (UID: \"06ca37fc-54d0-463c-9ac1-3a64cf8f2f00\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:25:18.845494 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.845445 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/06ca37fc-54d0-463c-9ac1-3a64cf8f2f00-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"06ca37fc-54d0-463c-9ac1-3a64cf8f2f00\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:25:18.845494 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.845469 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/06ca37fc-54d0-463c-9ac1-3a64cf8f2f00-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"06ca37fc-54d0-463c-9ac1-3a64cf8f2f00\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:25:18.845494 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.845486 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06ca37fc-54d0-463c-9ac1-3a64cf8f2f00-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"06ca37fc-54d0-463c-9ac1-3a64cf8f2f00\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:25:18.845823 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.845554 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/06ca37fc-54d0-463c-9ac1-3a64cf8f2f00-config-out\") pod \"alertmanager-main-0\" (UID: \"06ca37fc-54d0-463c-9ac1-3a64cf8f2f00\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:25:18.845823 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.845581 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/06ca37fc-54d0-463c-9ac1-3a64cf8f2f00-web-config\") pod \"alertmanager-main-0\" (UID: \"06ca37fc-54d0-463c-9ac1-3a64cf8f2f00\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:25:18.845823 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.845637 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06ca37fc-54d0-463c-9ac1-3a64cf8f2f00-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"06ca37fc-54d0-463c-9ac1-3a64cf8f2f00\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:25:18.845823 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.845687 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06ca37fc-54d0-463c-9ac1-3a64cf8f2f00-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"06ca37fc-54d0-463c-9ac1-3a64cf8f2f00\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:25:18.845823 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.845707 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfq6s\" (UniqueName: \"kubernetes.io/projected/06ca37fc-54d0-463c-9ac1-3a64cf8f2f00-kube-api-access-wfq6s\") pod \"alertmanager-main-0\" (UID: \"06ca37fc-54d0-463c-9ac1-3a64cf8f2f00\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:25:18.845823 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.845741 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06ca37fc-54d0-463c-9ac1-3a64cf8f2f00-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"06ca37fc-54d0-463c-9ac1-3a64cf8f2f00\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:25:18.845823 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.845763 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/06ca37fc-54d0-463c-9ac1-3a64cf8f2f00-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"06ca37fc-54d0-463c-9ac1-3a64cf8f2f00\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:25:18.845823 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.845792 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/06ca37fc-54d0-463c-9ac1-3a64cf8f2f00-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"06ca37fc-54d0-463c-9ac1-3a64cf8f2f00\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:25:18.846178 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.845836 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/06ca37fc-54d0-463c-9ac1-3a64cf8f2f00-tls-assets\") pod \"alertmanager-main-0\" (UID: \"06ca37fc-54d0-463c-9ac1-3a64cf8f2f00\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:25:18.947070 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.947021 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/06ca37fc-54d0-463c-9ac1-3a64cf8f2f00-config-volume\") pod \"alertmanager-main-0\" (UID: \"06ca37fc-54d0-463c-9ac1-3a64cf8f2f00\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:25:18.947070 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.947069 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/06ca37fc-54d0-463c-9ac1-3a64cf8f2f00-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"06ca37fc-54d0-463c-9ac1-3a64cf8f2f00\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:25:18.947285 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.947096 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/06ca37fc-54d0-463c-9ac1-3a64cf8f2f00-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"06ca37fc-54d0-463c-9ac1-3a64cf8f2f00\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:25:18.947285 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.947120 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06ca37fc-54d0-463c-9ac1-3a64cf8f2f00-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"06ca37fc-54d0-463c-9ac1-3a64cf8f2f00\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:25:18.947285 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.947162 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/06ca37fc-54d0-463c-9ac1-3a64cf8f2f00-config-out\") pod \"alertmanager-main-0\" (UID: \"06ca37fc-54d0-463c-9ac1-3a64cf8f2f00\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:25:18.947285 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.947184 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/06ca37fc-54d0-463c-9ac1-3a64cf8f2f00-web-config\") pod \"alertmanager-main-0\" (UID: \"06ca37fc-54d0-463c-9ac1-3a64cf8f2f00\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:25:18.947285 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.947222 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06ca37fc-54d0-463c-9ac1-3a64cf8f2f00-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"06ca37fc-54d0-463c-9ac1-3a64cf8f2f00\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:25:18.947285 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.947246 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06ca37fc-54d0-463c-9ac1-3a64cf8f2f00-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"06ca37fc-54d0-463c-9ac1-3a64cf8f2f00\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:25:18.947285 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.947270 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wfq6s\" (UniqueName: \"kubernetes.io/projected/06ca37fc-54d0-463c-9ac1-3a64cf8f2f00-kube-api-access-wfq6s\") pod \"alertmanager-main-0\" (UID: \"06ca37fc-54d0-463c-9ac1-3a64cf8f2f00\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:25:18.947606 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.947293 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06ca37fc-54d0-463c-9ac1-3a64cf8f2f00-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"06ca37fc-54d0-463c-9ac1-3a64cf8f2f00\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:25:18.947606 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.947332 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/06ca37fc-54d0-463c-9ac1-3a64cf8f2f00-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"06ca37fc-54d0-463c-9ac1-3a64cf8f2f00\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:25:18.947606 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.947365 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/06ca37fc-54d0-463c-9ac1-3a64cf8f2f00-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"06ca37fc-54d0-463c-9ac1-3a64cf8f2f00\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:25:18.947606 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.947415 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/06ca37fc-54d0-463c-9ac1-3a64cf8f2f00-tls-assets\") pod \"alertmanager-main-0\" (UID: \"06ca37fc-54d0-463c-9ac1-3a64cf8f2f00\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:25:18.947606 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.947549 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/06ca37fc-54d0-463c-9ac1-3a64cf8f2f00-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"06ca37fc-54d0-463c-9ac1-3a64cf8f2f00\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:25:18.948018 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.947993 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06ca37fc-54d0-463c-9ac1-3a64cf8f2f00-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"06ca37fc-54d0-463c-9ac1-3a64cf8f2f00\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:25:18.949030 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.948346 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06ca37fc-54d0-463c-9ac1-3a64cf8f2f00-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"06ca37fc-54d0-463c-9ac1-3a64cf8f2f00\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:25:18.950336 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.950305 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/06ca37fc-54d0-463c-9ac1-3a64cf8f2f00-tls-assets\") pod \"alertmanager-main-0\" (UID: \"06ca37fc-54d0-463c-9ac1-3a64cf8f2f00\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:25:18.950445 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.950317 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/06ca37fc-54d0-463c-9ac1-3a64cf8f2f00-config-out\") pod \"alertmanager-main-0\" (UID: \"06ca37fc-54d0-463c-9ac1-3a64cf8f2f00\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:25:18.950445 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.950373 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/06ca37fc-54d0-463c-9ac1-3a64cf8f2f00-web-config\") pod \"alertmanager-main-0\" (UID: \"06ca37fc-54d0-463c-9ac1-3a64cf8f2f00\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:25:18.950583 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.950442 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/06ca37fc-54d0-463c-9ac1-3a64cf8f2f00-config-volume\") pod \"alertmanager-main-0\" (UID: \"06ca37fc-54d0-463c-9ac1-3a64cf8f2f00\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:25:18.950583 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.950564 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/06ca37fc-54d0-463c-9ac1-3a64cf8f2f00-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"06ca37fc-54d0-463c-9ac1-3a64cf8f2f00\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:25:18.950822 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.950804 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/06ca37fc-54d0-463c-9ac1-3a64cf8f2f00-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"06ca37fc-54d0-463c-9ac1-3a64cf8f2f00\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:25:18.950925 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.950906 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06ca37fc-54d0-463c-9ac1-3a64cf8f2f00-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"06ca37fc-54d0-463c-9ac1-3a64cf8f2f00\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:25:18.951515 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.951493 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06ca37fc-54d0-463c-9ac1-3a64cf8f2f00-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"06ca37fc-54d0-463c-9ac1-3a64cf8f2f00\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:25:18.952372 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.952348 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/06ca37fc-54d0-463c-9ac1-3a64cf8f2f00-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"06ca37fc-54d0-463c-9ac1-3a64cf8f2f00\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:25:18.956896 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:18.956876 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfq6s\" (UniqueName: \"kubernetes.io/projected/06ca37fc-54d0-463c-9ac1-3a64cf8f2f00-kube-api-access-wfq6s\") pod \"alertmanager-main-0\" (UID: \"06ca37fc-54d0-463c-9ac1-3a64cf8f2f00\") " pod="openshift-monitoring/alertmanager-main-0" May 26 15:25:19.100081 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:19.100001 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 26 15:25:19.232917 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:19.232888 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 26 15:25:19.234794 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:25:19.234769 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06ca37fc_54d0_463c_9ac1_3a64cf8f2f00.slice/crio-beb1b266bfee73e1756049accd3b302cb1e1a674cfe3e4f6d7ef55ab4ca88804 WatchSource:0}: Error finding container beb1b266bfee73e1756049accd3b302cb1e1a674cfe3e4f6d7ef55ab4ca88804: Status 404 returned error can't find the container with id beb1b266bfee73e1756049accd3b302cb1e1a674cfe3e4f6d7ef55ab4ca88804 May 26 15:25:19.729533 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:19.729502 2566 generic.go:358] "Generic (PLEG): container finished" podID="06ca37fc-54d0-463c-9ac1-3a64cf8f2f00" containerID="cd27668d0dd9d5c860cf51053eac5aed0f3b5ebf588c3a62eb5686761a7547cf" exitCode=0 May 26 15:25:19.730029 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:19.729596 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"06ca37fc-54d0-463c-9ac1-3a64cf8f2f00","Type":"ContainerDied","Data":"cd27668d0dd9d5c860cf51053eac5aed0f3b5ebf588c3a62eb5686761a7547cf"} May 26 15:25:19.730029 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:19.729638 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"06ca37fc-54d0-463c-9ac1-3a64cf8f2f00","Type":"ContainerStarted","Data":"beb1b266bfee73e1756049accd3b302cb1e1a674cfe3e4f6d7ef55ab4ca88804"} May 26 15:25:19.770565 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:19.770533 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86b8017e-839d-46c6-866c-41233bc34634" path="/var/lib/kubelet/pods/86b8017e-839d-46c6-866c-41233bc34634/volumes" May 26 15:25:20.691923 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:20.691879 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 15:25:20.692422 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:20.692364 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="50e16ebf-245b-4f8c-86ab-1cc04d05656e" containerName="prometheus" containerID="cri-o://e2228b264b7ebf5d1464de31c4fd6bf1ce7659e1fc86d3058b3471f3c77b08bb" gracePeriod=600 May 26 15:25:20.692551 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:20.692417 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="50e16ebf-245b-4f8c-86ab-1cc04d05656e" containerName="thanos-sidecar" containerID="cri-o://22eb560b0f4141c539d2e764f803f3a139a40ffb1a5981bd053114cb709ca6c9" gracePeriod=600 May 26 15:25:20.692551 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:20.692447 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="50e16ebf-245b-4f8c-86ab-1cc04d05656e" containerName="config-reloader" containerID="cri-o://73645e881b8b3acb11ea0807bafc3f2d7a5618eebd048267c440363b5977aba1" gracePeriod=600 May 26 15:25:20.692551 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:20.692390 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="50e16ebf-245b-4f8c-86ab-1cc04d05656e" containerName="kube-rbac-proxy" containerID="cri-o://d0b5cf6e3bd066a0fe909896bd8c0e053834a8c2a1b7ad4585f0c81ddb94ef4d" gracePeriod=600 May 26 15:25:20.692551 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:20.692432 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="50e16ebf-245b-4f8c-86ab-1cc04d05656e" containerName="kube-rbac-proxy-thanos" containerID="cri-o://11c5cca0796985fdcf2fa78de1cbdaa1a57cd240ac9dad9f415c3acae629d3e4" gracePeriod=600 May 26 15:25:20.692813 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:20.692592 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="50e16ebf-245b-4f8c-86ab-1cc04d05656e" containerName="kube-rbac-proxy-web" containerID="cri-o://5fe6dd08345155b2a25358cfaf2953d9dac72070ecc22e8e63178c51432a269c" gracePeriod=600 May 26 15:25:20.738511 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:20.738476 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"06ca37fc-54d0-463c-9ac1-3a64cf8f2f00","Type":"ContainerStarted","Data":"5be76f47b67d94653ffdbbc3d62de60256b3c59988feec34feb6b21c13abbb12"} May 26 15:25:20.738930 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:20.738520 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"06ca37fc-54d0-463c-9ac1-3a64cf8f2f00","Type":"ContainerStarted","Data":"0fab99b788ad4f4d1ce3f70003535e18bcfae658a6e91953c51aeb25df3b6b5c"} May 26 15:25:20.738930 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:20.738534 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"06ca37fc-54d0-463c-9ac1-3a64cf8f2f00","Type":"ContainerStarted","Data":"943f481d64708578bf1a9066ea150b7fa787f477c83809f737822c6b7a87d3c2"} May 26 15:25:20.738930 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:20.738547 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"06ca37fc-54d0-463c-9ac1-3a64cf8f2f00","Type":"ContainerStarted","Data":"b9422d12c236aa57a169379dd8a3b1eb4685fde362b593d1cd2ad51bfc945c40"} May 26 15:25:20.738930 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:20.738561 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"06ca37fc-54d0-463c-9ac1-3a64cf8f2f00","Type":"ContainerStarted","Data":"52b5e36b58b0fa0f518a24bfd0f1730b4b20f05d7c431abc322db6353e0d12ec"} May 26 15:25:20.738930 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:20.738575 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"06ca37fc-54d0-463c-9ac1-3a64cf8f2f00","Type":"ContainerStarted","Data":"33912974ad281acca1a4f7104c5d5221de5bedb3799113b02e3965bde8a8ba7f"} May 26 15:25:20.764953 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:20.764814 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.764794625 podStartE2EDuration="2.764794625s" podCreationTimestamp="2026-05-26 15:25:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 15:25:20.764575376 +0000 UTC m=+271.588592244" watchObservedRunningTime="2026-05-26 15:25:20.764794625 +0000 UTC m=+271.588811446" May 26 15:25:21.745393 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:21.745360 2566 generic.go:358] "Generic (PLEG): container finished" podID="50e16ebf-245b-4f8c-86ab-1cc04d05656e" containerID="11c5cca0796985fdcf2fa78de1cbdaa1a57cd240ac9dad9f415c3acae629d3e4" exitCode=0 May 26 15:25:21.745393 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:21.745385 2566 generic.go:358] "Generic (PLEG): container finished" podID="50e16ebf-245b-4f8c-86ab-1cc04d05656e" containerID="d0b5cf6e3bd066a0fe909896bd8c0e053834a8c2a1b7ad4585f0c81ddb94ef4d" exitCode=0 May 26 15:25:21.745393 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:21.745392 2566 generic.go:358] "Generic (PLEG): container finished" podID="50e16ebf-245b-4f8c-86ab-1cc04d05656e" containerID="22eb560b0f4141c539d2e764f803f3a139a40ffb1a5981bd053114cb709ca6c9" exitCode=0 May 26 15:25:21.745393 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:21.745397 2566 generic.go:358] "Generic (PLEG): container finished" podID="50e16ebf-245b-4f8c-86ab-1cc04d05656e" containerID="73645e881b8b3acb11ea0807bafc3f2d7a5618eebd048267c440363b5977aba1" exitCode=0 May 26 15:25:21.745393 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:21.745402 2566 generic.go:358] "Generic (PLEG): container finished" podID="50e16ebf-245b-4f8c-86ab-1cc04d05656e" containerID="e2228b264b7ebf5d1464de31c4fd6bf1ce7659e1fc86d3058b3471f3c77b08bb" exitCode=0 May 26 15:25:21.745904 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:21.745428 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50e16ebf-245b-4f8c-86ab-1cc04d05656e","Type":"ContainerDied","Data":"11c5cca0796985fdcf2fa78de1cbdaa1a57cd240ac9dad9f415c3acae629d3e4"} May 26 15:25:21.745904 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:21.745461 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50e16ebf-245b-4f8c-86ab-1cc04d05656e","Type":"ContainerDied","Data":"d0b5cf6e3bd066a0fe909896bd8c0e053834a8c2a1b7ad4585f0c81ddb94ef4d"} May 26 15:25:21.745904 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:21.745474 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50e16ebf-245b-4f8c-86ab-1cc04d05656e","Type":"ContainerDied","Data":"22eb560b0f4141c539d2e764f803f3a139a40ffb1a5981bd053114cb709ca6c9"} May 26 15:25:21.745904 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:21.745483 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50e16ebf-245b-4f8c-86ab-1cc04d05656e","Type":"ContainerDied","Data":"73645e881b8b3acb11ea0807bafc3f2d7a5618eebd048267c440363b5977aba1"} May 26 15:25:21.745904 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:21.745492 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50e16ebf-245b-4f8c-86ab-1cc04d05656e","Type":"ContainerDied","Data":"e2228b264b7ebf5d1464de31c4fd6bf1ce7659e1fc86d3058b3471f3c77b08bb"} May 26 15:25:21.949898 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:21.949874 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:21.974139 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:21.974104 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/50e16ebf-245b-4f8c-86ab-1cc04d05656e-prometheus-k8s-db\") pod \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " May 26 15:25:21.974384 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:21.974150 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-secret-prometheus-k8s-tls\") pod \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " May 26 15:25:21.974384 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:21.974178 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-secret-grpc-tls\") pod \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " May 26 15:25:21.974384 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:21.974210 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50e16ebf-245b-4f8c-86ab-1cc04d05656e-configmap-metrics-client-ca\") pod \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " May 26 15:25:21.974384 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:21.974230 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-web-config\") pod \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " May 26 15:25:21.974384 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:21.974254 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-secret-metrics-client-certs\") pod \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " May 26 15:25:21.974384 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:21.974274 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " May 26 15:25:21.974384 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:21.974294 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g59pl\" (UniqueName: \"kubernetes.io/projected/50e16ebf-245b-4f8c-86ab-1cc04d05656e-kube-api-access-g59pl\") pod \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " May 26 15:25:21.974384 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:21.974329 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " May 26 15:25:21.974384 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:21.974354 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/50e16ebf-245b-4f8c-86ab-1cc04d05656e-prometheus-k8s-rulefiles-0\") pod \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " May 26 15:25:21.974873 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:21.974390 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-secret-kube-rbac-proxy\") pod \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " May 26 15:25:21.974873 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:21.974637 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50e16ebf-245b-4f8c-86ab-1cc04d05656e-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "50e16ebf-245b-4f8c-86ab-1cc04d05656e" (UID: "50e16ebf-245b-4f8c-86ab-1cc04d05656e"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 15:25:21.975599 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:21.975569 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-thanos-prometheus-http-client-file\") pod \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " May 26 15:25:21.975732 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:21.975633 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50e16ebf-245b-4f8c-86ab-1cc04d05656e-configmap-kubelet-serving-ca-bundle\") pod \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " May 26 15:25:21.975732 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:21.975713 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/50e16ebf-245b-4f8c-86ab-1cc04d05656e-config-out\") pod \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " May 26 15:25:21.975859 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:21.975767 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50e16ebf-245b-4f8c-86ab-1cc04d05656e-prometheus-trusted-ca-bundle\") pod \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " May 26 15:25:21.975859 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:21.975797 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50e16ebf-245b-4f8c-86ab-1cc04d05656e-configmap-serving-certs-ca-bundle\") pod \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " May 26 15:25:21.975859 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:21.975822 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/50e16ebf-245b-4f8c-86ab-1cc04d05656e-tls-assets\") pod \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " May 26 15:25:21.975859 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:21.975852 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-config\") pod \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\" (UID: \"50e16ebf-245b-4f8c-86ab-1cc04d05656e\") " May 26 15:25:21.976341 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:21.976296 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50e16ebf-245b-4f8c-86ab-1cc04d05656e-configmap-metrics-client-ca\") on node \"ip-10-0-129-103.ec2.internal\" DevicePath \"\"" May 26 15:25:21.977387 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:21.977080 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "50e16ebf-245b-4f8c-86ab-1cc04d05656e" (UID: "50e16ebf-245b-4f8c-86ab-1cc04d05656e"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 15:25:21.977387 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:21.977115 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50e16ebf-245b-4f8c-86ab-1cc04d05656e-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "50e16ebf-245b-4f8c-86ab-1cc04d05656e" (UID: "50e16ebf-245b-4f8c-86ab-1cc04d05656e"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 15:25:21.978116 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:21.977621 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50e16ebf-245b-4f8c-86ab-1cc04d05656e-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "50e16ebf-245b-4f8c-86ab-1cc04d05656e" (UID: "50e16ebf-245b-4f8c-86ab-1cc04d05656e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 15:25:21.978116 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:21.977660 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "50e16ebf-245b-4f8c-86ab-1cc04d05656e" (UID: "50e16ebf-245b-4f8c-86ab-1cc04d05656e"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 15:25:21.978116 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:21.977711 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50e16ebf-245b-4f8c-86ab-1cc04d05656e-kube-api-access-g59pl" (OuterVolumeSpecName: "kube-api-access-g59pl") pod "50e16ebf-245b-4f8c-86ab-1cc04d05656e" (UID: "50e16ebf-245b-4f8c-86ab-1cc04d05656e"). InnerVolumeSpecName "kube-api-access-g59pl". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 15:25:21.978328 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:21.978121 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50e16ebf-245b-4f8c-86ab-1cc04d05656e-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "50e16ebf-245b-4f8c-86ab-1cc04d05656e" (UID: "50e16ebf-245b-4f8c-86ab-1cc04d05656e"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 15:25:21.978777 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:21.978734 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "50e16ebf-245b-4f8c-86ab-1cc04d05656e" (UID: "50e16ebf-245b-4f8c-86ab-1cc04d05656e"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 15:25:21.979213 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:21.979178 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "50e16ebf-245b-4f8c-86ab-1cc04d05656e" (UID: "50e16ebf-245b-4f8c-86ab-1cc04d05656e"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 15:25:21.979803 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:21.979768 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50e16ebf-245b-4f8c-86ab-1cc04d05656e-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "50e16ebf-245b-4f8c-86ab-1cc04d05656e" (UID: "50e16ebf-245b-4f8c-86ab-1cc04d05656e"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 15:25:21.980018 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:21.979982 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "50e16ebf-245b-4f8c-86ab-1cc04d05656e" (UID: "50e16ebf-245b-4f8c-86ab-1cc04d05656e"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 15:25:21.980388 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:21.980319 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50e16ebf-245b-4f8c-86ab-1cc04d05656e-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "50e16ebf-245b-4f8c-86ab-1cc04d05656e" (UID: "50e16ebf-245b-4f8c-86ab-1cc04d05656e"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 15:25:21.980479 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:21.980430 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-config" (OuterVolumeSpecName: "config") pod "50e16ebf-245b-4f8c-86ab-1cc04d05656e" (UID: "50e16ebf-245b-4f8c-86ab-1cc04d05656e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 15:25:21.981167 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:21.981131 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50e16ebf-245b-4f8c-86ab-1cc04d05656e-config-out" (OuterVolumeSpecName: "config-out") pod "50e16ebf-245b-4f8c-86ab-1cc04d05656e" (UID: "50e16ebf-245b-4f8c-86ab-1cc04d05656e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 15:25:21.981357 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:21.981327 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "50e16ebf-245b-4f8c-86ab-1cc04d05656e" (UID: "50e16ebf-245b-4f8c-86ab-1cc04d05656e"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 15:25:21.982003 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:21.981888 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "50e16ebf-245b-4f8c-86ab-1cc04d05656e" (UID: "50e16ebf-245b-4f8c-86ab-1cc04d05656e"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 15:25:21.982368 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:21.982343 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50e16ebf-245b-4f8c-86ab-1cc04d05656e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "50e16ebf-245b-4f8c-86ab-1cc04d05656e" (UID: "50e16ebf-245b-4f8c-86ab-1cc04d05656e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 15:25:21.993387 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:21.993351 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-web-config" (OuterVolumeSpecName: "web-config") pod "50e16ebf-245b-4f8c-86ab-1cc04d05656e" (UID: "50e16ebf-245b-4f8c-86ab-1cc04d05656e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 15:25:22.077658 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.077564 2566 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/50e16ebf-245b-4f8c-86ab-1cc04d05656e-config-out\") on node \"ip-10-0-129-103.ec2.internal\" DevicePath \"\"" May 26 15:25:22.077658 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.077600 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50e16ebf-245b-4f8c-86ab-1cc04d05656e-prometheus-trusted-ca-bundle\") on node \"ip-10-0-129-103.ec2.internal\" DevicePath \"\"" May 26 15:25:22.077658 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.077611 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50e16ebf-245b-4f8c-86ab-1cc04d05656e-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-129-103.ec2.internal\" DevicePath \"\"" May 26 15:25:22.077658 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.077621 2566 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/50e16ebf-245b-4f8c-86ab-1cc04d05656e-tls-assets\") on node \"ip-10-0-129-103.ec2.internal\" DevicePath \"\"" May 26 15:25:22.077658 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.077630 2566 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-config\") on node \"ip-10-0-129-103.ec2.internal\" DevicePath \"\"" May 26 15:25:22.077658 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.077638 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/50e16ebf-245b-4f8c-86ab-1cc04d05656e-prometheus-k8s-db\") on node \"ip-10-0-129-103.ec2.internal\" DevicePath \"\"" May 26 15:25:22.077658 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.077646 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-secret-prometheus-k8s-tls\") on node \"ip-10-0-129-103.ec2.internal\" DevicePath \"\"" May 26 15:25:22.077658 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.077655 2566 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-secret-grpc-tls\") on node \"ip-10-0-129-103.ec2.internal\" DevicePath \"\"" May 26 15:25:22.078011 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.077692 2566 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-web-config\") on node \"ip-10-0-129-103.ec2.internal\" DevicePath \"\"" May 26 15:25:22.078011 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.077706 2566 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-secret-metrics-client-certs\") on node \"ip-10-0-129-103.ec2.internal\" DevicePath \"\"" May 26 15:25:22.078011 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.077721 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-129-103.ec2.internal\" DevicePath \"\"" May 26 15:25:22.078011 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.077734 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g59pl\" (UniqueName: \"kubernetes.io/projected/50e16ebf-245b-4f8c-86ab-1cc04d05656e-kube-api-access-g59pl\") on node \"ip-10-0-129-103.ec2.internal\" DevicePath \"\"" May 26 15:25:22.078011 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.077748 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-129-103.ec2.internal\" DevicePath \"\"" May 26 15:25:22.078011 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.077761 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/50e16ebf-245b-4f8c-86ab-1cc04d05656e-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-129-103.ec2.internal\" DevicePath \"\"" May 26 15:25:22.078011 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.077771 2566 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-secret-kube-rbac-proxy\") on node \"ip-10-0-129-103.ec2.internal\" DevicePath \"\"" May 26 15:25:22.078011 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.077780 2566 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/50e16ebf-245b-4f8c-86ab-1cc04d05656e-thanos-prometheus-http-client-file\") on node \"ip-10-0-129-103.ec2.internal\" DevicePath \"\"" May 26 15:25:22.078011 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.077790 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50e16ebf-245b-4f8c-86ab-1cc04d05656e-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-129-103.ec2.internal\" DevicePath \"\"" May 26 15:25:22.752379 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.752347 2566 generic.go:358] "Generic (PLEG): container finished" podID="50e16ebf-245b-4f8c-86ab-1cc04d05656e" containerID="5fe6dd08345155b2a25358cfaf2953d9dac72070ecc22e8e63178c51432a269c" exitCode=0 May 26 15:25:22.752765 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.752434 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50e16ebf-245b-4f8c-86ab-1cc04d05656e","Type":"ContainerDied","Data":"5fe6dd08345155b2a25358cfaf2953d9dac72070ecc22e8e63178c51432a269c"} May 26 15:25:22.752765 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.752471 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50e16ebf-245b-4f8c-86ab-1cc04d05656e","Type":"ContainerDied","Data":"958c751ae47164f46f9258b880837b620d9bad02214b16f0fa836f2549692aed"} May 26 15:25:22.752765 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.752489 2566 scope.go:117] "RemoveContainer" containerID="11c5cca0796985fdcf2fa78de1cbdaa1a57cd240ac9dad9f415c3acae629d3e4" May 26 15:25:22.752765 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.752448 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.761010 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.760882 2566 scope.go:117] "RemoveContainer" containerID="d0b5cf6e3bd066a0fe909896bd8c0e053834a8c2a1b7ad4585f0c81ddb94ef4d" May 26 15:25:22.768581 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.768563 2566 scope.go:117] "RemoveContainer" containerID="5fe6dd08345155b2a25358cfaf2953d9dac72070ecc22e8e63178c51432a269c" May 26 15:25:22.775166 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.775149 2566 scope.go:117] "RemoveContainer" containerID="22eb560b0f4141c539d2e764f803f3a139a40ffb1a5981bd053114cb709ca6c9" May 26 15:25:22.777658 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.777635 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 15:25:22.781895 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.781870 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 15:25:22.782918 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.782898 2566 scope.go:117] "RemoveContainer" containerID="73645e881b8b3acb11ea0807bafc3f2d7a5618eebd048267c440363b5977aba1" May 26 15:25:22.790852 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.790825 2566 scope.go:117] "RemoveContainer" containerID="e2228b264b7ebf5d1464de31c4fd6bf1ce7659e1fc86d3058b3471f3c77b08bb" May 26 15:25:22.797813 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.797796 2566 scope.go:117] "RemoveContainer" containerID="1dc212010cfebf2c841c2b71644ce57ebd25f2a7554299eef70227755d5fa89b" May 26 15:25:22.804492 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.804478 2566 scope.go:117] "RemoveContainer" containerID="11c5cca0796985fdcf2fa78de1cbdaa1a57cd240ac9dad9f415c3acae629d3e4" May 26 15:25:22.804762 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:25:22.804744 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11c5cca0796985fdcf2fa78de1cbdaa1a57cd240ac9dad9f415c3acae629d3e4\": container with ID starting with 11c5cca0796985fdcf2fa78de1cbdaa1a57cd240ac9dad9f415c3acae629d3e4 not found: ID does not exist" containerID="11c5cca0796985fdcf2fa78de1cbdaa1a57cd240ac9dad9f415c3acae629d3e4" May 26 15:25:22.804821 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.804774 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11c5cca0796985fdcf2fa78de1cbdaa1a57cd240ac9dad9f415c3acae629d3e4"} err="failed to get container status \"11c5cca0796985fdcf2fa78de1cbdaa1a57cd240ac9dad9f415c3acae629d3e4\": rpc error: code = NotFound desc = could not find container \"11c5cca0796985fdcf2fa78de1cbdaa1a57cd240ac9dad9f415c3acae629d3e4\": container with ID starting with 11c5cca0796985fdcf2fa78de1cbdaa1a57cd240ac9dad9f415c3acae629d3e4 not found: ID does not exist" May 26 15:25:22.804821 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.804798 2566 scope.go:117] "RemoveContainer" containerID="d0b5cf6e3bd066a0fe909896bd8c0e053834a8c2a1b7ad4585f0c81ddb94ef4d" May 26 15:25:22.805049 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:25:22.805033 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0b5cf6e3bd066a0fe909896bd8c0e053834a8c2a1b7ad4585f0c81ddb94ef4d\": container with ID starting with d0b5cf6e3bd066a0fe909896bd8c0e053834a8c2a1b7ad4585f0c81ddb94ef4d not found: ID does not exist" containerID="d0b5cf6e3bd066a0fe909896bd8c0e053834a8c2a1b7ad4585f0c81ddb94ef4d" May 26 15:25:22.805093 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.805053 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0b5cf6e3bd066a0fe909896bd8c0e053834a8c2a1b7ad4585f0c81ddb94ef4d"} err="failed to get container status \"d0b5cf6e3bd066a0fe909896bd8c0e053834a8c2a1b7ad4585f0c81ddb94ef4d\": rpc error: code = NotFound desc = could not find container \"d0b5cf6e3bd066a0fe909896bd8c0e053834a8c2a1b7ad4585f0c81ddb94ef4d\": container with ID starting with d0b5cf6e3bd066a0fe909896bd8c0e053834a8c2a1b7ad4585f0c81ddb94ef4d not found: ID does not exist" May 26 15:25:22.805093 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.805068 2566 scope.go:117] "RemoveContainer" containerID="5fe6dd08345155b2a25358cfaf2953d9dac72070ecc22e8e63178c51432a269c" May 26 15:25:22.805285 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:25:22.805266 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fe6dd08345155b2a25358cfaf2953d9dac72070ecc22e8e63178c51432a269c\": container with ID starting with 5fe6dd08345155b2a25358cfaf2953d9dac72070ecc22e8e63178c51432a269c not found: ID does not exist" containerID="5fe6dd08345155b2a25358cfaf2953d9dac72070ecc22e8e63178c51432a269c" May 26 15:25:22.805326 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.805291 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fe6dd08345155b2a25358cfaf2953d9dac72070ecc22e8e63178c51432a269c"} err="failed to get container status \"5fe6dd08345155b2a25358cfaf2953d9dac72070ecc22e8e63178c51432a269c\": rpc error: code = NotFound desc = could not find container \"5fe6dd08345155b2a25358cfaf2953d9dac72070ecc22e8e63178c51432a269c\": container with ID starting with 5fe6dd08345155b2a25358cfaf2953d9dac72070ecc22e8e63178c51432a269c not found: ID does not exist" May 26 15:25:22.805326 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.805307 2566 scope.go:117] "RemoveContainer" containerID="22eb560b0f4141c539d2e764f803f3a139a40ffb1a5981bd053114cb709ca6c9" May 26 15:25:22.805532 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:25:22.805517 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22eb560b0f4141c539d2e764f803f3a139a40ffb1a5981bd053114cb709ca6c9\": container with ID starting with 22eb560b0f4141c539d2e764f803f3a139a40ffb1a5981bd053114cb709ca6c9 not found: ID does not exist" containerID="22eb560b0f4141c539d2e764f803f3a139a40ffb1a5981bd053114cb709ca6c9" May 26 15:25:22.805568 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.805536 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22eb560b0f4141c539d2e764f803f3a139a40ffb1a5981bd053114cb709ca6c9"} err="failed to get container status \"22eb560b0f4141c539d2e764f803f3a139a40ffb1a5981bd053114cb709ca6c9\": rpc error: code = NotFound desc = could not find container \"22eb560b0f4141c539d2e764f803f3a139a40ffb1a5981bd053114cb709ca6c9\": container with ID starting with 22eb560b0f4141c539d2e764f803f3a139a40ffb1a5981bd053114cb709ca6c9 not found: ID does not exist" May 26 15:25:22.805568 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.805549 2566 scope.go:117] "RemoveContainer" containerID="73645e881b8b3acb11ea0807bafc3f2d7a5618eebd048267c440363b5977aba1" May 26 15:25:22.805782 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:25:22.805765 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73645e881b8b3acb11ea0807bafc3f2d7a5618eebd048267c440363b5977aba1\": container with ID starting with 73645e881b8b3acb11ea0807bafc3f2d7a5618eebd048267c440363b5977aba1 not found: ID does not exist" containerID="73645e881b8b3acb11ea0807bafc3f2d7a5618eebd048267c440363b5977aba1" May 26 15:25:22.805827 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.805785 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73645e881b8b3acb11ea0807bafc3f2d7a5618eebd048267c440363b5977aba1"} err="failed to get container status \"73645e881b8b3acb11ea0807bafc3f2d7a5618eebd048267c440363b5977aba1\": rpc error: code = NotFound desc = could not find container \"73645e881b8b3acb11ea0807bafc3f2d7a5618eebd048267c440363b5977aba1\": container with ID starting with 73645e881b8b3acb11ea0807bafc3f2d7a5618eebd048267c440363b5977aba1 not found: ID does not exist" May 26 15:25:22.805827 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.805807 2566 scope.go:117] "RemoveContainer" containerID="e2228b264b7ebf5d1464de31c4fd6bf1ce7659e1fc86d3058b3471f3c77b08bb" May 26 15:25:22.806020 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:25:22.806003 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2228b264b7ebf5d1464de31c4fd6bf1ce7659e1fc86d3058b3471f3c77b08bb\": container with ID starting with e2228b264b7ebf5d1464de31c4fd6bf1ce7659e1fc86d3058b3471f3c77b08bb not found: ID does not exist" containerID="e2228b264b7ebf5d1464de31c4fd6bf1ce7659e1fc86d3058b3471f3c77b08bb" May 26 15:25:22.806066 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.806023 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2228b264b7ebf5d1464de31c4fd6bf1ce7659e1fc86d3058b3471f3c77b08bb"} err="failed to get container status \"e2228b264b7ebf5d1464de31c4fd6bf1ce7659e1fc86d3058b3471f3c77b08bb\": rpc error: code = NotFound desc = could not find container \"e2228b264b7ebf5d1464de31c4fd6bf1ce7659e1fc86d3058b3471f3c77b08bb\": container with ID starting with e2228b264b7ebf5d1464de31c4fd6bf1ce7659e1fc86d3058b3471f3c77b08bb not found: ID does not exist" May 26 15:25:22.806066 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.806039 2566 scope.go:117] "RemoveContainer" containerID="1dc212010cfebf2c841c2b71644ce57ebd25f2a7554299eef70227755d5fa89b" May 26 15:25:22.806266 ip-10-0-129-103 kubenswrapper[2566]: E0526 15:25:22.806252 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dc212010cfebf2c841c2b71644ce57ebd25f2a7554299eef70227755d5fa89b\": container with ID starting with 1dc212010cfebf2c841c2b71644ce57ebd25f2a7554299eef70227755d5fa89b not found: ID does not exist" containerID="1dc212010cfebf2c841c2b71644ce57ebd25f2a7554299eef70227755d5fa89b" May 26 15:25:22.806313 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.806271 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dc212010cfebf2c841c2b71644ce57ebd25f2a7554299eef70227755d5fa89b"} err="failed to get container status \"1dc212010cfebf2c841c2b71644ce57ebd25f2a7554299eef70227755d5fa89b\": rpc error: code = NotFound desc = could not find container \"1dc212010cfebf2c841c2b71644ce57ebd25f2a7554299eef70227755d5fa89b\": container with ID starting with 1dc212010cfebf2c841c2b71644ce57ebd25f2a7554299eef70227755d5fa89b not found: ID does not exist" May 26 15:25:22.809734 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.809713 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 15:25:22.810018 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.810006 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50e16ebf-245b-4f8c-86ab-1cc04d05656e" containerName="prometheus" May 26 15:25:22.810018 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.810019 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="50e16ebf-245b-4f8c-86ab-1cc04d05656e" containerName="prometheus" May 26 15:25:22.810104 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.810033 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50e16ebf-245b-4f8c-86ab-1cc04d05656e" containerName="config-reloader" May 26 15:25:22.810104 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.810039 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="50e16ebf-245b-4f8c-86ab-1cc04d05656e" containerName="config-reloader" May 26 15:25:22.810104 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.810045 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50e16ebf-245b-4f8c-86ab-1cc04d05656e" containerName="kube-rbac-proxy-thanos" May 26 15:25:22.810104 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.810051 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="50e16ebf-245b-4f8c-86ab-1cc04d05656e" containerName="kube-rbac-proxy-thanos" May 26 15:25:22.810104 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.810061 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50e16ebf-245b-4f8c-86ab-1cc04d05656e" containerName="thanos-sidecar" May 26 15:25:22.810104 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.810066 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="50e16ebf-245b-4f8c-86ab-1cc04d05656e" containerName="thanos-sidecar" May 26 15:25:22.810104 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.810074 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50e16ebf-245b-4f8c-86ab-1cc04d05656e" containerName="kube-rbac-proxy-web" May 26 15:25:22.810104 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.810079 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="50e16ebf-245b-4f8c-86ab-1cc04d05656e" containerName="kube-rbac-proxy-web" May 26 15:25:22.810104 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.810085 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50e16ebf-245b-4f8c-86ab-1cc04d05656e" containerName="kube-rbac-proxy" May 26 15:25:22.810104 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.810090 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="50e16ebf-245b-4f8c-86ab-1cc04d05656e" containerName="kube-rbac-proxy" May 26 15:25:22.810104 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.810102 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50e16ebf-245b-4f8c-86ab-1cc04d05656e" containerName="init-config-reloader" May 26 15:25:22.810431 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.810110 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="50e16ebf-245b-4f8c-86ab-1cc04d05656e" containerName="init-config-reloader" May 26 15:25:22.810431 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.810181 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="50e16ebf-245b-4f8c-86ab-1cc04d05656e" containerName="config-reloader" May 26 15:25:22.810431 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.810191 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="50e16ebf-245b-4f8c-86ab-1cc04d05656e" containerName="kube-rbac-proxy" May 26 15:25:22.810431 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.810199 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="50e16ebf-245b-4f8c-86ab-1cc04d05656e" containerName="kube-rbac-proxy-thanos" May 26 15:25:22.810431 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.810206 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="50e16ebf-245b-4f8c-86ab-1cc04d05656e" containerName="kube-rbac-proxy-web" May 26 15:25:22.810431 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.810213 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="50e16ebf-245b-4f8c-86ab-1cc04d05656e" containerName="prometheus" May 26 15:25:22.810431 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.810219 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="50e16ebf-245b-4f8c-86ab-1cc04d05656e" containerName="thanos-sidecar" May 26 15:25:22.818194 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.818163 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.820996 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.820975 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2t0j6up3glv31\"" May 26 15:25:22.821098 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.821031 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 26 15:25:22.821098 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.820977 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 26 15:25:22.821098 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.821092 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 26 15:25:22.821247 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.821162 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 26 15:25:22.821410 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.821369 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 26 15:25:22.821410 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.821369 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 26 15:25:22.821410 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.821403 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 26 15:25:22.821569 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.821380 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 26 15:25:22.821718 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.821697 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 26 15:25:22.821718 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.821712 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 26 15:25:22.821857 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.821720 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 26 15:25:22.821857 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.821715 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-ppglb\"" May 26 15:25:22.824633 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.824614 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 26 15:25:22.827531 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.827486 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 15:25:22.827753 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.827585 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 26 15:25:22.884186 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.884147 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e96c2604-603f-4f1d-973e-bc4da77f92d9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.884186 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.884186 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg9g2\" (UniqueName: \"kubernetes.io/projected/e96c2604-603f-4f1d-973e-bc4da77f92d9-kube-api-access-zg9g2\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.884412 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.884209 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e96c2604-603f-4f1d-973e-bc4da77f92d9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.884412 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.884280 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e96c2604-603f-4f1d-973e-bc4da77f92d9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.884412 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.884311 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e96c2604-603f-4f1d-973e-bc4da77f92d9-config-out\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.884412 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.884329 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e96c2604-603f-4f1d-973e-bc4da77f92d9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.884412 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.884352 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e96c2604-603f-4f1d-973e-bc4da77f92d9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.884412 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.884400 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e96c2604-603f-4f1d-973e-bc4da77f92d9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.884635 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.884428 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e96c2604-603f-4f1d-973e-bc4da77f92d9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.884635 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.884466 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e96c2604-603f-4f1d-973e-bc4da77f92d9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.884635 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.884487 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e96c2604-603f-4f1d-973e-bc4da77f92d9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.884635 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.884508 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e96c2604-603f-4f1d-973e-bc4da77f92d9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.884635 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.884526 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e96c2604-603f-4f1d-973e-bc4da77f92d9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.884635 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.884545 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e96c2604-603f-4f1d-973e-bc4da77f92d9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.884635 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.884572 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e96c2604-603f-4f1d-973e-bc4da77f92d9-config\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.884635 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.884589 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e96c2604-603f-4f1d-973e-bc4da77f92d9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.884635 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.884610 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e96c2604-603f-4f1d-973e-bc4da77f92d9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.884635 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.884630 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e96c2604-603f-4f1d-973e-bc4da77f92d9-web-config\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.985257 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.985221 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e96c2604-603f-4f1d-973e-bc4da77f92d9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.985257 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.985261 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e96c2604-603f-4f1d-973e-bc4da77f92d9-config\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.985502 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.985283 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e96c2604-603f-4f1d-973e-bc4da77f92d9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.985502 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.985299 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e96c2604-603f-4f1d-973e-bc4da77f92d9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.985502 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.985323 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e96c2604-603f-4f1d-973e-bc4da77f92d9-web-config\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.985502 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.985346 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e96c2604-603f-4f1d-973e-bc4da77f92d9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.985502 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.985371 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zg9g2\" (UniqueName: \"kubernetes.io/projected/e96c2604-603f-4f1d-973e-bc4da77f92d9-kube-api-access-zg9g2\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.985502 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.985398 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e96c2604-603f-4f1d-973e-bc4da77f92d9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.985502 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.985422 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e96c2604-603f-4f1d-973e-bc4da77f92d9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.985502 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.985446 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e96c2604-603f-4f1d-973e-bc4da77f92d9-config-out\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.985502 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.985470 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e96c2604-603f-4f1d-973e-bc4da77f92d9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.985502 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.985499 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e96c2604-603f-4f1d-973e-bc4da77f92d9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.985995 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.985541 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e96c2604-603f-4f1d-973e-bc4da77f92d9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.985995 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.985579 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e96c2604-603f-4f1d-973e-bc4da77f92d9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.985995 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.985623 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e96c2604-603f-4f1d-973e-bc4da77f92d9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.985995 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.985647 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e96c2604-603f-4f1d-973e-bc4da77f92d9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.985995 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.985704 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e96c2604-603f-4f1d-973e-bc4da77f92d9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.985995 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.985734 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e96c2604-603f-4f1d-973e-bc4da77f92d9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.988067 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.986404 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e96c2604-603f-4f1d-973e-bc4da77f92d9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.988067 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.986961 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e96c2604-603f-4f1d-973e-bc4da77f92d9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.988067 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.987762 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e96c2604-603f-4f1d-973e-bc4da77f92d9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.988787 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.988470 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e96c2604-603f-4f1d-973e-bc4da77f92d9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.988787 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.988568 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e96c2604-603f-4f1d-973e-bc4da77f92d9-web-config\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.988787 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.988571 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e96c2604-603f-4f1d-973e-bc4da77f92d9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.988787 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.988604 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e96c2604-603f-4f1d-973e-bc4da77f92d9-config\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.989044 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.988862 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e96c2604-603f-4f1d-973e-bc4da77f92d9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.989101 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.989062 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e96c2604-603f-4f1d-973e-bc4da77f92d9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.989382 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.989324 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e96c2604-603f-4f1d-973e-bc4da77f92d9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.989539 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.989490 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e96c2604-603f-4f1d-973e-bc4da77f92d9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.990275 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.990248 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e96c2604-603f-4f1d-973e-bc4da77f92d9-config-out\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.990799 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.990772 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e96c2604-603f-4f1d-973e-bc4da77f92d9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.990875 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.990827 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e96c2604-603f-4f1d-973e-bc4da77f92d9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.991441 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.991423 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e96c2604-603f-4f1d-973e-bc4da77f92d9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.991550 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.991528 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e96c2604-603f-4f1d-973e-bc4da77f92d9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.991595 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.991581 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e96c2604-603f-4f1d-973e-bc4da77f92d9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:22.994748 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:22.994715 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg9g2\" (UniqueName: \"kubernetes.io/projected/e96c2604-603f-4f1d-973e-bc4da77f92d9-kube-api-access-zg9g2\") pod \"prometheus-k8s-0\" (UID: \"e96c2604-603f-4f1d-973e-bc4da77f92d9\") " pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:23.130824 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:23.130706 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:23.265152 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:23.265103 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 26 15:25:23.268016 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:25:23.267984 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode96c2604_603f_4f1d_973e_bc4da77f92d9.slice/crio-e20bf35a784552bf476120bdbca13c990c7ff2fc6e615ee19fef3d66baec43b5 WatchSource:0}: Error finding container e20bf35a784552bf476120bdbca13c990c7ff2fc6e615ee19fef3d66baec43b5: Status 404 returned error can't find the container with id e20bf35a784552bf476120bdbca13c990c7ff2fc6e615ee19fef3d66baec43b5 May 26 15:25:23.758581 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:23.758546 2566 generic.go:358] "Generic (PLEG): container finished" podID="e96c2604-603f-4f1d-973e-bc4da77f92d9" containerID="22142c5c9eee525c51ee4b8e704d2c60d4fbb2d1cb570edfc62876b3756af2e1" exitCode=0 May 26 15:25:23.758981 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:23.758629 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e96c2604-603f-4f1d-973e-bc4da77f92d9","Type":"ContainerDied","Data":"22142c5c9eee525c51ee4b8e704d2c60d4fbb2d1cb570edfc62876b3756af2e1"} May 26 15:25:23.758981 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:23.758661 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e96c2604-603f-4f1d-973e-bc4da77f92d9","Type":"ContainerStarted","Data":"e20bf35a784552bf476120bdbca13c990c7ff2fc6e615ee19fef3d66baec43b5"} May 26 15:25:23.771103 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:23.771077 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50e16ebf-245b-4f8c-86ab-1cc04d05656e" path="/var/lib/kubelet/pods/50e16ebf-245b-4f8c-86ab-1cc04d05656e/volumes" May 26 15:25:24.769982 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:24.769948 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e96c2604-603f-4f1d-973e-bc4da77f92d9","Type":"ContainerStarted","Data":"963e9b6b09b59c11608b06eda53d95a271dd831bddc7dba78e0426efc296bd25"} May 26 15:25:24.769982 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:24.769979 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e96c2604-603f-4f1d-973e-bc4da77f92d9","Type":"ContainerStarted","Data":"8077112e98e6f94b9e71395c3a1e88987c2312fb265e7b69807ab1472656d4b9"} May 26 15:25:24.769982 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:24.769988 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e96c2604-603f-4f1d-973e-bc4da77f92d9","Type":"ContainerStarted","Data":"4c3e34dd30f9dd23876ea99ec6be8e8ed397021418500e1be24a6b6fe4d8ecea"} May 26 15:25:24.770395 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:24.769997 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e96c2604-603f-4f1d-973e-bc4da77f92d9","Type":"ContainerStarted","Data":"84a0cae68a9d8750a520743918e2ec3f4e3e31ef90b427b5d31450053f1a7e0b"} May 26 15:25:24.770395 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:24.770005 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e96c2604-603f-4f1d-973e-bc4da77f92d9","Type":"ContainerStarted","Data":"69b129b3f3ab72a6c9c5f784fc8e65f757b3d8330f215212c741a721fe239434"} May 26 15:25:24.770395 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:24.770013 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e96c2604-603f-4f1d-973e-bc4da77f92d9","Type":"ContainerStarted","Data":"e7d2fd8ba5d32a42e7e40be5dfaddf35022343b43210e7084e373215030daaa5"} May 26 15:25:24.795107 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:24.795041 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.795026847 podStartE2EDuration="2.795026847s" podCreationTimestamp="2026-05-26 15:25:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 15:25:24.793388083 +0000 UTC m=+275.617404905" watchObservedRunningTime="2026-05-26 15:25:24.795026847 +0000 UTC m=+275.619043667" May 26 15:25:28.130822 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:28.130780 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 26 15:25:49.680396 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:49.680363 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pls4f_f635642a-6974-4f41-adf9-e7ec1fe16090/ovn-acl-logging/0.log" May 26 15:25:49.681063 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:49.681037 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pls4f_f635642a-6974-4f41-adf9-e7ec1fe16090/ovn-acl-logging/0.log" May 26 15:25:49.688015 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:25:49.687997 2566 kubelet.go:1628] "Image garbage collection succeeded" May 26 15:26:23.131435 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:26:23.131398 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 26 15:26:23.146896 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:26:23.146874 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 26 15:26:23.966990 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:26:23.966962 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 26 15:30:49.707551 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:30:49.707519 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pls4f_f635642a-6974-4f41-adf9-e7ec1fe16090/ovn-acl-logging/0.log" May 26 15:30:49.708405 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:30:49.708383 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pls4f_f635642a-6974-4f41-adf9-e7ec1fe16090/ovn-acl-logging/0.log" May 26 15:33:47.171138 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:33:47.171097 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-test-apply-csj52"] May 26 15:33:47.174507 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:33:47.174490 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-csj52" May 26 15:33:47.177153 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:33:47.177133 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\"" May 26 15:33:47.177255 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:33:47.177238 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" May 26 15:33:47.177303 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:33:47.177262 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" May 26 15:33:47.178376 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:33:47.178337 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-b94hz\"" May 26 15:33:47.180289 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:33:47.180268 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-csj52"] May 26 15:33:47.372871 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:33:47.372831 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6xf6\" (UniqueName: \"kubernetes.io/projected/1fa49e22-1d53-4b45-9a59-f7c6f2026ab2-kube-api-access-x6xf6\") pod \"feast-test-apply-csj52\" (UID: \"1fa49e22-1d53-4b45-9a59-f7c6f2026ab2\") " pod="test-ns-feast/feast-test-apply-csj52" May 26 15:33:47.474164 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:33:47.474114 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x6xf6\" (UniqueName: \"kubernetes.io/projected/1fa49e22-1d53-4b45-9a59-f7c6f2026ab2-kube-api-access-x6xf6\") pod \"feast-test-apply-csj52\" (UID: \"1fa49e22-1d53-4b45-9a59-f7c6f2026ab2\") " pod="test-ns-feast/feast-test-apply-csj52" May 26 15:33:47.482945 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:33:47.482922 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6xf6\" (UniqueName: \"kubernetes.io/projected/1fa49e22-1d53-4b45-9a59-f7c6f2026ab2-kube-api-access-x6xf6\") pod \"feast-test-apply-csj52\" (UID: \"1fa49e22-1d53-4b45-9a59-f7c6f2026ab2\") " pod="test-ns-feast/feast-test-apply-csj52" May 26 15:33:47.495698 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:33:47.495646 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-csj52" May 26 15:33:47.620626 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:33:47.620438 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-csj52"] May 26 15:33:47.623316 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:33:47.623287 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1fa49e22_1d53_4b45_9a59_f7c6f2026ab2.slice/crio-8daa9777afc1b7288764c98bda00e34dad84996121cec484110d6a7214780522 WatchSource:0}: Error finding container 8daa9777afc1b7288764c98bda00e34dad84996121cec484110d6a7214780522: Status 404 returned error can't find the container with id 8daa9777afc1b7288764c98bda00e34dad84996121cec484110d6a7214780522 May 26 15:33:47.624922 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:33:47.624905 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 26 15:33:48.261744 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:33:48.261695 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-csj52" event={"ID":"1fa49e22-1d53-4b45-9a59-f7c6f2026ab2","Type":"ContainerStarted","Data":"8daa9777afc1b7288764c98bda00e34dad84996121cec484110d6a7214780522"} May 26 15:33:53.024012 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:33:53.023977 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\"" May 26 15:33:53.278709 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:33:53.278608 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-csj52" event={"ID":"1fa49e22-1d53-4b45-9a59-f7c6f2026ab2","Type":"ContainerStarted","Data":"281a42e978efcd8b60055d1591000a48d2161d3812f1e99dc3f0d8974831e299"} May 26 15:34:00.300104 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:34:00.300003 2566 generic.go:358] "Generic (PLEG): container finished" podID="1fa49e22-1d53-4b45-9a59-f7c6f2026ab2" containerID="281a42e978efcd8b60055d1591000a48d2161d3812f1e99dc3f0d8974831e299" exitCode=0 May 26 15:34:00.300104 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:34:00.300070 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-csj52" event={"ID":"1fa49e22-1d53-4b45-9a59-f7c6f2026ab2","Type":"ContainerDied","Data":"281a42e978efcd8b60055d1591000a48d2161d3812f1e99dc3f0d8974831e299"} May 26 15:34:01.304260 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:34:01.304226 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-csj52" event={"ID":"1fa49e22-1d53-4b45-9a59-f7c6f2026ab2","Type":"ContainerStarted","Data":"473dde8d005b038975211f8b77ff36dc041359dba0b6b09e733bdc1df32f89c2"} May 26 15:34:01.321428 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:34:01.321376 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-test-apply-csj52" podStartSLOduration=8.925322644 podStartE2EDuration="14.321363927s" podCreationTimestamp="2026-05-26 15:33:47 +0000 UTC" firstStartedPulling="2026-05-26 15:33:47.625026587 +0000 UTC m=+778.449043386" lastFinishedPulling="2026-05-26 15:33:53.021067857 +0000 UTC m=+783.845084669" observedRunningTime="2026-05-26 15:34:01.320952028 +0000 UTC m=+792.144968848" watchObservedRunningTime="2026-05-26 15:34:01.321363927 +0000 UTC m=+792.145380747" May 26 15:34:10.332402 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:34:10.332366 2566 generic.go:358] "Generic (PLEG): container finished" podID="1fa49e22-1d53-4b45-9a59-f7c6f2026ab2" containerID="473dde8d005b038975211f8b77ff36dc041359dba0b6b09e733bdc1df32f89c2" exitCode=0 May 26 15:34:10.332402 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:34:10.332413 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-csj52" event={"ID":"1fa49e22-1d53-4b45-9a59-f7c6f2026ab2","Type":"ContainerDied","Data":"473dde8d005b038975211f8b77ff36dc041359dba0b6b09e733bdc1df32f89c2"} May 26 15:34:11.458985 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:34:11.458953 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-csj52" May 26 15:34:11.580772 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:34:11.580726 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6xf6\" (UniqueName: \"kubernetes.io/projected/1fa49e22-1d53-4b45-9a59-f7c6f2026ab2-kube-api-access-x6xf6\") pod \"1fa49e22-1d53-4b45-9a59-f7c6f2026ab2\" (UID: \"1fa49e22-1d53-4b45-9a59-f7c6f2026ab2\") " May 26 15:34:11.582940 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:34:11.582907 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fa49e22-1d53-4b45-9a59-f7c6f2026ab2-kube-api-access-x6xf6" (OuterVolumeSpecName: "kube-api-access-x6xf6") pod "1fa49e22-1d53-4b45-9a59-f7c6f2026ab2" (UID: "1fa49e22-1d53-4b45-9a59-f7c6f2026ab2"). InnerVolumeSpecName "kube-api-access-x6xf6". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 15:34:11.681611 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:34:11.681573 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6xf6\" (UniqueName: \"kubernetes.io/projected/1fa49e22-1d53-4b45-9a59-f7c6f2026ab2-kube-api-access-x6xf6\") on node \"ip-10-0-129-103.ec2.internal\" DevicePath \"\"" May 26 15:34:12.339972 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:34:12.339937 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-csj52" event={"ID":"1fa49e22-1d53-4b45-9a59-f7c6f2026ab2","Type":"ContainerDied","Data":"8daa9777afc1b7288764c98bda00e34dad84996121cec484110d6a7214780522"} May 26 15:34:12.339972 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:34:12.339979 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8daa9777afc1b7288764c98bda00e34dad84996121cec484110d6a7214780522" May 26 15:34:12.340179 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:34:12.339952 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-csj52" May 26 15:34:12.511714 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:34:12.511681 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-csj52_1fa49e22-1d53-4b45-9a59-f7c6f2026ab2/feast-0/0.log" May 26 15:34:12.518848 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:34:12.518821 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-csj52_1fa49e22-1d53-4b45-9a59-f7c6f2026ab2/feast-1/0.log" May 26 15:34:47.995067 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:34:47.995032 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-test-apply-csj52"] May 26 15:34:47.998414 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:34:47.998384 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-test-apply-csj52"] May 26 15:34:49.772213 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:34:49.772178 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fa49e22-1d53-4b45-9a59-f7c6f2026ab2" path="/var/lib/kubelet/pods/1fa49e22-1d53-4b45-9a59-f7c6f2026ab2/volumes" May 26 15:35:49.730850 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:35:49.730810 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pls4f_f635642a-6974-4f41-adf9-e7ec1fe16090/ovn-acl-logging/0.log" May 26 15:35:49.732054 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:35:49.732034 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pls4f_f635642a-6974-4f41-adf9-e7ec1fe16090/ovn-acl-logging/0.log" May 26 15:40:49.758258 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:40:49.758217 2566 scope.go:117] "RemoveContainer" containerID="281a42e978efcd8b60055d1591000a48d2161d3812f1e99dc3f0d8974831e299" May 26 15:40:49.760567 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:40:49.760534 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pls4f_f635642a-6974-4f41-adf9-e7ec1fe16090/ovn-acl-logging/0.log" May 26 15:40:49.763066 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:40:49.763045 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pls4f_f635642a-6974-4f41-adf9-e7ec1fe16090/ovn-acl-logging/0.log" May 26 15:40:49.767692 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:40:49.767650 2566 scope.go:117] "RemoveContainer" containerID="473dde8d005b038975211f8b77ff36dc041359dba0b6b09e733bdc1df32f89c2" May 26 15:45:49.783393 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:45:49.783360 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pls4f_f635642a-6974-4f41-adf9-e7ec1fe16090/ovn-acl-logging/0.log" May 26 15:45:49.787401 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:45:49.787377 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pls4f_f635642a-6974-4f41-adf9-e7ec1fe16090/ovn-acl-logging/0.log" May 26 15:50:17.464183 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:17.464154 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5lmkt_cca6b815-6207-49c3-a510-5c66f4e39f20/global-pull-secret-syncer/0.log" May 26 15:50:17.620196 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:17.620170 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-99gbh_2cf92f21-f6fe-4299-89a9-783c9b8a0433/konnectivity-agent/0.log" May 26 15:50:17.708090 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:17.708066 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-103.ec2.internal_30917405c30aa8defd1b7702e54589bd/haproxy/0.log" May 26 15:50:20.715548 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:20.715516 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_06ca37fc-54d0-463c-9ac1-3a64cf8f2f00/alertmanager/0.log" May 26 15:50:20.746182 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:20.746154 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_06ca37fc-54d0-463c-9ac1-3a64cf8f2f00/config-reloader/0.log" May 26 15:50:20.770212 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:20.770188 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_06ca37fc-54d0-463c-9ac1-3a64cf8f2f00/kube-rbac-proxy-web/0.log" May 26 15:50:20.800237 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:20.800214 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_06ca37fc-54d0-463c-9ac1-3a64cf8f2f00/kube-rbac-proxy/0.log" May 26 15:50:20.825896 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:20.825874 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_06ca37fc-54d0-463c-9ac1-3a64cf8f2f00/kube-rbac-proxy-metric/0.log" May 26 15:50:20.854648 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:20.854620 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_06ca37fc-54d0-463c-9ac1-3a64cf8f2f00/prom-label-proxy/0.log" May 26 15:50:20.882931 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:20.882905 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_06ca37fc-54d0-463c-9ac1-3a64cf8f2f00/init-config-reloader/0.log" May 26 15:50:20.923383 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:20.923356 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-zl9fs_0eed844c-87f5-403c-846c-6a0d177f47db/cluster-monitoring-operator/0.log" May 26 15:50:21.103054 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:21.102980 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b2qb9_656d13a7-2e82-4f26-90d1-7deac8d18093/node-exporter/0.log" May 26 15:50:21.130061 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:21.130034 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b2qb9_656d13a7-2e82-4f26-90d1-7deac8d18093/kube-rbac-proxy/0.log" May 26 15:50:21.154086 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:21.154054 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b2qb9_656d13a7-2e82-4f26-90d1-7deac8d18093/init-textfile/0.log" May 26 15:50:21.379088 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:21.379007 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-82bs9_649403a6-7d72-497d-b6fe-dcbdbd4e8af4/kube-rbac-proxy-main/0.log" May 26 15:50:21.405762 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:21.405731 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-82bs9_649403a6-7d72-497d-b6fe-dcbdbd4e8af4/kube-rbac-proxy-self/0.log" May 26 15:50:21.431058 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:21.431030 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-82bs9_649403a6-7d72-497d-b6fe-dcbdbd4e8af4/openshift-state-metrics/0.log" May 26 15:50:21.469493 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:21.469467 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e96c2604-603f-4f1d-973e-bc4da77f92d9/prometheus/0.log" May 26 15:50:21.495883 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:21.495857 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e96c2604-603f-4f1d-973e-bc4da77f92d9/config-reloader/0.log" May 26 15:50:21.521910 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:21.521886 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e96c2604-603f-4f1d-973e-bc4da77f92d9/thanos-sidecar/0.log" May 26 15:50:21.544848 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:21.544824 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e96c2604-603f-4f1d-973e-bc4da77f92d9/kube-rbac-proxy-web/0.log" May 26 15:50:21.570735 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:21.570705 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e96c2604-603f-4f1d-973e-bc4da77f92d9/kube-rbac-proxy/0.log" May 26 15:50:21.597763 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:21.597737 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e96c2604-603f-4f1d-973e-bc4da77f92d9/kube-rbac-proxy-thanos/0.log" May 26 15:50:21.622934 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:21.622907 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e96c2604-603f-4f1d-973e-bc4da77f92d9/init-config-reloader/0.log" May 26 15:50:21.655321 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:21.655243 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-m9rqw_c13bd2d0-638e-4c4d-910a-74c32387a889/prometheus-operator/0.log" May 26 15:50:21.676166 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:21.676142 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-m9rqw_c13bd2d0-638e-4c4d-910a-74c32387a889/kube-rbac-proxy/0.log" May 26 15:50:21.703133 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:21.703110 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-tcxcb_42f03e67-583d-43a7-8b1b-55aa466bc589/prometheus-operator-admission-webhook/0.log" May 26 15:50:21.734686 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:21.734642 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67696c5675-5tvnt_5682f4a2-29ce-458d-b7c3-b697301427dd/telemeter-client/0.log" May 26 15:50:21.760379 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:21.760355 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67696c5675-5tvnt_5682f4a2-29ce-458d-b7c3-b697301427dd/reload/0.log" May 26 15:50:21.784480 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:21.784448 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67696c5675-5tvnt_5682f4a2-29ce-458d-b7c3-b697301427dd/kube-rbac-proxy/0.log" May 26 15:50:21.817536 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:21.817512 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56484456c8-wbrxm_8f826df4-0674-4665-ba63-4c1ce848275d/thanos-query/0.log" May 26 15:50:21.841755 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:21.841730 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56484456c8-wbrxm_8f826df4-0674-4665-ba63-4c1ce848275d/kube-rbac-proxy-web/0.log" May 26 15:50:21.868271 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:21.868245 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56484456c8-wbrxm_8f826df4-0674-4665-ba63-4c1ce848275d/kube-rbac-proxy/0.log" May 26 15:50:21.894103 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:21.894080 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56484456c8-wbrxm_8f826df4-0674-4665-ba63-4c1ce848275d/prom-label-proxy/0.log" May 26 15:50:21.931907 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:21.931886 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56484456c8-wbrxm_8f826df4-0674-4665-ba63-4c1ce848275d/kube-rbac-proxy-rules/0.log" May 26 15:50:21.962567 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:21.962540 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56484456c8-wbrxm_8f826df4-0674-4665-ba63-4c1ce848275d/kube-rbac-proxy-metrics/0.log" May 26 15:50:23.940984 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:23.940953 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8ln6p/perf-node-gather-daemonset-kq4ns"] May 26 15:50:23.941367 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:23.941278 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fa49e22-1d53-4b45-9a59-f7c6f2026ab2" containerName="feast-1" May 26 15:50:23.941367 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:23.941288 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fa49e22-1d53-4b45-9a59-f7c6f2026ab2" containerName="feast-1" May 26 15:50:23.941367 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:23.941313 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fa49e22-1d53-4b45-9a59-f7c6f2026ab2" containerName="feast-0" May 26 15:50:23.941367 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:23.941319 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fa49e22-1d53-4b45-9a59-f7c6f2026ab2" containerName="feast-0" May 26 15:50:23.941492 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:23.941371 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="1fa49e22-1d53-4b45-9a59-f7c6f2026ab2" containerName="feast-1" May 26 15:50:23.946533 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:23.946513 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8ln6p/perf-node-gather-daemonset-kq4ns" May 26 15:50:23.949414 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:23.949396 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8ln6p\"/\"openshift-service-ca.crt\"" May 26 15:50:23.950583 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:23.950561 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8ln6p\"/\"default-dockercfg-s9jsb\"" May 26 15:50:23.950583 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:23.950569 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8ln6p\"/\"kube-root-ca.crt\"" May 26 15:50:23.963132 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:23.958579 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8ln6p/perf-node-gather-daemonset-kq4ns"] May 26 15:50:24.000474 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:24.000442 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f4878495-8345-48f7-bf79-830d0a0ba635-proc\") pod \"perf-node-gather-daemonset-kq4ns\" (UID: \"f4878495-8345-48f7-bf79-830d0a0ba635\") " pod="openshift-must-gather-8ln6p/perf-node-gather-daemonset-kq4ns" May 26 15:50:24.000637 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:24.000487 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f4878495-8345-48f7-bf79-830d0a0ba635-lib-modules\") pod \"perf-node-gather-daemonset-kq4ns\" (UID: \"f4878495-8345-48f7-bf79-830d0a0ba635\") " pod="openshift-must-gather-8ln6p/perf-node-gather-daemonset-kq4ns" May 26 15:50:24.000637 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:24.000516 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qn8s5\" (UniqueName: \"kubernetes.io/projected/f4878495-8345-48f7-bf79-830d0a0ba635-kube-api-access-qn8s5\") pod \"perf-node-gather-daemonset-kq4ns\" (UID: \"f4878495-8345-48f7-bf79-830d0a0ba635\") " pod="openshift-must-gather-8ln6p/perf-node-gather-daemonset-kq4ns" May 26 15:50:24.000637 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:24.000594 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f4878495-8345-48f7-bf79-830d0a0ba635-sys\") pod \"perf-node-gather-daemonset-kq4ns\" (UID: \"f4878495-8345-48f7-bf79-830d0a0ba635\") " pod="openshift-must-gather-8ln6p/perf-node-gather-daemonset-kq4ns" May 26 15:50:24.000771 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:24.000684 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f4878495-8345-48f7-bf79-830d0a0ba635-podres\") pod \"perf-node-gather-daemonset-kq4ns\" (UID: \"f4878495-8345-48f7-bf79-830d0a0ba635\") " pod="openshift-must-gather-8ln6p/perf-node-gather-daemonset-kq4ns" May 26 15:50:24.101855 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:24.101817 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f4878495-8345-48f7-bf79-830d0a0ba635-podres\") pod \"perf-node-gather-daemonset-kq4ns\" (UID: \"f4878495-8345-48f7-bf79-830d0a0ba635\") " pod="openshift-must-gather-8ln6p/perf-node-gather-daemonset-kq4ns" May 26 15:50:24.102030 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:24.101873 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f4878495-8345-48f7-bf79-830d0a0ba635-proc\") pod \"perf-node-gather-daemonset-kq4ns\" (UID: \"f4878495-8345-48f7-bf79-830d0a0ba635\") " pod="openshift-must-gather-8ln6p/perf-node-gather-daemonset-kq4ns" May 26 15:50:24.102030 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:24.101908 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f4878495-8345-48f7-bf79-830d0a0ba635-lib-modules\") pod \"perf-node-gather-daemonset-kq4ns\" (UID: \"f4878495-8345-48f7-bf79-830d0a0ba635\") " pod="openshift-must-gather-8ln6p/perf-node-gather-daemonset-kq4ns" May 26 15:50:24.102030 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:24.101929 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qn8s5\" (UniqueName: \"kubernetes.io/projected/f4878495-8345-48f7-bf79-830d0a0ba635-kube-api-access-qn8s5\") pod \"perf-node-gather-daemonset-kq4ns\" (UID: \"f4878495-8345-48f7-bf79-830d0a0ba635\") " pod="openshift-must-gather-8ln6p/perf-node-gather-daemonset-kq4ns" May 26 15:50:24.102030 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:24.101954 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f4878495-8345-48f7-bf79-830d0a0ba635-sys\") pod \"perf-node-gather-daemonset-kq4ns\" (UID: \"f4878495-8345-48f7-bf79-830d0a0ba635\") " pod="openshift-must-gather-8ln6p/perf-node-gather-daemonset-kq4ns" May 26 15:50:24.102030 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:24.101960 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f4878495-8345-48f7-bf79-830d0a0ba635-proc\") pod \"perf-node-gather-daemonset-kq4ns\" (UID: \"f4878495-8345-48f7-bf79-830d0a0ba635\") " pod="openshift-must-gather-8ln6p/perf-node-gather-daemonset-kq4ns" May 26 15:50:24.102030 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:24.101981 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f4878495-8345-48f7-bf79-830d0a0ba635-podres\") pod \"perf-node-gather-daemonset-kq4ns\" (UID: \"f4878495-8345-48f7-bf79-830d0a0ba635\") " pod="openshift-must-gather-8ln6p/perf-node-gather-daemonset-kq4ns" May 26 15:50:24.102251 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:24.102044 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f4878495-8345-48f7-bf79-830d0a0ba635-sys\") pod \"perf-node-gather-daemonset-kq4ns\" (UID: \"f4878495-8345-48f7-bf79-830d0a0ba635\") " pod="openshift-must-gather-8ln6p/perf-node-gather-daemonset-kq4ns" May 26 15:50:24.102251 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:24.102081 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f4878495-8345-48f7-bf79-830d0a0ba635-lib-modules\") pod \"perf-node-gather-daemonset-kq4ns\" (UID: \"f4878495-8345-48f7-bf79-830d0a0ba635\") " pod="openshift-must-gather-8ln6p/perf-node-gather-daemonset-kq4ns" May 26 15:50:24.111187 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:24.111156 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qn8s5\" (UniqueName: \"kubernetes.io/projected/f4878495-8345-48f7-bf79-830d0a0ba635-kube-api-access-qn8s5\") pod \"perf-node-gather-daemonset-kq4ns\" (UID: \"f4878495-8345-48f7-bf79-830d0a0ba635\") " pod="openshift-must-gather-8ln6p/perf-node-gather-daemonset-kq4ns" May 26 15:50:24.260245 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:24.260158 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8ln6p/perf-node-gather-daemonset-kq4ns" May 26 15:50:24.386740 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:24.386709 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8ln6p/perf-node-gather-daemonset-kq4ns"] May 26 15:50:24.389930 ip-10-0-129-103 kubenswrapper[2566]: W0526 15:50:24.389889 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf4878495_8345_48f7_bf79_830d0a0ba635.slice/crio-a91166f54ebf2fda5aad9297b6f2b9a108b58ee79e76f630a8792bea6e4702aa WatchSource:0}: Error finding container a91166f54ebf2fda5aad9297b6f2b9a108b58ee79e76f630a8792bea6e4702aa: Status 404 returned error can't find the container with id a91166f54ebf2fda5aad9297b6f2b9a108b58ee79e76f630a8792bea6e4702aa May 26 15:50:24.391498 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:24.391481 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 26 15:50:24.995441 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:24.995407 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9zv2j_a538280e-ec4c-477b-a61a-cdb23e4f91cb/dns/0.log" May 26 15:50:25.018324 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:25.018296 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9zv2j_a538280e-ec4c-477b-a61a-cdb23e4f91cb/kube-rbac-proxy/0.log" May 26 15:50:25.200116 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:25.200083 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sh6pn_44a8069f-bc00-4b3d-86da-9e01d0946556/dns-node-resolver/0.log" May 26 15:50:25.241575 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:25.241540 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8ln6p/perf-node-gather-daemonset-kq4ns" event={"ID":"f4878495-8345-48f7-bf79-830d0a0ba635","Type":"ContainerStarted","Data":"5727f31e03f10a32706a17464a48dbd429a1b19b9b2ea0edcd498c194f76d7a3"} May 26 15:50:25.241760 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:25.241581 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8ln6p/perf-node-gather-daemonset-kq4ns" event={"ID":"f4878495-8345-48f7-bf79-830d0a0ba635","Type":"ContainerStarted","Data":"a91166f54ebf2fda5aad9297b6f2b9a108b58ee79e76f630a8792bea6e4702aa"} May 26 15:50:25.241760 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:25.241601 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8ln6p/perf-node-gather-daemonset-kq4ns" May 26 15:50:25.259124 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:25.259039 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-8ln6p/perf-node-gather-daemonset-kq4ns" podStartSLOduration=2.259021767 podStartE2EDuration="2.259021767s" podCreationTimestamp="2026-05-26 15:50:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 15:50:25.258784546 +0000 UTC m=+1776.082801367" watchObservedRunningTime="2026-05-26 15:50:25.259021767 +0000 UTC m=+1776.083038588" May 26 15:50:25.649467 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:25.649386 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hf95k_db0ab8ec-7e6f-49ab-a120-bc7424a7a75d/node-ca/0.log" May 26 15:50:26.787097 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:26.787066 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qnqmv_0748d4e5-f906-42ba-8f02-543c7cdde1da/serve-healthcheck-canary/0.log" May 26 15:50:27.174458 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:27.174427 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ll9c5_9d214483-c3b0-4ae3-9a2f-4d8c7d90a881/kube-rbac-proxy/0.log" May 26 15:50:27.197304 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:27.197274 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ll9c5_9d214483-c3b0-4ae3-9a2f-4d8c7d90a881/exporter/0.log" May 26 15:50:27.221128 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:27.221104 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ll9c5_9d214483-c3b0-4ae3-9a2f-4d8c7d90a881/extractor/0.log" May 26 15:50:31.255085 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:31.255001 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8ln6p/perf-node-gather-daemonset-kq4ns" May 26 15:50:31.642602 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:31.642526 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-n8skw_17ea91cc-e67c-4030-b730-3cd958827e92/migrator/0.log" May 26 15:50:31.665482 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:31.665459 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-n8skw_17ea91cc-e67c-4030-b730-3cd958827e92/graceful-termination/0.log" May 26 15:50:31.981793 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:31.981764 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-sttlr_e837500d-b8b7-4216-a212-39b44e868435/kube-storage-version-migrator-operator/1.log" May 26 15:50:31.982536 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:31.982515 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-sttlr_e837500d-b8b7-4216-a212-39b44e868435/kube-storage-version-migrator-operator/0.log" May 26 15:50:33.459266 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:33.459240 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zr86w_27d969eb-42bb-4133-b203-406a10027876/kube-multus-additional-cni-plugins/0.log" May 26 15:50:33.483795 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:33.483771 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zr86w_27d969eb-42bb-4133-b203-406a10027876/egress-router-binary-copy/0.log" May 26 15:50:33.507971 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:33.507948 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zr86w_27d969eb-42bb-4133-b203-406a10027876/cni-plugins/0.log" May 26 15:50:33.530978 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:33.530954 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zr86w_27d969eb-42bb-4133-b203-406a10027876/bond-cni-plugin/0.log" May 26 15:50:33.551267 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:33.551243 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zr86w_27d969eb-42bb-4133-b203-406a10027876/routeoverride-cni/0.log" May 26 15:50:33.574226 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:33.574199 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zr86w_27d969eb-42bb-4133-b203-406a10027876/whereabouts-cni-bincopy/0.log" May 26 15:50:33.598712 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:33.598683 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zr86w_27d969eb-42bb-4133-b203-406a10027876/whereabouts-cni/0.log" May 26 15:50:33.666535 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:33.666507 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pmrcn_ab586da9-46af-4ac1-b026-1460a6b36d9b/kube-multus/0.log" May 26 15:50:33.754344 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:33.754269 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7v4tq_3822d872-a967-4800-8e87-c7d73d8f6c36/network-metrics-daemon/0.log" May 26 15:50:33.776952 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:33.776928 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7v4tq_3822d872-a967-4800-8e87-c7d73d8f6c36/kube-rbac-proxy/0.log" May 26 15:50:34.994134 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:34.994109 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pls4f_f635642a-6974-4f41-adf9-e7ec1fe16090/ovn-controller/0.log" May 26 15:50:35.015271 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:35.015242 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pls4f_f635642a-6974-4f41-adf9-e7ec1fe16090/ovn-acl-logging/0.log" May 26 15:50:35.022777 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:35.022754 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pls4f_f635642a-6974-4f41-adf9-e7ec1fe16090/ovn-acl-logging/1.log" May 26 15:50:35.042058 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:35.042035 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pls4f_f635642a-6974-4f41-adf9-e7ec1fe16090/kube-rbac-proxy-node/0.log" May 26 15:50:35.065252 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:35.065221 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pls4f_f635642a-6974-4f41-adf9-e7ec1fe16090/kube-rbac-proxy-ovn-metrics/0.log" May 26 15:50:35.087346 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:35.087324 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pls4f_f635642a-6974-4f41-adf9-e7ec1fe16090/northd/0.log" May 26 15:50:35.112834 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:35.112808 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pls4f_f635642a-6974-4f41-adf9-e7ec1fe16090/nbdb/0.log" May 26 15:50:35.157285 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:35.157213 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pls4f_f635642a-6974-4f41-adf9-e7ec1fe16090/sbdb/0.log" May 26 15:50:35.266453 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:35.266423 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pls4f_f635642a-6974-4f41-adf9-e7ec1fe16090/ovnkube-controller/0.log" May 26 15:50:36.560891 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:36.560853 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-49ztl_72f4a6a1-504d-47f8-a1e8-82d3a081c6f9/network-check-target-container/0.log" May 26 15:50:37.526973 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:37.526943 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-f6zxq_6224e4f7-52cd-4679-852d-8fe102d8bb91/iptables-alerter/0.log" May 26 15:50:38.259082 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:38.259050 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-w7spm_8f3bf1e5-e3c6-48e7-8bf5-0a04c341bc64/tuned/0.log" May 26 15:50:40.096344 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:40.096308 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-697587599-57tdf_f031b6fb-d2d8-40fa-a5b8-8962b62e9f37/cluster-samples-operator/0.log" May 26 15:50:40.129788 ip-10-0-129-103 kubenswrapper[2566]: I0526 15:50:40.129752 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-697587599-57tdf_f031b6fb-d2d8-40fa-a5b8-8962b62e9f37/cluster-samples-operator-watch/0.log"