May 29 14:43:38.854080 ip-10-0-129-189 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 29 14:43:38.854092 ip-10-0-129-189 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 29 14:43:38.854099 ip-10-0-129-189 systemd[1]: kubelet.service: Failed with result 'resources'. May 29 14:43:38.854375 ip-10-0-129-189 systemd[1]: Failed to start Kubernetes Kubelet. May 29 14:43:48.985377 ip-10-0-129-189 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 29 14:43:48.985395 ip-10-0-129-189 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot b442831bcdca464db342979b145b41a0 -- May 29 14:46:19.037474 ip-10-0-129-189 systemd[1]: Starting Kubernetes Kubelet... May 29 14:46:19.419098 ip-10-0-129-189 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 29 14:46:19.419098 ip-10-0-129-189 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 29 14:46:19.419098 ip-10-0-129-189 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 29 14:46:19.419098 ip-10-0-129-189 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 29 14:46:19.419098 ip-10-0-129-189 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 29 14:46:19.420616 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.420527 2564 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 29 14:46:19.423152 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423137 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 14:46:19.423152 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423152 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 14:46:19.423227 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423156 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 14:46:19.423227 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423159 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 14:46:19.423227 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423162 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 14:46:19.423227 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423165 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 14:46:19.423227 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423184 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 14:46:19.423227 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423187 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 14:46:19.423227 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423190 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 14:46:19.423227 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423193 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 14:46:19.423227 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423196 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 14:46:19.423227 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423199 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 14:46:19.423227 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423201 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 14:46:19.423227 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423204 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 14:46:19.423227 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423207 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 14:46:19.423227 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423209 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 14:46:19.423227 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423212 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 14:46:19.423227 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423214 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 14:46:19.423227 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423217 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 14:46:19.423227 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423219 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 14:46:19.423227 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423223 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 14:46:19.423227 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423225 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 14:46:19.423701 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423228 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 14:46:19.423701 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423233 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 14:46:19.423701 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423237 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 14:46:19.423701 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423240 2564 feature_gate.go:328] unrecognized feature gate: Example May 29 14:46:19.423701 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423243 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 14:46:19.423701 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423245 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 14:46:19.423701 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423248 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 14:46:19.423701 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423251 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 14:46:19.423701 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423253 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 14:46:19.423701 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423256 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 14:46:19.423701 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423258 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 14:46:19.423701 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423260 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 14:46:19.423701 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423263 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 14:46:19.423701 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423265 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 14:46:19.423701 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423268 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 14:46:19.423701 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423270 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 14:46:19.423701 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423273 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 14:46:19.423701 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423275 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 14:46:19.423701 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423278 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 14:46:19.423701 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423280 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 14:46:19.424204 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423283 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 14:46:19.424204 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423285 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 14:46:19.424204 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423288 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 14:46:19.424204 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423291 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 14:46:19.424204 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423293 2564 feature_gate.go:328] unrecognized feature gate: Example2 May 29 14:46:19.424204 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423296 2564 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 14:46:19.424204 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423299 2564 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 14:46:19.424204 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423301 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 14:46:19.424204 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423303 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 14:46:19.424204 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423307 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 14:46:19.424204 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423310 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 14:46:19.424204 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423313 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 14:46:19.424204 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423315 2564 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 14:46:19.424204 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423318 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 14:46:19.424204 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423321 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 14:46:19.424204 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423323 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 14:46:19.424204 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423326 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 14:46:19.424204 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423328 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 14:46:19.424204 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423331 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 14:46:19.424204 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423333 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 14:46:19.424760 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423336 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 14:46:19.424760 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423338 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 14:46:19.424760 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423341 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 14:46:19.424760 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423343 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 14:46:19.424760 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423347 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 14:46:19.424760 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423349 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 14:46:19.424760 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423352 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 14:46:19.424760 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423354 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 14:46:19.424760 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423357 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 14:46:19.424760 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423359 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 14:46:19.424760 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423362 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 14:46:19.424760 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423365 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 14:46:19.424760 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423367 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 14:46:19.424760 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423370 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 14:46:19.424760 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423372 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 14:46:19.424760 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423375 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 14:46:19.424760 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423377 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 14:46:19.424760 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423380 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 14:46:19.424760 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423382 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 14:46:19.424760 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423384 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 14:46:19.425251 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423387 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 14:46:19.425251 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423390 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 14:46:19.425251 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423393 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 14:46:19.425251 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423396 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 14:46:19.425251 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423774 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 14:46:19.425251 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423781 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 14:46:19.425251 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423784 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 14:46:19.425251 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423787 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 14:46:19.425251 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423789 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 14:46:19.425251 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423792 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 14:46:19.425251 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423795 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 14:46:19.425251 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423798 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 14:46:19.425251 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423802 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 14:46:19.425251 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423804 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 14:46:19.425251 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423807 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 14:46:19.425251 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423810 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 14:46:19.425251 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423812 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 14:46:19.425251 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423815 2564 feature_gate.go:328] unrecognized feature gate: Example May 29 14:46:19.425251 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423818 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 14:46:19.425251 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423820 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 14:46:19.425715 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423823 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 14:46:19.425715 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423825 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 14:46:19.425715 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423828 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 14:46:19.425715 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423831 2564 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 14:46:19.425715 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423833 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 14:46:19.425715 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423836 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 14:46:19.425715 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423838 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 14:46:19.425715 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423841 2564 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 14:46:19.425715 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423844 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 14:46:19.425715 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423846 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 14:46:19.425715 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423849 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 14:46:19.425715 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423853 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 14:46:19.425715 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423856 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 14:46:19.425715 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423860 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 14:46:19.425715 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423863 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 14:46:19.425715 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423865 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 14:46:19.425715 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423868 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 14:46:19.425715 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423871 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 14:46:19.425715 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423874 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 14:46:19.425715 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423876 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 14:46:19.426225 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423879 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 14:46:19.426225 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423882 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 14:46:19.426225 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423884 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 14:46:19.426225 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423887 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 14:46:19.426225 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423889 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 14:46:19.426225 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423892 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 14:46:19.426225 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423894 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 14:46:19.426225 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423896 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 14:46:19.426225 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423899 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 14:46:19.426225 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423901 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 14:46:19.426225 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423903 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 14:46:19.426225 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423906 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 14:46:19.426225 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423908 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 14:46:19.426225 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423910 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 14:46:19.426225 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423913 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 14:46:19.426225 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423916 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 14:46:19.426225 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423919 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 14:46:19.426225 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423922 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 14:46:19.426225 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423924 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 14:46:19.426225 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423927 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 14:46:19.426710 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423929 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 14:46:19.426710 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423931 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 14:46:19.426710 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423934 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 14:46:19.426710 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423936 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 14:46:19.426710 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423938 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 14:46:19.426710 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423941 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 14:46:19.426710 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423944 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 14:46:19.426710 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423946 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 14:46:19.426710 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423949 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 14:46:19.426710 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423951 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 14:46:19.426710 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423954 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 14:46:19.426710 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423956 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 14:46:19.426710 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423959 2564 feature_gate.go:328] unrecognized feature gate: Example2 May 29 14:46:19.426710 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423961 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 14:46:19.426710 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423964 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 14:46:19.426710 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423966 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 14:46:19.426710 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423969 2564 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 14:46:19.426710 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423971 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 14:46:19.426710 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423974 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 14:46:19.427183 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423976 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 14:46:19.427183 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423979 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 14:46:19.427183 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423981 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 14:46:19.427183 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423984 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 14:46:19.427183 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423986 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 14:46:19.427183 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423989 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 14:46:19.427183 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423991 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 14:46:19.427183 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423993 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 14:46:19.427183 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423996 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 14:46:19.427183 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.423999 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 14:46:19.427183 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.424002 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 14:46:19.427183 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424688 2564 flags.go:64] FLAG: --address="0.0.0.0" May 29 14:46:19.427183 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424696 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 29 14:46:19.427183 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424703 2564 flags.go:64] FLAG: --anonymous-auth="true" May 29 14:46:19.427183 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424708 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" May 29 14:46:19.427183 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424712 2564 flags.go:64] FLAG: --authentication-token-webhook="false" May 29 14:46:19.427183 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424715 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 29 14:46:19.427183 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424720 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 29 14:46:19.427183 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424724 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 29 14:46:19.427183 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424728 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 29 14:46:19.427183 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424731 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 29 14:46:19.427709 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424734 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 29 14:46:19.427709 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424737 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 29 14:46:19.427709 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424740 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 29 14:46:19.427709 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424743 2564 flags.go:64] FLAG: --cgroup-root="" May 29 14:46:19.427709 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424746 2564 flags.go:64] FLAG: --cgroups-per-qos="true" May 29 14:46:19.427709 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424749 2564 flags.go:64] FLAG: --client-ca-file="" May 29 14:46:19.427709 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424751 2564 flags.go:64] FLAG: --cloud-config="" May 29 14:46:19.427709 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424754 2564 flags.go:64] FLAG: --cloud-provider="external" May 29 14:46:19.427709 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424757 2564 flags.go:64] FLAG: --cluster-dns="[]" May 29 14:46:19.427709 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424763 2564 flags.go:64] FLAG: --cluster-domain="" May 29 14:46:19.427709 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424765 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 29 14:46:19.427709 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424768 2564 flags.go:64] FLAG: --config-dir="" May 29 14:46:19.427709 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424771 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 29 14:46:19.427709 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424775 2564 flags.go:64] FLAG: --container-log-max-files="5" May 29 14:46:19.427709 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424779 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" May 29 14:46:19.427709 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424782 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 29 14:46:19.427709 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424785 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 29 14:46:19.427709 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424788 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 29 14:46:19.427709 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424791 2564 flags.go:64] FLAG: --contention-profiling="false" May 29 14:46:19.427709 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424794 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" May 29 14:46:19.427709 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424797 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 29 14:46:19.427709 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424800 2564 flags.go:64] FLAG: --cpu-manager-policy="none" May 29 14:46:19.427709 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424803 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" May 29 14:46:19.427709 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424807 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 29 14:46:19.427709 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424810 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 29 14:46:19.428354 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424814 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" May 29 14:46:19.428354 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424816 2564 flags.go:64] FLAG: --enable-load-reader="false" May 29 14:46:19.428354 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424819 2564 flags.go:64] FLAG: --enable-server="true" May 29 14:46:19.428354 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424822 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 29 14:46:19.428354 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424827 2564 flags.go:64] FLAG: --event-burst="100" May 29 14:46:19.428354 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424830 2564 flags.go:64] FLAG: --event-qps="50" May 29 14:46:19.428354 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424833 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 29 14:46:19.428354 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424836 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 29 14:46:19.428354 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424840 2564 flags.go:64] FLAG: --eviction-hard="" May 29 14:46:19.428354 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424843 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 29 14:46:19.428354 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424846 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 29 14:46:19.428354 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424850 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 29 14:46:19.428354 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424853 2564 flags.go:64] FLAG: --eviction-soft="" May 29 14:46:19.428354 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424856 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" May 29 14:46:19.428354 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424859 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" May 29 14:46:19.428354 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424862 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 29 14:46:19.428354 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424865 2564 flags.go:64] FLAG: --experimental-mounter-path="" May 29 14:46:19.428354 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424868 2564 flags.go:64] FLAG: --fail-cgroupv1="false" May 29 14:46:19.428354 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424871 2564 flags.go:64] FLAG: --fail-swap-on="true" May 29 14:46:19.428354 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424874 2564 flags.go:64] FLAG: --feature-gates="" May 29 14:46:19.428354 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424877 2564 flags.go:64] FLAG: --file-check-frequency="20s" May 29 14:46:19.428354 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424881 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 29 14:46:19.428354 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424884 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 29 14:46:19.428354 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424887 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 29 14:46:19.428354 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424891 2564 flags.go:64] FLAG: --healthz-port="10248" May 29 14:46:19.428354 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424894 2564 flags.go:64] FLAG: --help="false" May 29 14:46:19.429002 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424897 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-129-189.ec2.internal" May 29 14:46:19.429002 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424900 2564 flags.go:64] FLAG: --housekeeping-interval="10s" May 29 14:46:19.429002 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424903 2564 flags.go:64] FLAG: --http-check-frequency="20s" May 29 14:46:19.429002 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424906 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 29 14:46:19.429002 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424909 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 29 14:46:19.429002 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424913 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" May 29 14:46:19.429002 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424916 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" May 29 14:46:19.429002 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424918 2564 flags.go:64] FLAG: --image-service-endpoint="" May 29 14:46:19.429002 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424921 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" May 29 14:46:19.429002 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424924 2564 flags.go:64] FLAG: --kube-api-burst="100" May 29 14:46:19.429002 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424928 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 29 14:46:19.429002 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424931 2564 flags.go:64] FLAG: --kube-api-qps="50" May 29 14:46:19.429002 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424934 2564 flags.go:64] FLAG: --kube-reserved="" May 29 14:46:19.429002 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424937 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" May 29 14:46:19.429002 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424940 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 29 14:46:19.429002 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424942 2564 flags.go:64] FLAG: --kubelet-cgroups="" May 29 14:46:19.429002 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424945 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 29 14:46:19.429002 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424948 2564 flags.go:64] FLAG: --lock-file="" May 29 14:46:19.429002 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424951 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" May 29 14:46:19.429002 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424954 2564 flags.go:64] FLAG: --log-flush-frequency="5s" May 29 14:46:19.429002 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424957 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 29 14:46:19.429002 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424965 2564 flags.go:64] FLAG: --log-json-split-stream="false" May 29 14:46:19.429002 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424968 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 29 14:46:19.429565 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424971 2564 flags.go:64] FLAG: --log-text-split-stream="false" May 29 14:46:19.429565 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424974 2564 flags.go:64] FLAG: --logging-format="text" May 29 14:46:19.429565 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424976 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 29 14:46:19.429565 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424980 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" May 29 14:46:19.429565 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424983 2564 flags.go:64] FLAG: --manifest-url="" May 29 14:46:19.429565 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424985 2564 flags.go:64] FLAG: --manifest-url-header="" May 29 14:46:19.429565 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424990 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 29 14:46:19.429565 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424993 2564 flags.go:64] FLAG: --max-open-files="1000000" May 29 14:46:19.429565 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.424997 2564 flags.go:64] FLAG: --max-pods="110" May 29 14:46:19.429565 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425000 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" May 29 14:46:19.429565 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425003 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 29 14:46:19.429565 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425006 2564 flags.go:64] FLAG: --memory-manager-policy="None" May 29 14:46:19.429565 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425009 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 29 14:46:19.429565 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425012 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 29 14:46:19.429565 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425015 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" May 29 14:46:19.429565 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425018 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 29 14:46:19.429565 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425025 2564 flags.go:64] FLAG: --node-status-max-images="50" May 29 14:46:19.429565 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425028 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" May 29 14:46:19.429565 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425031 2564 flags.go:64] FLAG: --oom-score-adj="-999" May 29 14:46:19.429565 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425035 2564 flags.go:64] FLAG: --pod-cidr="" May 29 14:46:19.429565 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425038 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" May 29 14:46:19.429565 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425043 2564 flags.go:64] FLAG: --pod-manifest-path="" May 29 14:46:19.429565 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425046 2564 flags.go:64] FLAG: --pod-max-pids="-1" May 29 14:46:19.429565 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425049 2564 flags.go:64] FLAG: --pods-per-core="0" May 29 14:46:19.430355 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425052 2564 flags.go:64] FLAG: --port="10250" May 29 14:46:19.430355 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425055 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" May 29 14:46:19.430355 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425058 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-042d60ec2bebdc5cb" May 29 14:46:19.430355 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425061 2564 flags.go:64] FLAG: --qos-reserved="" May 29 14:46:19.430355 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425064 2564 flags.go:64] FLAG: --read-only-port="10255" May 29 14:46:19.430355 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425067 2564 flags.go:64] FLAG: --register-node="true" May 29 14:46:19.430355 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425071 2564 flags.go:64] FLAG: --register-schedulable="true" May 29 14:46:19.430355 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425074 2564 flags.go:64] FLAG: --register-with-taints="" May 29 14:46:19.430355 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425082 2564 flags.go:64] FLAG: --registry-burst="10" May 29 14:46:19.430355 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425085 2564 flags.go:64] FLAG: --registry-qps="5" May 29 14:46:19.430355 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425088 2564 flags.go:64] FLAG: --reserved-cpus="" May 29 14:46:19.430355 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425091 2564 flags.go:64] FLAG: --reserved-memory="" May 29 14:46:19.430355 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425095 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 29 14:46:19.430355 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425097 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 29 14:46:19.430355 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425100 2564 flags.go:64] FLAG: --rotate-certificates="false" May 29 14:46:19.430355 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425103 2564 flags.go:64] FLAG: --rotate-server-certificates="false" May 29 14:46:19.430355 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425106 2564 flags.go:64] FLAG: --runonce="false" May 29 14:46:19.430355 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425109 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 29 14:46:19.430355 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425111 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 29 14:46:19.430355 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425114 2564 flags.go:64] FLAG: --seccomp-default="false" May 29 14:46:19.430355 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425117 2564 flags.go:64] FLAG: --serialize-image-pulls="true" May 29 14:46:19.430355 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425120 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 29 14:46:19.430355 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425124 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 29 14:46:19.430355 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425127 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 29 14:46:19.430355 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425131 2564 flags.go:64] FLAG: --storage-driver-password="root" May 29 14:46:19.430355 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425134 2564 flags.go:64] FLAG: --storage-driver-secure="false" May 29 14:46:19.431013 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425137 2564 flags.go:64] FLAG: --storage-driver-table="stats" May 29 14:46:19.431013 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425139 2564 flags.go:64] FLAG: --storage-driver-user="root" May 29 14:46:19.431013 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425142 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 29 14:46:19.431013 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425145 2564 flags.go:64] FLAG: --sync-frequency="1m0s" May 29 14:46:19.431013 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425148 2564 flags.go:64] FLAG: --system-cgroups="" May 29 14:46:19.431013 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425151 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 29 14:46:19.431013 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425156 2564 flags.go:64] FLAG: --system-reserved-cgroup="" May 29 14:46:19.431013 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425159 2564 flags.go:64] FLAG: --tls-cert-file="" May 29 14:46:19.431013 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425162 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" May 29 14:46:19.431013 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425180 2564 flags.go:64] FLAG: --tls-min-version="" May 29 14:46:19.431013 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425183 2564 flags.go:64] FLAG: --tls-private-key-file="" May 29 14:46:19.431013 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425186 2564 flags.go:64] FLAG: --topology-manager-policy="none" May 29 14:46:19.431013 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425191 2564 flags.go:64] FLAG: --topology-manager-policy-options="" May 29 14:46:19.431013 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425194 2564 flags.go:64] FLAG: --topology-manager-scope="container" May 29 14:46:19.431013 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425197 2564 flags.go:64] FLAG: --v="2" May 29 14:46:19.431013 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425201 2564 flags.go:64] FLAG: --version="false" May 29 14:46:19.431013 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425206 2564 flags.go:64] FLAG: --vmodule="" May 29 14:46:19.431013 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425210 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 29 14:46:19.431013 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.425213 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 29 14:46:19.431013 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425308 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 14:46:19.431013 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425311 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 14:46:19.431013 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425314 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 14:46:19.431013 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425317 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 14:46:19.431013 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425321 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 14:46:19.431633 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425323 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 14:46:19.431633 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425326 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 14:46:19.431633 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425329 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 14:46:19.431633 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425331 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 14:46:19.431633 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425334 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 14:46:19.431633 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425338 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 14:46:19.431633 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425341 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 14:46:19.431633 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425343 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 14:46:19.431633 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425346 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 14:46:19.431633 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425349 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 14:46:19.431633 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425351 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 14:46:19.431633 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425353 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 14:46:19.431633 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425356 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 14:46:19.431633 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425359 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 14:46:19.431633 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425361 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 14:46:19.431633 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425364 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 14:46:19.431633 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425366 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 14:46:19.431633 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425369 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 14:46:19.431633 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425372 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 14:46:19.431633 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425375 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 14:46:19.432161 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425378 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 14:46:19.432161 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425381 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 14:46:19.432161 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425383 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 14:46:19.432161 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425387 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 14:46:19.432161 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425391 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 14:46:19.432161 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425393 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 14:46:19.432161 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425396 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 14:46:19.432161 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425399 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 14:46:19.432161 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425401 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 14:46:19.432161 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425404 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 14:46:19.432161 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425406 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 14:46:19.432161 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425408 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 14:46:19.432161 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425411 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 14:46:19.432161 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425413 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 14:46:19.432161 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425417 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 14:46:19.432161 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425420 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 14:46:19.432161 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425422 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 14:46:19.432161 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425425 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 14:46:19.432161 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425428 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 14:46:19.432638 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425430 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 14:46:19.432638 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425433 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 14:46:19.432638 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425435 2564 feature_gate.go:328] unrecognized feature gate: Example2 May 29 14:46:19.432638 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425438 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 14:46:19.432638 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425440 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 14:46:19.432638 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425443 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 14:46:19.432638 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425445 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 14:46:19.432638 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425448 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 14:46:19.432638 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425450 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 14:46:19.432638 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425452 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 14:46:19.432638 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425455 2564 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 14:46:19.432638 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425457 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 14:46:19.432638 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425460 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 14:46:19.432638 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425463 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 14:46:19.432638 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425465 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 14:46:19.432638 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425468 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 14:46:19.432638 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425470 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 14:46:19.432638 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425473 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 14:46:19.432638 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425475 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 14:46:19.432638 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425478 2564 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 14:46:19.433123 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425480 2564 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 14:46:19.433123 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425483 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 14:46:19.433123 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425485 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 14:46:19.433123 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425488 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 14:46:19.433123 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425490 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 14:46:19.433123 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425493 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 14:46:19.433123 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425495 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 14:46:19.433123 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425499 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 14:46:19.433123 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425501 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 14:46:19.433123 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425504 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 14:46:19.433123 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425506 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 14:46:19.433123 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425509 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 14:46:19.433123 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425515 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 14:46:19.433123 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425519 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 14:46:19.433123 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425522 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 14:46:19.433123 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425525 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 14:46:19.433123 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425527 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 14:46:19.433123 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425530 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 14:46:19.433123 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425533 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 14:46:19.433587 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425536 2564 feature_gate.go:328] unrecognized feature gate: Example May 29 14:46:19.433587 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425538 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 14:46:19.433587 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.425541 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 14:46:19.433587 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.426183 2564 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 29 14:46:19.433920 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.433901 2564 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" May 29 14:46:19.433953 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.433921 2564 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 29 14:46:19.433984 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.433971 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 14:46:19.433984 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.433976 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 14:46:19.433984 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.433980 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 14:46:19.433984 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.433984 2564 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 14:46:19.434086 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.433987 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 14:46:19.434086 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.433990 2564 feature_gate.go:328] unrecognized feature gate: Example2 May 29 14:46:19.434086 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.433993 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 14:46:19.434086 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.433995 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 14:46:19.434086 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.433998 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 14:46:19.434086 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434001 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 14:46:19.434086 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434003 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 14:46:19.434086 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434006 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 14:46:19.434086 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434009 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 14:46:19.434086 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434012 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 14:46:19.434086 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434014 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 14:46:19.434086 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434017 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 14:46:19.434086 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434019 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 14:46:19.434086 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434022 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 14:46:19.434086 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434024 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 14:46:19.434086 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434027 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 14:46:19.434086 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434030 2564 feature_gate.go:328] unrecognized feature gate: Example May 29 14:46:19.434086 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434033 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 14:46:19.434086 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434035 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 14:46:19.434086 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434038 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 14:46:19.434086 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434040 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 14:46:19.434617 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434042 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 14:46:19.434617 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434045 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 14:46:19.434617 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434047 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 14:46:19.434617 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434050 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 14:46:19.434617 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434052 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 14:46:19.434617 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434055 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 14:46:19.434617 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434058 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 14:46:19.434617 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434060 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 14:46:19.434617 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434063 2564 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 14:46:19.434617 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434065 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 14:46:19.434617 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434068 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 14:46:19.434617 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434070 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 14:46:19.434617 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434074 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 14:46:19.434617 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434076 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 14:46:19.434617 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434079 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 14:46:19.434617 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434082 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 14:46:19.434617 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434084 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 14:46:19.434617 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434087 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 14:46:19.434617 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434089 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 14:46:19.435082 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434093 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 14:46:19.435082 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434098 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 14:46:19.435082 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434101 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 14:46:19.435082 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434105 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 14:46:19.435082 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434108 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 14:46:19.435082 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434110 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 14:46:19.435082 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434113 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 14:46:19.435082 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434116 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 14:46:19.435082 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434118 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 14:46:19.435082 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434121 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 14:46:19.435082 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434123 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 14:46:19.435082 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434125 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 14:46:19.435082 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434128 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 14:46:19.435082 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434131 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 14:46:19.435082 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434133 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 14:46:19.435082 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434136 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 14:46:19.435082 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434139 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 14:46:19.435082 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434141 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 14:46:19.435082 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434144 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 14:46:19.435633 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434146 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 14:46:19.435633 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434150 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 14:46:19.435633 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434153 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 14:46:19.435633 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434156 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 14:46:19.435633 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434158 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 14:46:19.435633 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434162 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 14:46:19.435633 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434164 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 14:46:19.435633 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434188 2564 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 14:46:19.435633 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434192 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 14:46:19.435633 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434195 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 14:46:19.435633 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434197 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 14:46:19.435633 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434200 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 14:46:19.435633 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434202 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 14:46:19.435633 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434205 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 14:46:19.435633 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434208 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 14:46:19.435633 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434210 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 14:46:19.435633 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434213 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 14:46:19.435633 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434216 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 14:46:19.435633 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434218 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 14:46:19.436091 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434221 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 14:46:19.436091 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434223 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 14:46:19.436091 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434226 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 14:46:19.436091 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434228 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 14:46:19.436091 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.434233 2564 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 29 14:46:19.436091 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434332 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 14:46:19.436091 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434337 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 14:46:19.436091 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434340 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 14:46:19.436091 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434343 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 14:46:19.436091 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434346 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 14:46:19.436091 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434349 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 14:46:19.436091 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434352 2564 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 14:46:19.436091 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434355 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 14:46:19.436091 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434357 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 14:46:19.436091 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434360 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 14:46:19.436091 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434363 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 14:46:19.436496 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434366 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 14:46:19.436496 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434369 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 14:46:19.436496 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434372 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 14:46:19.436496 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434375 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 14:46:19.436496 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434377 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 14:46:19.436496 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434380 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 14:46:19.436496 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434382 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 14:46:19.436496 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434385 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 14:46:19.436496 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434387 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 14:46:19.436496 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434390 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 14:46:19.436496 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434392 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 14:46:19.436496 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434395 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 14:46:19.436496 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434397 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 14:46:19.436496 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434401 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 14:46:19.436496 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434404 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 14:46:19.436496 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434407 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 14:46:19.436496 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434410 2564 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 14:46:19.436496 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434413 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 14:46:19.436496 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434415 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 14:46:19.436959 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434418 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 14:46:19.436959 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434421 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 14:46:19.436959 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434423 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 14:46:19.436959 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434426 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 14:46:19.436959 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434428 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 14:46:19.436959 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434458 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 14:46:19.436959 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434462 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 14:46:19.436959 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434466 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 14:46:19.436959 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434469 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 14:46:19.436959 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434471 2564 feature_gate.go:328] unrecognized feature gate: Example2 May 29 14:46:19.436959 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434474 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 14:46:19.436959 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434477 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 14:46:19.436959 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434479 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 14:46:19.436959 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434483 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 14:46:19.436959 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434486 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 14:46:19.436959 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434489 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 14:46:19.436959 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434491 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 14:46:19.436959 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434494 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 14:46:19.436959 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434496 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 14:46:19.436959 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434499 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 14:46:19.437462 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434508 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 14:46:19.437462 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434511 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 14:46:19.437462 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434514 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 14:46:19.437462 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434516 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 14:46:19.437462 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434519 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 14:46:19.437462 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434521 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 14:46:19.437462 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434524 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 14:46:19.437462 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434526 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 14:46:19.437462 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434529 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 14:46:19.437462 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434531 2564 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 14:46:19.437462 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434534 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 14:46:19.437462 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434536 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 14:46:19.437462 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434539 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 14:46:19.437462 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434541 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 14:46:19.437462 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434544 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 14:46:19.437462 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434546 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 14:46:19.437462 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434548 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 14:46:19.437462 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434551 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 14:46:19.437462 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434553 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 14:46:19.437956 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434556 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 14:46:19.437956 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434558 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 14:46:19.437956 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434560 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 14:46:19.437956 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434563 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 14:46:19.437956 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434565 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 14:46:19.437956 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434569 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 14:46:19.437956 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434573 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 14:46:19.437956 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434576 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 14:46:19.437956 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434580 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 14:46:19.437956 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434582 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 14:46:19.437956 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434585 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 14:46:19.437956 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434587 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 14:46:19.437956 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434590 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 14:46:19.437956 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434592 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 14:46:19.437956 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434595 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 14:46:19.437956 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434597 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 14:46:19.437956 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:19.434599 2564 feature_gate.go:328] unrecognized feature gate: Example May 29 14:46:19.438377 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.434604 2564 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 29 14:46:19.438377 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.435287 2564 server.go:962] "Client rotation is on, will bootstrap in background" May 29 14:46:19.438377 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.437267 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 29 14:46:19.438377 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.437986 2564 server.go:1019] "Starting client certificate rotation" May 29 14:46:19.438377 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.438084 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 29 14:46:19.438678 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.438666 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 29 14:46:19.459233 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.459213 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 29 14:46:19.460982 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.460964 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 29 14:46:19.473980 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.473955 2564 log.go:25] "Validated CRI v1 runtime API" May 29 14:46:19.478818 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.478801 2564 log.go:25] "Validated CRI v1 image API" May 29 14:46:19.480573 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.480552 2564 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 29 14:46:19.482841 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.482818 2564 fs.go:135] Filesystem UUIDs: map[2dc0ba1b-95a9-4afb-8d79-83bac1a2ab02:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 cca99a71-65a8-43e4-b2e6-8291c7bbeeda:/dev/nvme0n1p3] May 29 14:46:19.482896 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.482841 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 29 14:46:19.487212 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.487083 2564 manager.go:217] Machine: {Timestamp:2026-05-29 14:46:19.48659033 +0000 UTC m=+0.343702269 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099914 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29bb46f143a8c82677a4e55980774e SystemUUID:ec29bb46-f143-a8c8-2677-a4e55980774e BootID:b442831b-cdca-464d-b342-979b145b41a0 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:58:b3:c3:23:49 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:58:b3:c3:23:49 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:82:26:7d:81:07:ee Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 29 14:46:19.487212 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.487212 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 29 14:46:19.487312 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.487288 2564 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 29 14:46:19.489090 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.489061 2564 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 29 14:46:19.489275 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.489092 2564 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-189.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 29 14:46:19.489362 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.489289 2564 topology_manager.go:138] "Creating topology manager with none policy" May 29 14:46:19.489362 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.489303 2564 container_manager_linux.go:306] "Creating device plugin manager" May 29 14:46:19.489362 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.489312 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 29 14:46:19.489362 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.489339 2564 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 29 14:46:19.490095 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.490082 2564 state_mem.go:36] "Initialized new in-memory state store" May 29 14:46:19.490251 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.490240 2564 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 29 14:46:19.492915 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.492903 2564 kubelet.go:491] "Attempting to sync node with API server" May 29 14:46:19.492980 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.492928 2564 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 29 14:46:19.493672 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.493661 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 29 14:46:19.493722 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.493680 2564 kubelet.go:397] "Adding apiserver pod source" May 29 14:46:19.493722 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.493693 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 29 14:46:19.494652 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.494638 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 29 14:46:19.494728 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.494661 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 29 14:46:19.498955 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.498934 2564 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" May 29 14:46:19.500900 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.500887 2564 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 29 14:46:19.502917 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.502905 2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 29 14:46:19.502955 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.502922 2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 29 14:46:19.502955 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.502932 2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 29 14:46:19.502955 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.502937 2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 29 14:46:19.502955 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.502947 2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 29 14:46:19.502955 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.502953 2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 29 14:46:19.503080 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.502959 2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 29 14:46:19.503080 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.502964 2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 29 14:46:19.503080 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.502971 2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 29 14:46:19.503080 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.502976 2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 29 14:46:19.503080 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.502984 2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 29 14:46:19.503080 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.502990 2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 29 14:46:19.503677 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.503654 2564 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 29 14:46:19.503767 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.503757 2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 29 14:46:19.503808 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.503771 2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 29 14:46:19.510040 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.510021 2564 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 29 14:46:19.510208 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.510198 2564 server.go:1295] "Started kubelet" May 29 14:46:19.510977 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.510903 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 29 14:46:19.511068 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.510956 2564 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 29 14:46:19.511068 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.511023 2564 server_v1.go:47] "podresources" method="list" useActivePods=true May 29 14:46:19.511345 ip-10-0-129-189 systemd[1]: Started Kubernetes Kubelet. May 29 14:46:19.513892 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:19.513864 2564 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-189.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 29 14:46:19.513892 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:19.513874 2564 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 29 14:46:19.514019 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.513935 2564 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-189.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 29 14:46:19.514401 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.514381 2564 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 29 14:46:19.514539 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.514526 2564 server.go:317] "Adding debug handlers to kubelet server" May 29 14:46:19.518414 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.518394 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 29 14:46:19.519124 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.519107 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 29 14:46:19.519330 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.519311 2564 volume_manager.go:295] "The desired_state_of_world populator starts" May 29 14:46:19.519330 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.519327 2564 volume_manager.go:297] "Starting Kubelet Volume Manager" May 29 14:46:19.519481 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.519428 2564 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 29 14:46:19.519523 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.519490 2564 reconstruct.go:97] "Volume reconstruction finished" May 29 14:46:19.519523 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.519500 2564 reconciler.go:26] "Reconciler: start to sync state" May 29 14:46:19.519864 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.519846 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 29 14:46:19.519864 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.519864 2564 factory.go:55] Registering systemd factory May 29 14:46:19.519983 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.519874 2564 factory.go:223] Registration of the systemd container factory successfully May 29 14:46:19.519983 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:19.519880 2564 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 29 14:46:19.519983 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:19.519904 2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-189.ec2.internal\" not found" May 29 14:46:19.520311 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.520092 2564 factory.go:153] Registering CRI-O factory May 29 14:46:19.520311 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.520103 2564 factory.go:223] Registration of the crio container factory successfully May 29 14:46:19.520311 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.520116 2564 factory.go:103] Registering Raw factory May 29 14:46:19.520311 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.520127 2564 manager.go:1196] Started watching for new ooms in manager May 29 14:46:19.520473 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.520439 2564 manager.go:319] Starting recovery of all containers May 29 14:46:19.520517 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:19.519583 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-189.ec2.internal.18b41093c175c76e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-189.ec2.internal,UID:ip-10-0-129-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-189.ec2.internal,},FirstTimestamp:2026-05-29 14:46:19.510146926 +0000 UTC m=+0.367258864,LastTimestamp:2026-05-29 14:46:19.510146926 +0000 UTC m=+0.367258864,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-189.ec2.internal,}" May 29 14:46:19.528692 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.528511 2564 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 29 14:46:19.530086 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.530070 2564 manager.go:324] Recovery completed May 29 14:46:19.532497 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:19.532459 2564 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 29 14:46:19.532497 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:19.532488 2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-189.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 29 14:46:19.534851 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.534837 2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 14:46:19.536885 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.536868 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-189.ec2.internal" event="NodeHasSufficientMemory" May 29 14:46:19.536976 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.536903 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-189.ec2.internal" event="NodeHasNoDiskPressure" May 29 14:46:19.536976 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.536917 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-189.ec2.internal" event="NodeHasSufficientPID" May 29 14:46:19.537573 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.537545 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" May 29 14:46:19.537573 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.537561 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 29 14:46:19.537668 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.537578 2564 state_mem.go:36] "Initialized new in-memory state store" May 29 14:46:19.539367 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:19.539305 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-189.ec2.internal.18b41093c30dc7c9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-189.ec2.internal,UID:ip-10-0-129-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-189.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-189.ec2.internal,},FirstTimestamp:2026-05-29 14:46:19.536885705 +0000 UTC m=+0.393997645,LastTimestamp:2026-05-29 14:46:19.536885705 +0000 UTC m=+0.393997645,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-189.ec2.internal,}" May 29 14:46:19.539463 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.539452 2564 policy_none.go:49] "None policy: Start" May 29 14:46:19.539492 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.539469 2564 memory_manager.go:186] "Starting memorymanager" policy="None" May 29 14:46:19.539492 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.539479 2564 state_mem.go:35] "Initializing new in-memory state store" May 29 14:46:19.549580 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.549553 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mwqzz" May 29 14:46:19.550274 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:19.550205 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-189.ec2.internal.18b41093c30e2701 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-189.ec2.internal,UID:ip-10-0-129-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-189.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-189.ec2.internal,},FirstTimestamp:2026-05-29 14:46:19.536910081 +0000 UTC m=+0.394022021,LastTimestamp:2026-05-29 14:46:19.536910081 +0000 UTC m=+0.394022021,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-189.ec2.internal,}" May 29 14:46:19.559963 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:19.559876 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-189.ec2.internal.18b41093c30e59c7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-189.ec2.internal,UID:ip-10-0-129-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-129-189.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-129-189.ec2.internal,},FirstTimestamp:2026-05-29 14:46:19.536923079 +0000 UTC m=+0.394035021,LastTimestamp:2026-05-29 14:46:19.536923079 +0000 UTC m=+0.394035021,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-189.ec2.internal,}" May 29 14:46:19.560420 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.560405 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mwqzz" May 29 14:46:19.579007 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.578982 2564 manager.go:341] "Starting Device Plugin manager" May 29 14:46:19.591134 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:19.579029 2564 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 29 14:46:19.591134 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.579043 2564 server.go:85] "Starting device plugin registration server" May 29 14:46:19.591134 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.579374 2564 eviction_manager.go:189] "Eviction manager: starting control loop" May 29 14:46:19.591134 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.579387 2564 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 29 14:46:19.591134 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.579455 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 29 14:46:19.591134 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.579532 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 29 14:46:19.591134 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.579541 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 29 14:46:19.591134 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:19.580909 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 29 14:46:19.591134 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:19.580949 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-189.ec2.internal\" not found" May 29 14:46:19.650024 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.649993 2564 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 29 14:46:19.650024 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.650027 2564 status_manager.go:230] "Starting to sync pod status with apiserver" May 29 14:46:19.650223 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.650049 2564 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 29 14:46:19.650223 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.650056 2564 kubelet.go:2451] "Starting kubelet main sync loop" May 29 14:46:19.650223 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:19.650093 2564 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 29 14:46:19.652962 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.652943 2564 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 29 14:46:19.679731 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.679666 2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 14:46:19.680775 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.680760 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-189.ec2.internal" event="NodeHasSufficientMemory" May 29 14:46:19.680848 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.680790 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-189.ec2.internal" event="NodeHasNoDiskPressure" May 29 14:46:19.680848 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.680799 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-189.ec2.internal" event="NodeHasSufficientPID" May 29 14:46:19.680848 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.680821 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-189.ec2.internal" May 29 14:46:19.689726 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.689701 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-189.ec2.internal" May 29 14:46:19.689851 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:19.689729 2564 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-189.ec2.internal\": node \"ip-10-0-129-189.ec2.internal\" not found" May 29 14:46:19.705589 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:19.705563 2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-189.ec2.internal\" not found" May 29 14:46:19.750426 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.750382 2564 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-189.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-189.ec2.internal"] May 29 14:46:19.750558 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.750485 2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 14:46:19.752944 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.752929 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-189.ec2.internal" event="NodeHasSufficientMemory" May 29 14:46:19.753020 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.752958 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-189.ec2.internal" event="NodeHasNoDiskPressure" May 29 14:46:19.753020 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.752968 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-189.ec2.internal" event="NodeHasSufficientPID" May 29 14:46:19.754413 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.754398 2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 14:46:19.754572 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.754558 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-189.ec2.internal" May 29 14:46:19.754615 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.754587 2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 14:46:19.756036 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.756014 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-189.ec2.internal" event="NodeHasSufficientMemory" May 29 14:46:19.756135 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.756043 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-189.ec2.internal" event="NodeHasNoDiskPressure" May 29 14:46:19.756135 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.756046 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-189.ec2.internal" event="NodeHasSufficientMemory" May 29 14:46:19.756135 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.756057 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-189.ec2.internal" event="NodeHasSufficientPID" May 29 14:46:19.756135 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.756071 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-189.ec2.internal" event="NodeHasNoDiskPressure" May 29 14:46:19.756135 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.756088 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-189.ec2.internal" event="NodeHasSufficientPID" May 29 14:46:19.757069 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.757056 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-189.ec2.internal" May 29 14:46:19.757116 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.757084 2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 14:46:19.757794 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.757781 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-189.ec2.internal" event="NodeHasSufficientMemory" May 29 14:46:19.757858 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.757809 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-189.ec2.internal" event="NodeHasNoDiskPressure" May 29 14:46:19.757858 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.757821 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-189.ec2.internal" event="NodeHasSufficientPID" May 29 14:46:19.773732 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:19.773706 2564 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-189.ec2.internal\" not found" node="ip-10-0-129-189.ec2.internal" May 29 14:46:19.778192 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:19.778164 2564 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-189.ec2.internal\" not found" node="ip-10-0-129-189.ec2.internal" May 29 14:46:19.806368 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:19.806344 2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-189.ec2.internal\" not found" May 29 14:46:19.907502 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:19.907473 2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-189.ec2.internal\" not found" May 29 14:46:19.920772 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.920748 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ab87c0c59a9488515be757546d0accf7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-189.ec2.internal\" (UID: \"ab87c0c59a9488515be757546d0accf7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-189.ec2.internal" May 29 14:46:19.920834 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.920778 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab87c0c59a9488515be757546d0accf7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-189.ec2.internal\" (UID: \"ab87c0c59a9488515be757546d0accf7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-189.ec2.internal" May 29 14:46:19.920834 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:19.920797 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/33dc9f2399849a35b751db08f0aecf8e-config\") pod \"kube-apiserver-proxy-ip-10-0-129-189.ec2.internal\" (UID: \"33dc9f2399849a35b751db08f0aecf8e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-189.ec2.internal" May 29 14:46:20.008256 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:20.008153 2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-189.ec2.internal\" not found" May 29 14:46:20.021492 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:20.021468 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ab87c0c59a9488515be757546d0accf7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-189.ec2.internal\" (UID: \"ab87c0c59a9488515be757546d0accf7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-189.ec2.internal" May 29 14:46:20.021559 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:20.021502 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab87c0c59a9488515be757546d0accf7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-189.ec2.internal\" (UID: \"ab87c0c59a9488515be757546d0accf7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-189.ec2.internal" May 29 14:46:20.021559 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:20.021537 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/33dc9f2399849a35b751db08f0aecf8e-config\") pod \"kube-apiserver-proxy-ip-10-0-129-189.ec2.internal\" (UID: \"33dc9f2399849a35b751db08f0aecf8e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-189.ec2.internal" May 29 14:46:20.021624 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:20.021571 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ab87c0c59a9488515be757546d0accf7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-189.ec2.internal\" (UID: \"ab87c0c59a9488515be757546d0accf7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-189.ec2.internal" May 29 14:46:20.021624 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:20.021586 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/33dc9f2399849a35b751db08f0aecf8e-config\") pod \"kube-apiserver-proxy-ip-10-0-129-189.ec2.internal\" (UID: \"33dc9f2399849a35b751db08f0aecf8e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-189.ec2.internal" May 29 14:46:20.021624 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:20.021593 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab87c0c59a9488515be757546d0accf7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-189.ec2.internal\" (UID: \"ab87c0c59a9488515be757546d0accf7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-189.ec2.internal" May 29 14:46:20.075615 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:20.075574 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-189.ec2.internal" May 29 14:46:20.081049 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:20.081028 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-189.ec2.internal" May 29 14:46:20.109106 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:20.109067 2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-189.ec2.internal\" not found" May 29 14:46:20.209588 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:20.209554 2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-189.ec2.internal\" not found" May 29 14:46:20.310083 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:20.310015 2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-189.ec2.internal\" not found" May 29 14:46:20.410621 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:20.410588 2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-189.ec2.internal\" not found" May 29 14:46:20.439046 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:20.439018 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 29 14:46:20.439578 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:20.439215 2564 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 29 14:46:20.511053 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:20.511029 2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-189.ec2.internal\" not found" May 29 14:46:20.513552 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:20.513526 2564 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 29 14:46:20.518704 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:20.518673 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 29 14:46:20.528887 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:20.528865 2564 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 29 14:46:20.555766 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:20.555739 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zfmqx" May 29 14:46:20.561857 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:20.561795 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-28 14:41:19 +0000 UTC" deadline="2027-10-23 12:23:21.240847876 +0000 UTC" May 29 14:46:20.561857 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:20.561837 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12285h37m0.679015799s" May 29 14:46:20.565077 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:20.565060 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zfmqx" May 29 14:46:20.593125 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:20.593094 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab87c0c59a9488515be757546d0accf7.slice/crio-d334ecd56665c6b321873c7a2c905fe7824f47cc8d5177e6e5b2a69c83658ea9 WatchSource:0}: Error finding container d334ecd56665c6b321873c7a2c905fe7824f47cc8d5177e6e5b2a69c83658ea9: Status 404 returned error can't find the container with id d334ecd56665c6b321873c7a2c905fe7824f47cc8d5177e6e5b2a69c83658ea9 May 29 14:46:20.593351 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:20.593329 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33dc9f2399849a35b751db08f0aecf8e.slice/crio-91d96dd010d01f1d0c682318b0c1fe599e5249ac5eb9a46be5fda2463c68e118 WatchSource:0}: Error finding container 91d96dd010d01f1d0c682318b0c1fe599e5249ac5eb9a46be5fda2463c68e118: Status 404 returned error can't find the container with id 91d96dd010d01f1d0c682318b0c1fe599e5249ac5eb9a46be5fda2463c68e118 May 29 14:46:20.596431 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:20.596418 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 29 14:46:20.612126 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:20.612096 2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-189.ec2.internal\" not found" May 29 14:46:20.653842 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:20.653785 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-189.ec2.internal" event={"ID":"33dc9f2399849a35b751db08f0aecf8e","Type":"ContainerStarted","Data":"91d96dd010d01f1d0c682318b0c1fe599e5249ac5eb9a46be5fda2463c68e118"} May 29 14:46:20.654851 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:20.654818 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-189.ec2.internal" event={"ID":"ab87c0c59a9488515be757546d0accf7","Type":"ContainerStarted","Data":"d334ecd56665c6b321873c7a2c905fe7824f47cc8d5177e6e5b2a69c83658ea9"} May 29 14:46:20.713095 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:20.713065 2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-189.ec2.internal\" not found" May 29 14:46:20.813660 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:20.813583 2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-189.ec2.internal\" not found" May 29 14:46:20.914115 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:20.914087 2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-189.ec2.internal\" not found" May 29 14:46:21.014946 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:21.014909 2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-189.ec2.internal\" not found" May 29 14:46:21.049760 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.049718 2564 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 29 14:46:21.088280 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.088198 2564 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 29 14:46:21.120251 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.120218 2564 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-189.ec2.internal" May 29 14:46:21.134119 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.134090 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 29 14:46:21.135152 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.135083 2564 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-189.ec2.internal" May 29 14:46:21.142941 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.142918 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 29 14:46:21.293826 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.293796 2564 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 29 14:46:21.494490 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.494408 2564 apiserver.go:52] "Watching apiserver" May 29 14:46:21.501198 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.501160 2564 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 29 14:46:21.502208 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.502163 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-f48d9","kube-system/kube-apiserver-proxy-ip-10-0-129-189.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdj5k","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-189.ec2.internal","openshift-multus/multus-xg8cs","openshift-multus/network-metrics-daemon-pkxjk","openshift-ovn-kubernetes/ovnkube-node-gvn49","openshift-cluster-node-tuning-operator/tuned-xd9jk","openshift-image-registry/node-ca-5xdw9","openshift-multus/multus-additional-cni-plugins-skjzp","openshift-network-diagnostics/network-check-target-946gb","openshift-network-operator/iptables-alerter-nbfxf"] May 29 14:46:21.503441 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.503420 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f48d9" May 29 14:46:21.505420 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.505397 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdj5k" May 29 14:46:21.505862 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.505843 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-d27fp\"" May 29 14:46:21.506045 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.506030 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 29 14:46:21.506126 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.506112 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 29 14:46:21.506498 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.506480 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xg8cs" May 29 14:46:21.506604 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.506566 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkxjk" May 29 14:46:21.506666 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:21.506646 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkxjk" podUID="99dadb15-c9da-4773-b522-fc61ba649a8f" May 29 14:46:21.507446 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.507428 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gj5gm\"" May 29 14:46:21.507580 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.507565 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.507942 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.507924 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 29 14:46:21.508206 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.508167 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 29 14:46:21.508597 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.508574 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xd9jk" May 29 14:46:21.508707 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.508602 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 29 14:46:21.508772 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.508714 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 29 14:46:21.509417 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.509395 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xppt2\"" May 29 14:46:21.509633 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.509614 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 29 14:46:21.509865 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.509847 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 29 14:46:21.509943 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.509887 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 29 14:46:21.510001 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.509889 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5xdw9" May 29 14:46:21.510203 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.509966 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-x5tds\"" May 29 14:46:21.510352 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.510335 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 29 14:46:21.512114 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.512096 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 29 14:46:21.512200 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.512119 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-skjzp" May 29 14:46:21.512738 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.512721 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 29 14:46:21.512949 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.512934 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 29 14:46:21.514796 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.514773 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nbfxf" May 29 14:46:21.516224 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.515139 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-946gb" May 29 14:46:21.516224 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:21.515226 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-946gb" podUID="1e83cba4-a631-4284-be4b-0b2beed9fd46" May 29 14:46:21.516224 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.515839 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 29 14:46:21.516224 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.516082 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rq86w\"" May 29 14:46:21.516224 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.516216 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 29 14:46:21.516499 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.516355 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 29 14:46:21.516499 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.516447 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 29 14:46:21.516596 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.516540 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 29 14:46:21.516650 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.516592 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 29 14:46:21.516650 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.516609 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 29 14:46:21.516739 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.516670 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lb4nd\"" May 29 14:46:21.516739 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.516703 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 29 14:46:21.517199 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.517159 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 29 14:46:21.517278 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.517239 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-v7mdm\"" May 29 14:46:21.517612 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.517593 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 29 14:46:21.517766 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.517752 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 29 14:46:21.518032 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.517903 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vjpjt\"" May 29 14:46:21.519423 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.519404 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 29 14:46:21.520314 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.520299 2564 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 29 14:46:21.530315 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.530292 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef-etc-modprobe-d\") pod \"tuned-xd9jk\" (UID: \"8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef\") " pod="openshift-cluster-node-tuning-operator/tuned-xd9jk" May 29 14:46:21.530396 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.530326 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef-etc-tuned\") pod \"tuned-xd9jk\" (UID: \"8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef\") " pod="openshift-cluster-node-tuning-operator/tuned-xd9jk" May 29 14:46:21.530396 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.530344 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-host-run-netns\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.530396 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.530359 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5945bd9a-fb25-48aa-bbcb-53466990a078-cnibin\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.530396 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.530373 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef-etc-sysctl-d\") pod \"tuned-xd9jk\" (UID: \"8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef\") " pod="openshift-cluster-node-tuning-operator/tuned-xd9jk" May 29 14:46:21.530396 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.530388 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b3f8a5d9-4cf1-4106-acb5-7191a54c7a16-cnibin\") pod \"multus-additional-cni-plugins-skjzp\" (UID: \"b3f8a5d9-4cf1-4106-acb5-7191a54c7a16\") " pod="openshift-multus/multus-additional-cni-plugins-skjzp" May 29 14:46:21.530587 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.530402 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b3f8a5d9-4cf1-4106-acb5-7191a54c7a16-tuning-conf-dir\") pod \"multus-additional-cni-plugins-skjzp\" (UID: \"b3f8a5d9-4cf1-4106-acb5-7191a54c7a16\") " pod="openshift-multus/multus-additional-cni-plugins-skjzp" May 29 14:46:21.530587 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.530417 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef-run\") pod \"tuned-xd9jk\" (UID: \"8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef\") " pod="openshift-cluster-node-tuning-operator/tuned-xd9jk" May 29 14:46:21.530587 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.530441 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmdbp\" (UniqueName: \"kubernetes.io/projected/b3f8a5d9-4cf1-4106-acb5-7191a54c7a16-kube-api-access-rmdbp\") pod \"multus-additional-cni-plugins-skjzp\" (UID: \"b3f8a5d9-4cf1-4106-acb5-7191a54c7a16\") " pod="openshift-multus/multus-additional-cni-plugins-skjzp" May 29 14:46:21.530587 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.530462 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-node-log\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.530587 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.530477 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-ovn-node-metrics-cert\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.530587 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.530491 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b0f3d5ad-15b0-4747-bebd-caff2c900fcf-sys-fs\") pod \"aws-ebs-csi-driver-node-fdj5k\" (UID: \"b0f3d5ad-15b0-4747-bebd-caff2c900fcf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdj5k" May 29 14:46:21.530587 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.530505 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef-etc-kubernetes\") pod \"tuned-xd9jk\" (UID: \"8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef\") " pod="openshift-cluster-node-tuning-operator/tuned-xd9jk" May 29 14:46:21.530587 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.530519 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrggq\" (UniqueName: \"kubernetes.io/projected/1e83cba4-a631-4284-be4b-0b2beed9fd46-kube-api-access-vrggq\") pod \"network-check-target-946gb\" (UID: \"1e83cba4-a631-4284-be4b-0b2beed9fd46\") " pod="openshift-network-diagnostics/network-check-target-946gb" May 29 14:46:21.530587 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.530539 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7452a23e-4293-4ee4-9c04-5a0ff4fe08b3-agent-certs\") pod \"konnectivity-agent-f48d9\" (UID: \"7452a23e-4293-4ee4-9c04-5a0ff4fe08b3\") " pod="kube-system/konnectivity-agent-f48d9" May 29 14:46:21.530587 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.530561 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b3f8a5d9-4cf1-4106-acb5-7191a54c7a16-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-skjzp\" (UID: \"b3f8a5d9-4cf1-4106-acb5-7191a54c7a16\") " pod="openshift-multus/multus-additional-cni-plugins-skjzp" May 29 14:46:21.530587 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.530585 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b0f3d5ad-15b0-4747-bebd-caff2c900fcf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fdj5k\" (UID: \"b0f3d5ad-15b0-4747-bebd-caff2c900fcf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdj5k" May 29 14:46:21.530959 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.530606 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-run-ovn\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.530959 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.530625 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5945bd9a-fb25-48aa-bbcb-53466990a078-etc-kubernetes\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.530959 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.530650 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5945bd9a-fb25-48aa-bbcb-53466990a078-os-release\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.530959 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.530672 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5945bd9a-fb25-48aa-bbcb-53466990a078-multus-socket-dir-parent\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.530959 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.530690 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v7kz\" (UniqueName: \"kubernetes.io/projected/b0f3d5ad-15b0-4747-bebd-caff2c900fcf-kube-api-access-7v7kz\") pod \"aws-ebs-csi-driver-node-fdj5k\" (UID: \"b0f3d5ad-15b0-4747-bebd-caff2c900fcf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdj5k" May 29 14:46:21.530959 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.530704 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-var-lib-openvswitch\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.530959 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.530728 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-log-socket\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.530959 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.530748 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-host-run-ovn-kubernetes\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.530959 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.530763 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef-etc-sysconfig\") pod \"tuned-xd9jk\" (UID: \"8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef\") " pod="openshift-cluster-node-tuning-operator/tuned-xd9jk" May 29 14:46:21.530959 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.530776 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef-host\") pod \"tuned-xd9jk\" (UID: \"8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef\") " pod="openshift-cluster-node-tuning-operator/tuned-xd9jk" May 29 14:46:21.530959 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.530791 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b0f3d5ad-15b0-4747-bebd-caff2c900fcf-device-dir\") pod \"aws-ebs-csi-driver-node-fdj5k\" (UID: \"b0f3d5ad-15b0-4747-bebd-caff2c900fcf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdj5k" May 29 14:46:21.530959 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.530813 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-env-overrides\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.530959 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.530828 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b3f8a5d9-4cf1-4106-acb5-7191a54c7a16-system-cni-dir\") pod \"multus-additional-cni-plugins-skjzp\" (UID: \"b3f8a5d9-4cf1-4106-acb5-7191a54c7a16\") " pod="openshift-multus/multus-additional-cni-plugins-skjzp" May 29 14:46:21.530959 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.530842 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b3f8a5d9-4cf1-4106-acb5-7191a54c7a16-cni-binary-copy\") pod \"multus-additional-cni-plugins-skjzp\" (UID: \"b3f8a5d9-4cf1-4106-acb5-7191a54c7a16\") " pod="openshift-multus/multus-additional-cni-plugins-skjzp" May 29 14:46:21.530959 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.530867 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-run-openvswitch\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.530959 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.530889 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5945bd9a-fb25-48aa-bbcb-53466990a078-cni-binary-copy\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.531524 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.530910 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5945bd9a-fb25-48aa-bbcb-53466990a078-multus-conf-dir\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.531524 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.530941 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/55978d1f-3cbf-47ca-bf60-0457136ebe0e-iptables-alerter-script\") pod \"iptables-alerter-nbfxf\" (UID: \"55978d1f-3cbf-47ca-bf60-0457136ebe0e\") " pod="openshift-network-operator/iptables-alerter-nbfxf" May 29 14:46:21.531524 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.530963 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lb2ff\" (UniqueName: \"kubernetes.io/projected/55978d1f-3cbf-47ca-bf60-0457136ebe0e-kube-api-access-lb2ff\") pod \"iptables-alerter-nbfxf\" (UID: \"55978d1f-3cbf-47ca-bf60-0457136ebe0e\") " pod="openshift-network-operator/iptables-alerter-nbfxf" May 29 14:46:21.531524 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.530987 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/83518164-cbb0-445b-949b-0a9fc521e3e3-host\") pod \"node-ca-5xdw9\" (UID: \"83518164-cbb0-445b-949b-0a9fc521e3e3\") " pod="openshift-image-registry/node-ca-5xdw9" May 29 14:46:21.531524 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.531016 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2qzb\" (UniqueName: \"kubernetes.io/projected/99dadb15-c9da-4773-b522-fc61ba649a8f-kube-api-access-q2qzb\") pod \"network-metrics-daemon-pkxjk\" (UID: \"99dadb15-c9da-4773-b522-fc61ba649a8f\") " pod="openshift-multus/network-metrics-daemon-pkxjk" May 29 14:46:21.531524 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.531044 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7452a23e-4293-4ee4-9c04-5a0ff4fe08b3-konnectivity-ca\") pod \"konnectivity-agent-f48d9\" (UID: \"7452a23e-4293-4ee4-9c04-5a0ff4fe08b3\") " pod="kube-system/konnectivity-agent-f48d9" May 29 14:46:21.531524 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.531064 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5945bd9a-fb25-48aa-bbcb-53466990a078-multus-cni-dir\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.531524 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.531100 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5945bd9a-fb25-48aa-bbcb-53466990a078-host-var-lib-cni-multus\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.531524 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.531120 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef-etc-sysctl-conf\") pod \"tuned-xd9jk\" (UID: \"8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef\") " pod="openshift-cluster-node-tuning-operator/tuned-xd9jk" May 29 14:46:21.531524 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.531138 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef-etc-systemd\") pod \"tuned-xd9jk\" (UID: \"8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef\") " pod="openshift-cluster-node-tuning-operator/tuned-xd9jk" May 29 14:46:21.531524 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.531152 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdvlm\" (UniqueName: \"kubernetes.io/projected/8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef-kube-api-access-mdvlm\") pod \"tuned-xd9jk\" (UID: \"8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef\") " pod="openshift-cluster-node-tuning-operator/tuned-xd9jk" May 29 14:46:21.531524 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.531189 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b0f3d5ad-15b0-4747-bebd-caff2c900fcf-socket-dir\") pod \"aws-ebs-csi-driver-node-fdj5k\" (UID: \"b0f3d5ad-15b0-4747-bebd-caff2c900fcf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdj5k" May 29 14:46:21.531524 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.531209 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b0f3d5ad-15b0-4747-bebd-caff2c900fcf-registration-dir\") pod \"aws-ebs-csi-driver-node-fdj5k\" (UID: \"b0f3d5ad-15b0-4747-bebd-caff2c900fcf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdj5k" May 29 14:46:21.531524 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.531226 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-host-cni-netd\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.531524 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.531250 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.531524 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.531274 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-ovnkube-config\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.532051 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.531293 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cjcm\" (UniqueName: \"kubernetes.io/projected/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-kube-api-access-8cjcm\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.532051 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.531310 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef-tmp\") pod \"tuned-xd9jk\" (UID: \"8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef\") " pod="openshift-cluster-node-tuning-operator/tuned-xd9jk" May 29 14:46:21.532051 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.531325 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-host-kubelet\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.532051 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.531340 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-run-systemd\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.532051 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.531359 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-host-cni-bin\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.532051 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.531384 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5945bd9a-fb25-48aa-bbcb-53466990a078-host-run-netns\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.532051 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.531405 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5945bd9a-fb25-48aa-bbcb-53466990a078-host-var-lib-kubelet\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.532051 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.531421 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef-lib-modules\") pod \"tuned-xd9jk\" (UID: \"8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef\") " pod="openshift-cluster-node-tuning-operator/tuned-xd9jk" May 29 14:46:21.532051 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.531450 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-host-slash\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.532051 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.531474 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/55978d1f-3cbf-47ca-bf60-0457136ebe0e-host-slash\") pod \"iptables-alerter-nbfxf\" (UID: \"55978d1f-3cbf-47ca-bf60-0457136ebe0e\") " pod="openshift-network-operator/iptables-alerter-nbfxf" May 29 14:46:21.532051 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.531490 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrvzf\" (UniqueName: \"kubernetes.io/projected/5945bd9a-fb25-48aa-bbcb-53466990a078-kube-api-access-vrvzf\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.532051 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.531507 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5945bd9a-fb25-48aa-bbcb-53466990a078-hostroot\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.532051 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.531522 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b3f8a5d9-4cf1-4106-acb5-7191a54c7a16-os-release\") pod \"multus-additional-cni-plugins-skjzp\" (UID: \"b3f8a5d9-4cf1-4106-acb5-7191a54c7a16\") " pod="openshift-multus/multus-additional-cni-plugins-skjzp" May 29 14:46:21.532051 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.531542 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b3f8a5d9-4cf1-4106-acb5-7191a54c7a16-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-skjzp\" (UID: \"b3f8a5d9-4cf1-4106-acb5-7191a54c7a16\") " pod="openshift-multus/multus-additional-cni-plugins-skjzp" May 29 14:46:21.532051 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.531568 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-systemd-units\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.532051 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.531586 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-etc-openvswitch\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.532051 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.531602 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5945bd9a-fb25-48aa-bbcb-53466990a078-system-cni-dir\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.532884 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.531618 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5945bd9a-fb25-48aa-bbcb-53466990a078-host-var-lib-cni-bin\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.532884 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.531632 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-ovnkube-script-lib\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.532884 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.531658 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/83518164-cbb0-445b-949b-0a9fc521e3e3-serviceca\") pod \"node-ca-5xdw9\" (UID: \"83518164-cbb0-445b-949b-0a9fc521e3e3\") " pod="openshift-image-registry/node-ca-5xdw9" May 29 14:46:21.532884 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.531674 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw94q\" (UniqueName: \"kubernetes.io/projected/83518164-cbb0-445b-949b-0a9fc521e3e3-kube-api-access-bw94q\") pod \"node-ca-5xdw9\" (UID: \"83518164-cbb0-445b-949b-0a9fc521e3e3\") " pod="openshift-image-registry/node-ca-5xdw9" May 29 14:46:21.532884 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.531694 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5945bd9a-fb25-48aa-bbcb-53466990a078-host-run-k8s-cni-cncf-io\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.532884 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.531710 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99dadb15-c9da-4773-b522-fc61ba649a8f-metrics-certs\") pod \"network-metrics-daemon-pkxjk\" (UID: \"99dadb15-c9da-4773-b522-fc61ba649a8f\") " pod="openshift-multus/network-metrics-daemon-pkxjk" May 29 14:46:21.532884 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.531743 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef-var-lib-kubelet\") pod \"tuned-xd9jk\" (UID: \"8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef\") " pod="openshift-cluster-node-tuning-operator/tuned-xd9jk" May 29 14:46:21.532884 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.531769 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5945bd9a-fb25-48aa-bbcb-53466990a078-host-run-multus-certs\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.532884 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.531799 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5945bd9a-fb25-48aa-bbcb-53466990a078-multus-daemon-config\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.532884 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.531824 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef-sys\") pod \"tuned-xd9jk\" (UID: \"8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef\") " pod="openshift-cluster-node-tuning-operator/tuned-xd9jk" May 29 14:46:21.532884 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.531844 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b0f3d5ad-15b0-4747-bebd-caff2c900fcf-etc-selinux\") pod \"aws-ebs-csi-driver-node-fdj5k\" (UID: \"b0f3d5ad-15b0-4747-bebd-caff2c900fcf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdj5k" May 29 14:46:21.565997 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.565964 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-28 14:41:20 +0000 UTC" deadline="2028-03-10 02:31:57.314554818 +0000 UTC" May 29 14:46:21.565997 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.565994 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15611h45m35.74856434s" May 29 14:46:21.632645 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.632608 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7v7kz\" (UniqueName: \"kubernetes.io/projected/b0f3d5ad-15b0-4747-bebd-caff2c900fcf-kube-api-access-7v7kz\") pod \"aws-ebs-csi-driver-node-fdj5k\" (UID: \"b0f3d5ad-15b0-4747-bebd-caff2c900fcf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdj5k" May 29 14:46:21.632645 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.632649 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-var-lib-openvswitch\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.632859 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.632670 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-log-socket\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.632859 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.632689 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-host-run-ovn-kubernetes\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.632859 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.632705 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef-etc-sysconfig\") pod \"tuned-xd9jk\" (UID: \"8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef\") " pod="openshift-cluster-node-tuning-operator/tuned-xd9jk" May 29 14:46:21.632859 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.632711 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-var-lib-openvswitch\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.632859 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.632766 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-log-socket\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.632859 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.632777 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-host-run-ovn-kubernetes\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.632859 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.632719 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef-host\") pod \"tuned-xd9jk\" (UID: \"8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef\") " pod="openshift-cluster-node-tuning-operator/tuned-xd9jk" May 29 14:46:21.632859 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.632819 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b0f3d5ad-15b0-4747-bebd-caff2c900fcf-device-dir\") pod \"aws-ebs-csi-driver-node-fdj5k\" (UID: \"b0f3d5ad-15b0-4747-bebd-caff2c900fcf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdj5k" May 29 14:46:21.632859 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.632837 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-env-overrides\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.632859 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.632838 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef-etc-sysconfig\") pod \"tuned-xd9jk\" (UID: \"8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef\") " pod="openshift-cluster-node-tuning-operator/tuned-xd9jk" May 29 14:46:21.632859 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.632853 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b3f8a5d9-4cf1-4106-acb5-7191a54c7a16-system-cni-dir\") pod \"multus-additional-cni-plugins-skjzp\" (UID: \"b3f8a5d9-4cf1-4106-acb5-7191a54c7a16\") " pod="openshift-multus/multus-additional-cni-plugins-skjzp" May 29 14:46:21.632859 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.632869 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b3f8a5d9-4cf1-4106-acb5-7191a54c7a16-cni-binary-copy\") pod \"multus-additional-cni-plugins-skjzp\" (UID: \"b3f8a5d9-4cf1-4106-acb5-7191a54c7a16\") " pod="openshift-multus/multus-additional-cni-plugins-skjzp" May 29 14:46:21.633438 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.632885 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-run-openvswitch\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.633438 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.632900 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5945bd9a-fb25-48aa-bbcb-53466990a078-cni-binary-copy\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.633438 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.632894 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b0f3d5ad-15b0-4747-bebd-caff2c900fcf-device-dir\") pod \"aws-ebs-csi-driver-node-fdj5k\" (UID: \"b0f3d5ad-15b0-4747-bebd-caff2c900fcf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdj5k" May 29 14:46:21.633438 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.632783 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef-host\") pod \"tuned-xd9jk\" (UID: \"8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef\") " pod="openshift-cluster-node-tuning-operator/tuned-xd9jk" May 29 14:46:21.633438 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.632934 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b3f8a5d9-4cf1-4106-acb5-7191a54c7a16-system-cni-dir\") pod \"multus-additional-cni-plugins-skjzp\" (UID: \"b3f8a5d9-4cf1-4106-acb5-7191a54c7a16\") " pod="openshift-multus/multus-additional-cni-plugins-skjzp" May 29 14:46:21.633438 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.632968 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5945bd9a-fb25-48aa-bbcb-53466990a078-multus-conf-dir\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.633438 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.632998 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/55978d1f-3cbf-47ca-bf60-0457136ebe0e-iptables-alerter-script\") pod \"iptables-alerter-nbfxf\" (UID: \"55978d1f-3cbf-47ca-bf60-0457136ebe0e\") " pod="openshift-network-operator/iptables-alerter-nbfxf" May 29 14:46:21.633438 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.633023 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lb2ff\" (UniqueName: \"kubernetes.io/projected/55978d1f-3cbf-47ca-bf60-0457136ebe0e-kube-api-access-lb2ff\") pod \"iptables-alerter-nbfxf\" (UID: \"55978d1f-3cbf-47ca-bf60-0457136ebe0e\") " pod="openshift-network-operator/iptables-alerter-nbfxf" May 29 14:46:21.633438 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.633047 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/83518164-cbb0-445b-949b-0a9fc521e3e3-host\") pod \"node-ca-5xdw9\" (UID: \"83518164-cbb0-445b-949b-0a9fc521e3e3\") " pod="openshift-image-registry/node-ca-5xdw9" May 29 14:46:21.633438 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.633075 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q2qzb\" (UniqueName: \"kubernetes.io/projected/99dadb15-c9da-4773-b522-fc61ba649a8f-kube-api-access-q2qzb\") pod \"network-metrics-daemon-pkxjk\" (UID: \"99dadb15-c9da-4773-b522-fc61ba649a8f\") " pod="openshift-multus/network-metrics-daemon-pkxjk" May 29 14:46:21.633438 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.633101 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7452a23e-4293-4ee4-9c04-5a0ff4fe08b3-konnectivity-ca\") pod \"konnectivity-agent-f48d9\" (UID: \"7452a23e-4293-4ee4-9c04-5a0ff4fe08b3\") " pod="kube-system/konnectivity-agent-f48d9" May 29 14:46:21.633438 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.633128 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5945bd9a-fb25-48aa-bbcb-53466990a078-multus-cni-dir\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.633438 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.633151 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5945bd9a-fb25-48aa-bbcb-53466990a078-host-var-lib-cni-multus\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.633438 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.633198 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef-etc-sysctl-conf\") pod \"tuned-xd9jk\" (UID: \"8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef\") " pod="openshift-cluster-node-tuning-operator/tuned-xd9jk" May 29 14:46:21.633438 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.633225 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef-etc-systemd\") pod \"tuned-xd9jk\" (UID: \"8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef\") " pod="openshift-cluster-node-tuning-operator/tuned-xd9jk" May 29 14:46:21.633438 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.633251 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mdvlm\" (UniqueName: \"kubernetes.io/projected/8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef-kube-api-access-mdvlm\") pod \"tuned-xd9jk\" (UID: \"8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef\") " pod="openshift-cluster-node-tuning-operator/tuned-xd9jk" May 29 14:46:21.633438 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.633278 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b0f3d5ad-15b0-4747-bebd-caff2c900fcf-socket-dir\") pod \"aws-ebs-csi-driver-node-fdj5k\" (UID: \"b0f3d5ad-15b0-4747-bebd-caff2c900fcf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdj5k" May 29 14:46:21.634213 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.633304 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b0f3d5ad-15b0-4747-bebd-caff2c900fcf-registration-dir\") pod \"aws-ebs-csi-driver-node-fdj5k\" (UID: \"b0f3d5ad-15b0-4747-bebd-caff2c900fcf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdj5k" May 29 14:46:21.634213 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.633330 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-host-cni-netd\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.634213 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.633357 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.634213 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.633384 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-ovnkube-config\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.634213 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.633409 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8cjcm\" (UniqueName: \"kubernetes.io/projected/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-kube-api-access-8cjcm\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.634213 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.633437 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef-tmp\") pod \"tuned-xd9jk\" (UID: \"8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef\") " pod="openshift-cluster-node-tuning-operator/tuned-xd9jk" May 29 14:46:21.634213 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.633459 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-host-kubelet\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.634213 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.633484 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-run-systemd\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.634213 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.633501 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-run-openvswitch\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.634213 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.633509 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-host-cni-bin\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.634213 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.633536 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5945bd9a-fb25-48aa-bbcb-53466990a078-host-run-netns\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.634213 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.633605 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-host-cni-netd\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.634213 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.633622 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-host-cni-bin\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.634213 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.633631 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.634213 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.633839 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-env-overrides\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.634213 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.633889 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b3f8a5d9-4cf1-4106-acb5-7191a54c7a16-cni-binary-copy\") pod \"multus-additional-cni-plugins-skjzp\" (UID: \"b3f8a5d9-4cf1-4106-acb5-7191a54c7a16\") " pod="openshift-multus/multus-additional-cni-plugins-skjzp" May 29 14:46:21.634213 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.634073 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-ovnkube-config\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.634950 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.634086 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef-etc-systemd\") pod \"tuned-xd9jk\" (UID: \"8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef\") " pod="openshift-cluster-node-tuning-operator/tuned-xd9jk" May 29 14:46:21.634950 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.634135 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b0f3d5ad-15b0-4747-bebd-caff2c900fcf-registration-dir\") pod \"aws-ebs-csi-driver-node-fdj5k\" (UID: \"b0f3d5ad-15b0-4747-bebd-caff2c900fcf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdj5k" May 29 14:46:21.634950 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.634163 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b0f3d5ad-15b0-4747-bebd-caff2c900fcf-socket-dir\") pod \"aws-ebs-csi-driver-node-fdj5k\" (UID: \"b0f3d5ad-15b0-4747-bebd-caff2c900fcf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdj5k" May 29 14:46:21.634950 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.634196 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-run-systemd\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.634950 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.634209 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5945bd9a-fb25-48aa-bbcb-53466990a078-cni-binary-copy\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.634950 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.634225 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5945bd9a-fb25-48aa-bbcb-53466990a078-multus-cni-dir\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.634950 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.634263 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5945bd9a-fb25-48aa-bbcb-53466990a078-host-var-lib-cni-multus\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.634950 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.634304 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-host-kubelet\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.634950 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.634310 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef-etc-sysctl-conf\") pod \"tuned-xd9jk\" (UID: \"8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef\") " pod="openshift-cluster-node-tuning-operator/tuned-xd9jk" May 29 14:46:21.634950 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.634338 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/83518164-cbb0-445b-949b-0a9fc521e3e3-host\") pod \"node-ca-5xdw9\" (UID: \"83518164-cbb0-445b-949b-0a9fc521e3e3\") " pod="openshift-image-registry/node-ca-5xdw9" May 29 14:46:21.634950 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.634346 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5945bd9a-fb25-48aa-bbcb-53466990a078-host-var-lib-kubelet\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.634950 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.634392 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef-lib-modules\") pod \"tuned-xd9jk\" (UID: \"8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef\") " pod="openshift-cluster-node-tuning-operator/tuned-xd9jk" May 29 14:46:21.634950 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.634420 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-host-slash\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.634950 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.634439 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7452a23e-4293-4ee4-9c04-5a0ff4fe08b3-konnectivity-ca\") pod \"konnectivity-agent-f48d9\" (UID: \"7452a23e-4293-4ee4-9c04-5a0ff4fe08b3\") " pod="kube-system/konnectivity-agent-f48d9" May 29 14:46:21.634950 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.634481 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5945bd9a-fb25-48aa-bbcb-53466990a078-multus-conf-dir\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.634950 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.634495 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/55978d1f-3cbf-47ca-bf60-0457136ebe0e-host-slash\") pod \"iptables-alerter-nbfxf\" (UID: \"55978d1f-3cbf-47ca-bf60-0457136ebe0e\") " pod="openshift-network-operator/iptables-alerter-nbfxf" May 29 14:46:21.634950 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.634526 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vrvzf\" (UniqueName: \"kubernetes.io/projected/5945bd9a-fb25-48aa-bbcb-53466990a078-kube-api-access-vrvzf\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.634950 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.634530 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-host-slash\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.635816 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.634470 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 29 14:46:21.635816 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.634560 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5945bd9a-fb25-48aa-bbcb-53466990a078-hostroot\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.635816 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.634583 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef-lib-modules\") pod \"tuned-xd9jk\" (UID: \"8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef\") " pod="openshift-cluster-node-tuning-operator/tuned-xd9jk" May 29 14:46:21.635816 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.634620 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5945bd9a-fb25-48aa-bbcb-53466990a078-host-run-netns\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.635816 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.634627 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5945bd9a-fb25-48aa-bbcb-53466990a078-host-var-lib-kubelet\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.635816 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.634654 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5945bd9a-fb25-48aa-bbcb-53466990a078-hostroot\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.635816 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.634661 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b3f8a5d9-4cf1-4106-acb5-7191a54c7a16-os-release\") pod \"multus-additional-cni-plugins-skjzp\" (UID: \"b3f8a5d9-4cf1-4106-acb5-7191a54c7a16\") " pod="openshift-multus/multus-additional-cni-plugins-skjzp" May 29 14:46:21.635816 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.634685 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/55978d1f-3cbf-47ca-bf60-0457136ebe0e-host-slash\") pod \"iptables-alerter-nbfxf\" (UID: \"55978d1f-3cbf-47ca-bf60-0457136ebe0e\") " pod="openshift-network-operator/iptables-alerter-nbfxf" May 29 14:46:21.635816 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.634776 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b3f8a5d9-4cf1-4106-acb5-7191a54c7a16-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-skjzp\" (UID: \"b3f8a5d9-4cf1-4106-acb5-7191a54c7a16\") " pod="openshift-multus/multus-additional-cni-plugins-skjzp" May 29 14:46:21.635816 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.634804 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b3f8a5d9-4cf1-4106-acb5-7191a54c7a16-os-release\") pod \"multus-additional-cni-plugins-skjzp\" (UID: \"b3f8a5d9-4cf1-4106-acb5-7191a54c7a16\") " pod="openshift-multus/multus-additional-cni-plugins-skjzp" May 29 14:46:21.635816 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.634842 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-systemd-units\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.635816 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.634882 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-etc-openvswitch\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.635816 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.634923 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5945bd9a-fb25-48aa-bbcb-53466990a078-system-cni-dir\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.635816 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.634952 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5945bd9a-fb25-48aa-bbcb-53466990a078-host-var-lib-cni-bin\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.635816 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.634990 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-ovnkube-script-lib\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.635816 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.635018 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/83518164-cbb0-445b-949b-0a9fc521e3e3-serviceca\") pod \"node-ca-5xdw9\" (UID: \"83518164-cbb0-445b-949b-0a9fc521e3e3\") " pod="openshift-image-registry/node-ca-5xdw9" May 29 14:46:21.635816 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.635045 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bw94q\" (UniqueName: \"kubernetes.io/projected/83518164-cbb0-445b-949b-0a9fc521e3e3-kube-api-access-bw94q\") pod \"node-ca-5xdw9\" (UID: \"83518164-cbb0-445b-949b-0a9fc521e3e3\") " pod="openshift-image-registry/node-ca-5xdw9" May 29 14:46:21.635816 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.635073 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5945bd9a-fb25-48aa-bbcb-53466990a078-host-run-k8s-cni-cncf-io\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.636634 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.635119 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/55978d1f-3cbf-47ca-bf60-0457136ebe0e-iptables-alerter-script\") pod \"iptables-alerter-nbfxf\" (UID: \"55978d1f-3cbf-47ca-bf60-0457136ebe0e\") " pod="openshift-network-operator/iptables-alerter-nbfxf" May 29 14:46:21.636634 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.635135 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99dadb15-c9da-4773-b522-fc61ba649a8f-metrics-certs\") pod \"network-metrics-daemon-pkxjk\" (UID: \"99dadb15-c9da-4773-b522-fc61ba649a8f\") " pod="openshift-multus/network-metrics-daemon-pkxjk" May 29 14:46:21.636634 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.635165 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef-var-lib-kubelet\") pod \"tuned-xd9jk\" (UID: \"8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef\") " pod="openshift-cluster-node-tuning-operator/tuned-xd9jk" May 29 14:46:21.636634 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.635218 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5945bd9a-fb25-48aa-bbcb-53466990a078-host-run-multus-certs\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.636634 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.635248 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5945bd9a-fb25-48aa-bbcb-53466990a078-multus-daemon-config\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.636634 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.635257 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b3f8a5d9-4cf1-4106-acb5-7191a54c7a16-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-skjzp\" (UID: \"b3f8a5d9-4cf1-4106-acb5-7191a54c7a16\") " pod="openshift-multus/multus-additional-cni-plugins-skjzp" May 29 14:46:21.636634 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.635167 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5945bd9a-fb25-48aa-bbcb-53466990a078-host-run-k8s-cni-cncf-io\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.636634 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.635219 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-systemd-units\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.636634 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.635309 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef-sys\") pod \"tuned-xd9jk\" (UID: \"8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef\") " pod="openshift-cluster-node-tuning-operator/tuned-xd9jk" May 29 14:46:21.636634 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.635314 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5945bd9a-fb25-48aa-bbcb-53466990a078-host-run-multus-certs\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.636634 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.635325 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5945bd9a-fb25-48aa-bbcb-53466990a078-host-var-lib-cni-bin\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.636634 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.635348 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b0f3d5ad-15b0-4747-bebd-caff2c900fcf-etc-selinux\") pod \"aws-ebs-csi-driver-node-fdj5k\" (UID: \"b0f3d5ad-15b0-4747-bebd-caff2c900fcf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdj5k" May 29 14:46:21.636634 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.635358 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef-sys\") pod \"tuned-xd9jk\" (UID: \"8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef\") " pod="openshift-cluster-node-tuning-operator/tuned-xd9jk" May 29 14:46:21.636634 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.635367 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-etc-openvswitch\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.636634 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.635377 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef-etc-modprobe-d\") pod \"tuned-xd9jk\" (UID: \"8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef\") " pod="openshift-cluster-node-tuning-operator/tuned-xd9jk" May 29 14:46:21.636634 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.635398 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5945bd9a-fb25-48aa-bbcb-53466990a078-system-cni-dir\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.636634 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.635435 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef-var-lib-kubelet\") pod \"tuned-xd9jk\" (UID: \"8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef\") " pod="openshift-cluster-node-tuning-operator/tuned-xd9jk" May 29 14:46:21.637380 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.635476 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b0f3d5ad-15b0-4747-bebd-caff2c900fcf-etc-selinux\") pod \"aws-ebs-csi-driver-node-fdj5k\" (UID: \"b0f3d5ad-15b0-4747-bebd-caff2c900fcf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdj5k" May 29 14:46:21.637380 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.635538 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef-etc-modprobe-d\") pod \"tuned-xd9jk\" (UID: \"8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef\") " pod="openshift-cluster-node-tuning-operator/tuned-xd9jk" May 29 14:46:21.637380 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.635568 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/83518164-cbb0-445b-949b-0a9fc521e3e3-serviceca\") pod \"node-ca-5xdw9\" (UID: \"83518164-cbb0-445b-949b-0a9fc521e3e3\") " pod="openshift-image-registry/node-ca-5xdw9" May 29 14:46:21.637380 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.635575 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef-etc-tuned\") pod \"tuned-xd9jk\" (UID: \"8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef\") " pod="openshift-cluster-node-tuning-operator/tuned-xd9jk" May 29 14:46:21.637380 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.635607 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-host-run-netns\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.637380 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.635721 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5945bd9a-fb25-48aa-bbcb-53466990a078-cnibin\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.637380 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.635750 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef-etc-sysctl-d\") pod \"tuned-xd9jk\" (UID: \"8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef\") " pod="openshift-cluster-node-tuning-operator/tuned-xd9jk" May 29 14:46:21.637380 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.635795 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b3f8a5d9-4cf1-4106-acb5-7191a54c7a16-cnibin\") pod \"multus-additional-cni-plugins-skjzp\" (UID: \"b3f8a5d9-4cf1-4106-acb5-7191a54c7a16\") " pod="openshift-multus/multus-additional-cni-plugins-skjzp" May 29 14:46:21.637380 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.635822 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b3f8a5d9-4cf1-4106-acb5-7191a54c7a16-tuning-conf-dir\") pod \"multus-additional-cni-plugins-skjzp\" (UID: \"b3f8a5d9-4cf1-4106-acb5-7191a54c7a16\") " pod="openshift-multus/multus-additional-cni-plugins-skjzp" May 29 14:46:21.637380 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.635827 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5945bd9a-fb25-48aa-bbcb-53466990a078-multus-daemon-config\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.637380 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.635849 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef-run\") pod \"tuned-xd9jk\" (UID: \"8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef\") " pod="openshift-cluster-node-tuning-operator/tuned-xd9jk" May 29 14:46:21.637380 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.635854 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-host-run-netns\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.637380 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.635901 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5945bd9a-fb25-48aa-bbcb-53466990a078-cnibin\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.637380 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.635905 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b3f8a5d9-4cf1-4106-acb5-7191a54c7a16-cnibin\") pod \"multus-additional-cni-plugins-skjzp\" (UID: \"b3f8a5d9-4cf1-4106-acb5-7191a54c7a16\") " pod="openshift-multus/multus-additional-cni-plugins-skjzp" May 29 14:46:21.637380 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.635915 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-ovnkube-script-lib\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.637380 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.635910 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rmdbp\" (UniqueName: \"kubernetes.io/projected/b3f8a5d9-4cf1-4106-acb5-7191a54c7a16-kube-api-access-rmdbp\") pod \"multus-additional-cni-plugins-skjzp\" (UID: \"b3f8a5d9-4cf1-4106-acb5-7191a54c7a16\") " pod="openshift-multus/multus-additional-cni-plugins-skjzp" May 29 14:46:21.637380 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.635941 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef-run\") pod \"tuned-xd9jk\" (UID: \"8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef\") " pod="openshift-cluster-node-tuning-operator/tuned-xd9jk" May 29 14:46:21.637380 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:21.635955 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 14:46:21.638095 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.635972 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-node-log\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.638095 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.635974 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef-etc-sysctl-d\") pod \"tuned-xd9jk\" (UID: \"8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef\") " pod="openshift-cluster-node-tuning-operator/tuned-xd9jk" May 29 14:46:21.638095 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:21.636016 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99dadb15-c9da-4773-b522-fc61ba649a8f-metrics-certs podName:99dadb15-c9da-4773-b522-fc61ba649a8f nodeName:}" failed. No retries permitted until 2026-05-29 14:46:22.135999322 +0000 UTC m=+2.993111269 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/99dadb15-c9da-4773-b522-fc61ba649a8f-metrics-certs") pod "network-metrics-daemon-pkxjk" (UID: "99dadb15-c9da-4773-b522-fc61ba649a8f") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 14:46:21.638095 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.636033 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-ovn-node-metrics-cert\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.638095 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.636037 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-node-log\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.638095 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.636078 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b0f3d5ad-15b0-4747-bebd-caff2c900fcf-sys-fs\") pod \"aws-ebs-csi-driver-node-fdj5k\" (UID: \"b0f3d5ad-15b0-4747-bebd-caff2c900fcf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdj5k" May 29 14:46:21.638095 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.636187 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b3f8a5d9-4cf1-4106-acb5-7191a54c7a16-tuning-conf-dir\") pod \"multus-additional-cni-plugins-skjzp\" (UID: \"b3f8a5d9-4cf1-4106-acb5-7191a54c7a16\") " pod="openshift-multus/multus-additional-cni-plugins-skjzp" May 29 14:46:21.638095 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.636206 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef-etc-kubernetes\") pod \"tuned-xd9jk\" (UID: \"8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef\") " pod="openshift-cluster-node-tuning-operator/tuned-xd9jk" May 29 14:46:21.638095 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.636241 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vrggq\" (UniqueName: \"kubernetes.io/projected/1e83cba4-a631-4284-be4b-0b2beed9fd46-kube-api-access-vrggq\") pod \"network-check-target-946gb\" (UID: \"1e83cba4-a631-4284-be4b-0b2beed9fd46\") " pod="openshift-network-diagnostics/network-check-target-946gb" May 29 14:46:21.638095 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.636262 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b0f3d5ad-15b0-4747-bebd-caff2c900fcf-sys-fs\") pod \"aws-ebs-csi-driver-node-fdj5k\" (UID: \"b0f3d5ad-15b0-4747-bebd-caff2c900fcf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdj5k" May 29 14:46:21.638095 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.636271 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef-etc-kubernetes\") pod \"tuned-xd9jk\" (UID: \"8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef\") " pod="openshift-cluster-node-tuning-operator/tuned-xd9jk" May 29 14:46:21.638095 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.636309 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7452a23e-4293-4ee4-9c04-5a0ff4fe08b3-agent-certs\") pod \"konnectivity-agent-f48d9\" (UID: \"7452a23e-4293-4ee4-9c04-5a0ff4fe08b3\") " pod="kube-system/konnectivity-agent-f48d9" May 29 14:46:21.638095 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.636329 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b3f8a5d9-4cf1-4106-acb5-7191a54c7a16-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-skjzp\" (UID: \"b3f8a5d9-4cf1-4106-acb5-7191a54c7a16\") " pod="openshift-multus/multus-additional-cni-plugins-skjzp" May 29 14:46:21.638095 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.636473 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b0f3d5ad-15b0-4747-bebd-caff2c900fcf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fdj5k\" (UID: \"b0f3d5ad-15b0-4747-bebd-caff2c900fcf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdj5k" May 29 14:46:21.638095 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.636521 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-run-ovn\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.638095 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.636563 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5945bd9a-fb25-48aa-bbcb-53466990a078-etc-kubernetes\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.638775 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.636591 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5945bd9a-fb25-48aa-bbcb-53466990a078-os-release\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.638775 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.636628 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5945bd9a-fb25-48aa-bbcb-53466990a078-multus-socket-dir-parent\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.638775 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.636700 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-run-ovn\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.638775 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.636708 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b0f3d5ad-15b0-4747-bebd-caff2c900fcf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fdj5k\" (UID: \"b0f3d5ad-15b0-4747-bebd-caff2c900fcf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdj5k" May 29 14:46:21.638775 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.636735 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5945bd9a-fb25-48aa-bbcb-53466990a078-etc-kubernetes\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.638775 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.636758 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5945bd9a-fb25-48aa-bbcb-53466990a078-multus-socket-dir-parent\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.638775 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.636815 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5945bd9a-fb25-48aa-bbcb-53466990a078-os-release\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.638775 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.637090 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b3f8a5d9-4cf1-4106-acb5-7191a54c7a16-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-skjzp\" (UID: \"b3f8a5d9-4cf1-4106-acb5-7191a54c7a16\") " pod="openshift-multus/multus-additional-cni-plugins-skjzp" May 29 14:46:21.638775 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.638147 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef-tmp\") pod \"tuned-xd9jk\" (UID: \"8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef\") " pod="openshift-cluster-node-tuning-operator/tuned-xd9jk" May 29 14:46:21.638775 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.638166 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef-etc-tuned\") pod \"tuned-xd9jk\" (UID: \"8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef\") " pod="openshift-cluster-node-tuning-operator/tuned-xd9jk" May 29 14:46:21.638775 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.638634 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-ovn-node-metrics-cert\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.639338 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.639315 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7452a23e-4293-4ee4-9c04-5a0ff4fe08b3-agent-certs\") pod \"konnectivity-agent-f48d9\" (UID: \"7452a23e-4293-4ee4-9c04-5a0ff4fe08b3\") " pod="kube-system/konnectivity-agent-f48d9" May 29 14:46:21.648706 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.648676 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cjcm\" (UniqueName: \"kubernetes.io/projected/1300fffd-bfc2-4a5c-95d8-01941a39ca6c-kube-api-access-8cjcm\") pod \"ovnkube-node-gvn49\" (UID: \"1300fffd-bfc2-4a5c-95d8-01941a39ca6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.649620 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.649600 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v7kz\" (UniqueName: \"kubernetes.io/projected/b0f3d5ad-15b0-4747-bebd-caff2c900fcf-kube-api-access-7v7kz\") pod \"aws-ebs-csi-driver-node-fdj5k\" (UID: \"b0f3d5ad-15b0-4747-bebd-caff2c900fcf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdj5k" May 29 14:46:21.655733 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:21.655699 2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 14:46:21.655733 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:21.655725 2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 14:46:21.655896 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:21.655740 2564 projected.go:194] Error preparing data for projected volume kube-api-access-vrggq for pod openshift-network-diagnostics/network-check-target-946gb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 14:46:21.655896 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:21.655817 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e83cba4-a631-4284-be4b-0b2beed9fd46-kube-api-access-vrggq podName:1e83cba4-a631-4284-be4b-0b2beed9fd46 nodeName:}" failed. No retries permitted until 2026-05-29 14:46:22.155797346 +0000 UTC m=+3.012909292 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vrggq" (UniqueName: "kubernetes.io/projected/1e83cba4-a631-4284-be4b-0b2beed9fd46-kube-api-access-vrggq") pod "network-check-target-946gb" (UID: "1e83cba4-a631-4284-be4b-0b2beed9fd46") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 14:46:21.657007 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.656977 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmdbp\" (UniqueName: \"kubernetes.io/projected/b3f8a5d9-4cf1-4106-acb5-7191a54c7a16-kube-api-access-rmdbp\") pod \"multus-additional-cni-plugins-skjzp\" (UID: \"b3f8a5d9-4cf1-4106-acb5-7191a54c7a16\") " pod="openshift-multus/multus-additional-cni-plugins-skjzp" May 29 14:46:21.657615 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.657597 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrvzf\" (UniqueName: \"kubernetes.io/projected/5945bd9a-fb25-48aa-bbcb-53466990a078-kube-api-access-vrvzf\") pod \"multus-xg8cs\" (UID: \"5945bd9a-fb25-48aa-bbcb-53466990a078\") " pod="openshift-multus/multus-xg8cs" May 29 14:46:21.657962 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.657934 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2qzb\" (UniqueName: \"kubernetes.io/projected/99dadb15-c9da-4773-b522-fc61ba649a8f-kube-api-access-q2qzb\") pod \"network-metrics-daemon-pkxjk\" (UID: \"99dadb15-c9da-4773-b522-fc61ba649a8f\") " pod="openshift-multus/network-metrics-daemon-pkxjk" May 29 14:46:21.658052 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.658031 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw94q\" (UniqueName: \"kubernetes.io/projected/83518164-cbb0-445b-949b-0a9fc521e3e3-kube-api-access-bw94q\") pod \"node-ca-5xdw9\" (UID: \"83518164-cbb0-445b-949b-0a9fc521e3e3\") " pod="openshift-image-registry/node-ca-5xdw9" May 29 14:46:21.658351 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.658333 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lb2ff\" (UniqueName: \"kubernetes.io/projected/55978d1f-3cbf-47ca-bf60-0457136ebe0e-kube-api-access-lb2ff\") pod \"iptables-alerter-nbfxf\" (UID: \"55978d1f-3cbf-47ca-bf60-0457136ebe0e\") " pod="openshift-network-operator/iptables-alerter-nbfxf" May 29 14:46:21.658641 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.658615 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdvlm\" (UniqueName: \"kubernetes.io/projected/8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef-kube-api-access-mdvlm\") pod \"tuned-xd9jk\" (UID: \"8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef\") " pod="openshift-cluster-node-tuning-operator/tuned-xd9jk" May 29 14:46:21.815253 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.815156 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f48d9" May 29 14:46:21.822070 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.822043 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdj5k" May 29 14:46:21.830228 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.830207 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nbfxf" May 29 14:46:21.835841 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.835813 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xg8cs" May 29 14:46:21.841579 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.841550 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:21.848125 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.848106 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xd9jk" May 29 14:46:21.853664 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.853644 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5xdw9" May 29 14:46:21.858231 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:21.858215 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-skjzp" May 29 14:46:22.140550 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:22.140457 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99dadb15-c9da-4773-b522-fc61ba649a8f-metrics-certs\") pod \"network-metrics-daemon-pkxjk\" (UID: \"99dadb15-c9da-4773-b522-fc61ba649a8f\") " pod="openshift-multus/network-metrics-daemon-pkxjk" May 29 14:46:22.140716 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:22.140629 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 14:46:22.140716 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:22.140713 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99dadb15-c9da-4773-b522-fc61ba649a8f-metrics-certs podName:99dadb15-c9da-4773-b522-fc61ba649a8f nodeName:}" failed. No retries permitted until 2026-05-29 14:46:23.140692963 +0000 UTC m=+3.997804892 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/99dadb15-c9da-4773-b522-fc61ba649a8f-metrics-certs") pod "network-metrics-daemon-pkxjk" (UID: "99dadb15-c9da-4773-b522-fc61ba649a8f") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 14:46:22.190824 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:22.190792 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7452a23e_4293_4ee4_9c04_5a0ff4fe08b3.slice/crio-6bed8a194d23fe45a4d16dfdb1a9881448a9364d753408ea26ed5b92cf4dde8e WatchSource:0}: Error finding container 6bed8a194d23fe45a4d16dfdb1a9881448a9364d753408ea26ed5b92cf4dde8e: Status 404 returned error can't find the container with id 6bed8a194d23fe45a4d16dfdb1a9881448a9364d753408ea26ed5b92cf4dde8e May 29 14:46:22.192376 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:22.192349 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55978d1f_3cbf_47ca_bf60_0457136ebe0e.slice/crio-c29a81d7677039be86f7eb9ecc8b14baa91e5502d4ee18d77b7aa89e4604de32 WatchSource:0}: Error finding container c29a81d7677039be86f7eb9ecc8b14baa91e5502d4ee18d77b7aa89e4604de32: Status 404 returned error can't find the container with id c29a81d7677039be86f7eb9ecc8b14baa91e5502d4ee18d77b7aa89e4604de32 May 29 14:46:22.193043 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:22.193008 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3f8a5d9_4cf1_4106_acb5_7191a54c7a16.slice/crio-d6749ca98e05e18f24dc84d3bcfd4e32eb93ed135fff273cfe7154fc3d78626f WatchSource:0}: Error finding container d6749ca98e05e18f24dc84d3bcfd4e32eb93ed135fff273cfe7154fc3d78626f: Status 404 returned error can't find the container with id d6749ca98e05e18f24dc84d3bcfd4e32eb93ed135fff273cfe7154fc3d78626f May 29 14:46:22.194285 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:22.194206 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5945bd9a_fb25_48aa_bbcb_53466990a078.slice/crio-0f4d47209bba82f4f9c5303ac385389edc24eccfc0c37a009c79998270f762c7 WatchSource:0}: Error finding container 0f4d47209bba82f4f9c5303ac385389edc24eccfc0c37a009c79998270f762c7: Status 404 returned error can't find the container with id 0f4d47209bba82f4f9c5303ac385389edc24eccfc0c37a009c79998270f762c7 May 29 14:46:22.195643 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:22.195630 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f2463eb_0f37_4ad6_a7c2_0bc8047ec2ef.slice/crio-0b02e671841275e6c096886826e93939c38b8dea90e8d28ee6a01955ce70bdbb WatchSource:0}: Error finding container 0b02e671841275e6c096886826e93939c38b8dea90e8d28ee6a01955ce70bdbb: Status 404 returned error can't find the container with id 0b02e671841275e6c096886826e93939c38b8dea90e8d28ee6a01955ce70bdbb May 29 14:46:22.197084 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:22.197063 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1300fffd_bfc2_4a5c_95d8_01941a39ca6c.slice/crio-ef468b578ad8e024abf6130c3298253c1aed19e19ea8678ac397f2c3e42cc350 WatchSource:0}: Error finding container ef468b578ad8e024abf6130c3298253c1aed19e19ea8678ac397f2c3e42cc350: Status 404 returned error can't find the container with id ef468b578ad8e024abf6130c3298253c1aed19e19ea8678ac397f2c3e42cc350 May 29 14:46:22.199725 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:22.199574 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83518164_cbb0_445b_949b_0a9fc521e3e3.slice/crio-18515ff85abf2ed0b20d17a99e702a9231667fd987bc613d2b3d365e46e12b08 WatchSource:0}: Error finding container 18515ff85abf2ed0b20d17a99e702a9231667fd987bc613d2b3d365e46e12b08: Status 404 returned error can't find the container with id 18515ff85abf2ed0b20d17a99e702a9231667fd987bc613d2b3d365e46e12b08 May 29 14:46:22.200882 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:22.200550 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0f3d5ad_15b0_4747_bebd_caff2c900fcf.slice/crio-ca0e62a4a3d26f8644feeb52c600a9d057a56ae45a75b7da28d470edb2db18b5 WatchSource:0}: Error finding container ca0e62a4a3d26f8644feeb52c600a9d057a56ae45a75b7da28d470edb2db18b5: Status 404 returned error can't find the container with id ca0e62a4a3d26f8644feeb52c600a9d057a56ae45a75b7da28d470edb2db18b5 May 29 14:46:22.241006 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:22.240807 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vrggq\" (UniqueName: \"kubernetes.io/projected/1e83cba4-a631-4284-be4b-0b2beed9fd46-kube-api-access-vrggq\") pod \"network-check-target-946gb\" (UID: \"1e83cba4-a631-4284-be4b-0b2beed9fd46\") " pod="openshift-network-diagnostics/network-check-target-946gb" May 29 14:46:22.241165 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:22.240964 2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 14:46:22.241165 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:22.241055 2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 14:46:22.241165 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:22.241067 2564 projected.go:194] Error preparing data for projected volume kube-api-access-vrggq for pod openshift-network-diagnostics/network-check-target-946gb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 14:46:22.241165 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:22.241125 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e83cba4-a631-4284-be4b-0b2beed9fd46-kube-api-access-vrggq podName:1e83cba4-a631-4284-be4b-0b2beed9fd46 nodeName:}" failed. No retries permitted until 2026-05-29 14:46:23.241106423 +0000 UTC m=+4.098218362 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vrggq" (UniqueName: "kubernetes.io/projected/1e83cba4-a631-4284-be4b-0b2beed9fd46-kube-api-access-vrggq") pod "network-check-target-946gb" (UID: "1e83cba4-a631-4284-be4b-0b2beed9fd46") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 14:46:22.566934 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:22.566893 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-28 14:41:20 +0000 UTC" deadline="2027-11-13 16:49:55.685736459 +0000 UTC" May 29 14:46:22.566934 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:22.566927 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12794h3m33.118812873s" May 29 14:46:22.650878 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:22.650836 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-946gb" May 29 14:46:22.651061 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:22.650962 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-946gb" podUID="1e83cba4-a631-4284-be4b-0b2beed9fd46" May 29 14:46:22.662152 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:22.662093 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nbfxf" event={"ID":"55978d1f-3cbf-47ca-bf60-0457136ebe0e","Type":"ContainerStarted","Data":"c29a81d7677039be86f7eb9ecc8b14baa91e5502d4ee18d77b7aa89e4604de32"} May 29 14:46:22.667152 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:22.667118 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-189.ec2.internal" event={"ID":"33dc9f2399849a35b751db08f0aecf8e","Type":"ContainerStarted","Data":"d1fdde42312d9fecb7e71d24422064c21fc913ba137d1faef2ccda9ea3351ce3"} May 29 14:46:22.672037 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:22.672002 2564 generic.go:358] "Generic (PLEG): container finished" podID="ab87c0c59a9488515be757546d0accf7" containerID="5410cbd71de631a9efd0ba4f93c50ca99fd230f6b81008327b3729bff4ec9280" exitCode=0 May 29 14:46:22.672152 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:22.672081 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-189.ec2.internal" event={"ID":"ab87c0c59a9488515be757546d0accf7","Type":"ContainerDied","Data":"5410cbd71de631a9efd0ba4f93c50ca99fd230f6b81008327b3729bff4ec9280"} May 29 14:46:22.679425 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:22.679336 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdj5k" event={"ID":"b0f3d5ad-15b0-4747-bebd-caff2c900fcf","Type":"ContainerStarted","Data":"ca0e62a4a3d26f8644feeb52c600a9d057a56ae45a75b7da28d470edb2db18b5"} May 29 14:46:22.681550 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:22.681521 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" event={"ID":"1300fffd-bfc2-4a5c-95d8-01941a39ca6c","Type":"ContainerStarted","Data":"ef468b578ad8e024abf6130c3298253c1aed19e19ea8678ac397f2c3e42cc350"} May 29 14:46:22.696024 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:22.695989 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f48d9" event={"ID":"7452a23e-4293-4ee4-9c04-5a0ff4fe08b3","Type":"ContainerStarted","Data":"6bed8a194d23fe45a4d16dfdb1a9881448a9364d753408ea26ed5b92cf4dde8e"} May 29 14:46:22.702267 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:22.702129 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5xdw9" event={"ID":"83518164-cbb0-445b-949b-0a9fc521e3e3","Type":"ContainerStarted","Data":"18515ff85abf2ed0b20d17a99e702a9231667fd987bc613d2b3d365e46e12b08"} May 29 14:46:22.706615 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:22.706583 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xd9jk" event={"ID":"8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef","Type":"ContainerStarted","Data":"0b02e671841275e6c096886826e93939c38b8dea90e8d28ee6a01955ce70bdbb"} May 29 14:46:22.710994 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:22.709420 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-189.ec2.internal" podStartSLOduration=1.709404484 podStartE2EDuration="1.709404484s" podCreationTimestamp="2026-05-29 14:46:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 14:46:22.686813443 +0000 UTC m=+3.543925392" watchObservedRunningTime="2026-05-29 14:46:22.709404484 +0000 UTC m=+3.566516430" May 29 14:46:22.720781 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:22.720721 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xg8cs" event={"ID":"5945bd9a-fb25-48aa-bbcb-53466990a078","Type":"ContainerStarted","Data":"0f4d47209bba82f4f9c5303ac385389edc24eccfc0c37a009c79998270f762c7"} May 29 14:46:22.731779 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:22.731745 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-skjzp" event={"ID":"b3f8a5d9-4cf1-4106-acb5-7191a54c7a16","Type":"ContainerStarted","Data":"d6749ca98e05e18f24dc84d3bcfd4e32eb93ed135fff273cfe7154fc3d78626f"} May 29 14:46:23.149524 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:23.148522 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99dadb15-c9da-4773-b522-fc61ba649a8f-metrics-certs\") pod \"network-metrics-daemon-pkxjk\" (UID: \"99dadb15-c9da-4773-b522-fc61ba649a8f\") " pod="openshift-multus/network-metrics-daemon-pkxjk" May 29 14:46:23.149524 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:23.148671 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 14:46:23.149524 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:23.148735 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99dadb15-c9da-4773-b522-fc61ba649a8f-metrics-certs podName:99dadb15-c9da-4773-b522-fc61ba649a8f nodeName:}" failed. No retries permitted until 2026-05-29 14:46:25.148716331 +0000 UTC m=+6.005828273 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/99dadb15-c9da-4773-b522-fc61ba649a8f-metrics-certs") pod "network-metrics-daemon-pkxjk" (UID: "99dadb15-c9da-4773-b522-fc61ba649a8f") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 14:46:23.248940 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:23.248884 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vrggq\" (UniqueName: \"kubernetes.io/projected/1e83cba4-a631-4284-be4b-0b2beed9fd46-kube-api-access-vrggq\") pod \"network-check-target-946gb\" (UID: \"1e83cba4-a631-4284-be4b-0b2beed9fd46\") " pod="openshift-network-diagnostics/network-check-target-946gb" May 29 14:46:23.249105 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:23.249042 2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 14:46:23.249105 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:23.249061 2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 14:46:23.249105 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:23.249073 2564 projected.go:194] Error preparing data for projected volume kube-api-access-vrggq for pod openshift-network-diagnostics/network-check-target-946gb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 14:46:23.249293 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:23.249135 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e83cba4-a631-4284-be4b-0b2beed9fd46-kube-api-access-vrggq podName:1e83cba4-a631-4284-be4b-0b2beed9fd46 nodeName:}" failed. No retries permitted until 2026-05-29 14:46:25.249116489 +0000 UTC m=+6.106228418 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vrggq" (UniqueName: "kubernetes.io/projected/1e83cba4-a631-4284-be4b-0b2beed9fd46-kube-api-access-vrggq") pod "network-check-target-946gb" (UID: "1e83cba4-a631-4284-be4b-0b2beed9fd46") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 14:46:23.651484 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:23.651454 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkxjk" May 29 14:46:23.651949 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:23.651608 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkxjk" podUID="99dadb15-c9da-4773-b522-fc61ba649a8f" May 29 14:46:23.749317 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:23.749251 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-189.ec2.internal" event={"ID":"ab87c0c59a9488515be757546d0accf7","Type":"ContainerStarted","Data":"a34391dea813ef78a94b9ac5bf7e3f3b5ec117f2835c513d115e67d27921356a"} May 29 14:46:24.651573 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:24.651070 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-946gb" May 29 14:46:24.651573 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:24.651213 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-946gb" podUID="1e83cba4-a631-4284-be4b-0b2beed9fd46" May 29 14:46:25.164000 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:25.163955 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99dadb15-c9da-4773-b522-fc61ba649a8f-metrics-certs\") pod \"network-metrics-daemon-pkxjk\" (UID: \"99dadb15-c9da-4773-b522-fc61ba649a8f\") " pod="openshift-multus/network-metrics-daemon-pkxjk" May 29 14:46:25.166523 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:25.166427 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 14:46:25.166523 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:25.166501 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99dadb15-c9da-4773-b522-fc61ba649a8f-metrics-certs podName:99dadb15-c9da-4773-b522-fc61ba649a8f nodeName:}" failed. No retries permitted until 2026-05-29 14:46:29.166482896 +0000 UTC m=+10.023594823 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/99dadb15-c9da-4773-b522-fc61ba649a8f-metrics-certs") pod "network-metrics-daemon-pkxjk" (UID: "99dadb15-c9da-4773-b522-fc61ba649a8f") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 14:46:25.265187 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:25.264660 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vrggq\" (UniqueName: \"kubernetes.io/projected/1e83cba4-a631-4284-be4b-0b2beed9fd46-kube-api-access-vrggq\") pod \"network-check-target-946gb\" (UID: \"1e83cba4-a631-4284-be4b-0b2beed9fd46\") " pod="openshift-network-diagnostics/network-check-target-946gb" May 29 14:46:25.265187 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:25.264792 2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 14:46:25.265187 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:25.264807 2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 14:46:25.265187 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:25.264816 2564 projected.go:194] Error preparing data for projected volume kube-api-access-vrggq for pod openshift-network-diagnostics/network-check-target-946gb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 14:46:25.265187 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:25.264869 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e83cba4-a631-4284-be4b-0b2beed9fd46-kube-api-access-vrggq podName:1e83cba4-a631-4284-be4b-0b2beed9fd46 nodeName:}" failed. No retries permitted until 2026-05-29 14:46:29.264849448 +0000 UTC m=+10.121961394 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vrggq" (UniqueName: "kubernetes.io/projected/1e83cba4-a631-4284-be4b-0b2beed9fd46-kube-api-access-vrggq") pod "network-check-target-946gb" (UID: "1e83cba4-a631-4284-be4b-0b2beed9fd46") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 14:46:25.653501 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:25.653463 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkxjk" May 29 14:46:25.654061 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:25.653606 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkxjk" podUID="99dadb15-c9da-4773-b522-fc61ba649a8f" May 29 14:46:26.651135 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:26.651099 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-946gb" May 29 14:46:26.651340 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:26.651231 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-946gb" podUID="1e83cba4-a631-4284-be4b-0b2beed9fd46" May 29 14:46:27.653257 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:27.652790 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkxjk" May 29 14:46:27.653257 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:27.652910 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkxjk" podUID="99dadb15-c9da-4773-b522-fc61ba649a8f" May 29 14:46:28.651132 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:28.651092 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-946gb" May 29 14:46:28.651329 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:28.651260 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-946gb" podUID="1e83cba4-a631-4284-be4b-0b2beed9fd46" May 29 14:46:29.199959 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:29.199917 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99dadb15-c9da-4773-b522-fc61ba649a8f-metrics-certs\") pod \"network-metrics-daemon-pkxjk\" (UID: \"99dadb15-c9da-4773-b522-fc61ba649a8f\") " pod="openshift-multus/network-metrics-daemon-pkxjk" May 29 14:46:29.200443 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:29.200105 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 14:46:29.200443 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:29.200215 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99dadb15-c9da-4773-b522-fc61ba649a8f-metrics-certs podName:99dadb15-c9da-4773-b522-fc61ba649a8f nodeName:}" failed. No retries permitted until 2026-05-29 14:46:37.20014958 +0000 UTC m=+18.057261525 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/99dadb15-c9da-4773-b522-fc61ba649a8f-metrics-certs") pod "network-metrics-daemon-pkxjk" (UID: "99dadb15-c9da-4773-b522-fc61ba649a8f") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 14:46:29.300494 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:29.300450 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vrggq\" (UniqueName: \"kubernetes.io/projected/1e83cba4-a631-4284-be4b-0b2beed9fd46-kube-api-access-vrggq\") pod \"network-check-target-946gb\" (UID: \"1e83cba4-a631-4284-be4b-0b2beed9fd46\") " pod="openshift-network-diagnostics/network-check-target-946gb" May 29 14:46:29.300661 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:29.300623 2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 14:46:29.300661 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:29.300639 2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 14:46:29.300661 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:29.300648 2564 projected.go:194] Error preparing data for projected volume kube-api-access-vrggq for pod openshift-network-diagnostics/network-check-target-946gb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 14:46:29.300841 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:29.300694 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e83cba4-a631-4284-be4b-0b2beed9fd46-kube-api-access-vrggq podName:1e83cba4-a631-4284-be4b-0b2beed9fd46 nodeName:}" failed. No retries permitted until 2026-05-29 14:46:37.300681569 +0000 UTC m=+18.157793494 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vrggq" (UniqueName: "kubernetes.io/projected/1e83cba4-a631-4284-be4b-0b2beed9fd46-kube-api-access-vrggq") pod "network-check-target-946gb" (UID: "1e83cba4-a631-4284-be4b-0b2beed9fd46") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 14:46:29.663502 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:29.663469 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkxjk" May 29 14:46:29.663670 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:29.663602 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkxjk" podUID="99dadb15-c9da-4773-b522-fc61ba649a8f" May 29 14:46:30.651072 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:30.651029 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-946gb" May 29 14:46:30.651567 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:30.651193 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-946gb" podUID="1e83cba4-a631-4284-be4b-0b2beed9fd46" May 29 14:46:31.653999 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:31.653968 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkxjk" May 29 14:46:31.654489 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:31.654088 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkxjk" podUID="99dadb15-c9da-4773-b522-fc61ba649a8f" May 29 14:46:32.650437 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:32.650393 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-946gb" May 29 14:46:32.650606 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:32.650534 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-946gb" podUID="1e83cba4-a631-4284-be4b-0b2beed9fd46" May 29 14:46:33.651321 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:33.651284 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkxjk" May 29 14:46:33.651743 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:33.651409 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkxjk" podUID="99dadb15-c9da-4773-b522-fc61ba649a8f" May 29 14:46:34.650816 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:34.650775 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-946gb" May 29 14:46:34.651082 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:34.650905 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-946gb" podUID="1e83cba4-a631-4284-be4b-0b2beed9fd46" May 29 14:46:35.650864 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:35.650828 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkxjk" May 29 14:46:35.651354 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:35.650968 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkxjk" podUID="99dadb15-c9da-4773-b522-fc61ba649a8f" May 29 14:46:36.415461 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:36.415411 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-189.ec2.internal" podStartSLOduration=15.415393787 podStartE2EDuration="15.415393787s" podCreationTimestamp="2026-05-29 14:46:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 14:46:23.769412289 +0000 UTC m=+4.626524237" watchObservedRunningTime="2026-05-29 14:46:36.415393787 +0000 UTC m=+17.272505733" May 29 14:46:36.416010 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:36.415984 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-chfzg"] May 29 14:46:36.483934 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:36.483901 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-chfzg" May 29 14:46:36.487160 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:36.487137 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 29 14:46:36.487732 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:36.487707 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 29 14:46:36.487818 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:36.487758 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5tll2\"" May 29 14:46:36.554535 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:36.554499 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rghd5\" (UniqueName: \"kubernetes.io/projected/65f60412-1c59-4346-bcff-7c9dbf320f2a-kube-api-access-rghd5\") pod \"node-resolver-chfzg\" (UID: \"65f60412-1c59-4346-bcff-7c9dbf320f2a\") " pod="openshift-dns/node-resolver-chfzg" May 29 14:46:36.554704 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:36.554591 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/65f60412-1c59-4346-bcff-7c9dbf320f2a-hosts-file\") pod \"node-resolver-chfzg\" (UID: \"65f60412-1c59-4346-bcff-7c9dbf320f2a\") " pod="openshift-dns/node-resolver-chfzg" May 29 14:46:36.554704 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:36.554618 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65f60412-1c59-4346-bcff-7c9dbf320f2a-tmp-dir\") pod \"node-resolver-chfzg\" (UID: \"65f60412-1c59-4346-bcff-7c9dbf320f2a\") " pod="openshift-dns/node-resolver-chfzg" May 29 14:46:36.650959 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:36.650921 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-946gb" May 29 14:46:36.651440 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:36.651059 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-946gb" podUID="1e83cba4-a631-4284-be4b-0b2beed9fd46" May 29 14:46:36.654918 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:36.654894 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/65f60412-1c59-4346-bcff-7c9dbf320f2a-hosts-file\") pod \"node-resolver-chfzg\" (UID: \"65f60412-1c59-4346-bcff-7c9dbf320f2a\") " pod="openshift-dns/node-resolver-chfzg" May 29 14:46:36.655042 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:36.654923 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65f60412-1c59-4346-bcff-7c9dbf320f2a-tmp-dir\") pod \"node-resolver-chfzg\" (UID: \"65f60412-1c59-4346-bcff-7c9dbf320f2a\") " pod="openshift-dns/node-resolver-chfzg" May 29 14:46:36.655042 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:36.654953 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rghd5\" (UniqueName: \"kubernetes.io/projected/65f60412-1c59-4346-bcff-7c9dbf320f2a-kube-api-access-rghd5\") pod \"node-resolver-chfzg\" (UID: \"65f60412-1c59-4346-bcff-7c9dbf320f2a\") " pod="openshift-dns/node-resolver-chfzg" May 29 14:46:36.655042 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:36.655020 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/65f60412-1c59-4346-bcff-7c9dbf320f2a-hosts-file\") pod \"node-resolver-chfzg\" (UID: \"65f60412-1c59-4346-bcff-7c9dbf320f2a\") " pod="openshift-dns/node-resolver-chfzg" May 29 14:46:36.655345 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:36.655323 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65f60412-1c59-4346-bcff-7c9dbf320f2a-tmp-dir\") pod \"node-resolver-chfzg\" (UID: \"65f60412-1c59-4346-bcff-7c9dbf320f2a\") " pod="openshift-dns/node-resolver-chfzg" May 29 14:46:36.665059 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:36.665037 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rghd5\" (UniqueName: \"kubernetes.io/projected/65f60412-1c59-4346-bcff-7c9dbf320f2a-kube-api-access-rghd5\") pod \"node-resolver-chfzg\" (UID: \"65f60412-1c59-4346-bcff-7c9dbf320f2a\") " pod="openshift-dns/node-resolver-chfzg" May 29 14:46:36.793192 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:36.793149 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-chfzg" May 29 14:46:37.258415 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:37.258367 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99dadb15-c9da-4773-b522-fc61ba649a8f-metrics-certs\") pod \"network-metrics-daemon-pkxjk\" (UID: \"99dadb15-c9da-4773-b522-fc61ba649a8f\") " pod="openshift-multus/network-metrics-daemon-pkxjk" May 29 14:46:37.258595 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:37.258533 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 14:46:37.258672 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:37.258613 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99dadb15-c9da-4773-b522-fc61ba649a8f-metrics-certs podName:99dadb15-c9da-4773-b522-fc61ba649a8f nodeName:}" failed. No retries permitted until 2026-05-29 14:46:53.258591493 +0000 UTC m=+34.115703431 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/99dadb15-c9da-4773-b522-fc61ba649a8f-metrics-certs") pod "network-metrics-daemon-pkxjk" (UID: "99dadb15-c9da-4773-b522-fc61ba649a8f") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 14:46:37.359730 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:37.359695 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vrggq\" (UniqueName: \"kubernetes.io/projected/1e83cba4-a631-4284-be4b-0b2beed9fd46-kube-api-access-vrggq\") pod \"network-check-target-946gb\" (UID: \"1e83cba4-a631-4284-be4b-0b2beed9fd46\") " pod="openshift-network-diagnostics/network-check-target-946gb" May 29 14:46:37.359882 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:37.359840 2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 14:46:37.359882 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:37.359862 2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 14:46:37.359882 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:37.359875 2564 projected.go:194] Error preparing data for projected volume kube-api-access-vrggq for pod openshift-network-diagnostics/network-check-target-946gb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 14:46:37.359980 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:37.359931 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e83cba4-a631-4284-be4b-0b2beed9fd46-kube-api-access-vrggq podName:1e83cba4-a631-4284-be4b-0b2beed9fd46 nodeName:}" failed. No retries permitted until 2026-05-29 14:46:53.359916048 +0000 UTC m=+34.217027973 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vrggq" (UniqueName: "kubernetes.io/projected/1e83cba4-a631-4284-be4b-0b2beed9fd46-kube-api-access-vrggq") pod "network-check-target-946gb" (UID: "1e83cba4-a631-4284-be4b-0b2beed9fd46") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 14:46:37.650965 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:37.650883 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkxjk" May 29 14:46:37.651126 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:37.651046 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkxjk" podUID="99dadb15-c9da-4773-b522-fc61ba649a8f" May 29 14:46:38.650527 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:38.650482 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-946gb" May 29 14:46:38.650680 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:38.650600 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-946gb" podUID="1e83cba4-a631-4284-be4b-0b2beed9fd46" May 29 14:46:39.651130 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:39.651091 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkxjk" May 29 14:46:39.651540 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:39.651202 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkxjk" podUID="99dadb15-c9da-4773-b522-fc61ba649a8f" May 29 14:46:40.164718 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:46:40.164688 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65f60412_1c59_4346_bcff_7c9dbf320f2a.slice/crio-99d790832ceebadb3cc59a91c91f27a38fb50f7eb7305307ff91719b956ecca2 WatchSource:0}: Error finding container 99d790832ceebadb3cc59a91c91f27a38fb50f7eb7305307ff91719b956ecca2: Status 404 returned error can't find the container with id 99d790832ceebadb3cc59a91c91f27a38fb50f7eb7305307ff91719b956ecca2 May 29 14:46:40.650913 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:40.650759 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-946gb" May 29 14:46:40.651078 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:40.651015 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-946gb" podUID="1e83cba4-a631-4284-be4b-0b2beed9fd46" May 29 14:46:40.779118 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:40.778918 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdj5k" event={"ID":"b0f3d5ad-15b0-4747-bebd-caff2c900fcf","Type":"ContainerStarted","Data":"011a3b47ccc2e12c002ee064dd89902326c39db6c405279805c8efecbf8061e6"} May 29 14:46:40.780909 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:40.780887 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gvn49_1300fffd-bfc2-4a5c-95d8-01941a39ca6c/ovn-acl-logging/0.log" May 29 14:46:40.781218 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:40.781192 2564 generic.go:358] "Generic (PLEG): container finished" podID="1300fffd-bfc2-4a5c-95d8-01941a39ca6c" containerID="fb0cd3464ec7a7915b1480e92da4b06b2d320504744b1613345eef59846e30c3" exitCode=1 May 29 14:46:40.781281 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:40.781224 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" event={"ID":"1300fffd-bfc2-4a5c-95d8-01941a39ca6c","Type":"ContainerStarted","Data":"a101d83b8c6b652b11d4a1cb97b95710912a547046ef6672b664c3f7ee6e20fc"} May 29 14:46:40.781281 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:40.781254 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" event={"ID":"1300fffd-bfc2-4a5c-95d8-01941a39ca6c","Type":"ContainerDied","Data":"fb0cd3464ec7a7915b1480e92da4b06b2d320504744b1613345eef59846e30c3"} May 29 14:46:40.781281 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:40.781272 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" event={"ID":"1300fffd-bfc2-4a5c-95d8-01941a39ca6c","Type":"ContainerStarted","Data":"938b40da90ee385bc527c7eb28fc57092d538a13b6b49e7df4a8504d4034dcc4"} May 29 14:46:40.782406 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:40.782388 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f48d9" event={"ID":"7452a23e-4293-4ee4-9c04-5a0ff4fe08b3","Type":"ContainerStarted","Data":"5a1c8abb115416d21db97146cd27a750caa108e2dddd95dbdff703fe9826f19a"} May 29 14:46:40.783844 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:40.783823 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5xdw9" event={"ID":"83518164-cbb0-445b-949b-0a9fc521e3e3","Type":"ContainerStarted","Data":"7df0057ee770fd2097aaffc2b8629b60facf13d93774998e7f8c9dd24181973f"} May 29 14:46:40.785094 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:40.785069 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xd9jk" event={"ID":"8f2463eb-0f37-4ad6-a7c2-0bc8047ec2ef","Type":"ContainerStarted","Data":"955cebae641d1dbe15235e7cd92b0c6cedbc265e46fcbace4287b8e709b2a972"} May 29 14:46:40.786847 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:40.786742 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xg8cs" event={"ID":"5945bd9a-fb25-48aa-bbcb-53466990a078","Type":"ContainerStarted","Data":"7b1570a101125fdd1d8fd1c640b5440cd309d240aad2108e6232a09acf32e18e"} May 29 14:46:40.788337 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:40.788311 2564 generic.go:358] "Generic (PLEG): container finished" podID="b3f8a5d9-4cf1-4106-acb5-7191a54c7a16" containerID="dcaca0a006f65f13e65a92280671545f12a39a243c222efec088a2e397ef38e0" exitCode=0 May 29 14:46:40.788423 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:40.788390 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-skjzp" event={"ID":"b3f8a5d9-4cf1-4106-acb5-7191a54c7a16","Type":"ContainerDied","Data":"dcaca0a006f65f13e65a92280671545f12a39a243c222efec088a2e397ef38e0"} May 29 14:46:40.789605 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:40.789514 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-chfzg" event={"ID":"65f60412-1c59-4346-bcff-7c9dbf320f2a","Type":"ContainerStarted","Data":"fe152cb2f10cb14faf519638ba708e1dfc1f7dfcd780b8ea2bff02bb04bcfa4e"} May 29 14:46:40.789605 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:40.789544 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-chfzg" event={"ID":"65f60412-1c59-4346-bcff-7c9dbf320f2a","Type":"ContainerStarted","Data":"99d790832ceebadb3cc59a91c91f27a38fb50f7eb7305307ff91719b956ecca2"} May 29 14:46:40.799309 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:40.799272 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-f48d9" podStartSLOduration=4.224804366 podStartE2EDuration="21.7992577s" podCreationTimestamp="2026-05-29 14:46:19 +0000 UTC" firstStartedPulling="2026-05-29 14:46:22.192488765 +0000 UTC m=+3.049600690" lastFinishedPulling="2026-05-29 14:46:39.766942097 +0000 UTC m=+20.624054024" observedRunningTime="2026-05-29 14:46:40.79866699 +0000 UTC m=+21.655778939" watchObservedRunningTime="2026-05-29 14:46:40.7992577 +0000 UTC m=+21.656369644" May 29 14:46:40.841102 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:40.841046 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-xg8cs" podStartSLOduration=3.8605773880000003 podStartE2EDuration="21.841032078s" podCreationTimestamp="2026-05-29 14:46:19 +0000 UTC" firstStartedPulling="2026-05-29 14:46:22.19640322 +0000 UTC m=+3.053515161" lastFinishedPulling="2026-05-29 14:46:40.176857924 +0000 UTC m=+21.033969851" observedRunningTime="2026-05-29 14:46:40.840936868 +0000 UTC m=+21.698048815" watchObservedRunningTime="2026-05-29 14:46:40.841032078 +0000 UTC m=+21.698144025" May 29 14:46:40.860758 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:40.860715 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xd9jk" podStartSLOduration=3.896022167 podStartE2EDuration="21.860695458s" podCreationTimestamp="2026-05-29 14:46:19 +0000 UTC" firstStartedPulling="2026-05-29 14:46:22.198122204 +0000 UTC m=+3.055234135" lastFinishedPulling="2026-05-29 14:46:40.162795496 +0000 UTC m=+21.019907426" observedRunningTime="2026-05-29 14:46:40.860196539 +0000 UTC m=+21.717308480" watchObservedRunningTime="2026-05-29 14:46:40.860695458 +0000 UTC m=+21.717807405" May 29 14:46:40.887118 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:40.887067 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5xdw9" podStartSLOduration=3.9316156270000002 podStartE2EDuration="21.887052958s" podCreationTimestamp="2026-05-29 14:46:19 +0000 UTC" firstStartedPulling="2026-05-29 14:46:22.202772652 +0000 UTC m=+3.059884577" lastFinishedPulling="2026-05-29 14:46:40.158209983 +0000 UTC m=+21.015321908" observedRunningTime="2026-05-29 14:46:40.886619715 +0000 UTC m=+21.743731663" watchObservedRunningTime="2026-05-29 14:46:40.887052958 +0000 UTC m=+21.744164904" May 29 14:46:40.930912 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:40.930873 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-chfzg" podStartSLOduration=4.930857919 podStartE2EDuration="4.930857919s" podCreationTimestamp="2026-05-29 14:46:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 14:46:40.930484391 +0000 UTC m=+21.787596339" watchObservedRunningTime="2026-05-29 14:46:40.930857919 +0000 UTC m=+21.787969866" May 29 14:46:41.257930 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:41.257884 2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-f48d9" May 29 14:46:41.258592 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:41.258569 2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-f48d9" May 29 14:46:41.650666 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:41.650637 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkxjk" May 29 14:46:41.650821 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:41.650795 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkxjk" podUID="99dadb15-c9da-4773-b522-fc61ba649a8f" May 29 14:46:41.687647 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:41.687611 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 29 14:46:41.793383 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:41.793352 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nbfxf" event={"ID":"55978d1f-3cbf-47ca-bf60-0457136ebe0e","Type":"ContainerStarted","Data":"ec512c3cc85229bbcbb54814d3b16502d9b479f38631bb1ab299fa9bf32dff53"} May 29 14:46:41.795305 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:41.795276 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdj5k" event={"ID":"b0f3d5ad-15b0-4747-bebd-caff2c900fcf","Type":"ContainerStarted","Data":"5caae9652af4ff96076fc48ac04d7f7b2fc98da2be18b80438ba6bc28b3fb16b"} May 29 14:46:41.798381 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:41.798220 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gvn49_1300fffd-bfc2-4a5c-95d8-01941a39ca6c/ovn-acl-logging/0.log" May 29 14:46:41.798859 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:41.798829 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" event={"ID":"1300fffd-bfc2-4a5c-95d8-01941a39ca6c","Type":"ContainerStarted","Data":"51dd51b7df353c322133cfad1bb17e5f83bffe709862f7b3f292a7687ff5822b"} May 29 14:46:41.798949 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:41.798865 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" event={"ID":"1300fffd-bfc2-4a5c-95d8-01941a39ca6c","Type":"ContainerStarted","Data":"7aa3d4f886308c663192c67498debf7a7ad27d56fa6cd87385211568a22fa8f5"} May 29 14:46:41.798949 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:41.798878 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" event={"ID":"1300fffd-bfc2-4a5c-95d8-01941a39ca6c","Type":"ContainerStarted","Data":"e891d94926d2da5be21b8b32c89dba1d6988de7684ef2e138aade3e98c396dd8"} May 29 14:46:41.799417 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:41.799386 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-f48d9" May 29 14:46:41.799799 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:41.799778 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-f48d9" May 29 14:46:41.810319 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:41.810234 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nbfxf" podStartSLOduration=4.8446007479999995 podStartE2EDuration="22.810218094s" podCreationTimestamp="2026-05-29 14:46:19 +0000 UTC" firstStartedPulling="2026-05-29 14:46:22.194726301 +0000 UTC m=+3.051838244" lastFinishedPulling="2026-05-29 14:46:40.160343664 +0000 UTC m=+21.017455590" observedRunningTime="2026-05-29 14:46:41.80969158 +0000 UTC m=+22.666803528" watchObservedRunningTime="2026-05-29 14:46:41.810218094 +0000 UTC m=+22.667330042" May 29 14:46:42.592072 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:42.591969 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-29T14:46:41.687642104Z","UUID":"c77ecc84-1489-499c-8b9c-78456cb39ee2","Handler":null,"Name":"","Endpoint":""} May 29 14:46:42.593925 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:42.593897 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 29 14:46:42.594063 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:42.593935 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 29 14:46:42.650953 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:42.650915 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-946gb" May 29 14:46:42.651126 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:42.651042 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-946gb" podUID="1e83cba4-a631-4284-be4b-0b2beed9fd46" May 29 14:46:43.651290 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:43.651252 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkxjk" May 29 14:46:43.651788 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:43.651361 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkxjk" podUID="99dadb15-c9da-4773-b522-fc61ba649a8f" May 29 14:46:43.804583 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:43.804548 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdj5k" event={"ID":"b0f3d5ad-15b0-4747-bebd-caff2c900fcf","Type":"ContainerStarted","Data":"0e1a54775dd0eabd3221b4d19e6acd118341c92807b58aa89c752059f3a2e2cf"} May 29 14:46:43.807491 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:43.807469 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gvn49_1300fffd-bfc2-4a5c-95d8-01941a39ca6c/ovn-acl-logging/0.log" May 29 14:46:43.807884 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:43.807844 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" event={"ID":"1300fffd-bfc2-4a5c-95d8-01941a39ca6c","Type":"ContainerStarted","Data":"08c7a4bfe8d1c6ff448e31588c209aea195931e06ea41897fe2e504fa201edb8"} May 29 14:46:43.825276 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:43.825226 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fdj5k" podStartSLOduration=4.150042677 podStartE2EDuration="24.825212092s" podCreationTimestamp="2026-05-29 14:46:19 +0000 UTC" firstStartedPulling="2026-05-29 14:46:22.202761256 +0000 UTC m=+3.059873182" lastFinishedPulling="2026-05-29 14:46:42.877930668 +0000 UTC m=+23.735042597" observedRunningTime="2026-05-29 14:46:43.824998775 +0000 UTC m=+24.682110725" watchObservedRunningTime="2026-05-29 14:46:43.825212092 +0000 UTC m=+24.682324035" May 29 14:46:44.650596 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:44.650559 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-946gb" May 29 14:46:44.650784 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:44.650689 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-946gb" podUID="1e83cba4-a631-4284-be4b-0b2beed9fd46" May 29 14:46:44.914520 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:44.914441 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-chfzg_65f60412-1c59-4346-bcff-7c9dbf320f2a/dns-node-resolver/0.log" May 29 14:46:45.651031 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:45.650851 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkxjk" May 29 14:46:45.651222 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:45.651113 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkxjk" podUID="99dadb15-c9da-4773-b522-fc61ba649a8f" May 29 14:46:45.813272 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:45.813234 2564 generic.go:358] "Generic (PLEG): container finished" podID="b3f8a5d9-4cf1-4106-acb5-7191a54c7a16" containerID="c4718bc9b00a71e200181812880c68556fc8b19a715c6761d61859b585a8a565" exitCode=0 May 29 14:46:45.813426 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:45.813325 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-skjzp" event={"ID":"b3f8a5d9-4cf1-4106-acb5-7191a54c7a16","Type":"ContainerDied","Data":"c4718bc9b00a71e200181812880c68556fc8b19a715c6761d61859b585a8a565"} May 29 14:46:45.816441 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:45.816423 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gvn49_1300fffd-bfc2-4a5c-95d8-01941a39ca6c/ovn-acl-logging/0.log" May 29 14:46:45.816719 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:45.816698 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" event={"ID":"1300fffd-bfc2-4a5c-95d8-01941a39ca6c","Type":"ContainerStarted","Data":"bd136b402b97110bfc611a49d37d8f8fbcb0de6ba9534db2e8e8d91bb6835f4a"} May 29 14:46:45.817081 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:45.817064 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:45.817128 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:45.817096 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:45.817279 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:45.817263 2564 scope.go:117] "RemoveContainer" containerID="fb0cd3464ec7a7915b1480e92da4b06b2d320504744b1613345eef59846e30c3" May 29 14:46:45.833763 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:45.833738 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:45.833944 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:45.833931 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:45.896316 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:45.896293 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5xdw9_83518164-cbb0-445b-949b-0a9fc521e3e3/node-ca/0.log" May 29 14:46:46.650489 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:46.650408 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-946gb" May 29 14:46:46.651068 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:46.650536 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-946gb" podUID="1e83cba4-a631-4284-be4b-0b2beed9fd46" May 29 14:46:46.820391 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:46.820357 2564 generic.go:358] "Generic (PLEG): container finished" podID="b3f8a5d9-4cf1-4106-acb5-7191a54c7a16" containerID="e6734d0fbf015fe0229c175b92650a1e6041e28e6903fd3bef15b701bfe86284" exitCode=0 May 29 14:46:46.820541 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:46.820442 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-skjzp" event={"ID":"b3f8a5d9-4cf1-4106-acb5-7191a54c7a16","Type":"ContainerDied","Data":"e6734d0fbf015fe0229c175b92650a1e6041e28e6903fd3bef15b701bfe86284"} May 29 14:46:46.823756 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:46.823739 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gvn49_1300fffd-bfc2-4a5c-95d8-01941a39ca6c/ovn-acl-logging/0.log" May 29 14:46:46.824106 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:46.824084 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" event={"ID":"1300fffd-bfc2-4a5c-95d8-01941a39ca6c","Type":"ContainerStarted","Data":"45eb2eba50e3e44294742f38368a6383a8ec337fce991a7d9b24c41efa3ae71f"} May 29 14:46:46.824212 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:46.824199 2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 29 14:46:46.900329 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:46.900274 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" podStartSLOduration=9.892613401 podStartE2EDuration="27.900260615s" podCreationTimestamp="2026-05-29 14:46:19 +0000 UTC" firstStartedPulling="2026-05-29 14:46:22.200756145 +0000 UTC m=+3.057868077" lastFinishedPulling="2026-05-29 14:46:40.208403364 +0000 UTC m=+21.065515291" observedRunningTime="2026-05-29 14:46:46.899313616 +0000 UTC m=+27.756425562" watchObservedRunningTime="2026-05-29 14:46:46.900260615 +0000 UTC m=+27.757372561" May 29 14:46:47.260419 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:47.260385 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pkxjk"] May 29 14:46:47.260577 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:47.260518 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkxjk" May 29 14:46:47.260633 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:47.260610 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkxjk" podUID="99dadb15-c9da-4773-b522-fc61ba649a8f" May 29 14:46:47.265782 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:47.265755 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-946gb"] May 29 14:46:47.265935 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:47.265845 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-946gb" May 29 14:46:47.265986 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:47.265941 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-946gb" podUID="1e83cba4-a631-4284-be4b-0b2beed9fd46" May 29 14:46:47.827312 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:47.827280 2564 generic.go:358] "Generic (PLEG): container finished" podID="b3f8a5d9-4cf1-4106-acb5-7191a54c7a16" containerID="20eed89224c28c671b650fcfd9d62e3bf5ad868802939f2e12971bcfd433f2c1" exitCode=0 May 29 14:46:47.827681 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:47.827363 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-skjzp" event={"ID":"b3f8a5d9-4cf1-4106-acb5-7191a54c7a16","Type":"ContainerDied","Data":"20eed89224c28c671b650fcfd9d62e3bf5ad868802939f2e12971bcfd433f2c1"} May 29 14:46:47.827681 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:47.827424 2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 29 14:46:48.651217 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:48.651164 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-946gb" May 29 14:46:48.651384 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:48.651165 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkxjk" May 29 14:46:48.651384 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:48.651300 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-946gb" podUID="1e83cba4-a631-4284-be4b-0b2beed9fd46" May 29 14:46:48.651501 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:48.651459 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkxjk" podUID="99dadb15-c9da-4773-b522-fc61ba649a8f" May 29 14:46:50.532375 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:50.532335 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:46:50.533016 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:50.532574 2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 29 14:46:50.544496 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:50.544457 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" podUID="1300fffd-bfc2-4a5c-95d8-01941a39ca6c" containerName="ovnkube-controller" probeResult="failure" output="" May 29 14:46:50.554691 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:50.554658 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" podUID="1300fffd-bfc2-4a5c-95d8-01941a39ca6c" containerName="ovnkube-controller" probeResult="failure" output="" May 29 14:46:50.651161 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:50.651126 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-946gb" May 29 14:46:50.651364 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:50.651192 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkxjk" May 29 14:46:50.651364 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:50.651266 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-946gb" podUID="1e83cba4-a631-4284-be4b-0b2beed9fd46" May 29 14:46:50.651713 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:50.651687 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkxjk" podUID="99dadb15-c9da-4773-b522-fc61ba649a8f" May 29 14:46:52.650439 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:52.650400 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-946gb" May 29 14:46:52.651057 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:52.650514 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-946gb" podUID="1e83cba4-a631-4284-be4b-0b2beed9fd46" May 29 14:46:52.651057 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:52.650575 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkxjk" May 29 14:46:52.651057 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:52.650698 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkxjk" podUID="99dadb15-c9da-4773-b522-fc61ba649a8f" May 29 14:46:53.276336 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:53.276294 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99dadb15-c9da-4773-b522-fc61ba649a8f-metrics-certs\") pod \"network-metrics-daemon-pkxjk\" (UID: \"99dadb15-c9da-4773-b522-fc61ba649a8f\") " pod="openshift-multus/network-metrics-daemon-pkxjk" May 29 14:46:53.276510 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:53.276436 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 14:46:53.276510 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:53.276498 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99dadb15-c9da-4773-b522-fc61ba649a8f-metrics-certs podName:99dadb15-c9da-4773-b522-fc61ba649a8f nodeName:}" failed. No retries permitted until 2026-05-29 14:47:25.27648173 +0000 UTC m=+66.133593667 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/99dadb15-c9da-4773-b522-fc61ba649a8f-metrics-certs") pod "network-metrics-daemon-pkxjk" (UID: "99dadb15-c9da-4773-b522-fc61ba649a8f") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 14:46:53.376987 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:53.376954 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vrggq\" (UniqueName: \"kubernetes.io/projected/1e83cba4-a631-4284-be4b-0b2beed9fd46-kube-api-access-vrggq\") pod \"network-check-target-946gb\" (UID: \"1e83cba4-a631-4284-be4b-0b2beed9fd46\") " pod="openshift-network-diagnostics/network-check-target-946gb" May 29 14:46:53.377140 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:53.377073 2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 14:46:53.377140 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:53.377087 2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 14:46:53.377140 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:53.377098 2564 projected.go:194] Error preparing data for projected volume kube-api-access-vrggq for pod openshift-network-diagnostics/network-check-target-946gb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 14:46:53.377279 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:53.377154 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e83cba4-a631-4284-be4b-0b2beed9fd46-kube-api-access-vrggq podName:1e83cba4-a631-4284-be4b-0b2beed9fd46 nodeName:}" failed. No retries permitted until 2026-05-29 14:47:25.377141702 +0000 UTC m=+66.234253627 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vrggq" (UniqueName: "kubernetes.io/projected/1e83cba4-a631-4284-be4b-0b2beed9fd46-kube-api-access-vrggq") pod "network-check-target-946gb" (UID: "1e83cba4-a631-4284-be4b-0b2beed9fd46") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 14:46:53.841643 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:53.841388 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-skjzp" event={"ID":"b3f8a5d9-4cf1-4106-acb5-7191a54c7a16","Type":"ContainerStarted","Data":"35a654a622300e215008d56e5e7e713a3caeb01356ab4b851dad01ae2d22eea6"} May 29 14:46:54.650476 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:54.650437 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-946gb" May 29 14:46:54.650647 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:54.650437 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkxjk" May 29 14:46:54.650647 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:54.650548 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-946gb" podUID="1e83cba4-a631-4284-be4b-0b2beed9fd46" May 29 14:46:54.650647 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:54.650633 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkxjk" podUID="99dadb15-c9da-4773-b522-fc61ba649a8f" May 29 14:46:54.845902 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:54.845870 2564 generic.go:358] "Generic (PLEG): container finished" podID="b3f8a5d9-4cf1-4106-acb5-7191a54c7a16" containerID="35a654a622300e215008d56e5e7e713a3caeb01356ab4b851dad01ae2d22eea6" exitCode=0 May 29 14:46:54.846291 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:54.845937 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-skjzp" event={"ID":"b3f8a5d9-4cf1-4106-acb5-7191a54c7a16","Type":"ContainerDied","Data":"35a654a622300e215008d56e5e7e713a3caeb01356ab4b851dad01ae2d22eea6"} May 29 14:46:55.850244 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:55.850212 2564 generic.go:358] "Generic (PLEG): container finished" podID="b3f8a5d9-4cf1-4106-acb5-7191a54c7a16" containerID="488ae48078047714665f5d993c7960de381062b3b51b2efda4f24c3e71a363e7" exitCode=0 May 29 14:46:55.850623 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:55.850278 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-skjzp" event={"ID":"b3f8a5d9-4cf1-4106-acb5-7191a54c7a16","Type":"ContainerDied","Data":"488ae48078047714665f5d993c7960de381062b3b51b2efda4f24c3e71a363e7"} May 29 14:46:56.650361 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:56.650318 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-946gb" May 29 14:46:56.650553 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:56.650324 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkxjk" May 29 14:46:56.650553 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:56.650529 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkxjk" podUID="99dadb15-c9da-4773-b522-fc61ba649a8f" May 29 14:46:56.650675 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:56.650421 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-946gb" podUID="1e83cba4-a631-4284-be4b-0b2beed9fd46" May 29 14:46:56.854369 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:56.854337 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-skjzp" event={"ID":"b3f8a5d9-4cf1-4106-acb5-7191a54c7a16","Type":"ContainerStarted","Data":"58009b8a1ddc0a5e7a2e036615ed2f6cda32108feca4439d7704980848e64d9a"} May 29 14:46:56.879099 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:56.879040 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-skjzp" podStartSLOduration=6.378558946 podStartE2EDuration="37.879027782s" podCreationTimestamp="2026-05-29 14:46:19 +0000 UTC" firstStartedPulling="2026-05-29 14:46:22.195094958 +0000 UTC m=+3.052206897" lastFinishedPulling="2026-05-29 14:46:53.695563803 +0000 UTC m=+34.552675733" observedRunningTime="2026-05-29 14:46:56.878907655 +0000 UTC m=+37.736019601" watchObservedRunningTime="2026-05-29 14:46:56.879027782 +0000 UTC m=+37.736139728" May 29 14:46:58.650937 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:58.650899 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-946gb" May 29 14:46:58.651340 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:46:58.650902 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkxjk" May 29 14:46:58.651340 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:58.651003 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-946gb" podUID="1e83cba4-a631-4284-be4b-0b2beed9fd46" May 29 14:46:58.651340 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:46:58.651092 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkxjk" podUID="99dadb15-c9da-4773-b522-fc61ba649a8f" May 29 14:47:00.650273 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:00.650242 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-946gb" May 29 14:47:00.650652 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:47:00.650346 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-946gb" podUID="1e83cba4-a631-4284-be4b-0b2beed9fd46" May 29 14:47:00.650652 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:00.650428 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkxjk" May 29 14:47:00.650652 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:47:00.650514 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkxjk" podUID="99dadb15-c9da-4773-b522-fc61ba649a8f" May 29 14:47:02.650508 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:02.650472 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-946gb" May 29 14:47:02.650508 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:02.650514 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkxjk" May 29 14:47:02.650998 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:47:02.650609 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-946gb" podUID="1e83cba4-a631-4284-be4b-0b2beed9fd46" May 29 14:47:02.650998 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:47:02.650728 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkxjk" podUID="99dadb15-c9da-4773-b522-fc61ba649a8f" May 29 14:47:04.650989 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:04.650951 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-946gb" May 29 14:47:04.650989 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:04.650983 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkxjk" May 29 14:47:04.651523 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:47:04.651136 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-946gb" podUID="1e83cba4-a631-4284-be4b-0b2beed9fd46" May 29 14:47:04.651523 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:47:04.651254 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkxjk" podUID="99dadb15-c9da-4773-b522-fc61ba649a8f" May 29 14:47:06.650440 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:06.650413 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-946gb" May 29 14:47:06.650801 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:06.650413 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkxjk" May 29 14:47:06.650801 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:47:06.650527 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-946gb" podUID="1e83cba4-a631-4284-be4b-0b2beed9fd46" May 29 14:47:06.650801 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:47:06.650600 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pkxjk" podUID="99dadb15-c9da-4773-b522-fc61ba649a8f" May 29 14:47:07.949431 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:07.949403 2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-189.ec2.internal" event="NodeReady" May 29 14:47:07.949863 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:07.949516 2564 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 29 14:47:08.001842 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.001761 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-l4zs7"] May 29 14:47:08.034101 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.034064 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-m52vf"] May 29 14:47:08.034298 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.034215 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-l4zs7" May 29 14:47:08.041688 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.041664 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 29 14:47:08.041856 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.041837 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zhbb8\"" May 29 14:47:08.041979 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.041960 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 29 14:47:08.042455 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.042439 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 29 14:47:08.048139 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.048122 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-l4zs7"] May 29 14:47:08.048213 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.048144 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-m52vf"] May 29 14:47:08.048213 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.048153 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kpsnt"] May 29 14:47:08.048319 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.048303 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-m52vf" May 29 14:47:08.051603 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.051587 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qq6k7\"" May 29 14:47:08.051881 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.051870 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 29 14:47:08.053006 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.052991 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 29 14:47:08.066015 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.065992 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kpsnt"] May 29 14:47:08.066119 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.066101 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kpsnt" May 29 14:47:08.068241 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.068220 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 29 14:47:08.068366 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.068355 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 29 14:47:08.068587 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.068533 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 29 14:47:08.068693 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.068604 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-twxr9\"" May 29 14:47:08.068693 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.068623 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 29 14:47:08.184866 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.184829 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnw9z\" (UniqueName: \"kubernetes.io/projected/59d70ec0-5a9b-4b1e-b369-e1d7633bde79-kube-api-access-tnw9z\") pod \"insights-runtime-extractor-kpsnt\" (UID: \"59d70ec0-5a9b-4b1e-b369-e1d7633bde79\") " pod="openshift-insights/insights-runtime-extractor-kpsnt" May 29 14:47:08.184866 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.184868 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzxrb\" (UniqueName: \"kubernetes.io/projected/2fc9f29c-e5e7-45cd-b787-491b6f5078f0-kube-api-access-zzxrb\") pod \"ingress-canary-l4zs7\" (UID: \"2fc9f29c-e5e7-45cd-b787-491b6f5078f0\") " pod="openshift-ingress-canary/ingress-canary-l4zs7" May 29 14:47:08.185104 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.184948 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/59d70ec0-5a9b-4b1e-b369-e1d7633bde79-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kpsnt\" (UID: \"59d70ec0-5a9b-4b1e-b369-e1d7633bde79\") " pod="openshift-insights/insights-runtime-extractor-kpsnt" May 29 14:47:08.185104 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.184978 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2fc9f29c-e5e7-45cd-b787-491b6f5078f0-cert\") pod \"ingress-canary-l4zs7\" (UID: \"2fc9f29c-e5e7-45cd-b787-491b6f5078f0\") " pod="openshift-ingress-canary/ingress-canary-l4zs7" May 29 14:47:08.185104 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.185021 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/59d70ec0-5a9b-4b1e-b369-e1d7633bde79-data-volume\") pod \"insights-runtime-extractor-kpsnt\" (UID: \"59d70ec0-5a9b-4b1e-b369-e1d7633bde79\") " pod="openshift-insights/insights-runtime-extractor-kpsnt" May 29 14:47:08.185104 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.185041 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e3af19b3-9e7c-4ea9-a36f-ac4d8d54a1eb-config-volume\") pod \"dns-default-m52vf\" (UID: \"e3af19b3-9e7c-4ea9-a36f-ac4d8d54a1eb\") " pod="openshift-dns/dns-default-m52vf" May 29 14:47:08.185104 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.185063 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3af19b3-9e7c-4ea9-a36f-ac4d8d54a1eb-tmp-dir\") pod \"dns-default-m52vf\" (UID: \"e3af19b3-9e7c-4ea9-a36f-ac4d8d54a1eb\") " pod="openshift-dns/dns-default-m52vf" May 29 14:47:08.185104 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.185088 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/59d70ec0-5a9b-4b1e-b369-e1d7633bde79-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kpsnt\" (UID: \"59d70ec0-5a9b-4b1e-b369-e1d7633bde79\") " pod="openshift-insights/insights-runtime-extractor-kpsnt" May 29 14:47:08.185401 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.185122 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkkgx\" (UniqueName: \"kubernetes.io/projected/e3af19b3-9e7c-4ea9-a36f-ac4d8d54a1eb-kube-api-access-lkkgx\") pod \"dns-default-m52vf\" (UID: \"e3af19b3-9e7c-4ea9-a36f-ac4d8d54a1eb\") " pod="openshift-dns/dns-default-m52vf" May 29 14:47:08.185401 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.185204 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/59d70ec0-5a9b-4b1e-b369-e1d7633bde79-crio-socket\") pod \"insights-runtime-extractor-kpsnt\" (UID: \"59d70ec0-5a9b-4b1e-b369-e1d7633bde79\") " pod="openshift-insights/insights-runtime-extractor-kpsnt" May 29 14:47:08.185401 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.185247 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e3af19b3-9e7c-4ea9-a36f-ac4d8d54a1eb-metrics-tls\") pod \"dns-default-m52vf\" (UID: \"e3af19b3-9e7c-4ea9-a36f-ac4d8d54a1eb\") " pod="openshift-dns/dns-default-m52vf" May 29 14:47:08.286235 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.286145 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/59d70ec0-5a9b-4b1e-b369-e1d7633bde79-data-volume\") pod \"insights-runtime-extractor-kpsnt\" (UID: \"59d70ec0-5a9b-4b1e-b369-e1d7633bde79\") " pod="openshift-insights/insights-runtime-extractor-kpsnt" May 29 14:47:08.286235 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.286200 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e3af19b3-9e7c-4ea9-a36f-ac4d8d54a1eb-config-volume\") pod \"dns-default-m52vf\" (UID: \"e3af19b3-9e7c-4ea9-a36f-ac4d8d54a1eb\") " pod="openshift-dns/dns-default-m52vf" May 29 14:47:08.286438 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.286368 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3af19b3-9e7c-4ea9-a36f-ac4d8d54a1eb-tmp-dir\") pod \"dns-default-m52vf\" (UID: \"e3af19b3-9e7c-4ea9-a36f-ac4d8d54a1eb\") " pod="openshift-dns/dns-default-m52vf" May 29 14:47:08.286438 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.286386 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/59d70ec0-5a9b-4b1e-b369-e1d7633bde79-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kpsnt\" (UID: \"59d70ec0-5a9b-4b1e-b369-e1d7633bde79\") " pod="openshift-insights/insights-runtime-extractor-kpsnt" May 29 14:47:08.286438 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.286416 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lkkgx\" (UniqueName: \"kubernetes.io/projected/e3af19b3-9e7c-4ea9-a36f-ac4d8d54a1eb-kube-api-access-lkkgx\") pod \"dns-default-m52vf\" (UID: \"e3af19b3-9e7c-4ea9-a36f-ac4d8d54a1eb\") " pod="openshift-dns/dns-default-m52vf" May 29 14:47:08.286438 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.286437 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/59d70ec0-5a9b-4b1e-b369-e1d7633bde79-crio-socket\") pod \"insights-runtime-extractor-kpsnt\" (UID: \"59d70ec0-5a9b-4b1e-b369-e1d7633bde79\") " pod="openshift-insights/insights-runtime-extractor-kpsnt" May 29 14:47:08.286635 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.286465 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e3af19b3-9e7c-4ea9-a36f-ac4d8d54a1eb-metrics-tls\") pod \"dns-default-m52vf\" (UID: \"e3af19b3-9e7c-4ea9-a36f-ac4d8d54a1eb\") " pod="openshift-dns/dns-default-m52vf" May 29 14:47:08.286635 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.286484 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/59d70ec0-5a9b-4b1e-b369-e1d7633bde79-data-volume\") pod \"insights-runtime-extractor-kpsnt\" (UID: \"59d70ec0-5a9b-4b1e-b369-e1d7633bde79\") " pod="openshift-insights/insights-runtime-extractor-kpsnt" May 29 14:47:08.286635 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.286595 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tnw9z\" (UniqueName: \"kubernetes.io/projected/59d70ec0-5a9b-4b1e-b369-e1d7633bde79-kube-api-access-tnw9z\") pod \"insights-runtime-extractor-kpsnt\" (UID: \"59d70ec0-5a9b-4b1e-b369-e1d7633bde79\") " pod="openshift-insights/insights-runtime-extractor-kpsnt" May 29 14:47:08.286782 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.286710 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3af19b3-9e7c-4ea9-a36f-ac4d8d54a1eb-tmp-dir\") pod \"dns-default-m52vf\" (UID: \"e3af19b3-9e7c-4ea9-a36f-ac4d8d54a1eb\") " pod="openshift-dns/dns-default-m52vf" May 29 14:47:08.286866 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.286780 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zzxrb\" (UniqueName: \"kubernetes.io/projected/2fc9f29c-e5e7-45cd-b787-491b6f5078f0-kube-api-access-zzxrb\") pod \"ingress-canary-l4zs7\" (UID: \"2fc9f29c-e5e7-45cd-b787-491b6f5078f0\") " pod="openshift-ingress-canary/ingress-canary-l4zs7" May 29 14:47:08.286866 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.286819 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/59d70ec0-5a9b-4b1e-b369-e1d7633bde79-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kpsnt\" (UID: \"59d70ec0-5a9b-4b1e-b369-e1d7633bde79\") " pod="openshift-insights/insights-runtime-extractor-kpsnt" May 29 14:47:08.286866 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.286845 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2fc9f29c-e5e7-45cd-b787-491b6f5078f0-cert\") pod \"ingress-canary-l4zs7\" (UID: \"2fc9f29c-e5e7-45cd-b787-491b6f5078f0\") " pod="openshift-ingress-canary/ingress-canary-l4zs7" May 29 14:47:08.286866 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.286849 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e3af19b3-9e7c-4ea9-a36f-ac4d8d54a1eb-config-volume\") pod \"dns-default-m52vf\" (UID: \"e3af19b3-9e7c-4ea9-a36f-ac4d8d54a1eb\") " pod="openshift-dns/dns-default-m52vf" May 29 14:47:08.287036 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.286880 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/59d70ec0-5a9b-4b1e-b369-e1d7633bde79-crio-socket\") pod \"insights-runtime-extractor-kpsnt\" (UID: \"59d70ec0-5a9b-4b1e-b369-e1d7633bde79\") " pod="openshift-insights/insights-runtime-extractor-kpsnt" May 29 14:47:08.287036 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.286942 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/59d70ec0-5a9b-4b1e-b369-e1d7633bde79-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kpsnt\" (UID: \"59d70ec0-5a9b-4b1e-b369-e1d7633bde79\") " pod="openshift-insights/insights-runtime-extractor-kpsnt" May 29 14:47:08.290614 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.290587 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e3af19b3-9e7c-4ea9-a36f-ac4d8d54a1eb-metrics-tls\") pod \"dns-default-m52vf\" (UID: \"e3af19b3-9e7c-4ea9-a36f-ac4d8d54a1eb\") " pod="openshift-dns/dns-default-m52vf" May 29 14:47:08.290736 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.290590 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/59d70ec0-5a9b-4b1e-b369-e1d7633bde79-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kpsnt\" (UID: \"59d70ec0-5a9b-4b1e-b369-e1d7633bde79\") " pod="openshift-insights/insights-runtime-extractor-kpsnt" May 29 14:47:08.290736 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.290621 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2fc9f29c-e5e7-45cd-b787-491b6f5078f0-cert\") pod \"ingress-canary-l4zs7\" (UID: \"2fc9f29c-e5e7-45cd-b787-491b6f5078f0\") " pod="openshift-ingress-canary/ingress-canary-l4zs7" May 29 14:47:08.296897 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.296862 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnw9z\" (UniqueName: \"kubernetes.io/projected/59d70ec0-5a9b-4b1e-b369-e1d7633bde79-kube-api-access-tnw9z\") pod \"insights-runtime-extractor-kpsnt\" (UID: \"59d70ec0-5a9b-4b1e-b369-e1d7633bde79\") " pod="openshift-insights/insights-runtime-extractor-kpsnt" May 29 14:47:08.297015 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.296917 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkkgx\" (UniqueName: \"kubernetes.io/projected/e3af19b3-9e7c-4ea9-a36f-ac4d8d54a1eb-kube-api-access-lkkgx\") pod \"dns-default-m52vf\" (UID: \"e3af19b3-9e7c-4ea9-a36f-ac4d8d54a1eb\") " pod="openshift-dns/dns-default-m52vf" May 29 14:47:08.297411 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.297393 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzxrb\" (UniqueName: \"kubernetes.io/projected/2fc9f29c-e5e7-45cd-b787-491b6f5078f0-kube-api-access-zzxrb\") pod \"ingress-canary-l4zs7\" (UID: \"2fc9f29c-e5e7-45cd-b787-491b6f5078f0\") " pod="openshift-ingress-canary/ingress-canary-l4zs7" May 29 14:47:08.343359 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.343320 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-l4zs7" May 29 14:47:08.356102 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.356070 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-m52vf" May 29 14:47:08.373865 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.373835 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kpsnt" May 29 14:47:08.510454 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.510417 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-l4zs7"] May 29 14:47:08.515961 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:47:08.515931 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fc9f29c_e5e7_45cd_b787_491b6f5078f0.slice/crio-945056631e09e8fb470a52ed2990bbd5999a628ecd70e7d6f607ea16ea919456 WatchSource:0}: Error finding container 945056631e09e8fb470a52ed2990bbd5999a628ecd70e7d6f607ea16ea919456: Status 404 returned error can't find the container with id 945056631e09e8fb470a52ed2990bbd5999a628ecd70e7d6f607ea16ea919456 May 29 14:47:08.524730 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.524706 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-m52vf"] May 29 14:47:08.527853 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:47:08.527819 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3af19b3_9e7c_4ea9_a36f_ac4d8d54a1eb.slice/crio-7edf6c4ed2b98d409d78d99d4cbd5cd7444046bdb230575d72537d69c22ccf24 WatchSource:0}: Error finding container 7edf6c4ed2b98d409d78d99d4cbd5cd7444046bdb230575d72537d69c22ccf24: Status 404 returned error can't find the container with id 7edf6c4ed2b98d409d78d99d4cbd5cd7444046bdb230575d72537d69c22ccf24 May 29 14:47:08.540323 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.540249 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kpsnt"] May 29 14:47:08.564263 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:47:08.546014 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59d70ec0_5a9b_4b1e_b369_e1d7633bde79.slice/crio-4500536ff39b988f0b28611bb26e19dbeb99fcc42f85c6af37402d8d2da893d5 WatchSource:0}: Error finding container 4500536ff39b988f0b28611bb26e19dbeb99fcc42f85c6af37402d8d2da893d5: Status 404 returned error can't find the container with id 4500536ff39b988f0b28611bb26e19dbeb99fcc42f85c6af37402d8d2da893d5 May 29 14:47:08.650570 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.650539 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-946gb" May 29 14:47:08.650713 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.650698 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkxjk" May 29 14:47:08.653156 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.653133 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 29 14:47:08.653309 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.653283 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 29 14:47:08.653309 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.653291 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rmpcn\"" May 29 14:47:08.653423 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.653324 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 29 14:47:08.653731 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.653718 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hdq67\"" May 29 14:47:08.877163 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.877082 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kpsnt" event={"ID":"59d70ec0-5a9b-4b1e-b369-e1d7633bde79","Type":"ContainerStarted","Data":"37bd9b4ad29de902d4b97492fbc0020d47bfc78b2ea2c09001b2fac73236a0c9"} May 29 14:47:08.877163 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.877121 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kpsnt" event={"ID":"59d70ec0-5a9b-4b1e-b369-e1d7633bde79","Type":"ContainerStarted","Data":"4500536ff39b988f0b28611bb26e19dbeb99fcc42f85c6af37402d8d2da893d5"} May 29 14:47:08.878102 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.878081 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-l4zs7" event={"ID":"2fc9f29c-e5e7-45cd-b787-491b6f5078f0","Type":"ContainerStarted","Data":"945056631e09e8fb470a52ed2990bbd5999a628ecd70e7d6f607ea16ea919456"} May 29 14:47:08.878930 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:08.878905 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m52vf" event={"ID":"e3af19b3-9e7c-4ea9-a36f-ac4d8d54a1eb","Type":"ContainerStarted","Data":"7edf6c4ed2b98d409d78d99d4cbd5cd7444046bdb230575d72537d69c22ccf24"} May 29 14:47:11.889748 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:11.889704 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m52vf" event={"ID":"e3af19b3-9e7c-4ea9-a36f-ac4d8d54a1eb","Type":"ContainerStarted","Data":"966cd8bcd1e41f5a698aa83914517b629938364d69163d14c66543cfb5aee180"} May 29 14:47:11.889748 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:11.889751 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m52vf" event={"ID":"e3af19b3-9e7c-4ea9-a36f-ac4d8d54a1eb","Type":"ContainerStarted","Data":"a9093584af04b259acf3f50cadf50b5262ecf043390e0f6bb5e946aae47f4a53"} May 29 14:47:11.890296 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:11.889816 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-m52vf" May 29 14:47:11.891309 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:11.891272 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kpsnt" event={"ID":"59d70ec0-5a9b-4b1e-b369-e1d7633bde79","Type":"ContainerStarted","Data":"f8b79a310723543eba694fdfcf562603a3d71455a786aaf2f8fcf4bf1b4dd831"} May 29 14:47:11.892747 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:11.892726 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-l4zs7" event={"ID":"2fc9f29c-e5e7-45cd-b787-491b6f5078f0","Type":"ContainerStarted","Data":"3791bc43bdb4115ab9efe70d6cdc8c300708ed453d8b581effd0e7950df157a0"} May 29 14:47:11.910710 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:11.910648 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-m52vf" podStartSLOduration=2.349110897 podStartE2EDuration="4.910631363s" podCreationTimestamp="2026-05-29 14:47:07 +0000 UTC" firstStartedPulling="2026-05-29 14:47:08.529679357 +0000 UTC m=+49.386791285" lastFinishedPulling="2026-05-29 14:47:11.091199822 +0000 UTC m=+51.948311751" observedRunningTime="2026-05-29 14:47:11.910525975 +0000 UTC m=+52.767637923" watchObservedRunningTime="2026-05-29 14:47:11.910631363 +0000 UTC m=+52.767743312" May 29 14:47:11.934885 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:11.934832 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-l4zs7" podStartSLOduration=2.35701103 podStartE2EDuration="4.934815844s" podCreationTimestamp="2026-05-29 14:47:07 +0000 UTC" firstStartedPulling="2026-05-29 14:47:08.517885845 +0000 UTC m=+49.374997770" lastFinishedPulling="2026-05-29 14:47:11.095690659 +0000 UTC m=+51.952802584" observedRunningTime="2026-05-29 14:47:11.933735454 +0000 UTC m=+52.790847403" watchObservedRunningTime="2026-05-29 14:47:11.934815844 +0000 UTC m=+52.791927796" May 29 14:47:12.134459 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:12.134423 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-smbnc"] May 29 14:47:12.148100 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:12.148015 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-smbnc"] May 29 14:47:12.148293 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:12.148156 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-smbnc" May 29 14:47:12.150667 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:12.150645 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" May 29 14:47:12.150786 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:12.150698 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-btscs\"" May 29 14:47:12.315957 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:12.315910 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e0a7364e-0617-4687-86b9-26102df1792a-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-smbnc\" (UID: \"e0a7364e-0617-4687-86b9-26102df1792a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-smbnc" May 29 14:47:12.416343 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:12.416269 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e0a7364e-0617-4687-86b9-26102df1792a-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-smbnc\" (UID: \"e0a7364e-0617-4687-86b9-26102df1792a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-smbnc" May 29 14:47:12.416478 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:47:12.416409 2564 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found May 29 14:47:12.416478 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:47:12.416475 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0a7364e-0617-4687-86b9-26102df1792a-tls-certificates podName:e0a7364e-0617-4687-86b9-26102df1792a nodeName:}" failed. No retries permitted until 2026-05-29 14:47:12.916460237 +0000 UTC m=+53.773572165 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/e0a7364e-0617-4687-86b9-26102df1792a-tls-certificates") pod "prometheus-operator-admission-webhook-59b7f8756b-smbnc" (UID: "e0a7364e-0617-4687-86b9-26102df1792a") : secret "prometheus-operator-admission-webhook-tls" not found May 29 14:47:12.919951 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:12.919911 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e0a7364e-0617-4687-86b9-26102df1792a-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-smbnc\" (UID: \"e0a7364e-0617-4687-86b9-26102df1792a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-smbnc" May 29 14:47:12.922415 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:12.922388 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e0a7364e-0617-4687-86b9-26102df1792a-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-smbnc\" (UID: \"e0a7364e-0617-4687-86b9-26102df1792a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-smbnc" May 29 14:47:13.058639 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:13.058610 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-smbnc" May 29 14:47:13.184293 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:13.184209 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-smbnc"] May 29 14:47:13.188424 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:47:13.188397 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0a7364e_0617_4687_86b9_26102df1792a.slice/crio-641ce8b590056a3e77a5f3aeab67685ce5ac02558a0f0206489946f5d4a58d49 WatchSource:0}: Error finding container 641ce8b590056a3e77a5f3aeab67685ce5ac02558a0f0206489946f5d4a58d49: Status 404 returned error can't find the container with id 641ce8b590056a3e77a5f3aeab67685ce5ac02558a0f0206489946f5d4a58d49 May 29 14:47:13.902552 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:13.902510 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kpsnt" event={"ID":"59d70ec0-5a9b-4b1e-b369-e1d7633bde79","Type":"ContainerStarted","Data":"e6a41c7a109ec58b12375e4402783d24f35f38730b2d1e5e408d5a1cda71be78"} May 29 14:47:13.904122 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:13.904096 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-smbnc" event={"ID":"e0a7364e-0617-4687-86b9-26102df1792a","Type":"ContainerStarted","Data":"641ce8b590056a3e77a5f3aeab67685ce5ac02558a0f0206489946f5d4a58d49"} May 29 14:47:14.908372 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:14.908337 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-smbnc" event={"ID":"e0a7364e-0617-4687-86b9-26102df1792a","Type":"ContainerStarted","Data":"132ad8909a192cd386801c99da1c956d06e7d015815422e887f6dbcedfe9da2c"} May 29 14:47:14.908743 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:14.908498 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-smbnc" May 29 14:47:14.913836 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:14.913811 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-smbnc" May 29 14:47:14.929052 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:14.929013 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kpsnt" podStartSLOduration=2.596362787 podStartE2EDuration="6.929002407s" podCreationTimestamp="2026-05-29 14:47:08 +0000 UTC" firstStartedPulling="2026-05-29 14:47:08.689148165 +0000 UTC m=+49.546260101" lastFinishedPulling="2026-05-29 14:47:13.02178761 +0000 UTC m=+53.878899721" observedRunningTime="2026-05-29 14:47:13.922417949 +0000 UTC m=+54.779529897" watchObservedRunningTime="2026-05-29 14:47:14.929002407 +0000 UTC m=+55.786114354" May 29 14:47:14.929495 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:14.929471 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-smbnc" podStartSLOduration=1.3738543939999999 podStartE2EDuration="2.929463981s" podCreationTimestamp="2026-05-29 14:47:12 +0000 UTC" firstStartedPulling="2026-05-29 14:47:13.190345648 +0000 UTC m=+54.047457590" lastFinishedPulling="2026-05-29 14:47:14.74595525 +0000 UTC m=+55.603067177" observedRunningTime="2026-05-29 14:47:14.928891958 +0000 UTC m=+55.786003915" watchObservedRunningTime="2026-05-29 14:47:14.929463981 +0000 UTC m=+55.786575928" May 29 14:47:15.114880 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.114802 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5975fb4c78-pgn48"] May 29 14:47:15.136404 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.136376 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5975fb4c78-pgn48"] May 29 14:47:15.136572 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.136512 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5975fb4c78-pgn48" May 29 14:47:15.139053 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.139026 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 29 14:47:15.139206 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.139057 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 29 14:47:15.139206 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.139075 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 29 14:47:15.139206 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.139096 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 29 14:47:15.139206 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.139078 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 29 14:47:15.139423 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.139326 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-765qq\"" May 29 14:47:15.139526 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.139508 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 29 14:47:15.139615 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.139543 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 29 14:47:15.223964 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.223931 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-lmrm8"] May 29 14:47:15.237202 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.237156 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69eace9a-f87a-4bf3-bca2-8fd675d84167-console-serving-cert\") pod \"console-5975fb4c78-pgn48\" (UID: \"69eace9a-f87a-4bf3-bca2-8fd675d84167\") " pod="openshift-console/console-5975fb4c78-pgn48" May 29 14:47:15.237284 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.237212 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69eace9a-f87a-4bf3-bca2-8fd675d84167-console-config\") pod \"console-5975fb4c78-pgn48\" (UID: \"69eace9a-f87a-4bf3-bca2-8fd675d84167\") " pod="openshift-console/console-5975fb4c78-pgn48" May 29 14:47:15.237284 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.237246 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69eace9a-f87a-4bf3-bca2-8fd675d84167-console-oauth-config\") pod \"console-5975fb4c78-pgn48\" (UID: \"69eace9a-f87a-4bf3-bca2-8fd675d84167\") " pod="openshift-console/console-5975fb4c78-pgn48" May 29 14:47:15.237350 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.237300 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69eace9a-f87a-4bf3-bca2-8fd675d84167-oauth-serving-cert\") pod \"console-5975fb4c78-pgn48\" (UID: \"69eace9a-f87a-4bf3-bca2-8fd675d84167\") " pod="openshift-console/console-5975fb4c78-pgn48" May 29 14:47:15.237350 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.237327 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69eace9a-f87a-4bf3-bca2-8fd675d84167-service-ca\") pod \"console-5975fb4c78-pgn48\" (UID: \"69eace9a-f87a-4bf3-bca2-8fd675d84167\") " pod="openshift-console/console-5975fb4c78-pgn48" May 29 14:47:15.237350 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.237343 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h2l2\" (UniqueName: \"kubernetes.io/projected/69eace9a-f87a-4bf3-bca2-8fd675d84167-kube-api-access-2h2l2\") pod \"console-5975fb4c78-pgn48\" (UID: \"69eace9a-f87a-4bf3-bca2-8fd675d84167\") " pod="openshift-console/console-5975fb4c78-pgn48" May 29 14:47:15.240234 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.240209 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-lmrm8"] May 29 14:47:15.240374 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.240339 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-lmrm8" May 29 14:47:15.242988 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.242749 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 29 14:47:15.242988 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.242750 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" May 29 14:47:15.242988 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.242880 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 29 14:47:15.242988 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.242908 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 29 14:47:15.242988 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.242981 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" May 29 14:47:15.243281 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.243019 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-cnmxb\"" May 29 14:47:15.338473 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.338428 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69eace9a-f87a-4bf3-bca2-8fd675d84167-service-ca\") pod \"console-5975fb4c78-pgn48\" (UID: \"69eace9a-f87a-4bf3-bca2-8fd675d84167\") " pod="openshift-console/console-5975fb4c78-pgn48" May 29 14:47:15.338666 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.338480 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2h2l2\" (UniqueName: \"kubernetes.io/projected/69eace9a-f87a-4bf3-bca2-8fd675d84167-kube-api-access-2h2l2\") pod \"console-5975fb4c78-pgn48\" (UID: \"69eace9a-f87a-4bf3-bca2-8fd675d84167\") " pod="openshift-console/console-5975fb4c78-pgn48" May 29 14:47:15.338666 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.338522 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/72fb6b8e-c4c4-45c8-b5fb-8b19adcd23c3-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-lmrm8\" (UID: \"72fb6b8e-c4c4-45c8-b5fb-8b19adcd23c3\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-lmrm8" May 29 14:47:15.338666 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.338586 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72fb6b8e-c4c4-45c8-b5fb-8b19adcd23c3-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-lmrm8\" (UID: \"72fb6b8e-c4c4-45c8-b5fb-8b19adcd23c3\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-lmrm8" May 29 14:47:15.338666 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.338611 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8n8m\" (UniqueName: \"kubernetes.io/projected/72fb6b8e-c4c4-45c8-b5fb-8b19adcd23c3-kube-api-access-c8n8m\") pod \"prometheus-operator-658bcd8bdf-lmrm8\" (UID: \"72fb6b8e-c4c4-45c8-b5fb-8b19adcd23c3\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-lmrm8" May 29 14:47:15.338889 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.338662 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69eace9a-f87a-4bf3-bca2-8fd675d84167-console-serving-cert\") pod \"console-5975fb4c78-pgn48\" (UID: \"69eace9a-f87a-4bf3-bca2-8fd675d84167\") " pod="openshift-console/console-5975fb4c78-pgn48" May 29 14:47:15.338889 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.338730 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/72fb6b8e-c4c4-45c8-b5fb-8b19adcd23c3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-lmrm8\" (UID: \"72fb6b8e-c4c4-45c8-b5fb-8b19adcd23c3\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-lmrm8" May 29 14:47:15.339312 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.338787 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69eace9a-f87a-4bf3-bca2-8fd675d84167-console-config\") pod \"console-5975fb4c78-pgn48\" (UID: \"69eace9a-f87a-4bf3-bca2-8fd675d84167\") " pod="openshift-console/console-5975fb4c78-pgn48" May 29 14:47:15.339431 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.339343 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69eace9a-f87a-4bf3-bca2-8fd675d84167-console-oauth-config\") pod \"console-5975fb4c78-pgn48\" (UID: \"69eace9a-f87a-4bf3-bca2-8fd675d84167\") " pod="openshift-console/console-5975fb4c78-pgn48" May 29 14:47:15.339431 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.339380 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69eace9a-f87a-4bf3-bca2-8fd675d84167-console-config\") pod \"console-5975fb4c78-pgn48\" (UID: \"69eace9a-f87a-4bf3-bca2-8fd675d84167\") " pod="openshift-console/console-5975fb4c78-pgn48" May 29 14:47:15.339431 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.339385 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69eace9a-f87a-4bf3-bca2-8fd675d84167-oauth-serving-cert\") pod \"console-5975fb4c78-pgn48\" (UID: \"69eace9a-f87a-4bf3-bca2-8fd675d84167\") " pod="openshift-console/console-5975fb4c78-pgn48" May 29 14:47:15.339660 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.339228 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69eace9a-f87a-4bf3-bca2-8fd675d84167-service-ca\") pod \"console-5975fb4c78-pgn48\" (UID: \"69eace9a-f87a-4bf3-bca2-8fd675d84167\") " pod="openshift-console/console-5975fb4c78-pgn48" May 29 14:47:15.339870 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.339854 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69eace9a-f87a-4bf3-bca2-8fd675d84167-oauth-serving-cert\") pod \"console-5975fb4c78-pgn48\" (UID: \"69eace9a-f87a-4bf3-bca2-8fd675d84167\") " pod="openshift-console/console-5975fb4c78-pgn48" May 29 14:47:15.341544 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.341527 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69eace9a-f87a-4bf3-bca2-8fd675d84167-console-serving-cert\") pod \"console-5975fb4c78-pgn48\" (UID: \"69eace9a-f87a-4bf3-bca2-8fd675d84167\") " pod="openshift-console/console-5975fb4c78-pgn48" May 29 14:47:15.341693 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.341679 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69eace9a-f87a-4bf3-bca2-8fd675d84167-console-oauth-config\") pod \"console-5975fb4c78-pgn48\" (UID: \"69eace9a-f87a-4bf3-bca2-8fd675d84167\") " pod="openshift-console/console-5975fb4c78-pgn48" May 29 14:47:15.347950 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.347923 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h2l2\" (UniqueName: \"kubernetes.io/projected/69eace9a-f87a-4bf3-bca2-8fd675d84167-kube-api-access-2h2l2\") pod \"console-5975fb4c78-pgn48\" (UID: \"69eace9a-f87a-4bf3-bca2-8fd675d84167\") " pod="openshift-console/console-5975fb4c78-pgn48" May 29 14:47:15.439782 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.439697 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/72fb6b8e-c4c4-45c8-b5fb-8b19adcd23c3-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-lmrm8\" (UID: \"72fb6b8e-c4c4-45c8-b5fb-8b19adcd23c3\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-lmrm8" May 29 14:47:15.439782 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.439760 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72fb6b8e-c4c4-45c8-b5fb-8b19adcd23c3-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-lmrm8\" (UID: \"72fb6b8e-c4c4-45c8-b5fb-8b19adcd23c3\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-lmrm8" May 29 14:47:15.439782 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.439777 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c8n8m\" (UniqueName: \"kubernetes.io/projected/72fb6b8e-c4c4-45c8-b5fb-8b19adcd23c3-kube-api-access-c8n8m\") pod \"prometheus-operator-658bcd8bdf-lmrm8\" (UID: \"72fb6b8e-c4c4-45c8-b5fb-8b19adcd23c3\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-lmrm8" May 29 14:47:15.439982 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.439808 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/72fb6b8e-c4c4-45c8-b5fb-8b19adcd23c3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-lmrm8\" (UID: \"72fb6b8e-c4c4-45c8-b5fb-8b19adcd23c3\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-lmrm8" May 29 14:47:15.443721 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.441077 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72fb6b8e-c4c4-45c8-b5fb-8b19adcd23c3-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-lmrm8\" (UID: \"72fb6b8e-c4c4-45c8-b5fb-8b19adcd23c3\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-lmrm8" May 29 14:47:15.444502 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.444479 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/72fb6b8e-c4c4-45c8-b5fb-8b19adcd23c3-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-lmrm8\" (UID: \"72fb6b8e-c4c4-45c8-b5fb-8b19adcd23c3\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-lmrm8" May 29 14:47:15.444556 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.444492 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/72fb6b8e-c4c4-45c8-b5fb-8b19adcd23c3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-lmrm8\" (UID: \"72fb6b8e-c4c4-45c8-b5fb-8b19adcd23c3\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-lmrm8" May 29 14:47:15.445004 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.444989 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5975fb4c78-pgn48" May 29 14:47:15.452862 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.452841 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8n8m\" (UniqueName: \"kubernetes.io/projected/72fb6b8e-c4c4-45c8-b5fb-8b19adcd23c3-kube-api-access-c8n8m\") pod \"prometheus-operator-658bcd8bdf-lmrm8\" (UID: \"72fb6b8e-c4c4-45c8-b5fb-8b19adcd23c3\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-lmrm8" May 29 14:47:15.549785 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.549753 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-lmrm8" May 29 14:47:15.571063 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.570979 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5975fb4c78-pgn48"] May 29 14:47:15.574870 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:47:15.574840 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69eace9a_f87a_4bf3_bca2_8fd675d84167.slice/crio-75ccb7b4383aaf77d93f02a192a2392cbacbe206cc888a7fcc47872522f2282c WatchSource:0}: Error finding container 75ccb7b4383aaf77d93f02a192a2392cbacbe206cc888a7fcc47872522f2282c: Status 404 returned error can't find the container with id 75ccb7b4383aaf77d93f02a192a2392cbacbe206cc888a7fcc47872522f2282c May 29 14:47:15.678077 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.678046 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-lmrm8"] May 29 14:47:15.680987 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:47:15.680960 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72fb6b8e_c4c4_45c8_b5fb_8b19adcd23c3.slice/crio-f18582cf116e8db6fc5c4efc4e66388c81cfcaf5bb8ae195a33290f7eb5799f6 WatchSource:0}: Error finding container f18582cf116e8db6fc5c4efc4e66388c81cfcaf5bb8ae195a33290f7eb5799f6: Status 404 returned error can't find the container with id f18582cf116e8db6fc5c4efc4e66388c81cfcaf5bb8ae195a33290f7eb5799f6 May 29 14:47:15.911575 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.911530 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-lmrm8" event={"ID":"72fb6b8e-c4c4-45c8-b5fb-8b19adcd23c3","Type":"ContainerStarted","Data":"f18582cf116e8db6fc5c4efc4e66388c81cfcaf5bb8ae195a33290f7eb5799f6"} May 29 14:47:15.912522 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:15.912500 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5975fb4c78-pgn48" event={"ID":"69eace9a-f87a-4bf3-bca2-8fd675d84167","Type":"ContainerStarted","Data":"75ccb7b4383aaf77d93f02a192a2392cbacbe206cc888a7fcc47872522f2282c"} May 29 14:47:17.919969 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:17.919934 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-lmrm8" event={"ID":"72fb6b8e-c4c4-45c8-b5fb-8b19adcd23c3","Type":"ContainerStarted","Data":"9651112e618f4bb1ea5a9fd5a88535daf85a44101c1c04ad3232ea188eb2e688"} May 29 14:47:17.920444 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:17.919975 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-lmrm8" event={"ID":"72fb6b8e-c4c4-45c8-b5fb-8b19adcd23c3","Type":"ContainerStarted","Data":"7a554dfe53662c7c4df20e81d5a8ca9d0158ce44e903625e047e5abee56c4af4"} May 29 14:47:17.938156 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:17.938107 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-lmrm8" podStartSLOduration=1.262435072 podStartE2EDuration="2.938092168s" podCreationTimestamp="2026-05-29 14:47:15 +0000 UTC" firstStartedPulling="2026-05-29 14:47:15.68279816 +0000 UTC m=+56.539910084" lastFinishedPulling="2026-05-29 14:47:17.358455254 +0000 UTC m=+58.215567180" observedRunningTime="2026-05-29 14:47:17.936564357 +0000 UTC m=+58.793676305" watchObservedRunningTime="2026-05-29 14:47:17.938092168 +0000 UTC m=+58.795204115" May 29 14:47:19.717317 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.717285 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-sbgwg"] May 29 14:47:19.720107 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.720085 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-sbgwg" May 29 14:47:19.723658 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.723624 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" May 29 14:47:19.723774 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.723702 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" May 29 14:47:19.723774 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.723701 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-5bvps\"" May 29 14:47:19.729514 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.729495 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-k2zpv"] May 29 14:47:19.731456 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.731442 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-k2zpv" May 29 14:47:19.733845 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.733821 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" May 29 14:47:19.734114 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.734099 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" May 29 14:47:19.735000 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.734984 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-59p86\"" May 29 14:47:19.735352 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.735335 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" May 29 14:47:19.742666 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.742643 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-sbgwg"] May 29 14:47:19.762005 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.761975 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-k2zpv"] May 29 14:47:19.772214 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.772181 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1ae5ad4-c16b-4244-b536-9d440a44a785-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-k2zpv\" (UID: \"a1ae5ad4-c16b-4244-b536-9d440a44a785\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-k2zpv" May 29 14:47:19.773199 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.772214 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnjmx\" (UniqueName: \"kubernetes.io/projected/67041926-c320-411c-aaf3-fde0b869f39f-kube-api-access-jnjmx\") pod \"openshift-state-metrics-85658796db-sbgwg\" (UID: \"67041926-c320-411c-aaf3-fde0b869f39f\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-sbgwg" May 29 14:47:19.773199 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.772653 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1ae5ad4-c16b-4244-b536-9d440a44a785-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-k2zpv\" (UID: \"a1ae5ad4-c16b-4244-b536-9d440a44a785\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-k2zpv" May 29 14:47:19.773199 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.772715 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/67041926-c320-411c-aaf3-fde0b869f39f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-sbgwg\" (UID: \"67041926-c320-411c-aaf3-fde0b869f39f\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-sbgwg" May 29 14:47:19.773199 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.772819 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a1ae5ad4-c16b-4244-b536-9d440a44a785-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-k2zpv\" (UID: \"a1ae5ad4-c16b-4244-b536-9d440a44a785\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-k2zpv" May 29 14:47:19.773199 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.772980 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a1ae5ad4-c16b-4244-b536-9d440a44a785-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-k2zpv\" (UID: \"a1ae5ad4-c16b-4244-b536-9d440a44a785\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-k2zpv" May 29 14:47:19.773199 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.773052 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b5kc\" (UniqueName: \"kubernetes.io/projected/a1ae5ad4-c16b-4244-b536-9d440a44a785-kube-api-access-8b5kc\") pod \"kube-state-metrics-8469c486bb-k2zpv\" (UID: \"a1ae5ad4-c16b-4244-b536-9d440a44a785\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-k2zpv" May 29 14:47:19.773199 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.773094 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a1ae5ad4-c16b-4244-b536-9d440a44a785-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-k2zpv\" (UID: \"a1ae5ad4-c16b-4244-b536-9d440a44a785\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-k2zpv" May 29 14:47:19.773199 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.773193 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/67041926-c320-411c-aaf3-fde0b869f39f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-sbgwg\" (UID: \"67041926-c320-411c-aaf3-fde0b869f39f\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-sbgwg" May 29 14:47:19.773696 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.773224 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67041926-c320-411c-aaf3-fde0b869f39f-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-sbgwg\" (UID: \"67041926-c320-411c-aaf3-fde0b869f39f\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-sbgwg" May 29 14:47:19.775696 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.775665 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qplxf"] May 29 14:47:19.779221 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.779199 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qplxf" May 29 14:47:19.781420 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.781403 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-84w45\"" May 29 14:47:19.781495 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.781445 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 29 14:47:19.781836 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.781817 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 29 14:47:19.781927 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.781828 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 29 14:47:19.873804 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.873768 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289-node-exporter-tls\") pod \"node-exporter-qplxf\" (UID: \"b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289\") " pod="openshift-monitoring/node-exporter-qplxf" May 29 14:47:19.873804 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.873807 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1ae5ad4-c16b-4244-b536-9d440a44a785-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-k2zpv\" (UID: \"a1ae5ad4-c16b-4244-b536-9d440a44a785\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-k2zpv" May 29 14:47:19.874073 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.873827 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jnjmx\" (UniqueName: \"kubernetes.io/projected/67041926-c320-411c-aaf3-fde0b869f39f-kube-api-access-jnjmx\") pod \"openshift-state-metrics-85658796db-sbgwg\" (UID: \"67041926-c320-411c-aaf3-fde0b869f39f\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-sbgwg" May 29 14:47:19.874073 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.873846 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1ae5ad4-c16b-4244-b536-9d440a44a785-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-k2zpv\" (UID: \"a1ae5ad4-c16b-4244-b536-9d440a44a785\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-k2zpv" May 29 14:47:19.874073 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.873884 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/67041926-c320-411c-aaf3-fde0b869f39f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-sbgwg\" (UID: \"67041926-c320-411c-aaf3-fde0b869f39f\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-sbgwg" May 29 14:47:19.874073 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.873921 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a1ae5ad4-c16b-4244-b536-9d440a44a785-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-k2zpv\" (UID: \"a1ae5ad4-c16b-4244-b536-9d440a44a785\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-k2zpv" May 29 14:47:19.874073 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.873945 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289-metrics-client-ca\") pod \"node-exporter-qplxf\" (UID: \"b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289\") " pod="openshift-monitoring/node-exporter-qplxf" May 29 14:47:19.874073 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.873967 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289-node-exporter-accelerators-collector-config\") pod \"node-exporter-qplxf\" (UID: \"b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289\") " pod="openshift-monitoring/node-exporter-qplxf" May 29 14:47:19.874073 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:47:19.874004 2564 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found May 29 14:47:19.874073 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.874006 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qplxf\" (UID: \"b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289\") " pod="openshift-monitoring/node-exporter-qplxf" May 29 14:47:19.874073 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:47:19.874073 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1ae5ad4-c16b-4244-b536-9d440a44a785-kube-state-metrics-tls podName:a1ae5ad4-c16b-4244-b536-9d440a44a785 nodeName:}" failed. No retries permitted until 2026-05-29 14:47:20.374053927 +0000 UTC m=+61.231165867 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/a1ae5ad4-c16b-4244-b536-9d440a44a785-kube-state-metrics-tls") pod "kube-state-metrics-8469c486bb-k2zpv" (UID: "a1ae5ad4-c16b-4244-b536-9d440a44a785") : secret "kube-state-metrics-tls" not found May 29 14:47:19.874601 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.874112 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a1ae5ad4-c16b-4244-b536-9d440a44a785-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-k2zpv\" (UID: \"a1ae5ad4-c16b-4244-b536-9d440a44a785\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-k2zpv" May 29 14:47:19.874601 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.874147 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8b5kc\" (UniqueName: \"kubernetes.io/projected/a1ae5ad4-c16b-4244-b536-9d440a44a785-kube-api-access-8b5kc\") pod \"kube-state-metrics-8469c486bb-k2zpv\" (UID: \"a1ae5ad4-c16b-4244-b536-9d440a44a785\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-k2zpv" May 29 14:47:19.874601 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.874199 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289-node-exporter-wtmp\") pod \"node-exporter-qplxf\" (UID: \"b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289\") " pod="openshift-monitoring/node-exporter-qplxf" May 29 14:47:19.874601 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.874226 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwtwj\" (UniqueName: \"kubernetes.io/projected/b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289-kube-api-access-gwtwj\") pod \"node-exporter-qplxf\" (UID: \"b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289\") " pod="openshift-monitoring/node-exporter-qplxf" May 29 14:47:19.874601 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.874258 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a1ae5ad4-c16b-4244-b536-9d440a44a785-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-k2zpv\" (UID: \"a1ae5ad4-c16b-4244-b536-9d440a44a785\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-k2zpv" May 29 14:47:19.874601 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.874297 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289-sys\") pod \"node-exporter-qplxf\" (UID: \"b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289\") " pod="openshift-monitoring/node-exporter-qplxf" May 29 14:47:19.874601 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.874321 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a1ae5ad4-c16b-4244-b536-9d440a44a785-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-k2zpv\" (UID: \"a1ae5ad4-c16b-4244-b536-9d440a44a785\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-k2zpv" May 29 14:47:19.874601 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.874370 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/67041926-c320-411c-aaf3-fde0b869f39f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-sbgwg\" (UID: \"67041926-c320-411c-aaf3-fde0b869f39f\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-sbgwg" May 29 14:47:19.874601 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.874399 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67041926-c320-411c-aaf3-fde0b869f39f-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-sbgwg\" (UID: \"67041926-c320-411c-aaf3-fde0b869f39f\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-sbgwg" May 29 14:47:19.874601 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.874424 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289-root\") pod \"node-exporter-qplxf\" (UID: \"b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289\") " pod="openshift-monitoring/node-exporter-qplxf" May 29 14:47:19.874601 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.874449 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289-node-exporter-textfile\") pod \"node-exporter-qplxf\" (UID: \"b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289\") " pod="openshift-monitoring/node-exporter-qplxf" May 29 14:47:19.874601 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:47:19.874485 2564 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found May 29 14:47:19.874601 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:47:19.874554 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67041926-c320-411c-aaf3-fde0b869f39f-openshift-state-metrics-tls podName:67041926-c320-411c-aaf3-fde0b869f39f nodeName:}" failed. No retries permitted until 2026-05-29 14:47:20.374536741 +0000 UTC m=+61.231648667 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/67041926-c320-411c-aaf3-fde0b869f39f-openshift-state-metrics-tls") pod "openshift-state-metrics-85658796db-sbgwg" (UID: "67041926-c320-411c-aaf3-fde0b869f39f") : secret "openshift-state-metrics-tls" not found May 29 14:47:19.875049 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.874639 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1ae5ad4-c16b-4244-b536-9d440a44a785-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-k2zpv\" (UID: \"a1ae5ad4-c16b-4244-b536-9d440a44a785\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-k2zpv" May 29 14:47:19.875049 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.874963 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67041926-c320-411c-aaf3-fde0b869f39f-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-sbgwg\" (UID: \"67041926-c320-411c-aaf3-fde0b869f39f\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-sbgwg" May 29 14:47:19.875248 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.875206 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a1ae5ad4-c16b-4244-b536-9d440a44a785-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-k2zpv\" (UID: \"a1ae5ad4-c16b-4244-b536-9d440a44a785\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-k2zpv" May 29 14:47:19.876469 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.876449 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/67041926-c320-411c-aaf3-fde0b869f39f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-sbgwg\" (UID: \"67041926-c320-411c-aaf3-fde0b869f39f\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-sbgwg" May 29 14:47:19.876585 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.876564 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a1ae5ad4-c16b-4244-b536-9d440a44a785-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-k2zpv\" (UID: \"a1ae5ad4-c16b-4244-b536-9d440a44a785\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-k2zpv" May 29 14:47:19.887436 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.887411 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnjmx\" (UniqueName: \"kubernetes.io/projected/67041926-c320-411c-aaf3-fde0b869f39f-kube-api-access-jnjmx\") pod \"openshift-state-metrics-85658796db-sbgwg\" (UID: \"67041926-c320-411c-aaf3-fde0b869f39f\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-sbgwg" May 29 14:47:19.887554 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.887540 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b5kc\" (UniqueName: \"kubernetes.io/projected/a1ae5ad4-c16b-4244-b536-9d440a44a785-kube-api-access-8b5kc\") pod \"kube-state-metrics-8469c486bb-k2zpv\" (UID: \"a1ae5ad4-c16b-4244-b536-9d440a44a785\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-k2zpv" May 29 14:47:19.895874 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.895849 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-574b4894fc-46ssr"] May 29 14:47:19.898899 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.898885 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-574b4894fc-46ssr" May 29 14:47:19.906150 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.906128 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" May 29 14:47:19.910270 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.910249 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-574b4894fc-46ssr"] May 29 14:47:19.929218 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.929188 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5975fb4c78-pgn48" event={"ID":"69eace9a-f87a-4bf3-bca2-8fd675d84167","Type":"ContainerStarted","Data":"c6d788acff8013665a784c871de8dc26b1b65ce8972ae628281bd587cedfe6da"} May 29 14:47:19.948971 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.948928 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5975fb4c78-pgn48" podStartSLOduration=1.292925828 podStartE2EDuration="4.94891403s" podCreationTimestamp="2026-05-29 14:47:15 +0000 UTC" firstStartedPulling="2026-05-29 14:47:15.576701142 +0000 UTC m=+56.433813068" lastFinishedPulling="2026-05-29 14:47:19.232689343 +0000 UTC m=+60.089801270" observedRunningTime="2026-05-29 14:47:19.947762042 +0000 UTC m=+60.804873988" watchObservedRunningTime="2026-05-29 14:47:19.94891403 +0000 UTC m=+60.806025980" May 29 14:47:19.975377 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.975302 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qplxf\" (UID: \"b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289\") " pod="openshift-monitoring/node-exporter-qplxf" May 29 14:47:19.975377 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.975339 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58a9de72-d19a-4f67-9e24-936ca7f340aa-trusted-ca-bundle\") pod \"console-574b4894fc-46ssr\" (UID: \"58a9de72-d19a-4f67-9e24-936ca7f340aa\") " pod="openshift-console/console-574b4894fc-46ssr" May 29 14:47:19.975583 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.975381 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289-node-exporter-wtmp\") pod \"node-exporter-qplxf\" (UID: \"b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289\") " pod="openshift-monitoring/node-exporter-qplxf" May 29 14:47:19.975583 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.975494 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwtwj\" (UniqueName: \"kubernetes.io/projected/b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289-kube-api-access-gwtwj\") pod \"node-exporter-qplxf\" (UID: \"b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289\") " pod="openshift-monitoring/node-exporter-qplxf" May 29 14:47:19.975583 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.975553 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4ch2\" (UniqueName: \"kubernetes.io/projected/58a9de72-d19a-4f67-9e24-936ca7f340aa-kube-api-access-g4ch2\") pod \"console-574b4894fc-46ssr\" (UID: \"58a9de72-d19a-4f67-9e24-936ca7f340aa\") " pod="openshift-console/console-574b4894fc-46ssr" May 29 14:47:19.975720 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.975588 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58a9de72-d19a-4f67-9e24-936ca7f340aa-oauth-serving-cert\") pod \"console-574b4894fc-46ssr\" (UID: \"58a9de72-d19a-4f67-9e24-936ca7f340aa\") " pod="openshift-console/console-574b4894fc-46ssr" May 29 14:47:19.975720 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.975502 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289-node-exporter-wtmp\") pod \"node-exporter-qplxf\" (UID: \"b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289\") " pod="openshift-monitoring/node-exporter-qplxf" May 29 14:47:19.975720 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.975620 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289-sys\") pod \"node-exporter-qplxf\" (UID: \"b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289\") " pod="openshift-monitoring/node-exporter-qplxf" May 29 14:47:19.975720 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.975657 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289-sys\") pod \"node-exporter-qplxf\" (UID: \"b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289\") " pod="openshift-monitoring/node-exporter-qplxf" May 29 14:47:19.975979 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.975717 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289-root\") pod \"node-exporter-qplxf\" (UID: \"b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289\") " pod="openshift-monitoring/node-exporter-qplxf" May 29 14:47:19.975979 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.975747 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289-node-exporter-textfile\") pod \"node-exporter-qplxf\" (UID: \"b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289\") " pod="openshift-monitoring/node-exporter-qplxf" May 29 14:47:19.975979 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.975769 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289-root\") pod \"node-exporter-qplxf\" (UID: \"b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289\") " pod="openshift-monitoring/node-exporter-qplxf" May 29 14:47:19.975979 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.975785 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58a9de72-d19a-4f67-9e24-936ca7f340aa-service-ca\") pod \"console-574b4894fc-46ssr\" (UID: \"58a9de72-d19a-4f67-9e24-936ca7f340aa\") " pod="openshift-console/console-574b4894fc-46ssr" May 29 14:47:19.975979 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.975824 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289-node-exporter-tls\") pod \"node-exporter-qplxf\" (UID: \"b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289\") " pod="openshift-monitoring/node-exporter-qplxf" May 29 14:47:19.975979 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.975852 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58a9de72-d19a-4f67-9e24-936ca7f340aa-console-oauth-config\") pod \"console-574b4894fc-46ssr\" (UID: \"58a9de72-d19a-4f67-9e24-936ca7f340aa\") " pod="openshift-console/console-574b4894fc-46ssr" May 29 14:47:19.975979 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.975884 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58a9de72-d19a-4f67-9e24-936ca7f340aa-console-serving-cert\") pod \"console-574b4894fc-46ssr\" (UID: \"58a9de72-d19a-4f67-9e24-936ca7f340aa\") " pod="openshift-console/console-574b4894fc-46ssr" May 29 14:47:19.975979 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:47:19.975964 2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found May 29 14:47:19.976562 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:47:19.976042 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289-node-exporter-tls podName:b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289 nodeName:}" failed. No retries permitted until 2026-05-29 14:47:20.47602148 +0000 UTC m=+61.333133426 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289-node-exporter-tls") pod "node-exporter-qplxf" (UID: "b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289") : secret "node-exporter-tls" not found May 29 14:47:19.976562 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.976051 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289-node-exporter-textfile\") pod \"node-exporter-qplxf\" (UID: \"b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289\") " pod="openshift-monitoring/node-exporter-qplxf" May 29 14:47:19.976562 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.976084 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289-metrics-client-ca\") pod \"node-exporter-qplxf\" (UID: \"b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289\") " pod="openshift-monitoring/node-exporter-qplxf" May 29 14:47:19.976562 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.976123 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289-node-exporter-accelerators-collector-config\") pod \"node-exporter-qplxf\" (UID: \"b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289\") " pod="openshift-monitoring/node-exporter-qplxf" May 29 14:47:19.976562 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.976160 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58a9de72-d19a-4f67-9e24-936ca7f340aa-console-config\") pod \"console-574b4894fc-46ssr\" (UID: \"58a9de72-d19a-4f67-9e24-936ca7f340aa\") " pod="openshift-console/console-574b4894fc-46ssr" May 29 14:47:19.976562 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.976530 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289-metrics-client-ca\") pod \"node-exporter-qplxf\" (UID: \"b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289\") " pod="openshift-monitoring/node-exporter-qplxf" May 29 14:47:19.976562 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.976543 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289-node-exporter-accelerators-collector-config\") pod \"node-exporter-qplxf\" (UID: \"b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289\") " pod="openshift-monitoring/node-exporter-qplxf" May 29 14:47:19.977882 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.977862 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qplxf\" (UID: \"b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289\") " pod="openshift-monitoring/node-exporter-qplxf" May 29 14:47:19.983920 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:19.983895 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwtwj\" (UniqueName: \"kubernetes.io/projected/b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289-kube-api-access-gwtwj\") pod \"node-exporter-qplxf\" (UID: \"b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289\") " pod="openshift-monitoring/node-exporter-qplxf" May 29 14:47:20.077345 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.077310 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58a9de72-d19a-4f67-9e24-936ca7f340aa-service-ca\") pod \"console-574b4894fc-46ssr\" (UID: \"58a9de72-d19a-4f67-9e24-936ca7f340aa\") " pod="openshift-console/console-574b4894fc-46ssr" May 29 14:47:20.077510 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.077355 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58a9de72-d19a-4f67-9e24-936ca7f340aa-console-oauth-config\") pod \"console-574b4894fc-46ssr\" (UID: \"58a9de72-d19a-4f67-9e24-936ca7f340aa\") " pod="openshift-console/console-574b4894fc-46ssr" May 29 14:47:20.077510 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.077374 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58a9de72-d19a-4f67-9e24-936ca7f340aa-console-serving-cert\") pod \"console-574b4894fc-46ssr\" (UID: \"58a9de72-d19a-4f67-9e24-936ca7f340aa\") " pod="openshift-console/console-574b4894fc-46ssr" May 29 14:47:20.077692 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.077670 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58a9de72-d19a-4f67-9e24-936ca7f340aa-console-config\") pod \"console-574b4894fc-46ssr\" (UID: \"58a9de72-d19a-4f67-9e24-936ca7f340aa\") " pod="openshift-console/console-574b4894fc-46ssr" May 29 14:47:20.077754 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.077705 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58a9de72-d19a-4f67-9e24-936ca7f340aa-trusted-ca-bundle\") pod \"console-574b4894fc-46ssr\" (UID: \"58a9de72-d19a-4f67-9e24-936ca7f340aa\") " pod="openshift-console/console-574b4894fc-46ssr" May 29 14:47:20.077754 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.077747 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g4ch2\" (UniqueName: \"kubernetes.io/projected/58a9de72-d19a-4f67-9e24-936ca7f340aa-kube-api-access-g4ch2\") pod \"console-574b4894fc-46ssr\" (UID: \"58a9de72-d19a-4f67-9e24-936ca7f340aa\") " pod="openshift-console/console-574b4894fc-46ssr" May 29 14:47:20.077841 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.077770 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58a9de72-d19a-4f67-9e24-936ca7f340aa-oauth-serving-cert\") pod \"console-574b4894fc-46ssr\" (UID: \"58a9de72-d19a-4f67-9e24-936ca7f340aa\") " pod="openshift-console/console-574b4894fc-46ssr" May 29 14:47:20.078012 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.077981 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58a9de72-d19a-4f67-9e24-936ca7f340aa-service-ca\") pod \"console-574b4894fc-46ssr\" (UID: \"58a9de72-d19a-4f67-9e24-936ca7f340aa\") " pod="openshift-console/console-574b4894fc-46ssr" May 29 14:47:20.078291 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.078270 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58a9de72-d19a-4f67-9e24-936ca7f340aa-console-config\") pod \"console-574b4894fc-46ssr\" (UID: \"58a9de72-d19a-4f67-9e24-936ca7f340aa\") " pod="openshift-console/console-574b4894fc-46ssr" May 29 14:47:20.078530 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.078510 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58a9de72-d19a-4f67-9e24-936ca7f340aa-oauth-serving-cert\") pod \"console-574b4894fc-46ssr\" (UID: \"58a9de72-d19a-4f67-9e24-936ca7f340aa\") " pod="openshift-console/console-574b4894fc-46ssr" May 29 14:47:20.078870 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.078851 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58a9de72-d19a-4f67-9e24-936ca7f340aa-trusted-ca-bundle\") pod \"console-574b4894fc-46ssr\" (UID: \"58a9de72-d19a-4f67-9e24-936ca7f340aa\") " pod="openshift-console/console-574b4894fc-46ssr" May 29 14:47:20.079917 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.079899 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58a9de72-d19a-4f67-9e24-936ca7f340aa-console-serving-cert\") pod \"console-574b4894fc-46ssr\" (UID: \"58a9de72-d19a-4f67-9e24-936ca7f340aa\") " pod="openshift-console/console-574b4894fc-46ssr" May 29 14:47:20.079965 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.079943 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58a9de72-d19a-4f67-9e24-936ca7f340aa-console-oauth-config\") pod \"console-574b4894fc-46ssr\" (UID: \"58a9de72-d19a-4f67-9e24-936ca7f340aa\") " pod="openshift-console/console-574b4894fc-46ssr" May 29 14:47:20.087418 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.087390 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4ch2\" (UniqueName: \"kubernetes.io/projected/58a9de72-d19a-4f67-9e24-936ca7f340aa-kube-api-access-g4ch2\") pod \"console-574b4894fc-46ssr\" (UID: \"58a9de72-d19a-4f67-9e24-936ca7f340aa\") " pod="openshift-console/console-574b4894fc-46ssr" May 29 14:47:20.208001 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.207959 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-574b4894fc-46ssr" May 29 14:47:20.340616 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.340581 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-574b4894fc-46ssr"] May 29 14:47:20.344746 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:47:20.344705 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58a9de72_d19a_4f67_9e24_936ca7f340aa.slice/crio-4ad3d36f849c92743ed7cffa0f920f365f8067cccd42278a0d9317421f226674 WatchSource:0}: Error finding container 4ad3d36f849c92743ed7cffa0f920f365f8067cccd42278a0d9317421f226674: Status 404 returned error can't find the container with id 4ad3d36f849c92743ed7cffa0f920f365f8067cccd42278a0d9317421f226674 May 29 14:47:20.381141 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.381115 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/67041926-c320-411c-aaf3-fde0b869f39f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-sbgwg\" (UID: \"67041926-c320-411c-aaf3-fde0b869f39f\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-sbgwg" May 29 14:47:20.381273 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.381190 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1ae5ad4-c16b-4244-b536-9d440a44a785-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-k2zpv\" (UID: \"a1ae5ad4-c16b-4244-b536-9d440a44a785\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-k2zpv" May 29 14:47:20.383553 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.383526 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/67041926-c320-411c-aaf3-fde0b869f39f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-sbgwg\" (UID: \"67041926-c320-411c-aaf3-fde0b869f39f\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-sbgwg" May 29 14:47:20.383838 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.383815 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1ae5ad4-c16b-4244-b536-9d440a44a785-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-k2zpv\" (UID: \"a1ae5ad4-c16b-4244-b536-9d440a44a785\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-k2zpv" May 29 14:47:20.482023 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.481989 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289-node-exporter-tls\") pod \"node-exporter-qplxf\" (UID: \"b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289\") " pod="openshift-monitoring/node-exporter-qplxf" May 29 14:47:20.484764 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.484727 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289-node-exporter-tls\") pod \"node-exporter-qplxf\" (UID: \"b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289\") " pod="openshift-monitoring/node-exporter-qplxf" May 29 14:47:20.554748 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.554678 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gvn49" May 29 14:47:20.628308 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.628279 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-sbgwg" May 29 14:47:20.640151 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.640123 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-k2zpv" May 29 14:47:20.688164 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.687847 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qplxf" May 29 14:47:20.699011 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:47:20.698960 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5ded3ee_cf3c_4b6f_a5d3_5ad77323f289.slice/crio-b5f85443a6102e6d267948220ee340c67d3d7e810ab0d335270dae1ae11d2de6 WatchSource:0}: Error finding container b5f85443a6102e6d267948220ee340c67d3d7e810ab0d335270dae1ae11d2de6: Status 404 returned error can't find the container with id b5f85443a6102e6d267948220ee340c67d3d7e810ab0d335270dae1ae11d2de6 May 29 14:47:20.791692 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.791654 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-sbgwg"] May 29 14:47:20.796386 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:47:20.796356 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67041926_c320_411c_aaf3_fde0b869f39f.slice/crio-113b223f6c7ee69ee4848940461aee043220a6a325d84ddbbda7a0f5362bef3d WatchSource:0}: Error finding container 113b223f6c7ee69ee4848940461aee043220a6a325d84ddbbda7a0f5362bef3d: Status 404 returned error can't find the container with id 113b223f6c7ee69ee4848940461aee043220a6a325d84ddbbda7a0f5362bef3d May 29 14:47:20.824923 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.824860 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-k2zpv"] May 29 14:47:20.828719 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:47:20.828690 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1ae5ad4_c16b_4244_b536_9d440a44a785.slice/crio-43bb11c4d9765ea9144ca2226c5b43dd8575583643ba0ce82fbbb8bfbcf6ef7a WatchSource:0}: Error finding container 43bb11c4d9765ea9144ca2226c5b43dd8575583643ba0ce82fbbb8bfbcf6ef7a: Status 404 returned error can't find the container with id 43bb11c4d9765ea9144ca2226c5b43dd8575583643ba0ce82fbbb8bfbcf6ef7a May 29 14:47:20.907628 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.907599 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 29 14:47:20.909812 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.909757 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 29 14:47:20.912336 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.912312 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 29 14:47:20.916099 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.915919 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 29 14:47:20.916099 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.915926 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 29 14:47:20.916099 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.915930 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 29 14:47:20.916099 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.916082 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 29 14:47:20.916412 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.916208 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 29 14:47:20.916412 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.916350 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 29 14:47:20.916891 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.916871 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 29 14:47:20.916996 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.916948 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-l5c4v\"" May 29 14:47:20.917341 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.917324 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 29 14:47:20.933436 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.933402 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-k2zpv" event={"ID":"a1ae5ad4-c16b-4244-b536-9d440a44a785","Type":"ContainerStarted","Data":"43bb11c4d9765ea9144ca2226c5b43dd8575583643ba0ce82fbbb8bfbcf6ef7a"} May 29 14:47:20.935441 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.935412 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-sbgwg" event={"ID":"67041926-c320-411c-aaf3-fde0b869f39f","Type":"ContainerStarted","Data":"c54386f7d2240d8d1377578a001c0a5b1ddc3ae326e1cb6463644b96780dd94f"} May 29 14:47:20.935572 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.935452 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-sbgwg" event={"ID":"67041926-c320-411c-aaf3-fde0b869f39f","Type":"ContainerStarted","Data":"9c489f48021c0324b7092761482b86bd85e3b7dfed4bd109fbbc3588d98c3ad2"} May 29 14:47:20.935572 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.935468 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-sbgwg" event={"ID":"67041926-c320-411c-aaf3-fde0b869f39f","Type":"ContainerStarted","Data":"113b223f6c7ee69ee4848940461aee043220a6a325d84ddbbda7a0f5362bef3d"} May 29 14:47:20.938507 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.938422 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-574b4894fc-46ssr" event={"ID":"58a9de72-d19a-4f67-9e24-936ca7f340aa","Type":"ContainerStarted","Data":"f09fda99338d04d9a04f3fb1b7ab84be66d5d05dd0efd4c1ab2c1e8f2e28c97b"} May 29 14:47:20.938507 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.938461 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-574b4894fc-46ssr" event={"ID":"58a9de72-d19a-4f67-9e24-936ca7f340aa","Type":"ContainerStarted","Data":"4ad3d36f849c92743ed7cffa0f920f365f8067cccd42278a0d9317421f226674"} May 29 14:47:20.938507 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.938481 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 29 14:47:20.939799 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.939774 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qplxf" event={"ID":"b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289","Type":"ContainerStarted","Data":"b5f85443a6102e6d267948220ee340c67d3d7e810ab0d335270dae1ae11d2de6"} May 29 14:47:20.990353 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.990315 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f0cf30a-046c-43a1-af24-afa473342b19-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:47:20.990529 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.990357 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6f0cf30a-046c-43a1-af24-afa473342b19-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:47:20.990529 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.990465 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6f0cf30a-046c-43a1-af24-afa473342b19-web-config\") pod \"alertmanager-main-0\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:47:20.990657 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.990622 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6f0cf30a-046c-43a1-af24-afa473342b19-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:47:20.990718 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.990703 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f0cf30a-046c-43a1-af24-afa473342b19-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:47:20.990765 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.990732 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwhn2\" (UniqueName: \"kubernetes.io/projected/6f0cf30a-046c-43a1-af24-afa473342b19-kube-api-access-gwhn2\") pod \"alertmanager-main-0\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:47:20.990844 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.990826 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6f0cf30a-046c-43a1-af24-afa473342b19-config-volume\") pod \"alertmanager-main-0\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:47:20.990900 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.990879 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6f0cf30a-046c-43a1-af24-afa473342b19-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:47:20.990949 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.990929 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f0cf30a-046c-43a1-af24-afa473342b19-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:47:20.990996 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.990959 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6f0cf30a-046c-43a1-af24-afa473342b19-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:47:20.990996 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.990988 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f0cf30a-046c-43a1-af24-afa473342b19-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:47:20.991105 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.991086 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6f0cf30a-046c-43a1-af24-afa473342b19-config-out\") pod \"alertmanager-main-0\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:47:20.991160 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.991123 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6f0cf30a-046c-43a1-af24-afa473342b19-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:47:20.994681 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:20.994638 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-574b4894fc-46ssr" podStartSLOduration=1.9946262689999998 podStartE2EDuration="1.994626269s" podCreationTimestamp="2026-05-29 14:47:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 14:47:20.991336036 +0000 UTC m=+61.848447983" watchObservedRunningTime="2026-05-29 14:47:20.994626269 +0000 UTC m=+61.851738210" May 29 14:47:21.092512 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:21.092425 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f0cf30a-046c-43a1-af24-afa473342b19-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:47:21.092512 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:21.092465 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6f0cf30a-046c-43a1-af24-afa473342b19-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:47:21.092512 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:21.092488 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6f0cf30a-046c-43a1-af24-afa473342b19-web-config\") pod \"alertmanager-main-0\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:47:21.092777 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:21.092664 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6f0cf30a-046c-43a1-af24-afa473342b19-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:47:21.092777 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:21.092715 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f0cf30a-046c-43a1-af24-afa473342b19-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:47:21.092777 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:21.092743 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwhn2\" (UniqueName: \"kubernetes.io/projected/6f0cf30a-046c-43a1-af24-afa473342b19-kube-api-access-gwhn2\") pod \"alertmanager-main-0\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:47:21.092927 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:21.092788 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6f0cf30a-046c-43a1-af24-afa473342b19-config-volume\") pod \"alertmanager-main-0\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:47:21.092927 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:21.092814 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6f0cf30a-046c-43a1-af24-afa473342b19-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:47:21.092927 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:21.092842 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f0cf30a-046c-43a1-af24-afa473342b19-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:47:21.092927 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:21.092870 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6f0cf30a-046c-43a1-af24-afa473342b19-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:47:21.092927 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:21.092897 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f0cf30a-046c-43a1-af24-afa473342b19-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:47:21.093148 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:21.092936 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6f0cf30a-046c-43a1-af24-afa473342b19-config-out\") pod \"alertmanager-main-0\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:47:21.093148 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:21.092965 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6f0cf30a-046c-43a1-af24-afa473342b19-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:47:21.093556 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:21.093525 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f0cf30a-046c-43a1-af24-afa473342b19-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:47:21.093658 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:21.093600 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6f0cf30a-046c-43a1-af24-afa473342b19-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:47:21.095126 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:21.095095 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f0cf30a-046c-43a1-af24-afa473342b19-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:47:21.095850 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:21.095807 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6f0cf30a-046c-43a1-af24-afa473342b19-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:47:21.096051 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:21.096031 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f0cf30a-046c-43a1-af24-afa473342b19-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:47:21.096529 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:21.096500 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6f0cf30a-046c-43a1-af24-afa473342b19-config-volume\") pod \"alertmanager-main-0\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:47:21.096646 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:21.096625 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6f0cf30a-046c-43a1-af24-afa473342b19-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:47:21.096734 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:21.096704 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6f0cf30a-046c-43a1-af24-afa473342b19-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:47:21.096734 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:21.096724 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6f0cf30a-046c-43a1-af24-afa473342b19-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:47:21.097103 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:21.097084 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6f0cf30a-046c-43a1-af24-afa473342b19-web-config\") pod \"alertmanager-main-0\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:47:21.097314 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:21.097296 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f0cf30a-046c-43a1-af24-afa473342b19-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:47:21.097599 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:21.097579 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6f0cf30a-046c-43a1-af24-afa473342b19-config-out\") pod \"alertmanager-main-0\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:47:21.108236 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:21.108213 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwhn2\" (UniqueName: \"kubernetes.io/projected/6f0cf30a-046c-43a1-af24-afa473342b19-kube-api-access-gwhn2\") pod \"alertmanager-main-0\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:47:21.218817 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:21.218783 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 29 14:47:21.379321 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:21.379222 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 29 14:47:21.386581 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:47:21.386551 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f0cf30a_046c_43a1_af24_afa473342b19.slice/crio-136e6ec1ebfc2eba3a811be8bbafe3d537598075bb193dd66aefa996156b7fc1 WatchSource:0}: Error finding container 136e6ec1ebfc2eba3a811be8bbafe3d537598075bb193dd66aefa996156b7fc1: Status 404 returned error can't find the container with id 136e6ec1ebfc2eba3a811be8bbafe3d537598075bb193dd66aefa996156b7fc1 May 29 14:47:21.900335 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:21.900297 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-m52vf" May 29 14:47:21.945792 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:21.945759 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qplxf" event={"ID":"b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289","Type":"ContainerStarted","Data":"dacece394b09c512d28f55b52c9ecac8da24728c53559ec2abb2e6b32e1d57b3"} May 29 14:47:21.948645 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:21.948619 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f0cf30a-046c-43a1-af24-afa473342b19","Type":"ContainerStarted","Data":"136e6ec1ebfc2eba3a811be8bbafe3d537598075bb193dd66aefa996156b7fc1"} May 29 14:47:22.952957 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:22.952873 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-k2zpv" event={"ID":"a1ae5ad4-c16b-4244-b536-9d440a44a785","Type":"ContainerStarted","Data":"22a1a5d6bb9c9a04269832a6c4714c7b6f720e4bfde1994d2f83cc966a866b51"} May 29 14:47:22.955873 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:22.955827 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-sbgwg" event={"ID":"67041926-c320-411c-aaf3-fde0b869f39f","Type":"ContainerStarted","Data":"73cf9b001a5f46e10d0cbb4235fc2183fb6be72fc725522e0cf4c3ff1b2f8356"} May 29 14:47:22.959272 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:22.959230 2564 generic.go:358] "Generic (PLEG): container finished" podID="b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289" containerID="dacece394b09c512d28f55b52c9ecac8da24728c53559ec2abb2e6b32e1d57b3" exitCode=0 May 29 14:47:22.959409 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:22.959290 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qplxf" event={"ID":"b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289","Type":"ContainerDied","Data":"dacece394b09c512d28f55b52c9ecac8da24728c53559ec2abb2e6b32e1d57b3"} May 29 14:47:22.960832 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:22.960808 2564 generic.go:358] "Generic (PLEG): container finished" podID="6f0cf30a-046c-43a1-af24-afa473342b19" containerID="daeb38df9364d4a7a40eb79e1c54052b74ad0cca46afc5881a1e42b7db4cf090" exitCode=0 May 29 14:47:22.960902 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:22.960863 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f0cf30a-046c-43a1-af24-afa473342b19","Type":"ContainerDied","Data":"daeb38df9364d4a7a40eb79e1c54052b74ad0cca46afc5881a1e42b7db4cf090"} May 29 14:47:23.008541 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:23.008482 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-85658796db-sbgwg" podStartSLOduration=2.177009566 podStartE2EDuration="4.008462759s" podCreationTimestamp="2026-05-29 14:47:19 +0000 UTC" firstStartedPulling="2026-05-29 14:47:20.91801785 +0000 UTC m=+61.775129775" lastFinishedPulling="2026-05-29 14:47:22.74947104 +0000 UTC m=+63.606582968" observedRunningTime="2026-05-29 14:47:23.00692317 +0000 UTC m=+63.864035117" watchObservedRunningTime="2026-05-29 14:47:23.008462759 +0000 UTC m=+63.865574709" May 29 14:47:23.008677 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:23.008665 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-689c79bcff-gmzwt"] May 29 14:47:23.036943 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:23.036909 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-689c79bcff-gmzwt"] May 29 14:47:23.037102 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:23.037072 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-689c79bcff-gmzwt" May 29 14:47:23.040986 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:23.040736 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" May 29 14:47:23.040986 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:23.040817 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" May 29 14:47:23.041164 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:23.041131 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" May 29 14:47:23.041515 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:23.041372 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" May 29 14:47:23.041515 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:23.041403 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-9opq0nf40lc1f\"" May 29 14:47:23.041515 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:23.041403 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-4nsxj\"" May 29 14:47:23.044922 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:23.043114 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" May 29 14:47:23.110862 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:23.110829 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-689c79bcff-gmzwt\" (UID: \"d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae\") " pod="openshift-monitoring/thanos-querier-689c79bcff-gmzwt" May 29 14:47:23.110862 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:23.110863 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-689c79bcff-gmzwt\" (UID: \"d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae\") " pod="openshift-monitoring/thanos-querier-689c79bcff-gmzwt" May 29 14:47:23.111017 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:23.110886 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-689c79bcff-gmzwt\" (UID: \"d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae\") " pod="openshift-monitoring/thanos-querier-689c79bcff-gmzwt" May 29 14:47:23.111017 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:23.110929 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae-secret-thanos-querier-tls\") pod \"thanos-querier-689c79bcff-gmzwt\" (UID: \"d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae\") " pod="openshift-monitoring/thanos-querier-689c79bcff-gmzwt" May 29 14:47:23.111017 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:23.110964 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpzp6\" (UniqueName: \"kubernetes.io/projected/d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae-kube-api-access-bpzp6\") pod \"thanos-querier-689c79bcff-gmzwt\" (UID: \"d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae\") " pod="openshift-monitoring/thanos-querier-689c79bcff-gmzwt" May 29 14:47:23.111017 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:23.111007 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-689c79bcff-gmzwt\" (UID: \"d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae\") " pod="openshift-monitoring/thanos-querier-689c79bcff-gmzwt" May 29 14:47:23.111164 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:23.111125 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae-secret-grpc-tls\") pod \"thanos-querier-689c79bcff-gmzwt\" (UID: \"d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae\") " pod="openshift-monitoring/thanos-querier-689c79bcff-gmzwt" May 29 14:47:23.111224 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:23.111212 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae-metrics-client-ca\") pod \"thanos-querier-689c79bcff-gmzwt\" (UID: \"d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae\") " pod="openshift-monitoring/thanos-querier-689c79bcff-gmzwt" May 29 14:47:23.212539 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:23.212456 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae-secret-grpc-tls\") pod \"thanos-querier-689c79bcff-gmzwt\" (UID: \"d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae\") " pod="openshift-monitoring/thanos-querier-689c79bcff-gmzwt" May 29 14:47:23.212539 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:23.212505 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae-metrics-client-ca\") pod \"thanos-querier-689c79bcff-gmzwt\" (UID: \"d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae\") " pod="openshift-monitoring/thanos-querier-689c79bcff-gmzwt" May 29 14:47:23.212757 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:23.212557 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-689c79bcff-gmzwt\" (UID: \"d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae\") " pod="openshift-monitoring/thanos-querier-689c79bcff-gmzwt" May 29 14:47:23.212757 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:23.212588 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-689c79bcff-gmzwt\" (UID: \"d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae\") " pod="openshift-monitoring/thanos-querier-689c79bcff-gmzwt" May 29 14:47:23.212854 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:23.212820 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-689c79bcff-gmzwt\" (UID: \"d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae\") " pod="openshift-monitoring/thanos-querier-689c79bcff-gmzwt" May 29 14:47:23.212918 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:23.212896 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae-secret-thanos-querier-tls\") pod \"thanos-querier-689c79bcff-gmzwt\" (UID: \"d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae\") " pod="openshift-monitoring/thanos-querier-689c79bcff-gmzwt" May 29 14:47:23.212967 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:23.212942 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bpzp6\" (UniqueName: \"kubernetes.io/projected/d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae-kube-api-access-bpzp6\") pod \"thanos-querier-689c79bcff-gmzwt\" (UID: \"d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae\") " pod="openshift-monitoring/thanos-querier-689c79bcff-gmzwt" May 29 14:47:23.213021 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:23.212981 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-689c79bcff-gmzwt\" (UID: \"d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae\") " pod="openshift-monitoring/thanos-querier-689c79bcff-gmzwt" May 29 14:47:23.213482 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:23.213420 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae-metrics-client-ca\") pod \"thanos-querier-689c79bcff-gmzwt\" (UID: \"d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae\") " pod="openshift-monitoring/thanos-querier-689c79bcff-gmzwt" May 29 14:47:23.215839 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:23.215353 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-689c79bcff-gmzwt\" (UID: \"d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae\") " pod="openshift-monitoring/thanos-querier-689c79bcff-gmzwt" May 29 14:47:23.215954 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:23.215840 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae-secret-thanos-querier-tls\") pod \"thanos-querier-689c79bcff-gmzwt\" (UID: \"d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae\") " pod="openshift-monitoring/thanos-querier-689c79bcff-gmzwt" May 29 14:47:23.215954 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:23.215849 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae-secret-grpc-tls\") pod \"thanos-querier-689c79bcff-gmzwt\" (UID: \"d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae\") " pod="openshift-monitoring/thanos-querier-689c79bcff-gmzwt" May 29 14:47:23.216114 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:23.216091 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-689c79bcff-gmzwt\" (UID: \"d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae\") " pod="openshift-monitoring/thanos-querier-689c79bcff-gmzwt" May 29 14:47:23.216294 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:23.216272 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-689c79bcff-gmzwt\" (UID: \"d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae\") " pod="openshift-monitoring/thanos-querier-689c79bcff-gmzwt" May 29 14:47:23.216850 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:23.216832 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-689c79bcff-gmzwt\" (UID: \"d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae\") " pod="openshift-monitoring/thanos-querier-689c79bcff-gmzwt" May 29 14:47:23.220824 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:23.220807 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpzp6\" (UniqueName: \"kubernetes.io/projected/d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae-kube-api-access-bpzp6\") pod \"thanos-querier-689c79bcff-gmzwt\" (UID: \"d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae\") " pod="openshift-monitoring/thanos-querier-689c79bcff-gmzwt" May 29 14:47:23.358451 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:23.358415 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-689c79bcff-gmzwt" May 29 14:47:23.519447 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:23.519407 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-689c79bcff-gmzwt"] May 29 14:47:23.524243 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:47:23.524214 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd015aaa8_4890_4a2d_ba5c_5cdfb05a26ae.slice/crio-9300d5615b01187f71795ae57f547e27177c91723f5aa8331be07a4ba97fd0f7 WatchSource:0}: Error finding container 9300d5615b01187f71795ae57f547e27177c91723f5aa8331be07a4ba97fd0f7: Status 404 returned error can't find the container with id 9300d5615b01187f71795ae57f547e27177c91723f5aa8331be07a4ba97fd0f7 May 29 14:47:23.966331 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:23.966241 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qplxf" event={"ID":"b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289","Type":"ContainerStarted","Data":"4a5bddc25e91e5916e4c3085613c8fd00de9326a996ff28decde3599e8341175"} May 29 14:47:23.966331 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:23.966284 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qplxf" event={"ID":"b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289","Type":"ContainerStarted","Data":"0156ceb308b2c9a0289d8c053f15e82f320a051a2fc458d5ee29da34370eddb7"} May 29 14:47:23.967505 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:23.967480 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-689c79bcff-gmzwt" event={"ID":"d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae","Type":"ContainerStarted","Data":"9300d5615b01187f71795ae57f547e27177c91723f5aa8331be07a4ba97fd0f7"} May 29 14:47:23.970261 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:23.970236 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-k2zpv" event={"ID":"a1ae5ad4-c16b-4244-b536-9d440a44a785","Type":"ContainerStarted","Data":"73913cdb1a9187662e298bdff4a66df5cd7047bd1bbc58517e22b396ad6fe15d"} May 29 14:47:23.970361 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:23.970277 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-k2zpv" event={"ID":"a1ae5ad4-c16b-4244-b536-9d440a44a785","Type":"ContainerStarted","Data":"73e40425a55523ce03722a0db7ec13978669c683b811ab41de5eeaad12a7923d"} May 29 14:47:23.994370 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:23.994314 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qplxf" podStartSLOduration=3.9798938919999998 podStartE2EDuration="4.994295173s" podCreationTimestamp="2026-05-29 14:47:19 +0000 UTC" firstStartedPulling="2026-05-29 14:47:20.700797902 +0000 UTC m=+61.557909828" lastFinishedPulling="2026-05-29 14:47:21.715199182 +0000 UTC m=+62.572311109" observedRunningTime="2026-05-29 14:47:23.992891365 +0000 UTC m=+64.850003313" watchObservedRunningTime="2026-05-29 14:47:23.994295173 +0000 UTC m=+64.851407121" May 29 14:47:24.013824 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.013773 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-8469c486bb-k2zpv" podStartSLOduration=3.095690823 podStartE2EDuration="5.013755707s" podCreationTimestamp="2026-05-29 14:47:19 +0000 UTC" firstStartedPulling="2026-05-29 14:47:20.83090853 +0000 UTC m=+61.688020467" lastFinishedPulling="2026-05-29 14:47:22.748973426 +0000 UTC m=+63.606085351" observedRunningTime="2026-05-29 14:47:24.01271543 +0000 UTC m=+64.869827378" watchObservedRunningTime="2026-05-29 14:47:24.013755707 +0000 UTC m=+64.870867655" May 29 14:47:24.320637 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.320589 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-645dc96fd6-dlm2w"] May 29 14:47:24.335617 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.335588 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-645dc96fd6-dlm2w" May 29 14:47:24.336601 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.336575 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-645dc96fd6-dlm2w"] May 29 14:47:24.340365 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.340340 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 29 14:47:24.340365 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.340360 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-bp9wf\"" May 29 14:47:24.340565 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.340462 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-2dar8401joilk\"" May 29 14:47:24.340628 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.340581 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" May 29 14:47:24.340729 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.340710 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" May 29 14:47:24.340817 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.340714 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" May 29 14:47:24.427239 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.427199 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/88b389ca-5723-41ad-8b55-c74c2d12dcd3-metrics-server-audit-profiles\") pod \"metrics-server-645dc96fd6-dlm2w\" (UID: \"88b389ca-5723-41ad-8b55-c74c2d12dcd3\") " pod="openshift-monitoring/metrics-server-645dc96fd6-dlm2w" May 29 14:47:24.427431 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.427263 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7f8c\" (UniqueName: \"kubernetes.io/projected/88b389ca-5723-41ad-8b55-c74c2d12dcd3-kube-api-access-v7f8c\") pod \"metrics-server-645dc96fd6-dlm2w\" (UID: \"88b389ca-5723-41ad-8b55-c74c2d12dcd3\") " pod="openshift-monitoring/metrics-server-645dc96fd6-dlm2w" May 29 14:47:24.427431 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.427298 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/88b389ca-5723-41ad-8b55-c74c2d12dcd3-audit-log\") pod \"metrics-server-645dc96fd6-dlm2w\" (UID: \"88b389ca-5723-41ad-8b55-c74c2d12dcd3\") " pod="openshift-monitoring/metrics-server-645dc96fd6-dlm2w" May 29 14:47:24.427431 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.427347 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/88b389ca-5723-41ad-8b55-c74c2d12dcd3-client-ca-bundle\") pod \"metrics-server-645dc96fd6-dlm2w\" (UID: \"88b389ca-5723-41ad-8b55-c74c2d12dcd3\") " pod="openshift-monitoring/metrics-server-645dc96fd6-dlm2w" May 29 14:47:24.427431 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.427411 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/88b389ca-5723-41ad-8b55-c74c2d12dcd3-secret-metrics-server-tls\") pod \"metrics-server-645dc96fd6-dlm2w\" (UID: \"88b389ca-5723-41ad-8b55-c74c2d12dcd3\") " pod="openshift-monitoring/metrics-server-645dc96fd6-dlm2w" May 29 14:47:24.427610 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.427473 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88b389ca-5723-41ad-8b55-c74c2d12dcd3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-645dc96fd6-dlm2w\" (UID: \"88b389ca-5723-41ad-8b55-c74c2d12dcd3\") " pod="openshift-monitoring/metrics-server-645dc96fd6-dlm2w" May 29 14:47:24.427653 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.427628 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/88b389ca-5723-41ad-8b55-c74c2d12dcd3-secret-metrics-server-client-certs\") pod \"metrics-server-645dc96fd6-dlm2w\" (UID: \"88b389ca-5723-41ad-8b55-c74c2d12dcd3\") " pod="openshift-monitoring/metrics-server-645dc96fd6-dlm2w" May 29 14:47:24.446188 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.446143 2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5975fb4c78-pgn48"] May 29 14:47:24.466230 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.466198 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-qmlnt"] May 29 14:47:24.484166 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.484137 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-qmlnt"] May 29 14:47:24.484351 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.484297 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-qmlnt" May 29 14:47:24.489285 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.489187 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-vzwpf\"" May 29 14:47:24.493153 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.490400 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" May 29 14:47:24.493153 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.492604 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d67f6f97-49klb"] May 29 14:47:24.508489 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.508458 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d67f6f97-49klb" May 29 14:47:24.509055 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.509010 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d67f6f97-49klb"] May 29 14:47:24.528298 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.528272 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/88b389ca-5723-41ad-8b55-c74c2d12dcd3-secret-metrics-server-client-certs\") pod \"metrics-server-645dc96fd6-dlm2w\" (UID: \"88b389ca-5723-41ad-8b55-c74c2d12dcd3\") " pod="openshift-monitoring/metrics-server-645dc96fd6-dlm2w" May 29 14:47:24.528443 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.528309 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6d6f8cb0-b33a-4a5b-b425-11e50099726f-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-qmlnt\" (UID: \"6d6f8cb0-b33a-4a5b-b425-11e50099726f\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-qmlnt" May 29 14:47:24.528443 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.528354 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/88b389ca-5723-41ad-8b55-c74c2d12dcd3-metrics-server-audit-profiles\") pod \"metrics-server-645dc96fd6-dlm2w\" (UID: \"88b389ca-5723-41ad-8b55-c74c2d12dcd3\") " pod="openshift-monitoring/metrics-server-645dc96fd6-dlm2w" May 29 14:47:24.528443 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.528383 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v7f8c\" (UniqueName: \"kubernetes.io/projected/88b389ca-5723-41ad-8b55-c74c2d12dcd3-kube-api-access-v7f8c\") pod \"metrics-server-645dc96fd6-dlm2w\" (UID: \"88b389ca-5723-41ad-8b55-c74c2d12dcd3\") " pod="openshift-monitoring/metrics-server-645dc96fd6-dlm2w" May 29 14:47:24.528443 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.528410 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/88b389ca-5723-41ad-8b55-c74c2d12dcd3-audit-log\") pod \"metrics-server-645dc96fd6-dlm2w\" (UID: \"88b389ca-5723-41ad-8b55-c74c2d12dcd3\") " pod="openshift-monitoring/metrics-server-645dc96fd6-dlm2w" May 29 14:47:24.528443 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.528439 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/88b389ca-5723-41ad-8b55-c74c2d12dcd3-client-ca-bundle\") pod \"metrics-server-645dc96fd6-dlm2w\" (UID: \"88b389ca-5723-41ad-8b55-c74c2d12dcd3\") " pod="openshift-monitoring/metrics-server-645dc96fd6-dlm2w" May 29 14:47:24.528723 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.528699 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/88b389ca-5723-41ad-8b55-c74c2d12dcd3-secret-metrics-server-tls\") pod \"metrics-server-645dc96fd6-dlm2w\" (UID: \"88b389ca-5723-41ad-8b55-c74c2d12dcd3\") " pod="openshift-monitoring/metrics-server-645dc96fd6-dlm2w" May 29 14:47:24.528776 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.528746 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88b389ca-5723-41ad-8b55-c74c2d12dcd3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-645dc96fd6-dlm2w\" (UID: \"88b389ca-5723-41ad-8b55-c74c2d12dcd3\") " pod="openshift-monitoring/metrics-server-645dc96fd6-dlm2w" May 29 14:47:24.528858 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.528839 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/88b389ca-5723-41ad-8b55-c74c2d12dcd3-audit-log\") pod \"metrics-server-645dc96fd6-dlm2w\" (UID: \"88b389ca-5723-41ad-8b55-c74c2d12dcd3\") " pod="openshift-monitoring/metrics-server-645dc96fd6-dlm2w" May 29 14:47:24.529339 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.529320 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88b389ca-5723-41ad-8b55-c74c2d12dcd3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-645dc96fd6-dlm2w\" (UID: \"88b389ca-5723-41ad-8b55-c74c2d12dcd3\") " pod="openshift-monitoring/metrics-server-645dc96fd6-dlm2w" May 29 14:47:24.529404 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.529385 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/88b389ca-5723-41ad-8b55-c74c2d12dcd3-metrics-server-audit-profiles\") pod \"metrics-server-645dc96fd6-dlm2w\" (UID: \"88b389ca-5723-41ad-8b55-c74c2d12dcd3\") " pod="openshift-monitoring/metrics-server-645dc96fd6-dlm2w" May 29 14:47:24.531647 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.531623 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/88b389ca-5723-41ad-8b55-c74c2d12dcd3-client-ca-bundle\") pod \"metrics-server-645dc96fd6-dlm2w\" (UID: \"88b389ca-5723-41ad-8b55-c74c2d12dcd3\") " pod="openshift-monitoring/metrics-server-645dc96fd6-dlm2w" May 29 14:47:24.531753 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.531682 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/88b389ca-5723-41ad-8b55-c74c2d12dcd3-secret-metrics-server-client-certs\") pod \"metrics-server-645dc96fd6-dlm2w\" (UID: \"88b389ca-5723-41ad-8b55-c74c2d12dcd3\") " pod="openshift-monitoring/metrics-server-645dc96fd6-dlm2w" May 29 14:47:24.532363 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.532342 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/88b389ca-5723-41ad-8b55-c74c2d12dcd3-secret-metrics-server-tls\") pod \"metrics-server-645dc96fd6-dlm2w\" (UID: \"88b389ca-5723-41ad-8b55-c74c2d12dcd3\") " pod="openshift-monitoring/metrics-server-645dc96fd6-dlm2w" May 29 14:47:24.540068 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.540021 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7f8c\" (UniqueName: \"kubernetes.io/projected/88b389ca-5723-41ad-8b55-c74c2d12dcd3-kube-api-access-v7f8c\") pod \"metrics-server-645dc96fd6-dlm2w\" (UID: \"88b389ca-5723-41ad-8b55-c74c2d12dcd3\") " pod="openshift-monitoring/metrics-server-645dc96fd6-dlm2w" May 29 14:47:24.629893 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.629807 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc54c7ba-1311-4e74-b98d-da5d167af814-oauth-serving-cert\") pod \"console-7d67f6f97-49klb\" (UID: \"dc54c7ba-1311-4e74-b98d-da5d167af814\") " pod="openshift-console/console-7d67f6f97-49klb" May 29 14:47:24.629893 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.629891 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc54c7ba-1311-4e74-b98d-da5d167af814-console-config\") pod \"console-7d67f6f97-49klb\" (UID: \"dc54c7ba-1311-4e74-b98d-da5d167af814\") " pod="openshift-console/console-7d67f6f97-49klb" May 29 14:47:24.630124 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.629952 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc54c7ba-1311-4e74-b98d-da5d167af814-console-oauth-config\") pod \"console-7d67f6f97-49klb\" (UID: \"dc54c7ba-1311-4e74-b98d-da5d167af814\") " pod="openshift-console/console-7d67f6f97-49klb" May 29 14:47:24.630124 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.629985 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vnnb\" (UniqueName: \"kubernetes.io/projected/dc54c7ba-1311-4e74-b98d-da5d167af814-kube-api-access-8vnnb\") pod \"console-7d67f6f97-49klb\" (UID: \"dc54c7ba-1311-4e74-b98d-da5d167af814\") " pod="openshift-console/console-7d67f6f97-49klb" May 29 14:47:24.630124 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.630025 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc54c7ba-1311-4e74-b98d-da5d167af814-service-ca\") pod \"console-7d67f6f97-49klb\" (UID: \"dc54c7ba-1311-4e74-b98d-da5d167af814\") " pod="openshift-console/console-7d67f6f97-49klb" May 29 14:47:24.630124 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.630059 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc54c7ba-1311-4e74-b98d-da5d167af814-console-serving-cert\") pod \"console-7d67f6f97-49klb\" (UID: \"dc54c7ba-1311-4e74-b98d-da5d167af814\") " pod="openshift-console/console-7d67f6f97-49klb" May 29 14:47:24.630319 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.630134 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc54c7ba-1311-4e74-b98d-da5d167af814-trusted-ca-bundle\") pod \"console-7d67f6f97-49klb\" (UID: \"dc54c7ba-1311-4e74-b98d-da5d167af814\") " pod="openshift-console/console-7d67f6f97-49klb" May 29 14:47:24.630319 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.630196 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6d6f8cb0-b33a-4a5b-b425-11e50099726f-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-qmlnt\" (UID: \"6d6f8cb0-b33a-4a5b-b425-11e50099726f\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-qmlnt" May 29 14:47:24.630413 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:47:24.630358 2564 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found May 29 14:47:24.630467 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:47:24.630437 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d6f8cb0-b33a-4a5b-b425-11e50099726f-monitoring-plugin-cert podName:6d6f8cb0-b33a-4a5b-b425-11e50099726f nodeName:}" failed. No retries permitted until 2026-05-29 14:47:25.130416705 +0000 UTC m=+65.987528640 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/6d6f8cb0-b33a-4a5b-b425-11e50099726f-monitoring-plugin-cert") pod "monitoring-plugin-5768fcc9dd-qmlnt" (UID: "6d6f8cb0-b33a-4a5b-b425-11e50099726f") : secret "monitoring-plugin-cert" not found May 29 14:47:24.647631 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.647597 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-645dc96fd6-dlm2w" May 29 14:47:24.731070 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.731037 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc54c7ba-1311-4e74-b98d-da5d167af814-trusted-ca-bundle\") pod \"console-7d67f6f97-49klb\" (UID: \"dc54c7ba-1311-4e74-b98d-da5d167af814\") " pod="openshift-console/console-7d67f6f97-49klb" May 29 14:47:24.731230 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.731107 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc54c7ba-1311-4e74-b98d-da5d167af814-oauth-serving-cert\") pod \"console-7d67f6f97-49klb\" (UID: \"dc54c7ba-1311-4e74-b98d-da5d167af814\") " pod="openshift-console/console-7d67f6f97-49klb" May 29 14:47:24.731230 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.731159 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc54c7ba-1311-4e74-b98d-da5d167af814-console-config\") pod \"console-7d67f6f97-49klb\" (UID: \"dc54c7ba-1311-4e74-b98d-da5d167af814\") " pod="openshift-console/console-7d67f6f97-49klb" May 29 14:47:24.731230 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.731209 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc54c7ba-1311-4e74-b98d-da5d167af814-console-oauth-config\") pod \"console-7d67f6f97-49klb\" (UID: \"dc54c7ba-1311-4e74-b98d-da5d167af814\") " pod="openshift-console/console-7d67f6f97-49klb" May 29 14:47:24.731331 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.731236 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8vnnb\" (UniqueName: \"kubernetes.io/projected/dc54c7ba-1311-4e74-b98d-da5d167af814-kube-api-access-8vnnb\") pod \"console-7d67f6f97-49klb\" (UID: \"dc54c7ba-1311-4e74-b98d-da5d167af814\") " pod="openshift-console/console-7d67f6f97-49klb" May 29 14:47:24.731331 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.731263 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc54c7ba-1311-4e74-b98d-da5d167af814-service-ca\") pod \"console-7d67f6f97-49klb\" (UID: \"dc54c7ba-1311-4e74-b98d-da5d167af814\") " pod="openshift-console/console-7d67f6f97-49klb" May 29 14:47:24.731331 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.731292 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc54c7ba-1311-4e74-b98d-da5d167af814-console-serving-cert\") pod \"console-7d67f6f97-49klb\" (UID: \"dc54c7ba-1311-4e74-b98d-da5d167af814\") " pod="openshift-console/console-7d67f6f97-49klb" May 29 14:47:24.732610 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.732579 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc54c7ba-1311-4e74-b98d-da5d167af814-service-ca\") pod \"console-7d67f6f97-49klb\" (UID: \"dc54c7ba-1311-4e74-b98d-da5d167af814\") " pod="openshift-console/console-7d67f6f97-49klb" May 29 14:47:24.732791 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.732770 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc54c7ba-1311-4e74-b98d-da5d167af814-console-config\") pod \"console-7d67f6f97-49klb\" (UID: \"dc54c7ba-1311-4e74-b98d-da5d167af814\") " pod="openshift-console/console-7d67f6f97-49klb" May 29 14:47:24.733645 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.733618 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc54c7ba-1311-4e74-b98d-da5d167af814-trusted-ca-bundle\") pod \"console-7d67f6f97-49klb\" (UID: \"dc54c7ba-1311-4e74-b98d-da5d167af814\") " pod="openshift-console/console-7d67f6f97-49klb" May 29 14:47:24.733824 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.733803 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc54c7ba-1311-4e74-b98d-da5d167af814-oauth-serving-cert\") pod \"console-7d67f6f97-49klb\" (UID: \"dc54c7ba-1311-4e74-b98d-da5d167af814\") " pod="openshift-console/console-7d67f6f97-49klb" May 29 14:47:24.734796 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.734774 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc54c7ba-1311-4e74-b98d-da5d167af814-console-serving-cert\") pod \"console-7d67f6f97-49klb\" (UID: \"dc54c7ba-1311-4e74-b98d-da5d167af814\") " pod="openshift-console/console-7d67f6f97-49klb" May 29 14:47:24.735029 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.735006 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc54c7ba-1311-4e74-b98d-da5d167af814-console-oauth-config\") pod \"console-7d67f6f97-49klb\" (UID: \"dc54c7ba-1311-4e74-b98d-da5d167af814\") " pod="openshift-console/console-7d67f6f97-49klb" May 29 14:47:24.747267 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.747239 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vnnb\" (UniqueName: \"kubernetes.io/projected/dc54c7ba-1311-4e74-b98d-da5d167af814-kube-api-access-8vnnb\") pod \"console-7d67f6f97-49klb\" (UID: \"dc54c7ba-1311-4e74-b98d-da5d167af814\") " pod="openshift-console/console-7d67f6f97-49klb" May 29 14:47:24.802484 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.802459 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-645dc96fd6-dlm2w"] May 29 14:47:24.821356 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.821318 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d67f6f97-49klb" May 29 14:47:24.953454 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:47:24.953373 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88b389ca_5723_41ad_8b55_c74c2d12dcd3.slice/crio-d6cd7d22403b89a47448dff461aab5a169b750d6fdd33a813e51c0c611ccbe1b WatchSource:0}: Error finding container d6cd7d22403b89a47448dff461aab5a169b750d6fdd33a813e51c0c611ccbe1b: Status 404 returned error can't find the container with id d6cd7d22403b89a47448dff461aab5a169b750d6fdd33a813e51c0c611ccbe1b May 29 14:47:24.973498 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:24.973467 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-645dc96fd6-dlm2w" event={"ID":"88b389ca-5723-41ad-8b55-c74c2d12dcd3","Type":"ContainerStarted","Data":"d6cd7d22403b89a47448dff461aab5a169b750d6fdd33a813e51c0c611ccbe1b"} May 29 14:47:25.120413 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:25.120381 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d67f6f97-49klb"] May 29 14:47:25.123402 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:47:25.123379 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc54c7ba_1311_4e74_b98d_da5d167af814.slice/crio-0ea12726ca373fd2e9d7fc0e36c05993380737ef7211dd184048dd302a91e770 WatchSource:0}: Error finding container 0ea12726ca373fd2e9d7fc0e36c05993380737ef7211dd184048dd302a91e770: Status 404 returned error can't find the container with id 0ea12726ca373fd2e9d7fc0e36c05993380737ef7211dd184048dd302a91e770 May 29 14:47:25.138469 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:25.138433 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6d6f8cb0-b33a-4a5b-b425-11e50099726f-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-qmlnt\" (UID: \"6d6f8cb0-b33a-4a5b-b425-11e50099726f\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-qmlnt" May 29 14:47:25.140934 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:25.140912 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6d6f8cb0-b33a-4a5b-b425-11e50099726f-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-qmlnt\" (UID: \"6d6f8cb0-b33a-4a5b-b425-11e50099726f\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-qmlnt" May 29 14:47:25.339788 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:25.339692 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99dadb15-c9da-4773-b522-fc61ba649a8f-metrics-certs\") pod \"network-metrics-daemon-pkxjk\" (UID: \"99dadb15-c9da-4773-b522-fc61ba649a8f\") " pod="openshift-multus/network-metrics-daemon-pkxjk" May 29 14:47:25.342031 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:25.342012 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 29 14:47:25.352776 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:25.352756 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99dadb15-c9da-4773-b522-fc61ba649a8f-metrics-certs\") pod \"network-metrics-daemon-pkxjk\" (UID: \"99dadb15-c9da-4773-b522-fc61ba649a8f\") " pod="openshift-multus/network-metrics-daemon-pkxjk" May 29 14:47:25.401470 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:25.401341 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-qmlnt" May 29 14:47:25.440235 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:25.440204 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vrggq\" (UniqueName: \"kubernetes.io/projected/1e83cba4-a631-4284-be4b-0b2beed9fd46-kube-api-access-vrggq\") pod \"network-check-target-946gb\" (UID: \"1e83cba4-a631-4284-be4b-0b2beed9fd46\") " pod="openshift-network-diagnostics/network-check-target-946gb" May 29 14:47:25.442609 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:25.442580 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 29 14:47:25.445678 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:25.445641 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5975fb4c78-pgn48" May 29 14:47:25.453021 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:25.452998 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 29 14:47:25.463698 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:25.463643 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrggq\" (UniqueName: \"kubernetes.io/projected/1e83cba4-a631-4284-be4b-0b2beed9fd46-kube-api-access-vrggq\") pod \"network-check-target-946gb\" (UID: \"1e83cba4-a631-4284-be4b-0b2beed9fd46\") " pod="openshift-network-diagnostics/network-check-target-946gb" May 29 14:47:25.466517 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:25.466494 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rmpcn\"" May 29 14:47:25.474817 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:25.474797 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pkxjk" May 29 14:47:25.762592 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:25.762557 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hdq67\"" May 29 14:47:25.771974 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:25.771943 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-946gb" May 29 14:47:25.985644 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:25.985564 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d67f6f97-49klb" event={"ID":"dc54c7ba-1311-4e74-b98d-da5d167af814","Type":"ContainerStarted","Data":"7d6dd483bedaea6ac292e881d14deb001ffc78ef10db3890489d05cd1e73c22d"} May 29 14:47:25.985644 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:25.985608 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d67f6f97-49klb" event={"ID":"dc54c7ba-1311-4e74-b98d-da5d167af814","Type":"ContainerStarted","Data":"0ea12726ca373fd2e9d7fc0e36c05993380737ef7211dd184048dd302a91e770"} May 29 14:47:25.990024 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:25.989996 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f0cf30a-046c-43a1-af24-afa473342b19","Type":"ContainerStarted","Data":"62756c03cebd305c0ce3e9fdf1a5e072ebcee09452213e1b0088284226a92366"} May 29 14:47:25.990202 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:25.990030 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f0cf30a-046c-43a1-af24-afa473342b19","Type":"ContainerStarted","Data":"0d3e98678f47f9803971cdc0478376b051bca9a6a076e825d86aa46bcfc334a3"} May 29 14:47:25.990202 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:25.990047 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f0cf30a-046c-43a1-af24-afa473342b19","Type":"ContainerStarted","Data":"6447a357c53d7bf5a93579d901876c84db25d4396cb2c2f49316d52808ecf824"} May 29 14:47:26.009335 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.008220 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7d67f6f97-49klb" podStartSLOduration=2.008197383 podStartE2EDuration="2.008197383s" podCreationTimestamp="2026-05-29 14:47:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 14:47:26.006752976 +0000 UTC m=+66.863864926" watchObservedRunningTime="2026-05-29 14:47:26.008197383 +0000 UTC m=+66.865309332" May 29 14:47:26.089530 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.089453 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 14:47:26.107933 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.107887 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.116423 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.116395 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 14:47:26.116902 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.116874 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 29 14:47:26.117029 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.117007 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-ggmhl\"" May 29 14:47:26.117126 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.117110 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 29 14:47:26.117308 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.117288 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 29 14:47:26.117392 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.117340 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bl2br979s08k6\"" May 29 14:47:26.117392 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.117115 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 29 14:47:26.117392 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.117199 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 29 14:47:26.117938 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.117922 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 29 14:47:26.118146 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.118118 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 29 14:47:26.118319 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.118299 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 29 14:47:26.123597 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.119948 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 29 14:47:26.123597 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.120270 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 29 14:47:26.123597 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.121103 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 29 14:47:26.126616 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.126583 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 29 14:47:26.148556 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.147759 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.148556 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.147821 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.148556 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.147847 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.148556 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.147877 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92994076-f22b-4e9c-89b9-0610ddd5a804-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.148556 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.147908 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92994076-f22b-4e9c-89b9-0610ddd5a804-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.148556 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.147941 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92994076-f22b-4e9c-89b9-0610ddd5a804-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.148556 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.147980 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.148556 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.148003 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92994076-f22b-4e9c-89b9-0610ddd5a804-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.148556 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.148029 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-config\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.148556 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.148051 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/92994076-f22b-4e9c-89b9-0610ddd5a804-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.148556 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.148088 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.148556 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.148118 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/92994076-f22b-4e9c-89b9-0610ddd5a804-config-out\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.148556 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.148165 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.148556 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.148221 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.148556 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.148255 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/92994076-f22b-4e9c-89b9-0610ddd5a804-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.148556 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.148279 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m58d\" (UniqueName: \"kubernetes.io/projected/92994076-f22b-4e9c-89b9-0610ddd5a804-kube-api-access-5m58d\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.149447 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.148315 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/92994076-f22b-4e9c-89b9-0610ddd5a804-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.149447 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.148337 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-web-config\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.249611 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.249568 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.249611 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.249616 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92994076-f22b-4e9c-89b9-0610ddd5a804-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.249839 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.249763 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-config\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.249839 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.249803 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/92994076-f22b-4e9c-89b9-0610ddd5a804-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.253122 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.250002 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.253122 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.250054 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/92994076-f22b-4e9c-89b9-0610ddd5a804-config-out\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.253122 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.250108 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.253122 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.250135 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.253122 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.250160 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/92994076-f22b-4e9c-89b9-0610ddd5a804-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.253122 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.250195 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/92994076-f22b-4e9c-89b9-0610ddd5a804-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.253122 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.250251 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5m58d\" (UniqueName: \"kubernetes.io/projected/92994076-f22b-4e9c-89b9-0610ddd5a804-kube-api-access-5m58d\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.253122 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.250288 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/92994076-f22b-4e9c-89b9-0610ddd5a804-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.253122 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.250311 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-web-config\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.253122 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.250360 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.253122 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.250404 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.253122 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.250433 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.253122 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.250448 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92994076-f22b-4e9c-89b9-0610ddd5a804-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.253122 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.250463 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92994076-f22b-4e9c-89b9-0610ddd5a804-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.253122 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.250518 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92994076-f22b-4e9c-89b9-0610ddd5a804-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.253122 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.250553 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92994076-f22b-4e9c-89b9-0610ddd5a804-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.253122 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.251579 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92994076-f22b-4e9c-89b9-0610ddd5a804-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.255783 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.251695 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92994076-f22b-4e9c-89b9-0610ddd5a804-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.255783 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.251935 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92994076-f22b-4e9c-89b9-0610ddd5a804-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.255783 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.253218 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-config\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.255783 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.254645 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.255783 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.255501 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/92994076-f22b-4e9c-89b9-0610ddd5a804-config-out\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.257710 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.256868 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/92994076-f22b-4e9c-89b9-0610ddd5a804-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.257710 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.256929 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.257710 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.256942 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-web-config\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.257710 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.256957 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.257710 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.257281 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.257710 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.257667 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.258069 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.257878 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.258640 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.258597 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.259095 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.259075 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/92994076-f22b-4e9c-89b9-0610ddd5a804-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.259758 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.259730 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m58d\" (UniqueName: \"kubernetes.io/projected/92994076-f22b-4e9c-89b9-0610ddd5a804-kube-api-access-5m58d\") pod \"prometheus-k8s-0\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.430253 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.429718 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:26.812359 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.812330 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pkxjk"] May 29 14:47:26.816712 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:47:26.816662 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99dadb15_c9da_4773_b522_fc61ba649a8f.slice/crio-60973cfbf942d1e75c3fdbdde883812c647696e04a81197baccce17a3ea6355e WatchSource:0}: Error finding container 60973cfbf942d1e75c3fdbdde883812c647696e04a81197baccce17a3ea6355e: Status 404 returned error can't find the container with id 60973cfbf942d1e75c3fdbdde883812c647696e04a81197baccce17a3ea6355e May 29 14:47:26.994526 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.994491 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-645dc96fd6-dlm2w" event={"ID":"88b389ca-5723-41ad-8b55-c74c2d12dcd3","Type":"ContainerStarted","Data":"c8503840876672a54e44f57085c77dad9f17d692a495c32771b421c869b02ec9"} May 29 14:47:26.997227 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.997197 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f0cf30a-046c-43a1-af24-afa473342b19","Type":"ContainerStarted","Data":"15d5c3f4c308f70b7f85a032d4bfc2351fe7e4b4de0663d26a6b17ae445968d1"} May 29 14:47:26.997357 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:26.997232 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f0cf30a-046c-43a1-af24-afa473342b19","Type":"ContainerStarted","Data":"8dacddea86c833c16e98f6ab6306a57f572644e8bed6e8aa073e8a28868ecf32"} May 29 14:47:27.001659 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:27.001629 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-689c79bcff-gmzwt" event={"ID":"d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae","Type":"ContainerStarted","Data":"caba6417d504888af9fee18c65a804314cdd908f6fc17278f003cf5cd21dce21"} May 29 14:47:27.001792 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:27.001665 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-689c79bcff-gmzwt" event={"ID":"d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae","Type":"ContainerStarted","Data":"4cf8a722b769e0b36783c9cc06e87be3351662458f66fc0519c4d4460020ee21"} May 29 14:47:27.001792 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:27.001680 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-689c79bcff-gmzwt" event={"ID":"d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae","Type":"ContainerStarted","Data":"14f493b2b26b4231eb97d0daf9544c50fa2d17e3cc14273b3a18b196f512c7ce"} May 29 14:47:27.003005 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:27.002984 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pkxjk" event={"ID":"99dadb15-c9da-4773-b522-fc61ba649a8f","Type":"ContainerStarted","Data":"60973cfbf942d1e75c3fdbdde883812c647696e04a81197baccce17a3ea6355e"} May 29 14:47:27.016884 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:27.016827 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-645dc96fd6-dlm2w" podStartSLOduration=1.387288604 podStartE2EDuration="3.016806365s" podCreationTimestamp="2026-05-29 14:47:24 +0000 UTC" firstStartedPulling="2026-05-29 14:47:24.974228338 +0000 UTC m=+65.831340263" lastFinishedPulling="2026-05-29 14:47:26.603746092 +0000 UTC m=+67.460858024" observedRunningTime="2026-05-29 14:47:27.015157225 +0000 UTC m=+67.872269171" watchObservedRunningTime="2026-05-29 14:47:27.016806365 +0000 UTC m=+67.873918315" May 29 14:47:27.041108 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:27.041077 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-qmlnt"] May 29 14:47:27.043906 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:27.043873 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-946gb"] May 29 14:47:27.044812 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:47:27.044780 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d6f8cb0_b33a_4a5b_b425_11e50099726f.slice/crio-4bbc322734ecfb66de20d6014c6c7d9d905b563fdbda0570f5ba0f6e35b4a266 WatchSource:0}: Error finding container 4bbc322734ecfb66de20d6014c6c7d9d905b563fdbda0570f5ba0f6e35b4a266: Status 404 returned error can't find the container with id 4bbc322734ecfb66de20d6014c6c7d9d905b563fdbda0570f5ba0f6e35b4a266 May 29 14:47:27.046709 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:47:27.046681 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e83cba4_a631_4284_be4b_0b2beed9fd46.slice/crio-7212efcd329be7e560d2eaeb7df89261219041ebf1fafff4760568077141d50c WatchSource:0}: Error finding container 7212efcd329be7e560d2eaeb7df89261219041ebf1fafff4760568077141d50c: Status 404 returned error can't find the container with id 7212efcd329be7e560d2eaeb7df89261219041ebf1fafff4760568077141d50c May 29 14:47:27.056810 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:27.056782 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 14:47:27.059876 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:47:27.059851 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92994076_f22b_4e9c_89b9_0610ddd5a804.slice/crio-d1fc31f09f39ff65c45e2947ea59b3055a98e0e25bd33d6034da87f892c9feb1 WatchSource:0}: Error finding container d1fc31f09f39ff65c45e2947ea59b3055a98e0e25bd33d6034da87f892c9feb1: Status 404 returned error can't find the container with id d1fc31f09f39ff65c45e2947ea59b3055a98e0e25bd33d6034da87f892c9feb1 May 29 14:47:28.008762 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:28.008724 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-qmlnt" event={"ID":"6d6f8cb0-b33a-4a5b-b425-11e50099726f","Type":"ContainerStarted","Data":"4bbc322734ecfb66de20d6014c6c7d9d905b563fdbda0570f5ba0f6e35b4a266"} May 29 14:47:28.010382 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:28.010351 2564 generic.go:358] "Generic (PLEG): container finished" podID="92994076-f22b-4e9c-89b9-0610ddd5a804" containerID="7e63bdb3df8d713527287ae35fc1e6987ee46258854963585eabd51a8ba41a9c" exitCode=0 May 29 14:47:28.010505 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:28.010428 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92994076-f22b-4e9c-89b9-0610ddd5a804","Type":"ContainerDied","Data":"7e63bdb3df8d713527287ae35fc1e6987ee46258854963585eabd51a8ba41a9c"} May 29 14:47:28.010505 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:28.010456 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92994076-f22b-4e9c-89b9-0610ddd5a804","Type":"ContainerStarted","Data":"d1fc31f09f39ff65c45e2947ea59b3055a98e0e25bd33d6034da87f892c9feb1"} May 29 14:47:28.011933 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:28.011609 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-946gb" event={"ID":"1e83cba4-a631-4284-be4b-0b2beed9fd46","Type":"ContainerStarted","Data":"7212efcd329be7e560d2eaeb7df89261219041ebf1fafff4760568077141d50c"} May 29 14:47:29.016679 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:29.016642 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pkxjk" event={"ID":"99dadb15-c9da-4773-b522-fc61ba649a8f","Type":"ContainerStarted","Data":"d77ca1319d95e4ad97c61b4f9e73153d57cc60b17eb629192cd8d7e3fee9335a"} May 29 14:47:29.017109 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:29.016686 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pkxjk" event={"ID":"99dadb15-c9da-4773-b522-fc61ba649a8f","Type":"ContainerStarted","Data":"084a1adebd2484b47e11ad28fd8cd95474c597f7a8d8c963363d73edde07cc76"} May 29 14:47:29.017975 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:29.017945 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-qmlnt" event={"ID":"6d6f8cb0-b33a-4a5b-b425-11e50099726f","Type":"ContainerStarted","Data":"a6eab12941ce213f556411a66ab68ca4abf75221df6a7adfd3deb799e4271523"} May 29 14:47:29.022256 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:29.019041 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-qmlnt" May 29 14:47:29.025588 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:29.025563 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f0cf30a-046c-43a1-af24-afa473342b19","Type":"ContainerStarted","Data":"1951aedabad499d3b8feaf66b8bc446df53ef1d890a01317371054d2a6913762"} May 29 14:47:29.026555 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:29.026497 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-qmlnt" May 29 14:47:29.028396 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:29.028371 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-689c79bcff-gmzwt" event={"ID":"d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae","Type":"ContainerStarted","Data":"ef7085bffd3c1b010eaf7ede653b79e84a1bbdee6c7dc8939e9cbe48ed1a6792"} May 29 14:47:29.028396 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:29.028405 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-689c79bcff-gmzwt" event={"ID":"d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae","Type":"ContainerStarted","Data":"4a29e62a47a233efcfc4623cde60333b02cca7087e9bfc1f5b709f41f13d2b6a"} May 29 14:47:29.028531 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:29.028418 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-689c79bcff-gmzwt" event={"ID":"d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae","Type":"ContainerStarted","Data":"8357fbcc47109db38c57fe9741bd2372d7bc6c362e7825c2ab9fbea637fc8a72"} May 29 14:47:29.028612 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:29.028598 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-689c79bcff-gmzwt" May 29 14:47:29.038646 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:29.038606 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-pkxjk" podStartSLOduration=68.723186234 podStartE2EDuration="1m10.038590688s" podCreationTimestamp="2026-05-29 14:46:19 +0000 UTC" firstStartedPulling="2026-05-29 14:47:26.819120904 +0000 UTC m=+67.676232836" lastFinishedPulling="2026-05-29 14:47:28.134525361 +0000 UTC m=+68.991637290" observedRunningTime="2026-05-29 14:47:29.037244829 +0000 UTC m=+69.894356771" watchObservedRunningTime="2026-05-29 14:47:29.038590688 +0000 UTC m=+69.895702636" May 29 14:47:29.059514 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:29.059463 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-qmlnt" podStartSLOduration=3.32825421 podStartE2EDuration="5.059449158s" podCreationTimestamp="2026-05-29 14:47:24 +0000 UTC" firstStartedPulling="2026-05-29 14:47:27.046888065 +0000 UTC m=+67.903999990" lastFinishedPulling="2026-05-29 14:47:28.778082999 +0000 UTC m=+69.635194938" observedRunningTime="2026-05-29 14:47:29.056774887 +0000 UTC m=+69.913886835" watchObservedRunningTime="2026-05-29 14:47:29.059449158 +0000 UTC m=+69.916561104" May 29 14:47:29.084225 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:29.084152 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-689c79bcff-gmzwt" podStartSLOduration=2.474406389 podStartE2EDuration="7.084134611s" podCreationTimestamp="2026-05-29 14:47:22 +0000 UTC" firstStartedPulling="2026-05-29 14:47:23.526259366 +0000 UTC m=+64.383371291" lastFinishedPulling="2026-05-29 14:47:28.135987577 +0000 UTC m=+68.993099513" observedRunningTime="2026-05-29 14:47:29.083543468 +0000 UTC m=+69.940655420" watchObservedRunningTime="2026-05-29 14:47:29.084134611 +0000 UTC m=+69.941246560" May 29 14:47:29.132155 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:29.132099 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.387072976 podStartE2EDuration="9.132084368s" podCreationTimestamp="2026-05-29 14:47:20 +0000 UTC" firstStartedPulling="2026-05-29 14:47:21.389419344 +0000 UTC m=+62.246531271" lastFinishedPulling="2026-05-29 14:47:28.134430708 +0000 UTC m=+68.991542663" observedRunningTime="2026-05-29 14:47:29.128434962 +0000 UTC m=+69.985546908" watchObservedRunningTime="2026-05-29 14:47:29.132084368 +0000 UTC m=+69.989196314" May 29 14:47:30.209075 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:30.209026 2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-574b4894fc-46ssr" May 29 14:47:30.209647 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:30.209074 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-574b4894fc-46ssr" May 29 14:47:30.214508 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:30.214484 2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-574b4894fc-46ssr" May 29 14:47:31.040012 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:31.039912 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-946gb" event={"ID":"1e83cba4-a631-4284-be4b-0b2beed9fd46","Type":"ContainerStarted","Data":"d2a2acd7a4609759cd0233aeafd9394f07db7092dc1b216173f87a0b4a6e617b"} May 29 14:47:31.040348 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:31.040314 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-946gb" May 29 14:47:31.044883 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:31.044854 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-574b4894fc-46ssr" May 29 14:47:31.059073 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:31.058991 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-946gb" podStartSLOduration=68.349244117 podStartE2EDuration="1m12.058979668s" podCreationTimestamp="2026-05-29 14:46:19 +0000 UTC" firstStartedPulling="2026-05-29 14:47:27.048921194 +0000 UTC m=+67.906033119" lastFinishedPulling="2026-05-29 14:47:30.758656731 +0000 UTC m=+71.615768670" observedRunningTime="2026-05-29 14:47:31.058263419 +0000 UTC m=+71.915375367" watchObservedRunningTime="2026-05-29 14:47:31.058979668 +0000 UTC m=+71.916091615" May 29 14:47:34.054781 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:34.054752 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92994076-f22b-4e9c-89b9-0610ddd5a804","Type":"ContainerStarted","Data":"b43f7f5c3eebe8ab9895db6e2322451fe3160bd2c62a92459009bdcf0e1db933"} May 29 14:47:34.055102 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:34.054790 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92994076-f22b-4e9c-89b9-0610ddd5a804","Type":"ContainerStarted","Data":"6eb733d09b322fcf7d49c24b53c6b4149700adaf5d740158f4537408ebfa9b7c"} May 29 14:47:34.055102 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:34.054803 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92994076-f22b-4e9c-89b9-0610ddd5a804","Type":"ContainerStarted","Data":"5decf24d42650e46c2163c468ef84032a6bf4a3c63c78d1b9e99fd3097cc44ef"} May 29 14:47:34.055102 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:34.054815 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92994076-f22b-4e9c-89b9-0610ddd5a804","Type":"ContainerStarted","Data":"a7a1d523bcfa3b1d3251ea553bd19b1a828faaa7b9ebab841f04f971be32f6d7"} May 29 14:47:34.055102 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:34.054828 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92994076-f22b-4e9c-89b9-0610ddd5a804","Type":"ContainerStarted","Data":"8ff7ed2e8bbffe4097795cfe7ca52cf03a257c47628f0fb57c1fb346e3ba93bb"} May 29 14:47:34.822110 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:34.822073 2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d67f6f97-49klb" May 29 14:47:34.822350 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:34.822225 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d67f6f97-49klb" May 29 14:47:34.826736 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:34.826712 2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d67f6f97-49klb" May 29 14:47:35.039508 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:35.039482 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-689c79bcff-gmzwt" May 29 14:47:35.061393 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:35.061356 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92994076-f22b-4e9c-89b9-0610ddd5a804","Type":"ContainerStarted","Data":"b05b553a59f732ff555805688a4c93c7edd272710f59c8f8b7a6a47072f9d904"} May 29 14:47:35.066272 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:35.066244 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d67f6f97-49klb" May 29 14:47:35.099344 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:35.099217 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.43863363 podStartE2EDuration="9.099167281s" podCreationTimestamp="2026-05-29 14:47:26 +0000 UTC" firstStartedPulling="2026-05-29 14:47:28.012279445 +0000 UTC m=+68.869391389" lastFinishedPulling="2026-05-29 14:47:33.672813076 +0000 UTC m=+74.529925040" observedRunningTime="2026-05-29 14:47:35.097577213 +0000 UTC m=+75.954689154" watchObservedRunningTime="2026-05-29 14:47:35.099167281 +0000 UTC m=+75.956279229" May 29 14:47:35.153905 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:35.153877 2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-574b4894fc-46ssr"] May 29 14:47:36.430482 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:36.430437 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 29 14:47:44.647750 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:44.647708 2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-645dc96fd6-dlm2w" May 29 14:47:44.647750 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:44.647751 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-645dc96fd6-dlm2w" May 29 14:47:49.472878 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:49.472829 2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5975fb4c78-pgn48" podUID="69eace9a-f87a-4bf3-bca2-8fd675d84167" containerName="console" containerID="cri-o://c6d788acff8013665a784c871de8dc26b1b65ce8972ae628281bd587cedfe6da" gracePeriod=15 May 29 14:47:49.729351 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:49.729293 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5975fb4c78-pgn48_69eace9a-f87a-4bf3-bca2-8fd675d84167/console/0.log" May 29 14:47:49.729449 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:49.729389 2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5975fb4c78-pgn48" May 29 14:47:49.881464 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:49.881424 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2h2l2\" (UniqueName: \"kubernetes.io/projected/69eace9a-f87a-4bf3-bca2-8fd675d84167-kube-api-access-2h2l2\") pod \"69eace9a-f87a-4bf3-bca2-8fd675d84167\" (UID: \"69eace9a-f87a-4bf3-bca2-8fd675d84167\") " May 29 14:47:49.881656 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:49.881492 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69eace9a-f87a-4bf3-bca2-8fd675d84167-console-serving-cert\") pod \"69eace9a-f87a-4bf3-bca2-8fd675d84167\" (UID: \"69eace9a-f87a-4bf3-bca2-8fd675d84167\") " May 29 14:47:49.881656 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:49.881509 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69eace9a-f87a-4bf3-bca2-8fd675d84167-console-oauth-config\") pod \"69eace9a-f87a-4bf3-bca2-8fd675d84167\" (UID: \"69eace9a-f87a-4bf3-bca2-8fd675d84167\") " May 29 14:47:49.881656 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:49.881530 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69eace9a-f87a-4bf3-bca2-8fd675d84167-oauth-serving-cert\") pod \"69eace9a-f87a-4bf3-bca2-8fd675d84167\" (UID: \"69eace9a-f87a-4bf3-bca2-8fd675d84167\") " May 29 14:47:49.881656 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:49.881563 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69eace9a-f87a-4bf3-bca2-8fd675d84167-console-config\") pod \"69eace9a-f87a-4bf3-bca2-8fd675d84167\" (UID: \"69eace9a-f87a-4bf3-bca2-8fd675d84167\") " May 29 14:47:49.881656 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:49.881585 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69eace9a-f87a-4bf3-bca2-8fd675d84167-service-ca\") pod \"69eace9a-f87a-4bf3-bca2-8fd675d84167\" (UID: \"69eace9a-f87a-4bf3-bca2-8fd675d84167\") " May 29 14:47:49.882062 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:49.882028 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69eace9a-f87a-4bf3-bca2-8fd675d84167-console-config" (OuterVolumeSpecName: "console-config") pod "69eace9a-f87a-4bf3-bca2-8fd675d84167" (UID: "69eace9a-f87a-4bf3-bca2-8fd675d84167"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 14:47:49.882153 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:49.882047 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69eace9a-f87a-4bf3-bca2-8fd675d84167-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "69eace9a-f87a-4bf3-bca2-8fd675d84167" (UID: "69eace9a-f87a-4bf3-bca2-8fd675d84167"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 14:47:49.882153 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:49.882060 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69eace9a-f87a-4bf3-bca2-8fd675d84167-service-ca" (OuterVolumeSpecName: "service-ca") pod "69eace9a-f87a-4bf3-bca2-8fd675d84167" (UID: "69eace9a-f87a-4bf3-bca2-8fd675d84167"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 14:47:49.883924 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:49.883895 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69eace9a-f87a-4bf3-bca2-8fd675d84167-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "69eace9a-f87a-4bf3-bca2-8fd675d84167" (UID: "69eace9a-f87a-4bf3-bca2-8fd675d84167"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 14:47:49.884017 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:49.883942 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69eace9a-f87a-4bf3-bca2-8fd675d84167-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "69eace9a-f87a-4bf3-bca2-8fd675d84167" (UID: "69eace9a-f87a-4bf3-bca2-8fd675d84167"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 14:47:49.884017 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:49.883948 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69eace9a-f87a-4bf3-bca2-8fd675d84167-kube-api-access-2h2l2" (OuterVolumeSpecName: "kube-api-access-2h2l2") pod "69eace9a-f87a-4bf3-bca2-8fd675d84167" (UID: "69eace9a-f87a-4bf3-bca2-8fd675d84167"). InnerVolumeSpecName "kube-api-access-2h2l2". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 14:47:49.983211 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:49.983115 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2h2l2\" (UniqueName: \"kubernetes.io/projected/69eace9a-f87a-4bf3-bca2-8fd675d84167-kube-api-access-2h2l2\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:47:49.983211 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:49.983143 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69eace9a-f87a-4bf3-bca2-8fd675d84167-console-serving-cert\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:47:49.983211 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:49.983153 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69eace9a-f87a-4bf3-bca2-8fd675d84167-console-oauth-config\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:47:49.983211 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:49.983162 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69eace9a-f87a-4bf3-bca2-8fd675d84167-oauth-serving-cert\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:47:49.983211 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:49.983194 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69eace9a-f87a-4bf3-bca2-8fd675d84167-console-config\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:47:49.983211 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:49.983204 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69eace9a-f87a-4bf3-bca2-8fd675d84167-service-ca\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:47:50.111091 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:50.111067 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5975fb4c78-pgn48_69eace9a-f87a-4bf3-bca2-8fd675d84167/console/0.log" May 29 14:47:50.111260 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:50.111104 2564 generic.go:358] "Generic (PLEG): container finished" podID="69eace9a-f87a-4bf3-bca2-8fd675d84167" containerID="c6d788acff8013665a784c871de8dc26b1b65ce8972ae628281bd587cedfe6da" exitCode=2 May 29 14:47:50.111260 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:50.111140 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5975fb4c78-pgn48" event={"ID":"69eace9a-f87a-4bf3-bca2-8fd675d84167","Type":"ContainerDied","Data":"c6d788acff8013665a784c871de8dc26b1b65ce8972ae628281bd587cedfe6da"} May 29 14:47:50.111260 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:50.111200 2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5975fb4c78-pgn48" May 29 14:47:50.111260 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:50.111211 2564 scope.go:117] "RemoveContainer" containerID="c6d788acff8013665a784c871de8dc26b1b65ce8972ae628281bd587cedfe6da" May 29 14:47:50.111411 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:50.111201 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5975fb4c78-pgn48" event={"ID":"69eace9a-f87a-4bf3-bca2-8fd675d84167","Type":"ContainerDied","Data":"75ccb7b4383aaf77d93f02a192a2392cbacbe206cc888a7fcc47872522f2282c"} May 29 14:47:50.121108 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:50.120342 2564 scope.go:117] "RemoveContainer" containerID="c6d788acff8013665a784c871de8dc26b1b65ce8972ae628281bd587cedfe6da" May 29 14:47:50.121108 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:47:50.120655 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6d788acff8013665a784c871de8dc26b1b65ce8972ae628281bd587cedfe6da\": container with ID starting with c6d788acff8013665a784c871de8dc26b1b65ce8972ae628281bd587cedfe6da not found: ID does not exist" containerID="c6d788acff8013665a784c871de8dc26b1b65ce8972ae628281bd587cedfe6da" May 29 14:47:50.121108 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:50.120685 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6d788acff8013665a784c871de8dc26b1b65ce8972ae628281bd587cedfe6da"} err="failed to get container status \"c6d788acff8013665a784c871de8dc26b1b65ce8972ae628281bd587cedfe6da\": rpc error: code = NotFound desc = could not find container \"c6d788acff8013665a784c871de8dc26b1b65ce8972ae628281bd587cedfe6da\": container with ID starting with c6d788acff8013665a784c871de8dc26b1b65ce8972ae628281bd587cedfe6da not found: ID does not exist" May 29 14:47:50.131845 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:50.131821 2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5975fb4c78-pgn48"] May 29 14:47:50.135788 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:50.135764 2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5975fb4c78-pgn48"] May 29 14:47:51.655407 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:47:51.655376 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69eace9a-f87a-4bf3-bca2-8fd675d84167" path="/var/lib/kubelet/pods/69eace9a-f87a-4bf3-bca2-8fd675d84167/volumes" May 29 14:48:00.174451 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:00.174388 2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-574b4894fc-46ssr" podUID="58a9de72-d19a-4f67-9e24-936ca7f340aa" containerName="console" containerID="cri-o://f09fda99338d04d9a04f3fb1b7ab84be66d5d05dd0efd4c1ab2c1e8f2e28c97b" gracePeriod=15 May 29 14:48:00.434092 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:00.434034 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-574b4894fc-46ssr_58a9de72-d19a-4f67-9e24-936ca7f340aa/console/0.log" May 29 14:48:00.434242 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:00.434105 2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-574b4894fc-46ssr" May 29 14:48:00.467980 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:00.467946 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58a9de72-d19a-4f67-9e24-936ca7f340aa-console-config\") pod \"58a9de72-d19a-4f67-9e24-936ca7f340aa\" (UID: \"58a9de72-d19a-4f67-9e24-936ca7f340aa\") " May 29 14:48:00.468150 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:00.468000 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58a9de72-d19a-4f67-9e24-936ca7f340aa-oauth-serving-cert\") pod \"58a9de72-d19a-4f67-9e24-936ca7f340aa\" (UID: \"58a9de72-d19a-4f67-9e24-936ca7f340aa\") " May 29 14:48:00.468150 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:00.468089 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4ch2\" (UniqueName: \"kubernetes.io/projected/58a9de72-d19a-4f67-9e24-936ca7f340aa-kube-api-access-g4ch2\") pod \"58a9de72-d19a-4f67-9e24-936ca7f340aa\" (UID: \"58a9de72-d19a-4f67-9e24-936ca7f340aa\") " May 29 14:48:00.468150 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:00.468120 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58a9de72-d19a-4f67-9e24-936ca7f340aa-console-serving-cert\") pod \"58a9de72-d19a-4f67-9e24-936ca7f340aa\" (UID: \"58a9de72-d19a-4f67-9e24-936ca7f340aa\") " May 29 14:48:00.468150 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:00.468147 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58a9de72-d19a-4f67-9e24-936ca7f340aa-console-oauth-config\") pod \"58a9de72-d19a-4f67-9e24-936ca7f340aa\" (UID: \"58a9de72-d19a-4f67-9e24-936ca7f340aa\") " May 29 14:48:00.468426 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:00.468204 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58a9de72-d19a-4f67-9e24-936ca7f340aa-service-ca\") pod \"58a9de72-d19a-4f67-9e24-936ca7f340aa\" (UID: \"58a9de72-d19a-4f67-9e24-936ca7f340aa\") " May 29 14:48:00.468426 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:00.468253 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58a9de72-d19a-4f67-9e24-936ca7f340aa-trusted-ca-bundle\") pod \"58a9de72-d19a-4f67-9e24-936ca7f340aa\" (UID: \"58a9de72-d19a-4f67-9e24-936ca7f340aa\") " May 29 14:48:00.468426 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:00.468334 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58a9de72-d19a-4f67-9e24-936ca7f340aa-console-config" (OuterVolumeSpecName: "console-config") pod "58a9de72-d19a-4f67-9e24-936ca7f340aa" (UID: "58a9de72-d19a-4f67-9e24-936ca7f340aa"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 14:48:00.468570 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:00.468470 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58a9de72-d19a-4f67-9e24-936ca7f340aa-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "58a9de72-d19a-4f67-9e24-936ca7f340aa" (UID: "58a9de72-d19a-4f67-9e24-936ca7f340aa"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 14:48:00.468628 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:00.468563 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58a9de72-d19a-4f67-9e24-936ca7f340aa-console-config\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:48:00.468628 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:00.468585 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58a9de72-d19a-4f67-9e24-936ca7f340aa-oauth-serving-cert\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:48:00.468830 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:00.468803 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58a9de72-d19a-4f67-9e24-936ca7f340aa-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "58a9de72-d19a-4f67-9e24-936ca7f340aa" (UID: "58a9de72-d19a-4f67-9e24-936ca7f340aa"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 14:48:00.468992 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:00.468898 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58a9de72-d19a-4f67-9e24-936ca7f340aa-service-ca" (OuterVolumeSpecName: "service-ca") pod "58a9de72-d19a-4f67-9e24-936ca7f340aa" (UID: "58a9de72-d19a-4f67-9e24-936ca7f340aa"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 14:48:00.470390 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:00.470362 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58a9de72-d19a-4f67-9e24-936ca7f340aa-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "58a9de72-d19a-4f67-9e24-936ca7f340aa" (UID: "58a9de72-d19a-4f67-9e24-936ca7f340aa"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 14:48:00.470961 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:00.470939 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58a9de72-d19a-4f67-9e24-936ca7f340aa-kube-api-access-g4ch2" (OuterVolumeSpecName: "kube-api-access-g4ch2") pod "58a9de72-d19a-4f67-9e24-936ca7f340aa" (UID: "58a9de72-d19a-4f67-9e24-936ca7f340aa"). InnerVolumeSpecName "kube-api-access-g4ch2". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 14:48:00.471036 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:00.470962 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58a9de72-d19a-4f67-9e24-936ca7f340aa-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "58a9de72-d19a-4f67-9e24-936ca7f340aa" (UID: "58a9de72-d19a-4f67-9e24-936ca7f340aa"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 14:48:00.569517 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:00.569481 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4ch2\" (UniqueName: \"kubernetes.io/projected/58a9de72-d19a-4f67-9e24-936ca7f340aa-kube-api-access-g4ch2\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:48:00.569517 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:00.569510 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58a9de72-d19a-4f67-9e24-936ca7f340aa-console-serving-cert\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:48:00.569517 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:00.569522 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58a9de72-d19a-4f67-9e24-936ca7f340aa-console-oauth-config\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:48:00.569746 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:00.569531 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58a9de72-d19a-4f67-9e24-936ca7f340aa-service-ca\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:48:00.569746 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:00.569541 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58a9de72-d19a-4f67-9e24-936ca7f340aa-trusted-ca-bundle\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:48:01.148466 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:01.148438 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-574b4894fc-46ssr_58a9de72-d19a-4f67-9e24-936ca7f340aa/console/0.log" May 29 14:48:01.148664 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:01.148480 2564 generic.go:358] "Generic (PLEG): container finished" podID="58a9de72-d19a-4f67-9e24-936ca7f340aa" containerID="f09fda99338d04d9a04f3fb1b7ab84be66d5d05dd0efd4c1ab2c1e8f2e28c97b" exitCode=2 May 29 14:48:01.148664 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:01.148507 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-574b4894fc-46ssr" event={"ID":"58a9de72-d19a-4f67-9e24-936ca7f340aa","Type":"ContainerDied","Data":"f09fda99338d04d9a04f3fb1b7ab84be66d5d05dd0efd4c1ab2c1e8f2e28c97b"} May 29 14:48:01.148664 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:01.148544 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-574b4894fc-46ssr" event={"ID":"58a9de72-d19a-4f67-9e24-936ca7f340aa","Type":"ContainerDied","Data":"4ad3d36f849c92743ed7cffa0f920f365f8067cccd42278a0d9317421f226674"} May 29 14:48:01.148664 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:01.148559 2564 scope.go:117] "RemoveContainer" containerID="f09fda99338d04d9a04f3fb1b7ab84be66d5d05dd0efd4c1ab2c1e8f2e28c97b" May 29 14:48:01.148664 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:01.148560 2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-574b4894fc-46ssr" May 29 14:48:01.157058 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:01.157039 2564 scope.go:117] "RemoveContainer" containerID="f09fda99338d04d9a04f3fb1b7ab84be66d5d05dd0efd4c1ab2c1e8f2e28c97b" May 29 14:48:01.157362 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:48:01.157344 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f09fda99338d04d9a04f3fb1b7ab84be66d5d05dd0efd4c1ab2c1e8f2e28c97b\": container with ID starting with f09fda99338d04d9a04f3fb1b7ab84be66d5d05dd0efd4c1ab2c1e8f2e28c97b not found: ID does not exist" containerID="f09fda99338d04d9a04f3fb1b7ab84be66d5d05dd0efd4c1ab2c1e8f2e28c97b" May 29 14:48:01.157444 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:01.157369 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f09fda99338d04d9a04f3fb1b7ab84be66d5d05dd0efd4c1ab2c1e8f2e28c97b"} err="failed to get container status \"f09fda99338d04d9a04f3fb1b7ab84be66d5d05dd0efd4c1ab2c1e8f2e28c97b\": rpc error: code = NotFound desc = could not find container \"f09fda99338d04d9a04f3fb1b7ab84be66d5d05dd0efd4c1ab2c1e8f2e28c97b\": container with ID starting with f09fda99338d04d9a04f3fb1b7ab84be66d5d05dd0efd4c1ab2c1e8f2e28c97b not found: ID does not exist" May 29 14:48:01.169722 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:01.169700 2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-574b4894fc-46ssr"] May 29 14:48:01.174531 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:01.174510 2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-574b4894fc-46ssr"] May 29 14:48:01.655828 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:01.655797 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58a9de72-d19a-4f67-9e24-936ca7f340aa" path="/var/lib/kubelet/pods/58a9de72-d19a-4f67-9e24-936ca7f340aa/volumes" May 29 14:48:03.050394 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:03.050360 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-946gb" May 29 14:48:04.653352 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:04.653322 2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-645dc96fd6-dlm2w" May 29 14:48:04.657219 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:04.657192 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-645dc96fd6-dlm2w" May 29 14:48:04.698736 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:04.698688 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-l4zs7_2fc9f29c-e5e7-45cd-b787-491b6f5078f0/serve-healthcheck-canary/0.log" May 29 14:48:26.430526 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:26.430484 2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:26.451228 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:26.451198 2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:27.245958 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:27.245931 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:40.097569 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:40.097521 2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 29 14:48:40.098148 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:40.098013 2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6f0cf30a-046c-43a1-af24-afa473342b19" containerName="alertmanager" containerID="cri-o://6447a357c53d7bf5a93579d901876c84db25d4396cb2c2f49316d52808ecf824" gracePeriod=120 May 29 14:48:40.098148 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:40.098122 2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6f0cf30a-046c-43a1-af24-afa473342b19" containerName="kube-rbac-proxy" containerID="cri-o://8dacddea86c833c16e98f6ab6306a57f572644e8bed6e8aa073e8a28868ecf32" gracePeriod=120 May 29 14:48:40.098380 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:40.098055 2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6f0cf30a-046c-43a1-af24-afa473342b19" containerName="kube-rbac-proxy-metric" containerID="cri-o://15d5c3f4c308f70b7f85a032d4bfc2351fe7e4b4de0663d26a6b17ae445968d1" gracePeriod=120 May 29 14:48:40.098380 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:40.098077 2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6f0cf30a-046c-43a1-af24-afa473342b19" containerName="prom-label-proxy" containerID="cri-o://1951aedabad499d3b8feaf66b8bc446df53ef1d890a01317371054d2a6913762" gracePeriod=120 May 29 14:48:40.098380 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:40.098115 2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6f0cf30a-046c-43a1-af24-afa473342b19" containerName="kube-rbac-proxy-web" containerID="cri-o://62756c03cebd305c0ce3e9fdf1a5e072ebcee09452213e1b0088284226a92366" gracePeriod=120 May 29 14:48:40.098380 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:40.098098 2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6f0cf30a-046c-43a1-af24-afa473342b19" containerName="config-reloader" containerID="cri-o://0d3e98678f47f9803971cdc0478376b051bca9a6a076e825d86aa46bcfc334a3" gracePeriod=120 May 29 14:48:40.268730 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:40.268699 2564 generic.go:358] "Generic (PLEG): container finished" podID="6f0cf30a-046c-43a1-af24-afa473342b19" containerID="1951aedabad499d3b8feaf66b8bc446df53ef1d890a01317371054d2a6913762" exitCode=0 May 29 14:48:40.268730 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:40.268724 2564 generic.go:358] "Generic (PLEG): container finished" podID="6f0cf30a-046c-43a1-af24-afa473342b19" containerID="8dacddea86c833c16e98f6ab6306a57f572644e8bed6e8aa073e8a28868ecf32" exitCode=0 May 29 14:48:40.268730 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:40.268732 2564 generic.go:358] "Generic (PLEG): container finished" podID="6f0cf30a-046c-43a1-af24-afa473342b19" containerID="0d3e98678f47f9803971cdc0478376b051bca9a6a076e825d86aa46bcfc334a3" exitCode=0 May 29 14:48:40.268730 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:40.268739 2564 generic.go:358] "Generic (PLEG): container finished" podID="6f0cf30a-046c-43a1-af24-afa473342b19" containerID="6447a357c53d7bf5a93579d901876c84db25d4396cb2c2f49316d52808ecf824" exitCode=0 May 29 14:48:40.269019 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:40.268766 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f0cf30a-046c-43a1-af24-afa473342b19","Type":"ContainerDied","Data":"1951aedabad499d3b8feaf66b8bc446df53ef1d890a01317371054d2a6913762"} May 29 14:48:40.269019 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:40.268800 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f0cf30a-046c-43a1-af24-afa473342b19","Type":"ContainerDied","Data":"8dacddea86c833c16e98f6ab6306a57f572644e8bed6e8aa073e8a28868ecf32"} May 29 14:48:40.269019 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:40.268810 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f0cf30a-046c-43a1-af24-afa473342b19","Type":"ContainerDied","Data":"0d3e98678f47f9803971cdc0478376b051bca9a6a076e825d86aa46bcfc334a3"} May 29 14:48:40.269019 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:40.268820 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f0cf30a-046c-43a1-af24-afa473342b19","Type":"ContainerDied","Data":"6447a357c53d7bf5a93579d901876c84db25d4396cb2c2f49316d52808ecf824"} May 29 14:48:41.276016 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:41.275986 2564 generic.go:358] "Generic (PLEG): container finished" podID="6f0cf30a-046c-43a1-af24-afa473342b19" containerID="15d5c3f4c308f70b7f85a032d4bfc2351fe7e4b4de0663d26a6b17ae445968d1" exitCode=0 May 29 14:48:41.276016 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:41.276011 2564 generic.go:358] "Generic (PLEG): container finished" podID="6f0cf30a-046c-43a1-af24-afa473342b19" containerID="62756c03cebd305c0ce3e9fdf1a5e072ebcee09452213e1b0088284226a92366" exitCode=0 May 29 14:48:41.276401 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:41.276054 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f0cf30a-046c-43a1-af24-afa473342b19","Type":"ContainerDied","Data":"15d5c3f4c308f70b7f85a032d4bfc2351fe7e4b4de0663d26a6b17ae445968d1"} May 29 14:48:41.276401 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:41.276087 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f0cf30a-046c-43a1-af24-afa473342b19","Type":"ContainerDied","Data":"62756c03cebd305c0ce3e9fdf1a5e072ebcee09452213e1b0088284226a92366"} May 29 14:48:41.335196 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:41.335159 2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 29 14:48:41.432902 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:41.432818 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6f0cf30a-046c-43a1-af24-afa473342b19-config-out\") pod \"6f0cf30a-046c-43a1-af24-afa473342b19\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " May 29 14:48:41.432902 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:41.432857 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f0cf30a-046c-43a1-af24-afa473342b19-metrics-client-ca\") pod \"6f0cf30a-046c-43a1-af24-afa473342b19\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " May 29 14:48:41.432902 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:41.432881 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6f0cf30a-046c-43a1-af24-afa473342b19-secret-alertmanager-kube-rbac-proxy-metric\") pod \"6f0cf30a-046c-43a1-af24-afa473342b19\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " May 29 14:48:41.432902 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:41.432900 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6f0cf30a-046c-43a1-af24-afa473342b19-config-volume\") pod \"6f0cf30a-046c-43a1-af24-afa473342b19\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " May 29 14:48:41.433240 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:41.432924 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f0cf30a-046c-43a1-af24-afa473342b19-alertmanager-trusted-ca-bundle\") pod \"6f0cf30a-046c-43a1-af24-afa473342b19\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " May 29 14:48:41.433240 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:41.432952 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6f0cf30a-046c-43a1-af24-afa473342b19-tls-assets\") pod \"6f0cf30a-046c-43a1-af24-afa473342b19\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " May 29 14:48:41.433240 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:41.432995 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6f0cf30a-046c-43a1-af24-afa473342b19-cluster-tls-config\") pod \"6f0cf30a-046c-43a1-af24-afa473342b19\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " May 29 14:48:41.433240 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:41.433130 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6f0cf30a-046c-43a1-af24-afa473342b19-web-config\") pod \"6f0cf30a-046c-43a1-af24-afa473342b19\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " May 29 14:48:41.433240 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:41.433199 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f0cf30a-046c-43a1-af24-afa473342b19-secret-alertmanager-kube-rbac-proxy-web\") pod \"6f0cf30a-046c-43a1-af24-afa473342b19\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " May 29 14:48:41.433495 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:41.433272 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f0cf30a-046c-43a1-af24-afa473342b19-secret-alertmanager-kube-rbac-proxy\") pod \"6f0cf30a-046c-43a1-af24-afa473342b19\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " May 29 14:48:41.433495 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:41.433270 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f0cf30a-046c-43a1-af24-afa473342b19-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "6f0cf30a-046c-43a1-af24-afa473342b19" (UID: "6f0cf30a-046c-43a1-af24-afa473342b19"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 14:48:41.433495 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:41.433309 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6f0cf30a-046c-43a1-af24-afa473342b19-alertmanager-main-db\") pod \"6f0cf30a-046c-43a1-af24-afa473342b19\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " May 29 14:48:41.433495 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:41.433383 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gwhn2\" (UniqueName: \"kubernetes.io/projected/6f0cf30a-046c-43a1-af24-afa473342b19-kube-api-access-gwhn2\") pod \"6f0cf30a-046c-43a1-af24-afa473342b19\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " May 29 14:48:41.433495 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:41.433407 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6f0cf30a-046c-43a1-af24-afa473342b19-secret-alertmanager-main-tls\") pod \"6f0cf30a-046c-43a1-af24-afa473342b19\" (UID: \"6f0cf30a-046c-43a1-af24-afa473342b19\") " May 29 14:48:41.433793 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:41.433550 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f0cf30a-046c-43a1-af24-afa473342b19-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "6f0cf30a-046c-43a1-af24-afa473342b19" (UID: "6f0cf30a-046c-43a1-af24-afa473342b19"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 14:48:41.433793 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:41.433670 2564 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f0cf30a-046c-43a1-af24-afa473342b19-metrics-client-ca\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:48:41.433793 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:41.433688 2564 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f0cf30a-046c-43a1-af24-afa473342b19-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:48:41.436416 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:41.436378 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f0cf30a-046c-43a1-af24-afa473342b19-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "6f0cf30a-046c-43a1-af24-afa473342b19" (UID: "6f0cf30a-046c-43a1-af24-afa473342b19"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 14:48:41.436550 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:41.436460 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f0cf30a-046c-43a1-af24-afa473342b19-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "6f0cf30a-046c-43a1-af24-afa473342b19" (UID: "6f0cf30a-046c-43a1-af24-afa473342b19"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 14:48:41.436550 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:41.436520 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f0cf30a-046c-43a1-af24-afa473342b19-config-out" (OuterVolumeSpecName: "config-out") pod "6f0cf30a-046c-43a1-af24-afa473342b19" (UID: "6f0cf30a-046c-43a1-af24-afa473342b19"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 14:48:41.436669 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:41.436652 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f0cf30a-046c-43a1-af24-afa473342b19-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "6f0cf30a-046c-43a1-af24-afa473342b19" (UID: "6f0cf30a-046c-43a1-af24-afa473342b19"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 14:48:41.436732 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:41.436706 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f0cf30a-046c-43a1-af24-afa473342b19-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "6f0cf30a-046c-43a1-af24-afa473342b19" (UID: "6f0cf30a-046c-43a1-af24-afa473342b19"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 14:48:41.437276 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:41.437242 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f0cf30a-046c-43a1-af24-afa473342b19-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "6f0cf30a-046c-43a1-af24-afa473342b19" (UID: "6f0cf30a-046c-43a1-af24-afa473342b19"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 14:48:41.438228 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:41.438196 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f0cf30a-046c-43a1-af24-afa473342b19-config-volume" (OuterVolumeSpecName: "config-volume") pod "6f0cf30a-046c-43a1-af24-afa473342b19" (UID: "6f0cf30a-046c-43a1-af24-afa473342b19"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 14:48:41.438655 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:41.438633 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f0cf30a-046c-43a1-af24-afa473342b19-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "6f0cf30a-046c-43a1-af24-afa473342b19" (UID: "6f0cf30a-046c-43a1-af24-afa473342b19"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 14:48:41.438835 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:41.438817 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f0cf30a-046c-43a1-af24-afa473342b19-kube-api-access-gwhn2" (OuterVolumeSpecName: "kube-api-access-gwhn2") pod "6f0cf30a-046c-43a1-af24-afa473342b19" (UID: "6f0cf30a-046c-43a1-af24-afa473342b19"). InnerVolumeSpecName "kube-api-access-gwhn2". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 14:48:41.442389 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:41.442362 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f0cf30a-046c-43a1-af24-afa473342b19-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "6f0cf30a-046c-43a1-af24-afa473342b19" (UID: "6f0cf30a-046c-43a1-af24-afa473342b19"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 14:48:41.449506 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:41.449482 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f0cf30a-046c-43a1-af24-afa473342b19-web-config" (OuterVolumeSpecName: "web-config") pod "6f0cf30a-046c-43a1-af24-afa473342b19" (UID: "6f0cf30a-046c-43a1-af24-afa473342b19"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 14:48:41.534902 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:41.534863 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6f0cf30a-046c-43a1-af24-afa473342b19-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:48:41.534902 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:41.534893 2564 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6f0cf30a-046c-43a1-af24-afa473342b19-config-volume\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:48:41.534902 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:41.534903 2564 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6f0cf30a-046c-43a1-af24-afa473342b19-tls-assets\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:48:41.534902 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:41.534912 2564 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6f0cf30a-046c-43a1-af24-afa473342b19-cluster-tls-config\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:48:41.535156 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:41.534921 2564 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6f0cf30a-046c-43a1-af24-afa473342b19-web-config\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:48:41.535156 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:41.534930 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f0cf30a-046c-43a1-af24-afa473342b19-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:48:41.535156 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:41.534939 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f0cf30a-046c-43a1-af24-afa473342b19-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:48:41.535156 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:41.534949 2564 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6f0cf30a-046c-43a1-af24-afa473342b19-alertmanager-main-db\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:48:41.535156 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:41.534958 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gwhn2\" (UniqueName: \"kubernetes.io/projected/6f0cf30a-046c-43a1-af24-afa473342b19-kube-api-access-gwhn2\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:48:41.535156 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:41.534968 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6f0cf30a-046c-43a1-af24-afa473342b19-secret-alertmanager-main-tls\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:48:41.535156 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:41.534978 2564 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6f0cf30a-046c-43a1-af24-afa473342b19-config-out\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:48:42.281025 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.280991 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f0cf30a-046c-43a1-af24-afa473342b19","Type":"ContainerDied","Data":"136e6ec1ebfc2eba3a811be8bbafe3d537598075bb193dd66aefa996156b7fc1"} May 29 14:48:42.281025 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.281020 2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 29 14:48:42.281483 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.281038 2564 scope.go:117] "RemoveContainer" containerID="1951aedabad499d3b8feaf66b8bc446df53ef1d890a01317371054d2a6913762" May 29 14:48:42.288979 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.288960 2564 scope.go:117] "RemoveContainer" containerID="15d5c3f4c308f70b7f85a032d4bfc2351fe7e4b4de0663d26a6b17ae445968d1" May 29 14:48:42.295704 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.295683 2564 scope.go:117] "RemoveContainer" containerID="8dacddea86c833c16e98f6ab6306a57f572644e8bed6e8aa073e8a28868ecf32" May 29 14:48:42.302538 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.302488 2564 scope.go:117] "RemoveContainer" containerID="62756c03cebd305c0ce3e9fdf1a5e072ebcee09452213e1b0088284226a92366" May 29 14:48:42.304050 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.304026 2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 29 14:48:42.308396 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.308367 2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 29 14:48:42.310768 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.310752 2564 scope.go:117] "RemoveContainer" containerID="0d3e98678f47f9803971cdc0478376b051bca9a6a076e825d86aa46bcfc334a3" May 29 14:48:42.317654 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.317641 2564 scope.go:117] "RemoveContainer" containerID="6447a357c53d7bf5a93579d901876c84db25d4396cb2c2f49316d52808ecf824" May 29 14:48:42.324141 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.324124 2564 scope.go:117] "RemoveContainer" containerID="daeb38df9364d4a7a40eb79e1c54052b74ad0cca46afc5881a1e42b7db4cf090" May 29 14:48:42.343001 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.342967 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 29 14:48:42.343653 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.343630 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f0cf30a-046c-43a1-af24-afa473342b19" containerName="kube-rbac-proxy-web" May 29 14:48:42.343805 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.343791 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f0cf30a-046c-43a1-af24-afa473342b19" containerName="kube-rbac-proxy-web" May 29 14:48:42.343924 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.343910 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f0cf30a-046c-43a1-af24-afa473342b19" containerName="kube-rbac-proxy" May 29 14:48:42.344009 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.343998 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f0cf30a-046c-43a1-af24-afa473342b19" containerName="kube-rbac-proxy" May 29 14:48:42.344103 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.344090 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f0cf30a-046c-43a1-af24-afa473342b19" containerName="init-config-reloader" May 29 14:48:42.344214 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.344201 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f0cf30a-046c-43a1-af24-afa473342b19" containerName="init-config-reloader" May 29 14:48:42.344316 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.344278 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69eace9a-f87a-4bf3-bca2-8fd675d84167" containerName="console" May 29 14:48:42.344431 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.344421 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="69eace9a-f87a-4bf3-bca2-8fd675d84167" containerName="console" May 29 14:48:42.344623 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.344554 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f0cf30a-046c-43a1-af24-afa473342b19" containerName="alertmanager" May 29 14:48:42.344623 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.344567 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f0cf30a-046c-43a1-af24-afa473342b19" containerName="alertmanager" May 29 14:48:42.344623 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.344581 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58a9de72-d19a-4f67-9e24-936ca7f340aa" containerName="console" May 29 14:48:42.344623 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.344597 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="58a9de72-d19a-4f67-9e24-936ca7f340aa" containerName="console" May 29 14:48:42.344905 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.344847 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f0cf30a-046c-43a1-af24-afa473342b19" containerName="config-reloader" May 29 14:48:42.344905 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.344861 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f0cf30a-046c-43a1-af24-afa473342b19" containerName="config-reloader" May 29 14:48:42.344905 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.344870 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f0cf30a-046c-43a1-af24-afa473342b19" containerName="kube-rbac-proxy-metric" May 29 14:48:42.344905 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.344882 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f0cf30a-046c-43a1-af24-afa473342b19" containerName="kube-rbac-proxy-metric" May 29 14:48:42.345200 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.345107 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f0cf30a-046c-43a1-af24-afa473342b19" containerName="prom-label-proxy" May 29 14:48:42.345200 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.345121 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f0cf30a-046c-43a1-af24-afa473342b19" containerName="prom-label-proxy" May 29 14:48:42.345475 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.345440 2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="58a9de72-d19a-4f67-9e24-936ca7f340aa" containerName="console" May 29 14:48:42.345628 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.345552 2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="69eace9a-f87a-4bf3-bca2-8fd675d84167" containerName="console" May 29 14:48:42.345628 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.345568 2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="6f0cf30a-046c-43a1-af24-afa473342b19" containerName="prom-label-proxy" May 29 14:48:42.345628 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.345585 2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="6f0cf30a-046c-43a1-af24-afa473342b19" containerName="kube-rbac-proxy-metric" May 29 14:48:42.345628 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.345597 2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="6f0cf30a-046c-43a1-af24-afa473342b19" containerName="alertmanager" May 29 14:48:42.345628 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.345607 2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="6f0cf30a-046c-43a1-af24-afa473342b19" containerName="kube-rbac-proxy-web" May 29 14:48:42.345971 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.345914 2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="6f0cf30a-046c-43a1-af24-afa473342b19" containerName="kube-rbac-proxy" May 29 14:48:42.345971 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.345959 2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="6f0cf30a-046c-43a1-af24-afa473342b19" containerName="config-reloader" May 29 14:48:42.351937 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.351915 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 29 14:48:42.354409 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.354385 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 29 14:48:42.354521 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.354389 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-l5c4v\"" May 29 14:48:42.354521 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.354396 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 29 14:48:42.354521 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.354497 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 29 14:48:42.354674 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.354524 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 29 14:48:42.354958 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.354935 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 29 14:48:42.355394 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.355374 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 29 14:48:42.355881 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.355823 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 29 14:48:42.356222 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.356202 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 29 14:48:42.358776 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.358730 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 29 14:48:42.361026 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.361006 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 29 14:48:42.444838 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.444745 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b1f7e6f-3c99-414e-8267-47f15d2d875d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8b1f7e6f-3c99-414e-8267-47f15d2d875d\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:48:42.444838 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.444785 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8b1f7e6f-3c99-414e-8267-47f15d2d875d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8b1f7e6f-3c99-414e-8267-47f15d2d875d\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:48:42.444838 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.444807 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm2tg\" (UniqueName: \"kubernetes.io/projected/8b1f7e6f-3c99-414e-8267-47f15d2d875d-kube-api-access-gm2tg\") pod \"alertmanager-main-0\" (UID: \"8b1f7e6f-3c99-414e-8267-47f15d2d875d\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:48:42.444838 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.444831 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8b1f7e6f-3c99-414e-8267-47f15d2d875d-config-out\") pod \"alertmanager-main-0\" (UID: \"8b1f7e6f-3c99-414e-8267-47f15d2d875d\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:48:42.445082 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.444901 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8b1f7e6f-3c99-414e-8267-47f15d2d875d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8b1f7e6f-3c99-414e-8267-47f15d2d875d\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:48:42.445082 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.444943 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8b1f7e6f-3c99-414e-8267-47f15d2d875d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8b1f7e6f-3c99-414e-8267-47f15d2d875d\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:48:42.445082 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.444971 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8b1f7e6f-3c99-414e-8267-47f15d2d875d-config-volume\") pod \"alertmanager-main-0\" (UID: \"8b1f7e6f-3c99-414e-8267-47f15d2d875d\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:48:42.445082 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.444999 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8b1f7e6f-3c99-414e-8267-47f15d2d875d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8b1f7e6f-3c99-414e-8267-47f15d2d875d\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:48:42.445082 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.445025 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b1f7e6f-3c99-414e-8267-47f15d2d875d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8b1f7e6f-3c99-414e-8267-47f15d2d875d\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:48:42.445082 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.445053 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8b1f7e6f-3c99-414e-8267-47f15d2d875d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8b1f7e6f-3c99-414e-8267-47f15d2d875d\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:48:42.445299 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.445085 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8b1f7e6f-3c99-414e-8267-47f15d2d875d-web-config\") pod \"alertmanager-main-0\" (UID: \"8b1f7e6f-3c99-414e-8267-47f15d2d875d\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:48:42.445299 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.445109 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8b1f7e6f-3c99-414e-8267-47f15d2d875d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8b1f7e6f-3c99-414e-8267-47f15d2d875d\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:48:42.445299 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.445162 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8b1f7e6f-3c99-414e-8267-47f15d2d875d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8b1f7e6f-3c99-414e-8267-47f15d2d875d\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:48:42.545845 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.545791 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8b1f7e6f-3c99-414e-8267-47f15d2d875d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8b1f7e6f-3c99-414e-8267-47f15d2d875d\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:48:42.545845 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.545845 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b1f7e6f-3c99-414e-8267-47f15d2d875d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8b1f7e6f-3c99-414e-8267-47f15d2d875d\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:48:42.546068 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.545867 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8b1f7e6f-3c99-414e-8267-47f15d2d875d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8b1f7e6f-3c99-414e-8267-47f15d2d875d\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:48:42.546068 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.545977 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gm2tg\" (UniqueName: \"kubernetes.io/projected/8b1f7e6f-3c99-414e-8267-47f15d2d875d-kube-api-access-gm2tg\") pod \"alertmanager-main-0\" (UID: \"8b1f7e6f-3c99-414e-8267-47f15d2d875d\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:48:42.546068 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.546029 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8b1f7e6f-3c99-414e-8267-47f15d2d875d-config-out\") pod \"alertmanager-main-0\" (UID: \"8b1f7e6f-3c99-414e-8267-47f15d2d875d\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:48:42.546247 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.546220 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8b1f7e6f-3c99-414e-8267-47f15d2d875d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8b1f7e6f-3c99-414e-8267-47f15d2d875d\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:48:42.546295 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.546274 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8b1f7e6f-3c99-414e-8267-47f15d2d875d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8b1f7e6f-3c99-414e-8267-47f15d2d875d\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:48:42.546353 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.546326 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8b1f7e6f-3c99-414e-8267-47f15d2d875d-config-volume\") pod \"alertmanager-main-0\" (UID: \"8b1f7e6f-3c99-414e-8267-47f15d2d875d\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:48:42.546406 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.546372 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8b1f7e6f-3c99-414e-8267-47f15d2d875d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8b1f7e6f-3c99-414e-8267-47f15d2d875d\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:48:42.546459 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.546419 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b1f7e6f-3c99-414e-8267-47f15d2d875d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8b1f7e6f-3c99-414e-8267-47f15d2d875d\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:48:42.546885 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.546776 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b1f7e6f-3c99-414e-8267-47f15d2d875d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8b1f7e6f-3c99-414e-8267-47f15d2d875d\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:48:42.547328 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.547305 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8b1f7e6f-3c99-414e-8267-47f15d2d875d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8b1f7e6f-3c99-414e-8267-47f15d2d875d\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:48:42.547483 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.547460 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b1f7e6f-3c99-414e-8267-47f15d2d875d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8b1f7e6f-3c99-414e-8267-47f15d2d875d\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:48:42.547630 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.547471 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8b1f7e6f-3c99-414e-8267-47f15d2d875d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8b1f7e6f-3c99-414e-8267-47f15d2d875d\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:48:42.547743 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.547727 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8b1f7e6f-3c99-414e-8267-47f15d2d875d-web-config\") pod \"alertmanager-main-0\" (UID: \"8b1f7e6f-3c99-414e-8267-47f15d2d875d\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:48:42.547855 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.547840 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8b1f7e6f-3c99-414e-8267-47f15d2d875d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8b1f7e6f-3c99-414e-8267-47f15d2d875d\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:48:42.549203 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.549153 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8b1f7e6f-3c99-414e-8267-47f15d2d875d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8b1f7e6f-3c99-414e-8267-47f15d2d875d\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:48:42.549307 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.549272 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8b1f7e6f-3c99-414e-8267-47f15d2d875d-config-volume\") pod \"alertmanager-main-0\" (UID: \"8b1f7e6f-3c99-414e-8267-47f15d2d875d\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:48:42.549371 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.549305 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8b1f7e6f-3c99-414e-8267-47f15d2d875d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8b1f7e6f-3c99-414e-8267-47f15d2d875d\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:48:42.549371 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.549346 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8b1f7e6f-3c99-414e-8267-47f15d2d875d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8b1f7e6f-3c99-414e-8267-47f15d2d875d\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:48:42.549641 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.549617 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8b1f7e6f-3c99-414e-8267-47f15d2d875d-config-out\") pod \"alertmanager-main-0\" (UID: \"8b1f7e6f-3c99-414e-8267-47f15d2d875d\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:48:42.549993 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.549975 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8b1f7e6f-3c99-414e-8267-47f15d2d875d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8b1f7e6f-3c99-414e-8267-47f15d2d875d\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:48:42.550155 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.550135 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8b1f7e6f-3c99-414e-8267-47f15d2d875d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8b1f7e6f-3c99-414e-8267-47f15d2d875d\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:48:42.550457 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.550439 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8b1f7e6f-3c99-414e-8267-47f15d2d875d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8b1f7e6f-3c99-414e-8267-47f15d2d875d\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:48:42.551286 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.551269 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8b1f7e6f-3c99-414e-8267-47f15d2d875d-web-config\") pod \"alertmanager-main-0\" (UID: \"8b1f7e6f-3c99-414e-8267-47f15d2d875d\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:48:42.555036 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.555015 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm2tg\" (UniqueName: \"kubernetes.io/projected/8b1f7e6f-3c99-414e-8267-47f15d2d875d-kube-api-access-gm2tg\") pod \"alertmanager-main-0\" (UID: \"8b1f7e6f-3c99-414e-8267-47f15d2d875d\") " pod="openshift-monitoring/alertmanager-main-0" May 29 14:48:42.663561 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.663510 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 29 14:48:42.801365 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:42.801332 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 29 14:48:42.803983 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:48:42.803955 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b1f7e6f_3c99_414e_8267_47f15d2d875d.slice/crio-8af1814c0c3cc6be67ea1b150fb5db8479fdf4c5bee9d9877be346881ae35ae5 WatchSource:0}: Error finding container 8af1814c0c3cc6be67ea1b150fb5db8479fdf4c5bee9d9877be346881ae35ae5: Status 404 returned error can't find the container with id 8af1814c0c3cc6be67ea1b150fb5db8479fdf4c5bee9d9877be346881ae35ae5 May 29 14:48:43.284562 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:43.284531 2564 generic.go:358] "Generic (PLEG): container finished" podID="8b1f7e6f-3c99-414e-8267-47f15d2d875d" containerID="6c4b19dbc3347f652f6fb0199c327b5098038dd16e05e4f2534fd3c1fec9bf55" exitCode=0 May 29 14:48:43.284997 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:43.284625 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8b1f7e6f-3c99-414e-8267-47f15d2d875d","Type":"ContainerDied","Data":"6c4b19dbc3347f652f6fb0199c327b5098038dd16e05e4f2534fd3c1fec9bf55"} May 29 14:48:43.284997 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:43.284662 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8b1f7e6f-3c99-414e-8267-47f15d2d875d","Type":"ContainerStarted","Data":"8af1814c0c3cc6be67ea1b150fb5db8479fdf4c5bee9d9877be346881ae35ae5"} May 29 14:48:43.655294 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:43.655266 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f0cf30a-046c-43a1-af24-afa473342b19" path="/var/lib/kubelet/pods/6f0cf30a-046c-43a1-af24-afa473342b19/volumes" May 29 14:48:44.140995 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.140957 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6f59967fc9-wz9l2"] May 29 14:48:44.147974 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.147936 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6f59967fc9-wz9l2" May 29 14:48:44.151252 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.150948 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" May 29 14:48:44.151252 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.150962 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-q29q9\"" May 29 14:48:44.151252 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.151044 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" May 29 14:48:44.151252 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.151191 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" May 29 14:48:44.151523 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.151435 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" May 29 14:48:44.151523 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.151497 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" May 29 14:48:44.157106 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.157082 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6f59967fc9-wz9l2"] May 29 14:48:44.158211 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.158188 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" May 29 14:48:44.264492 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.264450 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4226ae0d-1f62-4077-9a05-484dc5e14808-telemeter-client-tls\") pod \"telemeter-client-6f59967fc9-wz9l2\" (UID: \"4226ae0d-1f62-4077-9a05-484dc5e14808\") " pod="openshift-monitoring/telemeter-client-6f59967fc9-wz9l2" May 29 14:48:44.264492 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.264493 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4226ae0d-1f62-4077-9a05-484dc5e14808-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6f59967fc9-wz9l2\" (UID: \"4226ae0d-1f62-4077-9a05-484dc5e14808\") " pod="openshift-monitoring/telemeter-client-6f59967fc9-wz9l2" May 29 14:48:44.264751 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.264515 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4226ae0d-1f62-4077-9a05-484dc5e14808-metrics-client-ca\") pod \"telemeter-client-6f59967fc9-wz9l2\" (UID: \"4226ae0d-1f62-4077-9a05-484dc5e14808\") " pod="openshift-monitoring/telemeter-client-6f59967fc9-wz9l2" May 29 14:48:44.264751 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.264612 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4226ae0d-1f62-4077-9a05-484dc5e14808-serving-certs-ca-bundle\") pod \"telemeter-client-6f59967fc9-wz9l2\" (UID: \"4226ae0d-1f62-4077-9a05-484dc5e14808\") " pod="openshift-monitoring/telemeter-client-6f59967fc9-wz9l2" May 29 14:48:44.264751 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.264653 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4226ae0d-1f62-4077-9a05-484dc5e14808-secret-telemeter-client\") pod \"telemeter-client-6f59967fc9-wz9l2\" (UID: \"4226ae0d-1f62-4077-9a05-484dc5e14808\") " pod="openshift-monitoring/telemeter-client-6f59967fc9-wz9l2" May 29 14:48:44.264751 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.264679 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4226ae0d-1f62-4077-9a05-484dc5e14808-federate-client-tls\") pod \"telemeter-client-6f59967fc9-wz9l2\" (UID: \"4226ae0d-1f62-4077-9a05-484dc5e14808\") " pod="openshift-monitoring/telemeter-client-6f59967fc9-wz9l2" May 29 14:48:44.264751 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.264745 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4226ae0d-1f62-4077-9a05-484dc5e14808-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6f59967fc9-wz9l2\" (UID: \"4226ae0d-1f62-4077-9a05-484dc5e14808\") " pod="openshift-monitoring/telemeter-client-6f59967fc9-wz9l2" May 29 14:48:44.264910 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.264808 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgczs\" (UniqueName: \"kubernetes.io/projected/4226ae0d-1f62-4077-9a05-484dc5e14808-kube-api-access-vgczs\") pod \"telemeter-client-6f59967fc9-wz9l2\" (UID: \"4226ae0d-1f62-4077-9a05-484dc5e14808\") " pod="openshift-monitoring/telemeter-client-6f59967fc9-wz9l2" May 29 14:48:44.291804 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.291770 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8b1f7e6f-3c99-414e-8267-47f15d2d875d","Type":"ContainerStarted","Data":"05367043a1b5f8f3180e4996c80a11867b275c91484af37a7ade60ccab7e5d0a"} May 29 14:48:44.291804 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.291805 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8b1f7e6f-3c99-414e-8267-47f15d2d875d","Type":"ContainerStarted","Data":"93449b830097e189c55fc062d2ba1633d39ef26e14596d52f3072eacc28faa2b"} May 29 14:48:44.292294 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.291815 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8b1f7e6f-3c99-414e-8267-47f15d2d875d","Type":"ContainerStarted","Data":"b3f3c86bb0e1bd481a1af698a794553297577cea9175d7cead0792b6a31d3e69"} May 29 14:48:44.292294 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.291823 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8b1f7e6f-3c99-414e-8267-47f15d2d875d","Type":"ContainerStarted","Data":"fa6b6170c021a5761a1dfcd8c0c06eea9985c868d2efc0f6011040fffcb7247f"} May 29 14:48:44.292294 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.291832 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8b1f7e6f-3c99-414e-8267-47f15d2d875d","Type":"ContainerStarted","Data":"e6f8ca82cc1813d31b62485cc9e211ceaed75732cbf16d214ad2cd549409a4ac"} May 29 14:48:44.292294 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.291840 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8b1f7e6f-3c99-414e-8267-47f15d2d875d","Type":"ContainerStarted","Data":"78423e610437c4d7548fb115764de70bf6907398e61ba949e13f04c9d414fd51"} May 29 14:48:44.325022 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.324966 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.324946355 podStartE2EDuration="2.324946355s" podCreationTimestamp="2026-05-29 14:48:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 14:48:44.322531744 +0000 UTC m=+145.179643691" watchObservedRunningTime="2026-05-29 14:48:44.324946355 +0000 UTC m=+145.182058302" May 29 14:48:44.365661 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.365628 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4226ae0d-1f62-4077-9a05-484dc5e14808-telemeter-client-tls\") pod \"telemeter-client-6f59967fc9-wz9l2\" (UID: \"4226ae0d-1f62-4077-9a05-484dc5e14808\") " pod="openshift-monitoring/telemeter-client-6f59967fc9-wz9l2" May 29 14:48:44.365661 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.365665 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4226ae0d-1f62-4077-9a05-484dc5e14808-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6f59967fc9-wz9l2\" (UID: \"4226ae0d-1f62-4077-9a05-484dc5e14808\") " pod="openshift-monitoring/telemeter-client-6f59967fc9-wz9l2" May 29 14:48:44.366228 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.365833 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4226ae0d-1f62-4077-9a05-484dc5e14808-metrics-client-ca\") pod \"telemeter-client-6f59967fc9-wz9l2\" (UID: \"4226ae0d-1f62-4077-9a05-484dc5e14808\") " pod="openshift-monitoring/telemeter-client-6f59967fc9-wz9l2" May 29 14:48:44.366228 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.365909 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4226ae0d-1f62-4077-9a05-484dc5e14808-serving-certs-ca-bundle\") pod \"telemeter-client-6f59967fc9-wz9l2\" (UID: \"4226ae0d-1f62-4077-9a05-484dc5e14808\") " pod="openshift-monitoring/telemeter-client-6f59967fc9-wz9l2" May 29 14:48:44.366228 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.365941 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4226ae0d-1f62-4077-9a05-484dc5e14808-secret-telemeter-client\") pod \"telemeter-client-6f59967fc9-wz9l2\" (UID: \"4226ae0d-1f62-4077-9a05-484dc5e14808\") " pod="openshift-monitoring/telemeter-client-6f59967fc9-wz9l2" May 29 14:48:44.366228 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.365970 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4226ae0d-1f62-4077-9a05-484dc5e14808-federate-client-tls\") pod \"telemeter-client-6f59967fc9-wz9l2\" (UID: \"4226ae0d-1f62-4077-9a05-484dc5e14808\") " pod="openshift-monitoring/telemeter-client-6f59967fc9-wz9l2" May 29 14:48:44.366228 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.366153 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4226ae0d-1f62-4077-9a05-484dc5e14808-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6f59967fc9-wz9l2\" (UID: \"4226ae0d-1f62-4077-9a05-484dc5e14808\") " pod="openshift-monitoring/telemeter-client-6f59967fc9-wz9l2" May 29 14:48:44.366485 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.366234 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vgczs\" (UniqueName: \"kubernetes.io/projected/4226ae0d-1f62-4077-9a05-484dc5e14808-kube-api-access-vgczs\") pod \"telemeter-client-6f59967fc9-wz9l2\" (UID: \"4226ae0d-1f62-4077-9a05-484dc5e14808\") " pod="openshift-monitoring/telemeter-client-6f59967fc9-wz9l2" May 29 14:48:44.366555 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.366538 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4226ae0d-1f62-4077-9a05-484dc5e14808-metrics-client-ca\") pod \"telemeter-client-6f59967fc9-wz9l2\" (UID: \"4226ae0d-1f62-4077-9a05-484dc5e14808\") " pod="openshift-monitoring/telemeter-client-6f59967fc9-wz9l2" May 29 14:48:44.366605 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.366565 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4226ae0d-1f62-4077-9a05-484dc5e14808-serving-certs-ca-bundle\") pod \"telemeter-client-6f59967fc9-wz9l2\" (UID: \"4226ae0d-1f62-4077-9a05-484dc5e14808\") " pod="openshift-monitoring/telemeter-client-6f59967fc9-wz9l2" May 29 14:48:44.366718 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.366610 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4226ae0d-1f62-4077-9a05-484dc5e14808-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6f59967fc9-wz9l2\" (UID: \"4226ae0d-1f62-4077-9a05-484dc5e14808\") " pod="openshift-monitoring/telemeter-client-6f59967fc9-wz9l2" May 29 14:48:44.368842 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.368818 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4226ae0d-1f62-4077-9a05-484dc5e14808-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6f59967fc9-wz9l2\" (UID: \"4226ae0d-1f62-4077-9a05-484dc5e14808\") " pod="openshift-monitoring/telemeter-client-6f59967fc9-wz9l2" May 29 14:48:44.369521 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.369501 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4226ae0d-1f62-4077-9a05-484dc5e14808-secret-telemeter-client\") pod \"telemeter-client-6f59967fc9-wz9l2\" (UID: \"4226ae0d-1f62-4077-9a05-484dc5e14808\") " pod="openshift-monitoring/telemeter-client-6f59967fc9-wz9l2" May 29 14:48:44.369665 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.369646 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4226ae0d-1f62-4077-9a05-484dc5e14808-federate-client-tls\") pod \"telemeter-client-6f59967fc9-wz9l2\" (UID: \"4226ae0d-1f62-4077-9a05-484dc5e14808\") " pod="openshift-monitoring/telemeter-client-6f59967fc9-wz9l2" May 29 14:48:44.369709 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.369646 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4226ae0d-1f62-4077-9a05-484dc5e14808-telemeter-client-tls\") pod \"telemeter-client-6f59967fc9-wz9l2\" (UID: \"4226ae0d-1f62-4077-9a05-484dc5e14808\") " pod="openshift-monitoring/telemeter-client-6f59967fc9-wz9l2" May 29 14:48:44.375391 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.375373 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgczs\" (UniqueName: \"kubernetes.io/projected/4226ae0d-1f62-4077-9a05-484dc5e14808-kube-api-access-vgczs\") pod \"telemeter-client-6f59967fc9-wz9l2\" (UID: \"4226ae0d-1f62-4077-9a05-484dc5e14808\") " pod="openshift-monitoring/telemeter-client-6f59967fc9-wz9l2" May 29 14:48:44.452296 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.452202 2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 14:48:44.452766 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.452692 2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="92994076-f22b-4e9c-89b9-0610ddd5a804" containerName="prometheus" containerID="cri-o://8ff7ed2e8bbffe4097795cfe7ca52cf03a257c47628f0fb57c1fb346e3ba93bb" gracePeriod=600 May 29 14:48:44.452899 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.452793 2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="92994076-f22b-4e9c-89b9-0610ddd5a804" containerName="kube-rbac-proxy-thanos" containerID="cri-o://b05b553a59f732ff555805688a4c93c7edd272710f59c8f8b7a6a47072f9d904" gracePeriod=600 May 29 14:48:44.452899 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.452714 2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="92994076-f22b-4e9c-89b9-0610ddd5a804" containerName="thanos-sidecar" containerID="cri-o://5decf24d42650e46c2163c468ef84032a6bf4a3c63c78d1b9e99fd3097cc44ef" gracePeriod=600 May 29 14:48:44.452899 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.452722 2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="92994076-f22b-4e9c-89b9-0610ddd5a804" containerName="kube-rbac-proxy" containerID="cri-o://b43f7f5c3eebe8ab9895db6e2322451fe3160bd2c62a92459009bdcf0e1db933" gracePeriod=600 May 29 14:48:44.452899 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.452722 2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="92994076-f22b-4e9c-89b9-0610ddd5a804" containerName="kube-rbac-proxy-web" containerID="cri-o://6eb733d09b322fcf7d49c24b53c6b4149700adaf5d740158f4537408ebfa9b7c" gracePeriod=600 May 29 14:48:44.453113 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.452750 2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="92994076-f22b-4e9c-89b9-0610ddd5a804" containerName="config-reloader" containerID="cri-o://a7a1d523bcfa3b1d3251ea553bd19b1a828faaa7b9ebab841f04f971be32f6d7" gracePeriod=600 May 29 14:48:44.472270 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.472239 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6f59967fc9-wz9l2" May 29 14:48:44.628046 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.628022 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6f59967fc9-wz9l2"] May 29 14:48:44.630684 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:48:44.630653 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4226ae0d_1f62_4077_9a05_484dc5e14808.slice/crio-3e0f64d7366c95eab8966675da4bc9fff6af37a963cfa66a5995441945a84796 WatchSource:0}: Error finding container 3e0f64d7366c95eab8966675da4bc9fff6af37a963cfa66a5995441945a84796: Status 404 returned error can't find the container with id 3e0f64d7366c95eab8966675da4bc9fff6af37a963cfa66a5995441945a84796 May 29 14:48:44.707886 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.707828 2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:44.776602 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.775286 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/92994076-f22b-4e9c-89b9-0610ddd5a804-prometheus-k8s-rulefiles-0\") pod \"92994076-f22b-4e9c-89b9-0610ddd5a804\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " May 29 14:48:44.776602 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.775340 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5m58d\" (UniqueName: \"kubernetes.io/projected/92994076-f22b-4e9c-89b9-0610ddd5a804-kube-api-access-5m58d\") pod \"92994076-f22b-4e9c-89b9-0610ddd5a804\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " May 29 14:48:44.776602 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.775371 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/92994076-f22b-4e9c-89b9-0610ddd5a804-prometheus-k8s-db\") pod \"92994076-f22b-4e9c-89b9-0610ddd5a804\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " May 29 14:48:44.776602 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.775405 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/92994076-f22b-4e9c-89b9-0610ddd5a804-tls-assets\") pod \"92994076-f22b-4e9c-89b9-0610ddd5a804\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " May 29 14:48:44.776602 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.775431 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-secret-metrics-client-certs\") pod \"92994076-f22b-4e9c-89b9-0610ddd5a804\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " May 29 14:48:44.776602 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.775460 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92994076-f22b-4e9c-89b9-0610ddd5a804-configmap-kubelet-serving-ca-bundle\") pod \"92994076-f22b-4e9c-89b9-0610ddd5a804\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " May 29 14:48:44.776602 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.775482 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92994076-f22b-4e9c-89b9-0610ddd5a804-configmap-metrics-client-ca\") pod \"92994076-f22b-4e9c-89b9-0610ddd5a804\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " May 29 14:48:44.776602 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.775509 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"92994076-f22b-4e9c-89b9-0610ddd5a804\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " May 29 14:48:44.776602 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.775567 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92994076-f22b-4e9c-89b9-0610ddd5a804-prometheus-trusted-ca-bundle\") pod \"92994076-f22b-4e9c-89b9-0610ddd5a804\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " May 29 14:48:44.776602 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.775609 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/92994076-f22b-4e9c-89b9-0610ddd5a804-config-out\") pod \"92994076-f22b-4e9c-89b9-0610ddd5a804\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " May 29 14:48:44.776602 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.775634 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-thanos-prometheus-http-client-file\") pod \"92994076-f22b-4e9c-89b9-0610ddd5a804\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " May 29 14:48:44.776602 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.775659 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-web-config\") pod \"92994076-f22b-4e9c-89b9-0610ddd5a804\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " May 29 14:48:44.776602 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.775691 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-secret-prometheus-k8s-tls\") pod \"92994076-f22b-4e9c-89b9-0610ddd5a804\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " May 29 14:48:44.776602 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.775715 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"92994076-f22b-4e9c-89b9-0610ddd5a804\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " May 29 14:48:44.776602 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.775745 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92994076-f22b-4e9c-89b9-0610ddd5a804-configmap-serving-certs-ca-bundle\") pod \"92994076-f22b-4e9c-89b9-0610ddd5a804\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " May 29 14:48:44.776602 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.775768 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-secret-grpc-tls\") pod \"92994076-f22b-4e9c-89b9-0610ddd5a804\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " May 29 14:48:44.776602 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.775807 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-config\") pod \"92994076-f22b-4e9c-89b9-0610ddd5a804\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " May 29 14:48:44.776602 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.775848 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-secret-kube-rbac-proxy\") pod \"92994076-f22b-4e9c-89b9-0610ddd5a804\" (UID: \"92994076-f22b-4e9c-89b9-0610ddd5a804\") " May 29 14:48:44.777711 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.777211 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92994076-f22b-4e9c-89b9-0610ddd5a804-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "92994076-f22b-4e9c-89b9-0610ddd5a804" (UID: "92994076-f22b-4e9c-89b9-0610ddd5a804"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 14:48:44.777711 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.777218 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92994076-f22b-4e9c-89b9-0610ddd5a804-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "92994076-f22b-4e9c-89b9-0610ddd5a804" (UID: "92994076-f22b-4e9c-89b9-0610ddd5a804"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 14:48:44.779818 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.779786 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "92994076-f22b-4e9c-89b9-0610ddd5a804" (UID: "92994076-f22b-4e9c-89b9-0610ddd5a804"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 14:48:44.779997 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.779971 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "92994076-f22b-4e9c-89b9-0610ddd5a804" (UID: "92994076-f22b-4e9c-89b9-0610ddd5a804"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 14:48:44.780657 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.780365 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "92994076-f22b-4e9c-89b9-0610ddd5a804" (UID: "92994076-f22b-4e9c-89b9-0610ddd5a804"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 14:48:44.780657 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.780411 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92994076-f22b-4e9c-89b9-0610ddd5a804-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "92994076-f22b-4e9c-89b9-0610ddd5a804" (UID: "92994076-f22b-4e9c-89b9-0610ddd5a804"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 14:48:44.780853 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.780827 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92994076-f22b-4e9c-89b9-0610ddd5a804-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "92994076-f22b-4e9c-89b9-0610ddd5a804" (UID: "92994076-f22b-4e9c-89b9-0610ddd5a804"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 14:48:44.781272 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.781166 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92994076-f22b-4e9c-89b9-0610ddd5a804-kube-api-access-5m58d" (OuterVolumeSpecName: "kube-api-access-5m58d") pod "92994076-f22b-4e9c-89b9-0610ddd5a804" (UID: "92994076-f22b-4e9c-89b9-0610ddd5a804"). InnerVolumeSpecName "kube-api-access-5m58d". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 14:48:44.782584 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.782551 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "92994076-f22b-4e9c-89b9-0610ddd5a804" (UID: "92994076-f22b-4e9c-89b9-0610ddd5a804"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 14:48:44.782680 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.782633 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "92994076-f22b-4e9c-89b9-0610ddd5a804" (UID: "92994076-f22b-4e9c-89b9-0610ddd5a804"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 14:48:44.782738 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.782697 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92994076-f22b-4e9c-89b9-0610ddd5a804-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "92994076-f22b-4e9c-89b9-0610ddd5a804" (UID: "92994076-f22b-4e9c-89b9-0610ddd5a804"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 14:48:44.783573 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.783533 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "92994076-f22b-4e9c-89b9-0610ddd5a804" (UID: "92994076-f22b-4e9c-89b9-0610ddd5a804"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 14:48:44.783783 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.783733 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-config" (OuterVolumeSpecName: "config") pod "92994076-f22b-4e9c-89b9-0610ddd5a804" (UID: "92994076-f22b-4e9c-89b9-0610ddd5a804"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 14:48:44.783783 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.783750 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92994076-f22b-4e9c-89b9-0610ddd5a804-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "92994076-f22b-4e9c-89b9-0610ddd5a804" (UID: "92994076-f22b-4e9c-89b9-0610ddd5a804"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 14:48:44.783892 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.783852 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92994076-f22b-4e9c-89b9-0610ddd5a804-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "92994076-f22b-4e9c-89b9-0610ddd5a804" (UID: "92994076-f22b-4e9c-89b9-0610ddd5a804"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 14:48:44.784233 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.784212 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "92994076-f22b-4e9c-89b9-0610ddd5a804" (UID: "92994076-f22b-4e9c-89b9-0610ddd5a804"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 14:48:44.784424 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.784406 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92994076-f22b-4e9c-89b9-0610ddd5a804-config-out" (OuterVolumeSpecName: "config-out") pod "92994076-f22b-4e9c-89b9-0610ddd5a804" (UID: "92994076-f22b-4e9c-89b9-0610ddd5a804"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 14:48:44.797206 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.797159 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-web-config" (OuterVolumeSpecName: "web-config") pod "92994076-f22b-4e9c-89b9-0610ddd5a804" (UID: "92994076-f22b-4e9c-89b9-0610ddd5a804"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 14:48:44.878757 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.877677 2564 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-secret-kube-rbac-proxy\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:48:44.878757 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.877714 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/92994076-f22b-4e9c-89b9-0610ddd5a804-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:48:44.878757 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.877727 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5m58d\" (UniqueName: \"kubernetes.io/projected/92994076-f22b-4e9c-89b9-0610ddd5a804-kube-api-access-5m58d\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:48:44.878757 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.877741 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/92994076-f22b-4e9c-89b9-0610ddd5a804-prometheus-k8s-db\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:48:44.878757 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.877754 2564 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/92994076-f22b-4e9c-89b9-0610ddd5a804-tls-assets\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:48:44.878757 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.877766 2564 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-secret-metrics-client-certs\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:48:44.878757 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.877784 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92994076-f22b-4e9c-89b9-0610ddd5a804-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:48:44.878757 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.877799 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92994076-f22b-4e9c-89b9-0610ddd5a804-configmap-metrics-client-ca\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:48:44.878757 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.877812 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:48:44.878757 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.877826 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92994076-f22b-4e9c-89b9-0610ddd5a804-prometheus-trusted-ca-bundle\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:48:44.878757 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.877838 2564 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/92994076-f22b-4e9c-89b9-0610ddd5a804-config-out\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:48:44.878757 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.877851 2564 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-thanos-prometheus-http-client-file\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:48:44.878757 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.877862 2564 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-web-config\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:48:44.878757 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.877875 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-secret-prometheus-k8s-tls\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:48:44.878757 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.877888 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:48:44.878757 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.877901 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92994076-f22b-4e9c-89b9-0610ddd5a804-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:48:44.878757 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.877914 2564 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-secret-grpc-tls\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:48:44.878757 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:44.877926 2564 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/92994076-f22b-4e9c-89b9-0610ddd5a804-config\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:48:45.297407 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.297341 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6f59967fc9-wz9l2" event={"ID":"4226ae0d-1f62-4077-9a05-484dc5e14808","Type":"ContainerStarted","Data":"3e0f64d7366c95eab8966675da4bc9fff6af37a963cfa66a5995441945a84796"} May 29 14:48:45.300073 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.300043 2564 generic.go:358] "Generic (PLEG): container finished" podID="92994076-f22b-4e9c-89b9-0610ddd5a804" containerID="b05b553a59f732ff555805688a4c93c7edd272710f59c8f8b7a6a47072f9d904" exitCode=0 May 29 14:48:45.300073 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.300072 2564 generic.go:358] "Generic (PLEG): container finished" podID="92994076-f22b-4e9c-89b9-0610ddd5a804" containerID="b43f7f5c3eebe8ab9895db6e2322451fe3160bd2c62a92459009bdcf0e1db933" exitCode=0 May 29 14:48:45.300246 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.300082 2564 generic.go:358] "Generic (PLEG): container finished" podID="92994076-f22b-4e9c-89b9-0610ddd5a804" containerID="6eb733d09b322fcf7d49c24b53c6b4149700adaf5d740158f4537408ebfa9b7c" exitCode=0 May 29 14:48:45.300246 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.300090 2564 generic.go:358] "Generic (PLEG): container finished" podID="92994076-f22b-4e9c-89b9-0610ddd5a804" containerID="5decf24d42650e46c2163c468ef84032a6bf4a3c63c78d1b9e99fd3097cc44ef" exitCode=0 May 29 14:48:45.300246 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.300097 2564 generic.go:358] "Generic (PLEG): container finished" podID="92994076-f22b-4e9c-89b9-0610ddd5a804" containerID="a7a1d523bcfa3b1d3251ea553bd19b1a828faaa7b9ebab841f04f971be32f6d7" exitCode=0 May 29 14:48:45.300246 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.300104 2564 generic.go:358] "Generic (PLEG): container finished" podID="92994076-f22b-4e9c-89b9-0610ddd5a804" containerID="8ff7ed2e8bbffe4097795cfe7ca52cf03a257c47628f0fb57c1fb346e3ba93bb" exitCode=0 May 29 14:48:45.300246 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.300126 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92994076-f22b-4e9c-89b9-0610ddd5a804","Type":"ContainerDied","Data":"b05b553a59f732ff555805688a4c93c7edd272710f59c8f8b7a6a47072f9d904"} May 29 14:48:45.300246 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.300144 2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.300246 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.300163 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92994076-f22b-4e9c-89b9-0610ddd5a804","Type":"ContainerDied","Data":"b43f7f5c3eebe8ab9895db6e2322451fe3160bd2c62a92459009bdcf0e1db933"} May 29 14:48:45.300246 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.300192 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92994076-f22b-4e9c-89b9-0610ddd5a804","Type":"ContainerDied","Data":"6eb733d09b322fcf7d49c24b53c6b4149700adaf5d740158f4537408ebfa9b7c"} May 29 14:48:45.300246 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.300202 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92994076-f22b-4e9c-89b9-0610ddd5a804","Type":"ContainerDied","Data":"5decf24d42650e46c2163c468ef84032a6bf4a3c63c78d1b9e99fd3097cc44ef"} May 29 14:48:45.300246 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.300211 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92994076-f22b-4e9c-89b9-0610ddd5a804","Type":"ContainerDied","Data":"a7a1d523bcfa3b1d3251ea553bd19b1a828faaa7b9ebab841f04f971be32f6d7"} May 29 14:48:45.300246 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.300220 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92994076-f22b-4e9c-89b9-0610ddd5a804","Type":"ContainerDied","Data":"8ff7ed2e8bbffe4097795cfe7ca52cf03a257c47628f0fb57c1fb346e3ba93bb"} May 29 14:48:45.300246 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.300228 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92994076-f22b-4e9c-89b9-0610ddd5a804","Type":"ContainerDied","Data":"d1fc31f09f39ff65c45e2947ea59b3055a98e0e25bd33d6034da87f892c9feb1"} May 29 14:48:45.300246 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.300243 2564 scope.go:117] "RemoveContainer" containerID="b05b553a59f732ff555805688a4c93c7edd272710f59c8f8b7a6a47072f9d904" May 29 14:48:45.309999 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.309977 2564 scope.go:117] "RemoveContainer" containerID="b43f7f5c3eebe8ab9895db6e2322451fe3160bd2c62a92459009bdcf0e1db933" May 29 14:48:45.318503 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.318277 2564 scope.go:117] "RemoveContainer" containerID="6eb733d09b322fcf7d49c24b53c6b4149700adaf5d740158f4537408ebfa9b7c" May 29 14:48:45.327252 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.327069 2564 scope.go:117] "RemoveContainer" containerID="5decf24d42650e46c2163c468ef84032a6bf4a3c63c78d1b9e99fd3097cc44ef" May 29 14:48:45.335234 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.332875 2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 14:48:45.335234 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.334897 2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 14:48:45.344257 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.344226 2564 scope.go:117] "RemoveContainer" containerID="a7a1d523bcfa3b1d3251ea553bd19b1a828faaa7b9ebab841f04f971be32f6d7" May 29 14:48:45.352683 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.352665 2564 scope.go:117] "RemoveContainer" containerID="8ff7ed2e8bbffe4097795cfe7ca52cf03a257c47628f0fb57c1fb346e3ba93bb" May 29 14:48:45.359600 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.358373 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 14:48:45.359600 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.358745 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92994076-f22b-4e9c-89b9-0610ddd5a804" containerName="init-config-reloader" May 29 14:48:45.359600 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.358760 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="92994076-f22b-4e9c-89b9-0610ddd5a804" containerName="init-config-reloader" May 29 14:48:45.359600 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.358776 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92994076-f22b-4e9c-89b9-0610ddd5a804" containerName="kube-rbac-proxy-thanos" May 29 14:48:45.359600 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.358781 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="92994076-f22b-4e9c-89b9-0610ddd5a804" containerName="kube-rbac-proxy-thanos" May 29 14:48:45.359600 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.358791 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92994076-f22b-4e9c-89b9-0610ddd5a804" containerName="prometheus" May 29 14:48:45.359600 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.358797 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="92994076-f22b-4e9c-89b9-0610ddd5a804" containerName="prometheus" May 29 14:48:45.359600 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.358806 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92994076-f22b-4e9c-89b9-0610ddd5a804" containerName="config-reloader" May 29 14:48:45.359600 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.358811 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="92994076-f22b-4e9c-89b9-0610ddd5a804" containerName="config-reloader" May 29 14:48:45.359600 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.358819 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92994076-f22b-4e9c-89b9-0610ddd5a804" containerName="kube-rbac-proxy-web" May 29 14:48:45.359600 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.358824 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="92994076-f22b-4e9c-89b9-0610ddd5a804" containerName="kube-rbac-proxy-web" May 29 14:48:45.359600 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.358836 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92994076-f22b-4e9c-89b9-0610ddd5a804" containerName="thanos-sidecar" May 29 14:48:45.359600 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.358844 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="92994076-f22b-4e9c-89b9-0610ddd5a804" containerName="thanos-sidecar" May 29 14:48:45.359600 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.358852 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92994076-f22b-4e9c-89b9-0610ddd5a804" containerName="kube-rbac-proxy" May 29 14:48:45.359600 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.358857 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="92994076-f22b-4e9c-89b9-0610ddd5a804" containerName="kube-rbac-proxy" May 29 14:48:45.359600 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.358907 2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="92994076-f22b-4e9c-89b9-0610ddd5a804" containerName="kube-rbac-proxy-thanos" May 29 14:48:45.359600 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.358921 2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="92994076-f22b-4e9c-89b9-0610ddd5a804" containerName="config-reloader" May 29 14:48:45.359600 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.358930 2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="92994076-f22b-4e9c-89b9-0610ddd5a804" containerName="kube-rbac-proxy-web" May 29 14:48:45.359600 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.358939 2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="92994076-f22b-4e9c-89b9-0610ddd5a804" containerName="kube-rbac-proxy" May 29 14:48:45.359600 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.358951 2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="92994076-f22b-4e9c-89b9-0610ddd5a804" containerName="thanos-sidecar" May 29 14:48:45.359600 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.358963 2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="92994076-f22b-4e9c-89b9-0610ddd5a804" containerName="prometheus" May 29 14:48:45.362374 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.362356 2564 scope.go:117] "RemoveContainer" containerID="7e63bdb3df8d713527287ae35fc1e6987ee46258854963585eabd51a8ba41a9c" May 29 14:48:45.363501 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.363485 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.366402 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.366378 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 29 14:48:45.366497 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.366422 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bl2br979s08k6\"" May 29 14:48:45.366613 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.366597 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-ggmhl\"" May 29 14:48:45.366704 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.366688 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 29 14:48:45.366765 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.366722 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 29 14:48:45.366806 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.366793 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 29 14:48:45.367101 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.367088 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 29 14:48:45.367167 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.367107 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 29 14:48:45.367167 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.367138 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 29 14:48:45.367267 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.367163 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 29 14:48:45.367474 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.367462 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 29 14:48:45.368555 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.368534 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 29 14:48:45.370216 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.370167 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 29 14:48:45.372646 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.372476 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 29 14:48:45.375162 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.374436 2564 scope.go:117] "RemoveContainer" containerID="b05b553a59f732ff555805688a4c93c7edd272710f59c8f8b7a6a47072f9d904" May 29 14:48:45.375162 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:48:45.375012 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b05b553a59f732ff555805688a4c93c7edd272710f59c8f8b7a6a47072f9d904\": container with ID starting with b05b553a59f732ff555805688a4c93c7edd272710f59c8f8b7a6a47072f9d904 not found: ID does not exist" containerID="b05b553a59f732ff555805688a4c93c7edd272710f59c8f8b7a6a47072f9d904" May 29 14:48:45.375162 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.375069 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b05b553a59f732ff555805688a4c93c7edd272710f59c8f8b7a6a47072f9d904"} err="failed to get container status \"b05b553a59f732ff555805688a4c93c7edd272710f59c8f8b7a6a47072f9d904\": rpc error: code = NotFound desc = could not find container \"b05b553a59f732ff555805688a4c93c7edd272710f59c8f8b7a6a47072f9d904\": container with ID starting with b05b553a59f732ff555805688a4c93c7edd272710f59c8f8b7a6a47072f9d904 not found: ID does not exist" May 29 14:48:45.375162 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.375094 2564 scope.go:117] "RemoveContainer" containerID="b43f7f5c3eebe8ab9895db6e2322451fe3160bd2c62a92459009bdcf0e1db933" May 29 14:48:45.377343 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:48:45.376411 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b43f7f5c3eebe8ab9895db6e2322451fe3160bd2c62a92459009bdcf0e1db933\": container with ID starting with b43f7f5c3eebe8ab9895db6e2322451fe3160bd2c62a92459009bdcf0e1db933 not found: ID does not exist" containerID="b43f7f5c3eebe8ab9895db6e2322451fe3160bd2c62a92459009bdcf0e1db933" May 29 14:48:45.377343 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.376445 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b43f7f5c3eebe8ab9895db6e2322451fe3160bd2c62a92459009bdcf0e1db933"} err="failed to get container status \"b43f7f5c3eebe8ab9895db6e2322451fe3160bd2c62a92459009bdcf0e1db933\": rpc error: code = NotFound desc = could not find container \"b43f7f5c3eebe8ab9895db6e2322451fe3160bd2c62a92459009bdcf0e1db933\": container with ID starting with b43f7f5c3eebe8ab9895db6e2322451fe3160bd2c62a92459009bdcf0e1db933 not found: ID does not exist" May 29 14:48:45.377343 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.376469 2564 scope.go:117] "RemoveContainer" containerID="6eb733d09b322fcf7d49c24b53c6b4149700adaf5d740158f4537408ebfa9b7c" May 29 14:48:45.378039 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:48:45.377984 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6eb733d09b322fcf7d49c24b53c6b4149700adaf5d740158f4537408ebfa9b7c\": container with ID starting with 6eb733d09b322fcf7d49c24b53c6b4149700adaf5d740158f4537408ebfa9b7c not found: ID does not exist" containerID="6eb733d09b322fcf7d49c24b53c6b4149700adaf5d740158f4537408ebfa9b7c" May 29 14:48:45.378121 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.378042 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6eb733d09b322fcf7d49c24b53c6b4149700adaf5d740158f4537408ebfa9b7c"} err="failed to get container status \"6eb733d09b322fcf7d49c24b53c6b4149700adaf5d740158f4537408ebfa9b7c\": rpc error: code = NotFound desc = could not find container \"6eb733d09b322fcf7d49c24b53c6b4149700adaf5d740158f4537408ebfa9b7c\": container with ID starting with 6eb733d09b322fcf7d49c24b53c6b4149700adaf5d740158f4537408ebfa9b7c not found: ID does not exist" May 29 14:48:45.378121 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.378067 2564 scope.go:117] "RemoveContainer" containerID="5decf24d42650e46c2163c468ef84032a6bf4a3c63c78d1b9e99fd3097cc44ef" May 29 14:48:45.378514 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:48:45.378489 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5decf24d42650e46c2163c468ef84032a6bf4a3c63c78d1b9e99fd3097cc44ef\": container with ID starting with 5decf24d42650e46c2163c468ef84032a6bf4a3c63c78d1b9e99fd3097cc44ef not found: ID does not exist" containerID="5decf24d42650e46c2163c468ef84032a6bf4a3c63c78d1b9e99fd3097cc44ef" May 29 14:48:45.379783 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.378522 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5decf24d42650e46c2163c468ef84032a6bf4a3c63c78d1b9e99fd3097cc44ef"} err="failed to get container status \"5decf24d42650e46c2163c468ef84032a6bf4a3c63c78d1b9e99fd3097cc44ef\": rpc error: code = NotFound desc = could not find container \"5decf24d42650e46c2163c468ef84032a6bf4a3c63c78d1b9e99fd3097cc44ef\": container with ID starting with 5decf24d42650e46c2163c468ef84032a6bf4a3c63c78d1b9e99fd3097cc44ef not found: ID does not exist" May 29 14:48:45.379783 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.378543 2564 scope.go:117] "RemoveContainer" containerID="a7a1d523bcfa3b1d3251ea553bd19b1a828faaa7b9ebab841f04f971be32f6d7" May 29 14:48:45.379783 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:48:45.379128 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7a1d523bcfa3b1d3251ea553bd19b1a828faaa7b9ebab841f04f971be32f6d7\": container with ID starting with a7a1d523bcfa3b1d3251ea553bd19b1a828faaa7b9ebab841f04f971be32f6d7 not found: ID does not exist" containerID="a7a1d523bcfa3b1d3251ea553bd19b1a828faaa7b9ebab841f04f971be32f6d7" May 29 14:48:45.379783 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.379155 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7a1d523bcfa3b1d3251ea553bd19b1a828faaa7b9ebab841f04f971be32f6d7"} err="failed to get container status \"a7a1d523bcfa3b1d3251ea553bd19b1a828faaa7b9ebab841f04f971be32f6d7\": rpc error: code = NotFound desc = could not find container \"a7a1d523bcfa3b1d3251ea553bd19b1a828faaa7b9ebab841f04f971be32f6d7\": container with ID starting with a7a1d523bcfa3b1d3251ea553bd19b1a828faaa7b9ebab841f04f971be32f6d7 not found: ID does not exist" May 29 14:48:45.379783 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.379223 2564 scope.go:117] "RemoveContainer" containerID="8ff7ed2e8bbffe4097795cfe7ca52cf03a257c47628f0fb57c1fb346e3ba93bb" May 29 14:48:45.379783 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:48:45.379643 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ff7ed2e8bbffe4097795cfe7ca52cf03a257c47628f0fb57c1fb346e3ba93bb\": container with ID starting with 8ff7ed2e8bbffe4097795cfe7ca52cf03a257c47628f0fb57c1fb346e3ba93bb not found: ID does not exist" containerID="8ff7ed2e8bbffe4097795cfe7ca52cf03a257c47628f0fb57c1fb346e3ba93bb" May 29 14:48:45.379783 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.379672 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ff7ed2e8bbffe4097795cfe7ca52cf03a257c47628f0fb57c1fb346e3ba93bb"} err="failed to get container status \"8ff7ed2e8bbffe4097795cfe7ca52cf03a257c47628f0fb57c1fb346e3ba93bb\": rpc error: code = NotFound desc = could not find container \"8ff7ed2e8bbffe4097795cfe7ca52cf03a257c47628f0fb57c1fb346e3ba93bb\": container with ID starting with 8ff7ed2e8bbffe4097795cfe7ca52cf03a257c47628f0fb57c1fb346e3ba93bb not found: ID does not exist" May 29 14:48:45.379783 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.379694 2564 scope.go:117] "RemoveContainer" containerID="7e63bdb3df8d713527287ae35fc1e6987ee46258854963585eabd51a8ba41a9c" May 29 14:48:45.380289 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:48:45.380202 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e63bdb3df8d713527287ae35fc1e6987ee46258854963585eabd51a8ba41a9c\": container with ID starting with 7e63bdb3df8d713527287ae35fc1e6987ee46258854963585eabd51a8ba41a9c not found: ID does not exist" containerID="7e63bdb3df8d713527287ae35fc1e6987ee46258854963585eabd51a8ba41a9c" May 29 14:48:45.380289 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.380227 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e63bdb3df8d713527287ae35fc1e6987ee46258854963585eabd51a8ba41a9c"} err="failed to get container status \"7e63bdb3df8d713527287ae35fc1e6987ee46258854963585eabd51a8ba41a9c\": rpc error: code = NotFound desc = could not find container \"7e63bdb3df8d713527287ae35fc1e6987ee46258854963585eabd51a8ba41a9c\": container with ID starting with 7e63bdb3df8d713527287ae35fc1e6987ee46258854963585eabd51a8ba41a9c not found: ID does not exist" May 29 14:48:45.380289 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.380249 2564 scope.go:117] "RemoveContainer" containerID="b05b553a59f732ff555805688a4c93c7edd272710f59c8f8b7a6a47072f9d904" May 29 14:48:45.380520 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.380496 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b05b553a59f732ff555805688a4c93c7edd272710f59c8f8b7a6a47072f9d904"} err="failed to get container status \"b05b553a59f732ff555805688a4c93c7edd272710f59c8f8b7a6a47072f9d904\": rpc error: code = NotFound desc = could not find container \"b05b553a59f732ff555805688a4c93c7edd272710f59c8f8b7a6a47072f9d904\": container with ID starting with b05b553a59f732ff555805688a4c93c7edd272710f59c8f8b7a6a47072f9d904 not found: ID does not exist" May 29 14:48:45.380591 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.380524 2564 scope.go:117] "RemoveContainer" containerID="b43f7f5c3eebe8ab9895db6e2322451fe3160bd2c62a92459009bdcf0e1db933" May 29 14:48:45.380702 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.380677 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 14:48:45.380798 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.380744 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b43f7f5c3eebe8ab9895db6e2322451fe3160bd2c62a92459009bdcf0e1db933"} err="failed to get container status \"b43f7f5c3eebe8ab9895db6e2322451fe3160bd2c62a92459009bdcf0e1db933\": rpc error: code = NotFound desc = could not find container \"b43f7f5c3eebe8ab9895db6e2322451fe3160bd2c62a92459009bdcf0e1db933\": container with ID starting with b43f7f5c3eebe8ab9895db6e2322451fe3160bd2c62a92459009bdcf0e1db933 not found: ID does not exist" May 29 14:48:45.380798 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.380763 2564 scope.go:117] "RemoveContainer" containerID="6eb733d09b322fcf7d49c24b53c6b4149700adaf5d740158f4537408ebfa9b7c" May 29 14:48:45.381030 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.381003 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6eb733d09b322fcf7d49c24b53c6b4149700adaf5d740158f4537408ebfa9b7c"} err="failed to get container status \"6eb733d09b322fcf7d49c24b53c6b4149700adaf5d740158f4537408ebfa9b7c\": rpc error: code = NotFound desc = could not find container \"6eb733d09b322fcf7d49c24b53c6b4149700adaf5d740158f4537408ebfa9b7c\": container with ID starting with 6eb733d09b322fcf7d49c24b53c6b4149700adaf5d740158f4537408ebfa9b7c not found: ID does not exist" May 29 14:48:45.381101 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.381034 2564 scope.go:117] "RemoveContainer" containerID="5decf24d42650e46c2163c468ef84032a6bf4a3c63c78d1b9e99fd3097cc44ef" May 29 14:48:45.381390 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.381370 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5decf24d42650e46c2163c468ef84032a6bf4a3c63c78d1b9e99fd3097cc44ef"} err="failed to get container status \"5decf24d42650e46c2163c468ef84032a6bf4a3c63c78d1b9e99fd3097cc44ef\": rpc error: code = NotFound desc = could not find container \"5decf24d42650e46c2163c468ef84032a6bf4a3c63c78d1b9e99fd3097cc44ef\": container with ID starting with 5decf24d42650e46c2163c468ef84032a6bf4a3c63c78d1b9e99fd3097cc44ef not found: ID does not exist" May 29 14:48:45.381390 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.381389 2564 scope.go:117] "RemoveContainer" containerID="a7a1d523bcfa3b1d3251ea553bd19b1a828faaa7b9ebab841f04f971be32f6d7" May 29 14:48:45.381619 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.381602 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7a1d523bcfa3b1d3251ea553bd19b1a828faaa7b9ebab841f04f971be32f6d7"} err="failed to get container status \"a7a1d523bcfa3b1d3251ea553bd19b1a828faaa7b9ebab841f04f971be32f6d7\": rpc error: code = NotFound desc = could not find container \"a7a1d523bcfa3b1d3251ea553bd19b1a828faaa7b9ebab841f04f971be32f6d7\": container with ID starting with a7a1d523bcfa3b1d3251ea553bd19b1a828faaa7b9ebab841f04f971be32f6d7 not found: ID does not exist" May 29 14:48:45.381679 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.381618 2564 scope.go:117] "RemoveContainer" containerID="8ff7ed2e8bbffe4097795cfe7ca52cf03a257c47628f0fb57c1fb346e3ba93bb" May 29 14:48:45.381886 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.381819 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ff7ed2e8bbffe4097795cfe7ca52cf03a257c47628f0fb57c1fb346e3ba93bb"} err="failed to get container status \"8ff7ed2e8bbffe4097795cfe7ca52cf03a257c47628f0fb57c1fb346e3ba93bb\": rpc error: code = NotFound desc = could not find container \"8ff7ed2e8bbffe4097795cfe7ca52cf03a257c47628f0fb57c1fb346e3ba93bb\": container with ID starting with 8ff7ed2e8bbffe4097795cfe7ca52cf03a257c47628f0fb57c1fb346e3ba93bb not found: ID does not exist" May 29 14:48:45.381886 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.381844 2564 scope.go:117] "RemoveContainer" containerID="7e63bdb3df8d713527287ae35fc1e6987ee46258854963585eabd51a8ba41a9c" May 29 14:48:45.382882 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.382399 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e63bdb3df8d713527287ae35fc1e6987ee46258854963585eabd51a8ba41a9c"} err="failed to get container status \"7e63bdb3df8d713527287ae35fc1e6987ee46258854963585eabd51a8ba41a9c\": rpc error: code = NotFound desc = could not find container \"7e63bdb3df8d713527287ae35fc1e6987ee46258854963585eabd51a8ba41a9c\": container with ID starting with 7e63bdb3df8d713527287ae35fc1e6987ee46258854963585eabd51a8ba41a9c not found: ID does not exist" May 29 14:48:45.382882 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.382426 2564 scope.go:117] "RemoveContainer" containerID="b05b553a59f732ff555805688a4c93c7edd272710f59c8f8b7a6a47072f9d904" May 29 14:48:45.383107 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.383078 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b05b553a59f732ff555805688a4c93c7edd272710f59c8f8b7a6a47072f9d904"} err="failed to get container status \"b05b553a59f732ff555805688a4c93c7edd272710f59c8f8b7a6a47072f9d904\": rpc error: code = NotFound desc = could not find container \"b05b553a59f732ff555805688a4c93c7edd272710f59c8f8b7a6a47072f9d904\": container with ID starting with b05b553a59f732ff555805688a4c93c7edd272710f59c8f8b7a6a47072f9d904 not found: ID does not exist" May 29 14:48:45.383213 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.383111 2564 scope.go:117] "RemoveContainer" containerID="b43f7f5c3eebe8ab9895db6e2322451fe3160bd2c62a92459009bdcf0e1db933" May 29 14:48:45.383467 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.383377 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b43f7f5c3eebe8ab9895db6e2322451fe3160bd2c62a92459009bdcf0e1db933"} err="failed to get container status \"b43f7f5c3eebe8ab9895db6e2322451fe3160bd2c62a92459009bdcf0e1db933\": rpc error: code = NotFound desc = could not find container \"b43f7f5c3eebe8ab9895db6e2322451fe3160bd2c62a92459009bdcf0e1db933\": container with ID starting with b43f7f5c3eebe8ab9895db6e2322451fe3160bd2c62a92459009bdcf0e1db933 not found: ID does not exist" May 29 14:48:45.383467 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.383403 2564 scope.go:117] "RemoveContainer" containerID="6eb733d09b322fcf7d49c24b53c6b4149700adaf5d740158f4537408ebfa9b7c" May 29 14:48:45.383754 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.383669 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6eb733d09b322fcf7d49c24b53c6b4149700adaf5d740158f4537408ebfa9b7c"} err="failed to get container status \"6eb733d09b322fcf7d49c24b53c6b4149700adaf5d740158f4537408ebfa9b7c\": rpc error: code = NotFound desc = could not find container \"6eb733d09b322fcf7d49c24b53c6b4149700adaf5d740158f4537408ebfa9b7c\": container with ID starting with 6eb733d09b322fcf7d49c24b53c6b4149700adaf5d740158f4537408ebfa9b7c not found: ID does not exist" May 29 14:48:45.383754 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.383691 2564 scope.go:117] "RemoveContainer" containerID="5decf24d42650e46c2163c468ef84032a6bf4a3c63c78d1b9e99fd3097cc44ef" May 29 14:48:45.384037 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.383966 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5decf24d42650e46c2163c468ef84032a6bf4a3c63c78d1b9e99fd3097cc44ef"} err="failed to get container status \"5decf24d42650e46c2163c468ef84032a6bf4a3c63c78d1b9e99fd3097cc44ef\": rpc error: code = NotFound desc = could not find container \"5decf24d42650e46c2163c468ef84032a6bf4a3c63c78d1b9e99fd3097cc44ef\": container with ID starting with 5decf24d42650e46c2163c468ef84032a6bf4a3c63c78d1b9e99fd3097cc44ef not found: ID does not exist" May 29 14:48:45.384037 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.383989 2564 scope.go:117] "RemoveContainer" containerID="a7a1d523bcfa3b1d3251ea553bd19b1a828faaa7b9ebab841f04f971be32f6d7" May 29 14:48:45.384267 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.384236 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7a1d523bcfa3b1d3251ea553bd19b1a828faaa7b9ebab841f04f971be32f6d7"} err="failed to get container status \"a7a1d523bcfa3b1d3251ea553bd19b1a828faaa7b9ebab841f04f971be32f6d7\": rpc error: code = NotFound desc = could not find container \"a7a1d523bcfa3b1d3251ea553bd19b1a828faaa7b9ebab841f04f971be32f6d7\": container with ID starting with a7a1d523bcfa3b1d3251ea553bd19b1a828faaa7b9ebab841f04f971be32f6d7 not found: ID does not exist" May 29 14:48:45.384356 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.384269 2564 scope.go:117] "RemoveContainer" containerID="8ff7ed2e8bbffe4097795cfe7ca52cf03a257c47628f0fb57c1fb346e3ba93bb" May 29 14:48:45.384531 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.384510 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ff7ed2e8bbffe4097795cfe7ca52cf03a257c47628f0fb57c1fb346e3ba93bb"} err="failed to get container status \"8ff7ed2e8bbffe4097795cfe7ca52cf03a257c47628f0fb57c1fb346e3ba93bb\": rpc error: code = NotFound desc = could not find container \"8ff7ed2e8bbffe4097795cfe7ca52cf03a257c47628f0fb57c1fb346e3ba93bb\": container with ID starting with 8ff7ed2e8bbffe4097795cfe7ca52cf03a257c47628f0fb57c1fb346e3ba93bb not found: ID does not exist" May 29 14:48:45.384585 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.384534 2564 scope.go:117] "RemoveContainer" containerID="7e63bdb3df8d713527287ae35fc1e6987ee46258854963585eabd51a8ba41a9c" May 29 14:48:45.384868 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.384845 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e63bdb3df8d713527287ae35fc1e6987ee46258854963585eabd51a8ba41a9c"} err="failed to get container status \"7e63bdb3df8d713527287ae35fc1e6987ee46258854963585eabd51a8ba41a9c\": rpc error: code = NotFound desc = could not find container \"7e63bdb3df8d713527287ae35fc1e6987ee46258854963585eabd51a8ba41a9c\": container with ID starting with 7e63bdb3df8d713527287ae35fc1e6987ee46258854963585eabd51a8ba41a9c not found: ID does not exist" May 29 14:48:45.384868 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.384869 2564 scope.go:117] "RemoveContainer" containerID="b05b553a59f732ff555805688a4c93c7edd272710f59c8f8b7a6a47072f9d904" May 29 14:48:45.385149 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.385127 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b05b553a59f732ff555805688a4c93c7edd272710f59c8f8b7a6a47072f9d904"} err="failed to get container status \"b05b553a59f732ff555805688a4c93c7edd272710f59c8f8b7a6a47072f9d904\": rpc error: code = NotFound desc = could not find container \"b05b553a59f732ff555805688a4c93c7edd272710f59c8f8b7a6a47072f9d904\": container with ID starting with b05b553a59f732ff555805688a4c93c7edd272710f59c8f8b7a6a47072f9d904 not found: ID does not exist" May 29 14:48:45.385149 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.385149 2564 scope.go:117] "RemoveContainer" containerID="b43f7f5c3eebe8ab9895db6e2322451fe3160bd2c62a92459009bdcf0e1db933" May 29 14:48:45.385450 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.385431 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b43f7f5c3eebe8ab9895db6e2322451fe3160bd2c62a92459009bdcf0e1db933"} err="failed to get container status \"b43f7f5c3eebe8ab9895db6e2322451fe3160bd2c62a92459009bdcf0e1db933\": rpc error: code = NotFound desc = could not find container \"b43f7f5c3eebe8ab9895db6e2322451fe3160bd2c62a92459009bdcf0e1db933\": container with ID starting with b43f7f5c3eebe8ab9895db6e2322451fe3160bd2c62a92459009bdcf0e1db933 not found: ID does not exist" May 29 14:48:45.385541 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.385451 2564 scope.go:117] "RemoveContainer" containerID="6eb733d09b322fcf7d49c24b53c6b4149700adaf5d740158f4537408ebfa9b7c" May 29 14:48:45.385710 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.385688 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6eb733d09b322fcf7d49c24b53c6b4149700adaf5d740158f4537408ebfa9b7c"} err="failed to get container status \"6eb733d09b322fcf7d49c24b53c6b4149700adaf5d740158f4537408ebfa9b7c\": rpc error: code = NotFound desc = could not find container \"6eb733d09b322fcf7d49c24b53c6b4149700adaf5d740158f4537408ebfa9b7c\": container with ID starting with 6eb733d09b322fcf7d49c24b53c6b4149700adaf5d740158f4537408ebfa9b7c not found: ID does not exist" May 29 14:48:45.385760 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.385709 2564 scope.go:117] "RemoveContainer" containerID="5decf24d42650e46c2163c468ef84032a6bf4a3c63c78d1b9e99fd3097cc44ef" May 29 14:48:45.385986 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.385959 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5decf24d42650e46c2163c468ef84032a6bf4a3c63c78d1b9e99fd3097cc44ef"} err="failed to get container status \"5decf24d42650e46c2163c468ef84032a6bf4a3c63c78d1b9e99fd3097cc44ef\": rpc error: code = NotFound desc = could not find container \"5decf24d42650e46c2163c468ef84032a6bf4a3c63c78d1b9e99fd3097cc44ef\": container with ID starting with 5decf24d42650e46c2163c468ef84032a6bf4a3c63c78d1b9e99fd3097cc44ef not found: ID does not exist" May 29 14:48:45.385986 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.385985 2564 scope.go:117] "RemoveContainer" containerID="a7a1d523bcfa3b1d3251ea553bd19b1a828faaa7b9ebab841f04f971be32f6d7" May 29 14:48:45.386347 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.386322 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7a1d523bcfa3b1d3251ea553bd19b1a828faaa7b9ebab841f04f971be32f6d7"} err="failed to get container status \"a7a1d523bcfa3b1d3251ea553bd19b1a828faaa7b9ebab841f04f971be32f6d7\": rpc error: code = NotFound desc = could not find container \"a7a1d523bcfa3b1d3251ea553bd19b1a828faaa7b9ebab841f04f971be32f6d7\": container with ID starting with a7a1d523bcfa3b1d3251ea553bd19b1a828faaa7b9ebab841f04f971be32f6d7 not found: ID does not exist" May 29 14:48:45.386425 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.386350 2564 scope.go:117] "RemoveContainer" containerID="8ff7ed2e8bbffe4097795cfe7ca52cf03a257c47628f0fb57c1fb346e3ba93bb" May 29 14:48:45.386600 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.386579 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ff7ed2e8bbffe4097795cfe7ca52cf03a257c47628f0fb57c1fb346e3ba93bb"} err="failed to get container status \"8ff7ed2e8bbffe4097795cfe7ca52cf03a257c47628f0fb57c1fb346e3ba93bb\": rpc error: code = NotFound desc = could not find container \"8ff7ed2e8bbffe4097795cfe7ca52cf03a257c47628f0fb57c1fb346e3ba93bb\": container with ID starting with 8ff7ed2e8bbffe4097795cfe7ca52cf03a257c47628f0fb57c1fb346e3ba93bb not found: ID does not exist" May 29 14:48:45.386665 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.386603 2564 scope.go:117] "RemoveContainer" containerID="7e63bdb3df8d713527287ae35fc1e6987ee46258854963585eabd51a8ba41a9c" May 29 14:48:45.386832 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.386806 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e63bdb3df8d713527287ae35fc1e6987ee46258854963585eabd51a8ba41a9c"} err="failed to get container status \"7e63bdb3df8d713527287ae35fc1e6987ee46258854963585eabd51a8ba41a9c\": rpc error: code = NotFound desc = could not find container \"7e63bdb3df8d713527287ae35fc1e6987ee46258854963585eabd51a8ba41a9c\": container with ID starting with 7e63bdb3df8d713527287ae35fc1e6987ee46258854963585eabd51a8ba41a9c not found: ID does not exist" May 29 14:48:45.386914 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.386834 2564 scope.go:117] "RemoveContainer" containerID="b05b553a59f732ff555805688a4c93c7edd272710f59c8f8b7a6a47072f9d904" May 29 14:48:45.387098 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.387069 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b05b553a59f732ff555805688a4c93c7edd272710f59c8f8b7a6a47072f9d904"} err="failed to get container status \"b05b553a59f732ff555805688a4c93c7edd272710f59c8f8b7a6a47072f9d904\": rpc error: code = NotFound desc = could not find container \"b05b553a59f732ff555805688a4c93c7edd272710f59c8f8b7a6a47072f9d904\": container with ID starting with b05b553a59f732ff555805688a4c93c7edd272710f59c8f8b7a6a47072f9d904 not found: ID does not exist" May 29 14:48:45.387195 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.387099 2564 scope.go:117] "RemoveContainer" containerID="b43f7f5c3eebe8ab9895db6e2322451fe3160bd2c62a92459009bdcf0e1db933" May 29 14:48:45.387368 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.387346 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b43f7f5c3eebe8ab9895db6e2322451fe3160bd2c62a92459009bdcf0e1db933"} err="failed to get container status \"b43f7f5c3eebe8ab9895db6e2322451fe3160bd2c62a92459009bdcf0e1db933\": rpc error: code = NotFound desc = could not find container \"b43f7f5c3eebe8ab9895db6e2322451fe3160bd2c62a92459009bdcf0e1db933\": container with ID starting with b43f7f5c3eebe8ab9895db6e2322451fe3160bd2c62a92459009bdcf0e1db933 not found: ID does not exist" May 29 14:48:45.387453 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.387370 2564 scope.go:117] "RemoveContainer" containerID="6eb733d09b322fcf7d49c24b53c6b4149700adaf5d740158f4537408ebfa9b7c" May 29 14:48:45.387598 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.387575 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6eb733d09b322fcf7d49c24b53c6b4149700adaf5d740158f4537408ebfa9b7c"} err="failed to get container status \"6eb733d09b322fcf7d49c24b53c6b4149700adaf5d740158f4537408ebfa9b7c\": rpc error: code = NotFound desc = could not find container \"6eb733d09b322fcf7d49c24b53c6b4149700adaf5d740158f4537408ebfa9b7c\": container with ID starting with 6eb733d09b322fcf7d49c24b53c6b4149700adaf5d740158f4537408ebfa9b7c not found: ID does not exist" May 29 14:48:45.387671 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.387600 2564 scope.go:117] "RemoveContainer" containerID="5decf24d42650e46c2163c468ef84032a6bf4a3c63c78d1b9e99fd3097cc44ef" May 29 14:48:45.387823 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.387800 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5decf24d42650e46c2163c468ef84032a6bf4a3c63c78d1b9e99fd3097cc44ef"} err="failed to get container status \"5decf24d42650e46c2163c468ef84032a6bf4a3c63c78d1b9e99fd3097cc44ef\": rpc error: code = NotFound desc = could not find container \"5decf24d42650e46c2163c468ef84032a6bf4a3c63c78d1b9e99fd3097cc44ef\": container with ID starting with 5decf24d42650e46c2163c468ef84032a6bf4a3c63c78d1b9e99fd3097cc44ef not found: ID does not exist" May 29 14:48:45.387894 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.387825 2564 scope.go:117] "RemoveContainer" containerID="a7a1d523bcfa3b1d3251ea553bd19b1a828faaa7b9ebab841f04f971be32f6d7" May 29 14:48:45.388043 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.388023 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7a1d523bcfa3b1d3251ea553bd19b1a828faaa7b9ebab841f04f971be32f6d7"} err="failed to get container status \"a7a1d523bcfa3b1d3251ea553bd19b1a828faaa7b9ebab841f04f971be32f6d7\": rpc error: code = NotFound desc = could not find container \"a7a1d523bcfa3b1d3251ea553bd19b1a828faaa7b9ebab841f04f971be32f6d7\": container with ID starting with a7a1d523bcfa3b1d3251ea553bd19b1a828faaa7b9ebab841f04f971be32f6d7 not found: ID does not exist" May 29 14:48:45.388122 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.388044 2564 scope.go:117] "RemoveContainer" containerID="8ff7ed2e8bbffe4097795cfe7ca52cf03a257c47628f0fb57c1fb346e3ba93bb" May 29 14:48:45.388323 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.388296 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ff7ed2e8bbffe4097795cfe7ca52cf03a257c47628f0fb57c1fb346e3ba93bb"} err="failed to get container status \"8ff7ed2e8bbffe4097795cfe7ca52cf03a257c47628f0fb57c1fb346e3ba93bb\": rpc error: code = NotFound desc = could not find container \"8ff7ed2e8bbffe4097795cfe7ca52cf03a257c47628f0fb57c1fb346e3ba93bb\": container with ID starting with 8ff7ed2e8bbffe4097795cfe7ca52cf03a257c47628f0fb57c1fb346e3ba93bb not found: ID does not exist" May 29 14:48:45.388414 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.388324 2564 scope.go:117] "RemoveContainer" containerID="7e63bdb3df8d713527287ae35fc1e6987ee46258854963585eabd51a8ba41a9c" May 29 14:48:45.388621 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.388545 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e63bdb3df8d713527287ae35fc1e6987ee46258854963585eabd51a8ba41a9c"} err="failed to get container status \"7e63bdb3df8d713527287ae35fc1e6987ee46258854963585eabd51a8ba41a9c\": rpc error: code = NotFound desc = could not find container \"7e63bdb3df8d713527287ae35fc1e6987ee46258854963585eabd51a8ba41a9c\": container with ID starting with 7e63bdb3df8d713527287ae35fc1e6987ee46258854963585eabd51a8ba41a9c not found: ID does not exist" May 29 14:48:45.388621 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.388568 2564 scope.go:117] "RemoveContainer" containerID="b05b553a59f732ff555805688a4c93c7edd272710f59c8f8b7a6a47072f9d904" May 29 14:48:45.388828 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.388800 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b05b553a59f732ff555805688a4c93c7edd272710f59c8f8b7a6a47072f9d904"} err="failed to get container status \"b05b553a59f732ff555805688a4c93c7edd272710f59c8f8b7a6a47072f9d904\": rpc error: code = NotFound desc = could not find container \"b05b553a59f732ff555805688a4c93c7edd272710f59c8f8b7a6a47072f9d904\": container with ID starting with b05b553a59f732ff555805688a4c93c7edd272710f59c8f8b7a6a47072f9d904 not found: ID does not exist" May 29 14:48:45.388901 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.388831 2564 scope.go:117] "RemoveContainer" containerID="b43f7f5c3eebe8ab9895db6e2322451fe3160bd2c62a92459009bdcf0e1db933" May 29 14:48:45.389068 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.389050 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b43f7f5c3eebe8ab9895db6e2322451fe3160bd2c62a92459009bdcf0e1db933"} err="failed to get container status \"b43f7f5c3eebe8ab9895db6e2322451fe3160bd2c62a92459009bdcf0e1db933\": rpc error: code = NotFound desc = could not find container \"b43f7f5c3eebe8ab9895db6e2322451fe3160bd2c62a92459009bdcf0e1db933\": container with ID starting with b43f7f5c3eebe8ab9895db6e2322451fe3160bd2c62a92459009bdcf0e1db933 not found: ID does not exist" May 29 14:48:45.389141 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.389071 2564 scope.go:117] "RemoveContainer" containerID="6eb733d09b322fcf7d49c24b53c6b4149700adaf5d740158f4537408ebfa9b7c" May 29 14:48:45.389349 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.389328 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6eb733d09b322fcf7d49c24b53c6b4149700adaf5d740158f4537408ebfa9b7c"} err="failed to get container status \"6eb733d09b322fcf7d49c24b53c6b4149700adaf5d740158f4537408ebfa9b7c\": rpc error: code = NotFound desc = could not find container \"6eb733d09b322fcf7d49c24b53c6b4149700adaf5d740158f4537408ebfa9b7c\": container with ID starting with 6eb733d09b322fcf7d49c24b53c6b4149700adaf5d740158f4537408ebfa9b7c not found: ID does not exist" May 29 14:48:45.389349 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.389348 2564 scope.go:117] "RemoveContainer" containerID="5decf24d42650e46c2163c468ef84032a6bf4a3c63c78d1b9e99fd3097cc44ef" May 29 14:48:45.389577 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.389558 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5decf24d42650e46c2163c468ef84032a6bf4a3c63c78d1b9e99fd3097cc44ef"} err="failed to get container status \"5decf24d42650e46c2163c468ef84032a6bf4a3c63c78d1b9e99fd3097cc44ef\": rpc error: code = NotFound desc = could not find container \"5decf24d42650e46c2163c468ef84032a6bf4a3c63c78d1b9e99fd3097cc44ef\": container with ID starting with 5decf24d42650e46c2163c468ef84032a6bf4a3c63c78d1b9e99fd3097cc44ef not found: ID does not exist" May 29 14:48:45.389577 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.389576 2564 scope.go:117] "RemoveContainer" containerID="a7a1d523bcfa3b1d3251ea553bd19b1a828faaa7b9ebab841f04f971be32f6d7" May 29 14:48:45.389894 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.389868 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7a1d523bcfa3b1d3251ea553bd19b1a828faaa7b9ebab841f04f971be32f6d7"} err="failed to get container status \"a7a1d523bcfa3b1d3251ea553bd19b1a828faaa7b9ebab841f04f971be32f6d7\": rpc error: code = NotFound desc = could not find container \"a7a1d523bcfa3b1d3251ea553bd19b1a828faaa7b9ebab841f04f971be32f6d7\": container with ID starting with a7a1d523bcfa3b1d3251ea553bd19b1a828faaa7b9ebab841f04f971be32f6d7 not found: ID does not exist" May 29 14:48:45.389959 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.389895 2564 scope.go:117] "RemoveContainer" containerID="8ff7ed2e8bbffe4097795cfe7ca52cf03a257c47628f0fb57c1fb346e3ba93bb" May 29 14:48:45.390294 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.390262 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ff7ed2e8bbffe4097795cfe7ca52cf03a257c47628f0fb57c1fb346e3ba93bb"} err="failed to get container status \"8ff7ed2e8bbffe4097795cfe7ca52cf03a257c47628f0fb57c1fb346e3ba93bb\": rpc error: code = NotFound desc = could not find container \"8ff7ed2e8bbffe4097795cfe7ca52cf03a257c47628f0fb57c1fb346e3ba93bb\": container with ID starting with 8ff7ed2e8bbffe4097795cfe7ca52cf03a257c47628f0fb57c1fb346e3ba93bb not found: ID does not exist" May 29 14:48:45.390294 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.390294 2564 scope.go:117] "RemoveContainer" containerID="7e63bdb3df8d713527287ae35fc1e6987ee46258854963585eabd51a8ba41a9c" May 29 14:48:45.390586 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.390563 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e63bdb3df8d713527287ae35fc1e6987ee46258854963585eabd51a8ba41a9c"} err="failed to get container status \"7e63bdb3df8d713527287ae35fc1e6987ee46258854963585eabd51a8ba41a9c\": rpc error: code = NotFound desc = could not find container \"7e63bdb3df8d713527287ae35fc1e6987ee46258854963585eabd51a8ba41a9c\": container with ID starting with 7e63bdb3df8d713527287ae35fc1e6987ee46258854963585eabd51a8ba41a9c not found: ID does not exist" May 29 14:48:45.483231 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.483100 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7545f44-c0b4-4740-82d8-e74e15d9acb7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.483231 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.483148 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d7545f44-c0b4-4740-82d8-e74e15d9acb7-config\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.483231 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.483231 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d7545f44-c0b4-4740-82d8-e74e15d9acb7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.483497 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.483266 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d7545f44-c0b4-4740-82d8-e74e15d9acb7-web-config\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.483497 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.483290 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps6r7\" (UniqueName: \"kubernetes.io/projected/d7545f44-c0b4-4740-82d8-e74e15d9acb7-kube-api-access-ps6r7\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.483497 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.483323 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d7545f44-c0b4-4740-82d8-e74e15d9acb7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.483497 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.483364 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d7545f44-c0b4-4740-82d8-e74e15d9acb7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.483497 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.483389 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7545f44-c0b4-4740-82d8-e74e15d9acb7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.483497 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.483436 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d7545f44-c0b4-4740-82d8-e74e15d9acb7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.483497 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.483479 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d7545f44-c0b4-4740-82d8-e74e15d9acb7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.483757 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.483500 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d7545f44-c0b4-4740-82d8-e74e15d9acb7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.483757 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.483521 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d7545f44-c0b4-4740-82d8-e74e15d9acb7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.483757 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.483541 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d7545f44-c0b4-4740-82d8-e74e15d9acb7-config-out\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.483757 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.483556 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7545f44-c0b4-4740-82d8-e74e15d9acb7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.483757 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.483609 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d7545f44-c0b4-4740-82d8-e74e15d9acb7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.483757 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.483654 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d7545f44-c0b4-4740-82d8-e74e15d9acb7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.483757 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.483669 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7545f44-c0b4-4740-82d8-e74e15d9acb7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.483757 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.483697 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d7545f44-c0b4-4740-82d8-e74e15d9acb7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.584615 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.584568 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d7545f44-c0b4-4740-82d8-e74e15d9acb7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.584798 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.584628 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d7545f44-c0b4-4740-82d8-e74e15d9acb7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.584798 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.584655 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7545f44-c0b4-4740-82d8-e74e15d9acb7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.584798 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.584686 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d7545f44-c0b4-4740-82d8-e74e15d9acb7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.584798 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.584710 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7545f44-c0b4-4740-82d8-e74e15d9acb7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.584798 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.584762 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d7545f44-c0b4-4740-82d8-e74e15d9acb7-config\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.585095 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.584826 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d7545f44-c0b4-4740-82d8-e74e15d9acb7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.585095 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.584866 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d7545f44-c0b4-4740-82d8-e74e15d9acb7-web-config\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.585095 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.584892 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ps6r7\" (UniqueName: \"kubernetes.io/projected/d7545f44-c0b4-4740-82d8-e74e15d9acb7-kube-api-access-ps6r7\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.585095 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.584931 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d7545f44-c0b4-4740-82d8-e74e15d9acb7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.585095 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.584972 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d7545f44-c0b4-4740-82d8-e74e15d9acb7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.585095 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.584999 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7545f44-c0b4-4740-82d8-e74e15d9acb7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.585095 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.585034 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d7545f44-c0b4-4740-82d8-e74e15d9acb7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.585095 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.585066 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d7545f44-c0b4-4740-82d8-e74e15d9acb7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.585492 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.585121 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d7545f44-c0b4-4740-82d8-e74e15d9acb7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.585492 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.585147 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d7545f44-c0b4-4740-82d8-e74e15d9acb7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.585492 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.585157 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d7545f44-c0b4-4740-82d8-e74e15d9acb7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.585492 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.585229 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d7545f44-c0b4-4740-82d8-e74e15d9acb7-config-out\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.585492 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.585257 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7545f44-c0b4-4740-82d8-e74e15d9acb7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.586328 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.585883 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7545f44-c0b4-4740-82d8-e74e15d9acb7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.586533 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.586510 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7545f44-c0b4-4740-82d8-e74e15d9acb7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.587091 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.586776 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7545f44-c0b4-4740-82d8-e74e15d9acb7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.587091 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.586956 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7545f44-c0b4-4740-82d8-e74e15d9acb7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.589023 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.588997 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d7545f44-c0b4-4740-82d8-e74e15d9acb7-config-out\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.589139 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.589118 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d7545f44-c0b4-4740-82d8-e74e15d9acb7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.589456 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.589433 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d7545f44-c0b4-4740-82d8-e74e15d9acb7-config\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.589623 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.589598 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d7545f44-c0b4-4740-82d8-e74e15d9acb7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.589860 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.589831 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d7545f44-c0b4-4740-82d8-e74e15d9acb7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.589948 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.589859 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d7545f44-c0b4-4740-82d8-e74e15d9acb7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.590285 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.590254 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d7545f44-c0b4-4740-82d8-e74e15d9acb7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.590384 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.590261 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d7545f44-c0b4-4740-82d8-e74e15d9acb7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.590710 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.590693 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d7545f44-c0b4-4740-82d8-e74e15d9acb7-web-config\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.590781 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.590770 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d7545f44-c0b4-4740-82d8-e74e15d9acb7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.590830 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.590806 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d7545f44-c0b4-4740-82d8-e74e15d9acb7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.591119 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.591104 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d7545f44-c0b4-4740-82d8-e74e15d9acb7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.593812 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.593790 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps6r7\" (UniqueName: \"kubernetes.io/projected/d7545f44-c0b4-4740-82d8-e74e15d9acb7-kube-api-access-ps6r7\") pod \"prometheus-k8s-0\" (UID: \"d7545f44-c0b4-4740-82d8-e74e15d9acb7\") " pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.655634 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.655596 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92994076-f22b-4e9c-89b9-0610ddd5a804" path="/var/lib/kubelet/pods/92994076-f22b-4e9c-89b9-0610ddd5a804/volumes" May 29 14:48:45.676118 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.676082 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:45.823763 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:45.823737 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 29 14:48:45.826433 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:48:45.826394 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7545f44_c0b4_4740_82d8_e74e15d9acb7.slice/crio-cb00ec808e317dcce95c4cb52bddc1a3beabce5ce8b3b70723d30e8edce4ce7b WatchSource:0}: Error finding container cb00ec808e317dcce95c4cb52bddc1a3beabce5ce8b3b70723d30e8edce4ce7b: Status 404 returned error can't find the container with id cb00ec808e317dcce95c4cb52bddc1a3beabce5ce8b3b70723d30e8edce4ce7b May 29 14:48:46.305925 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:46.305888 2564 generic.go:358] "Generic (PLEG): container finished" podID="d7545f44-c0b4-4740-82d8-e74e15d9acb7" containerID="df3a9a3c6281df883f24e945120fb5afd9a52fc09659d0ae49b0d8a10e1f179b" exitCode=0 May 29 14:48:46.306342 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:46.305966 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d7545f44-c0b4-4740-82d8-e74e15d9acb7","Type":"ContainerDied","Data":"df3a9a3c6281df883f24e945120fb5afd9a52fc09659d0ae49b0d8a10e1f179b"} May 29 14:48:46.306342 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:46.305998 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d7545f44-c0b4-4740-82d8-e74e15d9acb7","Type":"ContainerStarted","Data":"cb00ec808e317dcce95c4cb52bddc1a3beabce5ce8b3b70723d30e8edce4ce7b"} May 29 14:48:47.313492 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:47.313456 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d7545f44-c0b4-4740-82d8-e74e15d9acb7","Type":"ContainerStarted","Data":"7e8d84efae82fd03ba5375a633a5459332e97b900156829114afc03dd416bf0d"} May 29 14:48:47.313492 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:47.313498 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d7545f44-c0b4-4740-82d8-e74e15d9acb7","Type":"ContainerStarted","Data":"2db1e1c3e8a42d813cf0ad1cd7b7d41666d8a68b0a1b30d60039da8b024e2e88"} May 29 14:48:47.313968 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:47.313510 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d7545f44-c0b4-4740-82d8-e74e15d9acb7","Type":"ContainerStarted","Data":"9d31433679c0a32f83d4789b9acb4989d7bd36d69a0a61dcc8a428a55b58a509"} May 29 14:48:47.313968 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:47.313522 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d7545f44-c0b4-4740-82d8-e74e15d9acb7","Type":"ContainerStarted","Data":"de69ac33fda39b9e3f3e30c6884c457c5b6df411aa36729fec8e5ab2c776af51"} May 29 14:48:47.313968 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:47.313532 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d7545f44-c0b4-4740-82d8-e74e15d9acb7","Type":"ContainerStarted","Data":"88044b09d23a094bad70395eeced95857948d999f83df727e15130f35c2f67d2"} May 29 14:48:47.313968 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:47.313543 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d7545f44-c0b4-4740-82d8-e74e15d9acb7","Type":"ContainerStarted","Data":"7ef33c4dda7264a8abd1d68acc2a350212b33784db39c2308b9e2b2c92d05b23"} May 29 14:48:47.345740 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:47.345506 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.345486796 podStartE2EDuration="2.345486796s" podCreationTimestamp="2026-05-29 14:48:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 14:48:47.344511615 +0000 UTC m=+148.201623563" watchObservedRunningTime="2026-05-29 14:48:47.345486796 +0000 UTC m=+148.202598744" May 29 14:48:48.322281 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:48.322235 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6f59967fc9-wz9l2" event={"ID":"4226ae0d-1f62-4077-9a05-484dc5e14808","Type":"ContainerStarted","Data":"9d7107a4af8c7d79b029f18437d87955e5333fedeac4050c37e6b587c2c2bd01"} May 29 14:48:48.322281 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:48.322284 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6f59967fc9-wz9l2" event={"ID":"4226ae0d-1f62-4077-9a05-484dc5e14808","Type":"ContainerStarted","Data":"224ab63aa411ed23253145705061432312f682d23ec4e4484eca423aab1b2c9c"} May 29 14:48:48.322766 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:48.322298 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6f59967fc9-wz9l2" event={"ID":"4226ae0d-1f62-4077-9a05-484dc5e14808","Type":"ContainerStarted","Data":"39e86c7f60d1f071ab5233ac29060b0c8d2865c3d3b4aaafe3297226d93565a3"} May 29 14:48:48.346442 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:48.346380 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6f59967fc9-wz9l2" podStartSLOduration=1.583935535 podStartE2EDuration="4.346363914s" podCreationTimestamp="2026-05-29 14:48:44 +0000 UTC" firstStartedPulling="2026-05-29 14:48:44.632778867 +0000 UTC m=+145.489890809" lastFinishedPulling="2026-05-29 14:48:47.395207258 +0000 UTC m=+148.252319188" observedRunningTime="2026-05-29 14:48:48.344800192 +0000 UTC m=+149.201912140" watchObservedRunningTime="2026-05-29 14:48:48.346363914 +0000 UTC m=+149.203475864" May 29 14:48:49.102264 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:49.102222 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-9fd8dcfd6-rljwz"] May 29 14:48:49.104730 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:49.104713 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9fd8dcfd6-rljwz" May 29 14:48:49.127420 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:49.127386 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9fd8dcfd6-rljwz"] May 29 14:48:49.222432 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:49.222395 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lh9n\" (UniqueName: \"kubernetes.io/projected/73a258f2-4f8a-4e61-90c9-84b543770e79-kube-api-access-8lh9n\") pod \"console-9fd8dcfd6-rljwz\" (UID: \"73a258f2-4f8a-4e61-90c9-84b543770e79\") " pod="openshift-console/console-9fd8dcfd6-rljwz" May 29 14:48:49.222432 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:49.222435 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/73a258f2-4f8a-4e61-90c9-84b543770e79-console-config\") pod \"console-9fd8dcfd6-rljwz\" (UID: \"73a258f2-4f8a-4e61-90c9-84b543770e79\") " pod="openshift-console/console-9fd8dcfd6-rljwz" May 29 14:48:49.222650 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:49.222462 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73a258f2-4f8a-4e61-90c9-84b543770e79-trusted-ca-bundle\") pod \"console-9fd8dcfd6-rljwz\" (UID: \"73a258f2-4f8a-4e61-90c9-84b543770e79\") " pod="openshift-console/console-9fd8dcfd6-rljwz" May 29 14:48:49.222650 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:49.222528 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/73a258f2-4f8a-4e61-90c9-84b543770e79-service-ca\") pod \"console-9fd8dcfd6-rljwz\" (UID: \"73a258f2-4f8a-4e61-90c9-84b543770e79\") " pod="openshift-console/console-9fd8dcfd6-rljwz" May 29 14:48:49.222650 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:49.222575 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/73a258f2-4f8a-4e61-90c9-84b543770e79-console-oauth-config\") pod \"console-9fd8dcfd6-rljwz\" (UID: \"73a258f2-4f8a-4e61-90c9-84b543770e79\") " pod="openshift-console/console-9fd8dcfd6-rljwz" May 29 14:48:49.222650 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:49.222594 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/73a258f2-4f8a-4e61-90c9-84b543770e79-console-serving-cert\") pod \"console-9fd8dcfd6-rljwz\" (UID: \"73a258f2-4f8a-4e61-90c9-84b543770e79\") " pod="openshift-console/console-9fd8dcfd6-rljwz" May 29 14:48:49.222650 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:49.222633 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/73a258f2-4f8a-4e61-90c9-84b543770e79-oauth-serving-cert\") pod \"console-9fd8dcfd6-rljwz\" (UID: \"73a258f2-4f8a-4e61-90c9-84b543770e79\") " pod="openshift-console/console-9fd8dcfd6-rljwz" May 29 14:48:49.323340 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:49.323311 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/73a258f2-4f8a-4e61-90c9-84b543770e79-console-serving-cert\") pod \"console-9fd8dcfd6-rljwz\" (UID: \"73a258f2-4f8a-4e61-90c9-84b543770e79\") " pod="openshift-console/console-9fd8dcfd6-rljwz" May 29 14:48:49.323777 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:49.323359 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/73a258f2-4f8a-4e61-90c9-84b543770e79-oauth-serving-cert\") pod \"console-9fd8dcfd6-rljwz\" (UID: \"73a258f2-4f8a-4e61-90c9-84b543770e79\") " pod="openshift-console/console-9fd8dcfd6-rljwz" May 29 14:48:49.323777 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:49.323389 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8lh9n\" (UniqueName: \"kubernetes.io/projected/73a258f2-4f8a-4e61-90c9-84b543770e79-kube-api-access-8lh9n\") pod \"console-9fd8dcfd6-rljwz\" (UID: \"73a258f2-4f8a-4e61-90c9-84b543770e79\") " pod="openshift-console/console-9fd8dcfd6-rljwz" May 29 14:48:49.323777 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:49.323420 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/73a258f2-4f8a-4e61-90c9-84b543770e79-console-config\") pod \"console-9fd8dcfd6-rljwz\" (UID: \"73a258f2-4f8a-4e61-90c9-84b543770e79\") " pod="openshift-console/console-9fd8dcfd6-rljwz" May 29 14:48:49.323777 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:49.323455 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73a258f2-4f8a-4e61-90c9-84b543770e79-trusted-ca-bundle\") pod \"console-9fd8dcfd6-rljwz\" (UID: \"73a258f2-4f8a-4e61-90c9-84b543770e79\") " pod="openshift-console/console-9fd8dcfd6-rljwz" May 29 14:48:49.323777 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:49.323513 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/73a258f2-4f8a-4e61-90c9-84b543770e79-service-ca\") pod \"console-9fd8dcfd6-rljwz\" (UID: \"73a258f2-4f8a-4e61-90c9-84b543770e79\") " pod="openshift-console/console-9fd8dcfd6-rljwz" May 29 14:48:49.323777 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:49.323577 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/73a258f2-4f8a-4e61-90c9-84b543770e79-console-oauth-config\") pod \"console-9fd8dcfd6-rljwz\" (UID: \"73a258f2-4f8a-4e61-90c9-84b543770e79\") " pod="openshift-console/console-9fd8dcfd6-rljwz" May 29 14:48:49.324265 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:49.324234 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/73a258f2-4f8a-4e61-90c9-84b543770e79-oauth-serving-cert\") pod \"console-9fd8dcfd6-rljwz\" (UID: \"73a258f2-4f8a-4e61-90c9-84b543770e79\") " pod="openshift-console/console-9fd8dcfd6-rljwz" May 29 14:48:49.324265 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:49.324266 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/73a258f2-4f8a-4e61-90c9-84b543770e79-console-config\") pod \"console-9fd8dcfd6-rljwz\" (UID: \"73a258f2-4f8a-4e61-90c9-84b543770e79\") " pod="openshift-console/console-9fd8dcfd6-rljwz" May 29 14:48:49.324576 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:49.324551 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/73a258f2-4f8a-4e61-90c9-84b543770e79-service-ca\") pod \"console-9fd8dcfd6-rljwz\" (UID: \"73a258f2-4f8a-4e61-90c9-84b543770e79\") " pod="openshift-console/console-9fd8dcfd6-rljwz" May 29 14:48:49.324646 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:49.324610 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73a258f2-4f8a-4e61-90c9-84b543770e79-trusted-ca-bundle\") pod \"console-9fd8dcfd6-rljwz\" (UID: \"73a258f2-4f8a-4e61-90c9-84b543770e79\") " pod="openshift-console/console-9fd8dcfd6-rljwz" May 29 14:48:49.326072 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:49.326051 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/73a258f2-4f8a-4e61-90c9-84b543770e79-console-oauth-config\") pod \"console-9fd8dcfd6-rljwz\" (UID: \"73a258f2-4f8a-4e61-90c9-84b543770e79\") " pod="openshift-console/console-9fd8dcfd6-rljwz" May 29 14:48:49.326571 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:49.326546 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/73a258f2-4f8a-4e61-90c9-84b543770e79-console-serving-cert\") pod \"console-9fd8dcfd6-rljwz\" (UID: \"73a258f2-4f8a-4e61-90c9-84b543770e79\") " pod="openshift-console/console-9fd8dcfd6-rljwz" May 29 14:48:49.335516 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:49.335494 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lh9n\" (UniqueName: \"kubernetes.io/projected/73a258f2-4f8a-4e61-90c9-84b543770e79-kube-api-access-8lh9n\") pod \"console-9fd8dcfd6-rljwz\" (UID: \"73a258f2-4f8a-4e61-90c9-84b543770e79\") " pod="openshift-console/console-9fd8dcfd6-rljwz" May 29 14:48:49.414972 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:49.414875 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9fd8dcfd6-rljwz" May 29 14:48:49.557434 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:49.557253 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9fd8dcfd6-rljwz"] May 29 14:48:49.560034 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:48:49.560006 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73a258f2_4f8a_4e61_90c9_84b543770e79.slice/crio-572b1b945221afa2a76daae6bf0814d7ae9994e0e99a166d8328ddc38976528c WatchSource:0}: Error finding container 572b1b945221afa2a76daae6bf0814d7ae9994e0e99a166d8328ddc38976528c: Status 404 returned error can't find the container with id 572b1b945221afa2a76daae6bf0814d7ae9994e0e99a166d8328ddc38976528c May 29 14:48:50.329101 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:50.329063 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9fd8dcfd6-rljwz" event={"ID":"73a258f2-4f8a-4e61-90c9-84b543770e79","Type":"ContainerStarted","Data":"36f95ea1c2eb7dcfbd8478e470adb4ea22bd5101a1b0500a080de23bef6f5d03"} May 29 14:48:50.329101 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:50.329104 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9fd8dcfd6-rljwz" event={"ID":"73a258f2-4f8a-4e61-90c9-84b543770e79","Type":"ContainerStarted","Data":"572b1b945221afa2a76daae6bf0814d7ae9994e0e99a166d8328ddc38976528c"} May 29 14:48:50.356272 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:50.353344 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-9fd8dcfd6-rljwz" podStartSLOduration=1.353325207 podStartE2EDuration="1.353325207s" podCreationTimestamp="2026-05-29 14:48:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 14:48:50.352613573 +0000 UTC m=+151.209725525" watchObservedRunningTime="2026-05-29 14:48:50.353325207 +0000 UTC m=+151.210437158" May 29 14:48:50.676894 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:50.676801 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 29 14:48:59.416028 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:59.415974 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9fd8dcfd6-rljwz" May 29 14:48:59.416028 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:59.416037 2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9fd8dcfd6-rljwz" May 29 14:48:59.420985 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:48:59.420962 2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-9fd8dcfd6-rljwz" May 29 14:49:00.362669 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:00.362637 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-9fd8dcfd6-rljwz" May 29 14:49:00.415578 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:00.415542 2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d67f6f97-49klb"] May 29 14:49:25.436049 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:25.435988 2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7d67f6f97-49klb" podUID="dc54c7ba-1311-4e74-b98d-da5d167af814" containerName="console" containerID="cri-o://7d6dd483bedaea6ac292e881d14deb001ffc78ef10db3890489d05cd1e73c22d" gracePeriod=15 May 29 14:49:25.678834 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:25.678810 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7d67f6f97-49klb_dc54c7ba-1311-4e74-b98d-da5d167af814/console/0.log" May 29 14:49:25.678960 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:25.678869 2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d67f6f97-49klb" May 29 14:49:25.771490 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:25.771457 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc54c7ba-1311-4e74-b98d-da5d167af814-console-config\") pod \"dc54c7ba-1311-4e74-b98d-da5d167af814\" (UID: \"dc54c7ba-1311-4e74-b98d-da5d167af814\") " May 29 14:49:25.771650 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:25.771524 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc54c7ba-1311-4e74-b98d-da5d167af814-trusted-ca-bundle\") pod \"dc54c7ba-1311-4e74-b98d-da5d167af814\" (UID: \"dc54c7ba-1311-4e74-b98d-da5d167af814\") " May 29 14:49:25.771650 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:25.771548 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc54c7ba-1311-4e74-b98d-da5d167af814-service-ca\") pod \"dc54c7ba-1311-4e74-b98d-da5d167af814\" (UID: \"dc54c7ba-1311-4e74-b98d-da5d167af814\") " May 29 14:49:25.771650 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:25.771622 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc54c7ba-1311-4e74-b98d-da5d167af814-console-oauth-config\") pod \"dc54c7ba-1311-4e74-b98d-da5d167af814\" (UID: \"dc54c7ba-1311-4e74-b98d-da5d167af814\") " May 29 14:49:25.771799 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:25.771651 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8vnnb\" (UniqueName: \"kubernetes.io/projected/dc54c7ba-1311-4e74-b98d-da5d167af814-kube-api-access-8vnnb\") pod \"dc54c7ba-1311-4e74-b98d-da5d167af814\" (UID: \"dc54c7ba-1311-4e74-b98d-da5d167af814\") " May 29 14:49:25.771799 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:25.771675 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc54c7ba-1311-4e74-b98d-da5d167af814-console-serving-cert\") pod \"dc54c7ba-1311-4e74-b98d-da5d167af814\" (UID: \"dc54c7ba-1311-4e74-b98d-da5d167af814\") " May 29 14:49:25.771799 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:25.771715 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc54c7ba-1311-4e74-b98d-da5d167af814-oauth-serving-cert\") pod \"dc54c7ba-1311-4e74-b98d-da5d167af814\" (UID: \"dc54c7ba-1311-4e74-b98d-da5d167af814\") " May 29 14:49:25.771951 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:25.771915 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc54c7ba-1311-4e74-b98d-da5d167af814-console-config" (OuterVolumeSpecName: "console-config") pod "dc54c7ba-1311-4e74-b98d-da5d167af814" (UID: "dc54c7ba-1311-4e74-b98d-da5d167af814"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 14:49:25.772004 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:25.771990 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc54c7ba-1311-4e74-b98d-da5d167af814-console-config\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:49:25.772064 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:25.772012 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc54c7ba-1311-4e74-b98d-da5d167af814-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "dc54c7ba-1311-4e74-b98d-da5d167af814" (UID: "dc54c7ba-1311-4e74-b98d-da5d167af814"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 14:49:25.772064 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:25.772007 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc54c7ba-1311-4e74-b98d-da5d167af814-service-ca" (OuterVolumeSpecName: "service-ca") pod "dc54c7ba-1311-4e74-b98d-da5d167af814" (UID: "dc54c7ba-1311-4e74-b98d-da5d167af814"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 14:49:25.772259 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:25.772235 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc54c7ba-1311-4e74-b98d-da5d167af814-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "dc54c7ba-1311-4e74-b98d-da5d167af814" (UID: "dc54c7ba-1311-4e74-b98d-da5d167af814"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 14:49:25.773894 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:25.773870 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc54c7ba-1311-4e74-b98d-da5d167af814-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "dc54c7ba-1311-4e74-b98d-da5d167af814" (UID: "dc54c7ba-1311-4e74-b98d-da5d167af814"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 14:49:25.773894 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:25.773881 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc54c7ba-1311-4e74-b98d-da5d167af814-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "dc54c7ba-1311-4e74-b98d-da5d167af814" (UID: "dc54c7ba-1311-4e74-b98d-da5d167af814"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 14:49:25.774049 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:25.773987 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc54c7ba-1311-4e74-b98d-da5d167af814-kube-api-access-8vnnb" (OuterVolumeSpecName: "kube-api-access-8vnnb") pod "dc54c7ba-1311-4e74-b98d-da5d167af814" (UID: "dc54c7ba-1311-4e74-b98d-da5d167af814"). InnerVolumeSpecName "kube-api-access-8vnnb". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 14:49:25.872916 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:25.872878 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc54c7ba-1311-4e74-b98d-da5d167af814-trusted-ca-bundle\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:49:25.872916 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:25.872910 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc54c7ba-1311-4e74-b98d-da5d167af814-service-ca\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:49:25.872916 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:25.872920 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc54c7ba-1311-4e74-b98d-da5d167af814-console-oauth-config\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:49:25.873148 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:25.872929 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8vnnb\" (UniqueName: \"kubernetes.io/projected/dc54c7ba-1311-4e74-b98d-da5d167af814-kube-api-access-8vnnb\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:49:25.873148 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:25.872940 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc54c7ba-1311-4e74-b98d-da5d167af814-console-serving-cert\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:49:25.873148 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:25.872949 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc54c7ba-1311-4e74-b98d-da5d167af814-oauth-serving-cert\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:49:26.448030 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:26.448004 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7d67f6f97-49klb_dc54c7ba-1311-4e74-b98d-da5d167af814/console/0.log" May 29 14:49:26.448475 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:26.448042 2564 generic.go:358] "Generic (PLEG): container finished" podID="dc54c7ba-1311-4e74-b98d-da5d167af814" containerID="7d6dd483bedaea6ac292e881d14deb001ffc78ef10db3890489d05cd1e73c22d" exitCode=2 May 29 14:49:26.448475 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:26.448102 2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d67f6f97-49klb" May 29 14:49:26.448475 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:26.448116 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d67f6f97-49klb" event={"ID":"dc54c7ba-1311-4e74-b98d-da5d167af814","Type":"ContainerDied","Data":"7d6dd483bedaea6ac292e881d14deb001ffc78ef10db3890489d05cd1e73c22d"} May 29 14:49:26.448475 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:26.448144 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d67f6f97-49klb" event={"ID":"dc54c7ba-1311-4e74-b98d-da5d167af814","Type":"ContainerDied","Data":"0ea12726ca373fd2e9d7fc0e36c05993380737ef7211dd184048dd302a91e770"} May 29 14:49:26.448475 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:26.448159 2564 scope.go:117] "RemoveContainer" containerID="7d6dd483bedaea6ac292e881d14deb001ffc78ef10db3890489d05cd1e73c22d" May 29 14:49:26.456477 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:26.456456 2564 scope.go:117] "RemoveContainer" containerID="7d6dd483bedaea6ac292e881d14deb001ffc78ef10db3890489d05cd1e73c22d" May 29 14:49:26.456722 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:49:26.456705 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d6dd483bedaea6ac292e881d14deb001ffc78ef10db3890489d05cd1e73c22d\": container with ID starting with 7d6dd483bedaea6ac292e881d14deb001ffc78ef10db3890489d05cd1e73c22d not found: ID does not exist" containerID="7d6dd483bedaea6ac292e881d14deb001ffc78ef10db3890489d05cd1e73c22d" May 29 14:49:26.456769 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:26.456746 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d6dd483bedaea6ac292e881d14deb001ffc78ef10db3890489d05cd1e73c22d"} err="failed to get container status \"7d6dd483bedaea6ac292e881d14deb001ffc78ef10db3890489d05cd1e73c22d\": rpc error: code = NotFound desc = could not find container \"7d6dd483bedaea6ac292e881d14deb001ffc78ef10db3890489d05cd1e73c22d\": container with ID starting with 7d6dd483bedaea6ac292e881d14deb001ffc78ef10db3890489d05cd1e73c22d not found: ID does not exist" May 29 14:49:26.470737 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:26.470708 2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d67f6f97-49klb"] May 29 14:49:26.475518 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:26.475497 2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d67f6f97-49klb"] May 29 14:49:27.654403 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:27.654367 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc54c7ba-1311-4e74-b98d-da5d167af814" path="/var/lib/kubelet/pods/dc54c7ba-1311-4e74-b98d-da5d167af814/volumes" May 29 14:49:45.677271 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:45.677218 2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 29 14:49:45.693331 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:45.693306 2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 29 14:49:46.526318 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:46.526290 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 29 14:49:54.584942 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:54.584901 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-669fc66b8d-gcgb5"] May 29 14:49:54.585541 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:54.585417 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc54c7ba-1311-4e74-b98d-da5d167af814" containerName="console" May 29 14:49:54.585541 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:54.585436 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc54c7ba-1311-4e74-b98d-da5d167af814" containerName="console" May 29 14:49:54.585541 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:54.585523 2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="dc54c7ba-1311-4e74-b98d-da5d167af814" containerName="console" May 29 14:49:54.589876 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:54.589855 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-669fc66b8d-gcgb5" May 29 14:49:54.601573 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:54.601546 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-669fc66b8d-gcgb5"] May 29 14:49:54.628823 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:54.628789 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d46q5\" (UniqueName: \"kubernetes.io/projected/a51f8300-8cc4-4d27-9af9-c868757cc3d1-kube-api-access-d46q5\") pod \"console-669fc66b8d-gcgb5\" (UID: \"a51f8300-8cc4-4d27-9af9-c868757cc3d1\") " pod="openshift-console/console-669fc66b8d-gcgb5" May 29 14:49:54.628973 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:54.628832 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a51f8300-8cc4-4d27-9af9-c868757cc3d1-console-config\") pod \"console-669fc66b8d-gcgb5\" (UID: \"a51f8300-8cc4-4d27-9af9-c868757cc3d1\") " pod="openshift-console/console-669fc66b8d-gcgb5" May 29 14:49:54.628973 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:54.628890 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a51f8300-8cc4-4d27-9af9-c868757cc3d1-trusted-ca-bundle\") pod \"console-669fc66b8d-gcgb5\" (UID: \"a51f8300-8cc4-4d27-9af9-c868757cc3d1\") " pod="openshift-console/console-669fc66b8d-gcgb5" May 29 14:49:54.628973 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:54.628924 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a51f8300-8cc4-4d27-9af9-c868757cc3d1-oauth-serving-cert\") pod \"console-669fc66b8d-gcgb5\" (UID: \"a51f8300-8cc4-4d27-9af9-c868757cc3d1\") " pod="openshift-console/console-669fc66b8d-gcgb5" May 29 14:49:54.628973 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:54.628965 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a51f8300-8cc4-4d27-9af9-c868757cc3d1-service-ca\") pod \"console-669fc66b8d-gcgb5\" (UID: \"a51f8300-8cc4-4d27-9af9-c868757cc3d1\") " pod="openshift-console/console-669fc66b8d-gcgb5" May 29 14:49:54.629163 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:54.629031 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a51f8300-8cc4-4d27-9af9-c868757cc3d1-console-oauth-config\") pod \"console-669fc66b8d-gcgb5\" (UID: \"a51f8300-8cc4-4d27-9af9-c868757cc3d1\") " pod="openshift-console/console-669fc66b8d-gcgb5" May 29 14:49:54.629163 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:54.629054 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a51f8300-8cc4-4d27-9af9-c868757cc3d1-console-serving-cert\") pod \"console-669fc66b8d-gcgb5\" (UID: \"a51f8300-8cc4-4d27-9af9-c868757cc3d1\") " pod="openshift-console/console-669fc66b8d-gcgb5" May 29 14:49:54.730526 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:54.730485 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a51f8300-8cc4-4d27-9af9-c868757cc3d1-console-oauth-config\") pod \"console-669fc66b8d-gcgb5\" (UID: \"a51f8300-8cc4-4d27-9af9-c868757cc3d1\") " pod="openshift-console/console-669fc66b8d-gcgb5" May 29 14:49:54.730526 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:54.730526 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a51f8300-8cc4-4d27-9af9-c868757cc3d1-console-serving-cert\") pod \"console-669fc66b8d-gcgb5\" (UID: \"a51f8300-8cc4-4d27-9af9-c868757cc3d1\") " pod="openshift-console/console-669fc66b8d-gcgb5" May 29 14:49:54.730767 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:54.730559 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d46q5\" (UniqueName: \"kubernetes.io/projected/a51f8300-8cc4-4d27-9af9-c868757cc3d1-kube-api-access-d46q5\") pod \"console-669fc66b8d-gcgb5\" (UID: \"a51f8300-8cc4-4d27-9af9-c868757cc3d1\") " pod="openshift-console/console-669fc66b8d-gcgb5" May 29 14:49:54.730767 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:54.730583 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a51f8300-8cc4-4d27-9af9-c868757cc3d1-console-config\") pod \"console-669fc66b8d-gcgb5\" (UID: \"a51f8300-8cc4-4d27-9af9-c868757cc3d1\") " pod="openshift-console/console-669fc66b8d-gcgb5" May 29 14:49:54.730767 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:54.730606 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a51f8300-8cc4-4d27-9af9-c868757cc3d1-trusted-ca-bundle\") pod \"console-669fc66b8d-gcgb5\" (UID: \"a51f8300-8cc4-4d27-9af9-c868757cc3d1\") " pod="openshift-console/console-669fc66b8d-gcgb5" May 29 14:49:54.730767 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:54.730627 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a51f8300-8cc4-4d27-9af9-c868757cc3d1-oauth-serving-cert\") pod \"console-669fc66b8d-gcgb5\" (UID: \"a51f8300-8cc4-4d27-9af9-c868757cc3d1\") " pod="openshift-console/console-669fc66b8d-gcgb5" May 29 14:49:54.730767 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:54.730659 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a51f8300-8cc4-4d27-9af9-c868757cc3d1-service-ca\") pod \"console-669fc66b8d-gcgb5\" (UID: \"a51f8300-8cc4-4d27-9af9-c868757cc3d1\") " pod="openshift-console/console-669fc66b8d-gcgb5" May 29 14:49:54.731453 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:54.731434 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a51f8300-8cc4-4d27-9af9-c868757cc3d1-console-config\") pod \"console-669fc66b8d-gcgb5\" (UID: \"a51f8300-8cc4-4d27-9af9-c868757cc3d1\") " pod="openshift-console/console-669fc66b8d-gcgb5" May 29 14:49:54.731558 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:54.731448 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a51f8300-8cc4-4d27-9af9-c868757cc3d1-service-ca\") pod \"console-669fc66b8d-gcgb5\" (UID: \"a51f8300-8cc4-4d27-9af9-c868757cc3d1\") " pod="openshift-console/console-669fc66b8d-gcgb5" May 29 14:49:54.731558 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:54.731502 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a51f8300-8cc4-4d27-9af9-c868757cc3d1-oauth-serving-cert\") pod \"console-669fc66b8d-gcgb5\" (UID: \"a51f8300-8cc4-4d27-9af9-c868757cc3d1\") " pod="openshift-console/console-669fc66b8d-gcgb5" May 29 14:49:54.731899 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:54.731872 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a51f8300-8cc4-4d27-9af9-c868757cc3d1-trusted-ca-bundle\") pod \"console-669fc66b8d-gcgb5\" (UID: \"a51f8300-8cc4-4d27-9af9-c868757cc3d1\") " pod="openshift-console/console-669fc66b8d-gcgb5" May 29 14:49:54.733111 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:54.733095 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a51f8300-8cc4-4d27-9af9-c868757cc3d1-console-oauth-config\") pod \"console-669fc66b8d-gcgb5\" (UID: \"a51f8300-8cc4-4d27-9af9-c868757cc3d1\") " pod="openshift-console/console-669fc66b8d-gcgb5" May 29 14:49:54.733323 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:54.733307 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a51f8300-8cc4-4d27-9af9-c868757cc3d1-console-serving-cert\") pod \"console-669fc66b8d-gcgb5\" (UID: \"a51f8300-8cc4-4d27-9af9-c868757cc3d1\") " pod="openshift-console/console-669fc66b8d-gcgb5" May 29 14:49:54.740444 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:54.740423 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d46q5\" (UniqueName: \"kubernetes.io/projected/a51f8300-8cc4-4d27-9af9-c868757cc3d1-kube-api-access-d46q5\") pod \"console-669fc66b8d-gcgb5\" (UID: \"a51f8300-8cc4-4d27-9af9-c868757cc3d1\") " pod="openshift-console/console-669fc66b8d-gcgb5" May 29 14:49:54.898399 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:54.898303 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-669fc66b8d-gcgb5" May 29 14:49:55.043162 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:55.043140 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-669fc66b8d-gcgb5"] May 29 14:49:55.045232 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:49:55.045206 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda51f8300_8cc4_4d27_9af9_c868757cc3d1.slice/crio-9832d7b80450cee263cfe71212663ec7c35bfefb18fda49d27fe734ff98c49c0 WatchSource:0}: Error finding container 9832d7b80450cee263cfe71212663ec7c35bfefb18fda49d27fe734ff98c49c0: Status 404 returned error can't find the container with id 9832d7b80450cee263cfe71212663ec7c35bfefb18fda49d27fe734ff98c49c0 May 29 14:49:55.539477 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:55.539442 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-669fc66b8d-gcgb5" event={"ID":"a51f8300-8cc4-4d27-9af9-c868757cc3d1","Type":"ContainerStarted","Data":"bee8afb1b2c88aaf1f9fb2ae91fd956f350b950e6081ae6e24165895c5e0f136"} May 29 14:49:55.539477 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:55.539479 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-669fc66b8d-gcgb5" event={"ID":"a51f8300-8cc4-4d27-9af9-c868757cc3d1","Type":"ContainerStarted","Data":"9832d7b80450cee263cfe71212663ec7c35bfefb18fda49d27fe734ff98c49c0"} May 29 14:49:55.560015 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:49:55.559960 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-669fc66b8d-gcgb5" podStartSLOduration=1.559940952 podStartE2EDuration="1.559940952s" podCreationTimestamp="2026-05-29 14:49:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 14:49:55.559373028 +0000 UTC m=+216.416484976" watchObservedRunningTime="2026-05-29 14:49:55.559940952 +0000 UTC m=+216.417052899" May 29 14:50:04.899245 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:04.899198 2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-669fc66b8d-gcgb5" May 29 14:50:04.899646 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:04.899262 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-669fc66b8d-gcgb5" May 29 14:50:04.904037 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:04.904009 2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-669fc66b8d-gcgb5" May 29 14:50:05.571822 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:05.571797 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-669fc66b8d-gcgb5" May 29 14:50:05.628985 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:05.628952 2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9fd8dcfd6-rljwz"] May 29 14:50:30.649272 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:30.649227 2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-9fd8dcfd6-rljwz" podUID="73a258f2-4f8a-4e61-90c9-84b543770e79" containerName="console" containerID="cri-o://36f95ea1c2eb7dcfbd8478e470adb4ea22bd5101a1b0500a080de23bef6f5d03" gracePeriod=15 May 29 14:50:30.887980 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:30.887955 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-9fd8dcfd6-rljwz_73a258f2-4f8a-4e61-90c9-84b543770e79/console/0.log" May 29 14:50:30.888137 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:30.888030 2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9fd8dcfd6-rljwz" May 29 14:50:30.958345 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:30.958251 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/73a258f2-4f8a-4e61-90c9-84b543770e79-service-ca\") pod \"73a258f2-4f8a-4e61-90c9-84b543770e79\" (UID: \"73a258f2-4f8a-4e61-90c9-84b543770e79\") " May 29 14:50:30.958345 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:30.958293 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8lh9n\" (UniqueName: \"kubernetes.io/projected/73a258f2-4f8a-4e61-90c9-84b543770e79-kube-api-access-8lh9n\") pod \"73a258f2-4f8a-4e61-90c9-84b543770e79\" (UID: \"73a258f2-4f8a-4e61-90c9-84b543770e79\") " May 29 14:50:30.958345 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:30.958320 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/73a258f2-4f8a-4e61-90c9-84b543770e79-console-oauth-config\") pod \"73a258f2-4f8a-4e61-90c9-84b543770e79\" (UID: \"73a258f2-4f8a-4e61-90c9-84b543770e79\") " May 29 14:50:30.958345 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:30.958342 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/73a258f2-4f8a-4e61-90c9-84b543770e79-console-serving-cert\") pod \"73a258f2-4f8a-4e61-90c9-84b543770e79\" (UID: \"73a258f2-4f8a-4e61-90c9-84b543770e79\") " May 29 14:50:30.958698 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:30.958391 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/73a258f2-4f8a-4e61-90c9-84b543770e79-console-config\") pod \"73a258f2-4f8a-4e61-90c9-84b543770e79\" (UID: \"73a258f2-4f8a-4e61-90c9-84b543770e79\") " May 29 14:50:30.958698 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:30.958413 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/73a258f2-4f8a-4e61-90c9-84b543770e79-oauth-serving-cert\") pod \"73a258f2-4f8a-4e61-90c9-84b543770e79\" (UID: \"73a258f2-4f8a-4e61-90c9-84b543770e79\") " May 29 14:50:30.958698 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:30.958449 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73a258f2-4f8a-4e61-90c9-84b543770e79-trusted-ca-bundle\") pod \"73a258f2-4f8a-4e61-90c9-84b543770e79\" (UID: \"73a258f2-4f8a-4e61-90c9-84b543770e79\") " May 29 14:50:30.958863 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:30.958834 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73a258f2-4f8a-4e61-90c9-84b543770e79-service-ca" (OuterVolumeSpecName: "service-ca") pod "73a258f2-4f8a-4e61-90c9-84b543770e79" (UID: "73a258f2-4f8a-4e61-90c9-84b543770e79"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 14:50:30.958919 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:30.958880 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73a258f2-4f8a-4e61-90c9-84b543770e79-console-config" (OuterVolumeSpecName: "console-config") pod "73a258f2-4f8a-4e61-90c9-84b543770e79" (UID: "73a258f2-4f8a-4e61-90c9-84b543770e79"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 14:50:30.958919 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:30.958887 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73a258f2-4f8a-4e61-90c9-84b543770e79-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "73a258f2-4f8a-4e61-90c9-84b543770e79" (UID: "73a258f2-4f8a-4e61-90c9-84b543770e79"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 14:50:30.959007 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:30.958935 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73a258f2-4f8a-4e61-90c9-84b543770e79-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "73a258f2-4f8a-4e61-90c9-84b543770e79" (UID: "73a258f2-4f8a-4e61-90c9-84b543770e79"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 14:50:30.960696 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:30.960674 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73a258f2-4f8a-4e61-90c9-84b543770e79-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "73a258f2-4f8a-4e61-90c9-84b543770e79" (UID: "73a258f2-4f8a-4e61-90c9-84b543770e79"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 14:50:30.961153 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:30.961125 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73a258f2-4f8a-4e61-90c9-84b543770e79-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "73a258f2-4f8a-4e61-90c9-84b543770e79" (UID: "73a258f2-4f8a-4e61-90c9-84b543770e79"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 14:50:30.961153 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:30.961128 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73a258f2-4f8a-4e61-90c9-84b543770e79-kube-api-access-8lh9n" (OuterVolumeSpecName: "kube-api-access-8lh9n") pod "73a258f2-4f8a-4e61-90c9-84b543770e79" (UID: "73a258f2-4f8a-4e61-90c9-84b543770e79"). InnerVolumeSpecName "kube-api-access-8lh9n". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 14:50:31.059062 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:31.059028 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/73a258f2-4f8a-4e61-90c9-84b543770e79-service-ca\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:50:31.059062 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:31.059055 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8lh9n\" (UniqueName: \"kubernetes.io/projected/73a258f2-4f8a-4e61-90c9-84b543770e79-kube-api-access-8lh9n\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:50:31.059062 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:31.059065 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/73a258f2-4f8a-4e61-90c9-84b543770e79-console-oauth-config\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:50:31.059326 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:31.059074 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/73a258f2-4f8a-4e61-90c9-84b543770e79-console-serving-cert\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:50:31.059326 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:31.059084 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/73a258f2-4f8a-4e61-90c9-84b543770e79-console-config\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:50:31.059326 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:31.059092 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/73a258f2-4f8a-4e61-90c9-84b543770e79-oauth-serving-cert\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:50:31.059326 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:31.059100 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73a258f2-4f8a-4e61-90c9-84b543770e79-trusted-ca-bundle\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:50:31.651430 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:31.651401 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-9fd8dcfd6-rljwz_73a258f2-4f8a-4e61-90c9-84b543770e79/console/0.log" May 29 14:50:31.651887 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:31.651443 2564 generic.go:358] "Generic (PLEG): container finished" podID="73a258f2-4f8a-4e61-90c9-84b543770e79" containerID="36f95ea1c2eb7dcfbd8478e470adb4ea22bd5101a1b0500a080de23bef6f5d03" exitCode=2 May 29 14:50:31.651887 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:31.651610 2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9fd8dcfd6-rljwz" May 29 14:50:31.654793 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:31.654765 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9fd8dcfd6-rljwz" event={"ID":"73a258f2-4f8a-4e61-90c9-84b543770e79","Type":"ContainerDied","Data":"36f95ea1c2eb7dcfbd8478e470adb4ea22bd5101a1b0500a080de23bef6f5d03"} May 29 14:50:31.654793 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:31.654795 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9fd8dcfd6-rljwz" event={"ID":"73a258f2-4f8a-4e61-90c9-84b543770e79","Type":"ContainerDied","Data":"572b1b945221afa2a76daae6bf0814d7ae9994e0e99a166d8328ddc38976528c"} May 29 14:50:31.654979 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:31.654810 2564 scope.go:117] "RemoveContainer" containerID="36f95ea1c2eb7dcfbd8478e470adb4ea22bd5101a1b0500a080de23bef6f5d03" May 29 14:50:31.663992 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:31.663970 2564 scope.go:117] "RemoveContainer" containerID="36f95ea1c2eb7dcfbd8478e470adb4ea22bd5101a1b0500a080de23bef6f5d03" May 29 14:50:31.664278 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:50:31.664261 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36f95ea1c2eb7dcfbd8478e470adb4ea22bd5101a1b0500a080de23bef6f5d03\": container with ID starting with 36f95ea1c2eb7dcfbd8478e470adb4ea22bd5101a1b0500a080de23bef6f5d03 not found: ID does not exist" containerID="36f95ea1c2eb7dcfbd8478e470adb4ea22bd5101a1b0500a080de23bef6f5d03" May 29 14:50:31.664354 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:31.664284 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36f95ea1c2eb7dcfbd8478e470adb4ea22bd5101a1b0500a080de23bef6f5d03"} err="failed to get container status \"36f95ea1c2eb7dcfbd8478e470adb4ea22bd5101a1b0500a080de23bef6f5d03\": rpc error: code = NotFound desc = could not find container \"36f95ea1c2eb7dcfbd8478e470adb4ea22bd5101a1b0500a080de23bef6f5d03\": container with ID starting with 36f95ea1c2eb7dcfbd8478e470adb4ea22bd5101a1b0500a080de23bef6f5d03 not found: ID does not exist" May 29 14:50:31.676604 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:31.676565 2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9fd8dcfd6-rljwz"] May 29 14:50:31.681043 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:31.681017 2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-9fd8dcfd6-rljwz"] May 29 14:50:33.654584 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:33.654503 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73a258f2-4f8a-4e61-90c9-84b543770e79" path="/var/lib/kubelet/pods/73a258f2-4f8a-4e61-90c9-84b543770e79/volumes" May 29 14:50:45.159359 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:45.159311 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-xvmpr"] May 29 14:50:45.159792 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:45.159727 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73a258f2-4f8a-4e61-90c9-84b543770e79" containerName="console" May 29 14:50:45.159792 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:45.159745 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="73a258f2-4f8a-4e61-90c9-84b543770e79" containerName="console" May 29 14:50:45.159893 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:45.159827 2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="73a258f2-4f8a-4e61-90c9-84b543770e79" containerName="console" May 29 14:50:45.163143 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:45.163125 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvmpr" May 29 14:50:45.165251 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:45.165224 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 29 14:50:45.171637 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:45.171613 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xvmpr"] May 29 14:50:45.282135 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:45.282089 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/aac4a14b-f4a9-4b27-bd4e-aecd5fdbe765-dbus\") pod \"global-pull-secret-syncer-xvmpr\" (UID: \"aac4a14b-f4a9-4b27-bd4e-aecd5fdbe765\") " pod="kube-system/global-pull-secret-syncer-xvmpr" May 29 14:50:45.282361 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:45.282203 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/aac4a14b-f4a9-4b27-bd4e-aecd5fdbe765-kubelet-config\") pod \"global-pull-secret-syncer-xvmpr\" (UID: \"aac4a14b-f4a9-4b27-bd4e-aecd5fdbe765\") " pod="kube-system/global-pull-secret-syncer-xvmpr" May 29 14:50:45.282361 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:45.282283 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aac4a14b-f4a9-4b27-bd4e-aecd5fdbe765-original-pull-secret\") pod \"global-pull-secret-syncer-xvmpr\" (UID: \"aac4a14b-f4a9-4b27-bd4e-aecd5fdbe765\") " pod="kube-system/global-pull-secret-syncer-xvmpr" May 29 14:50:45.383617 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:45.383575 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/aac4a14b-f4a9-4b27-bd4e-aecd5fdbe765-dbus\") pod \"global-pull-secret-syncer-xvmpr\" (UID: \"aac4a14b-f4a9-4b27-bd4e-aecd5fdbe765\") " pod="kube-system/global-pull-secret-syncer-xvmpr" May 29 14:50:45.383742 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:45.383636 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/aac4a14b-f4a9-4b27-bd4e-aecd5fdbe765-kubelet-config\") pod \"global-pull-secret-syncer-xvmpr\" (UID: \"aac4a14b-f4a9-4b27-bd4e-aecd5fdbe765\") " pod="kube-system/global-pull-secret-syncer-xvmpr" May 29 14:50:45.383742 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:45.383675 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aac4a14b-f4a9-4b27-bd4e-aecd5fdbe765-original-pull-secret\") pod \"global-pull-secret-syncer-xvmpr\" (UID: \"aac4a14b-f4a9-4b27-bd4e-aecd5fdbe765\") " pod="kube-system/global-pull-secret-syncer-xvmpr" May 29 14:50:45.383815 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:45.383754 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/aac4a14b-f4a9-4b27-bd4e-aecd5fdbe765-dbus\") pod \"global-pull-secret-syncer-xvmpr\" (UID: \"aac4a14b-f4a9-4b27-bd4e-aecd5fdbe765\") " pod="kube-system/global-pull-secret-syncer-xvmpr" May 29 14:50:45.383815 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:45.383756 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/aac4a14b-f4a9-4b27-bd4e-aecd5fdbe765-kubelet-config\") pod \"global-pull-secret-syncer-xvmpr\" (UID: \"aac4a14b-f4a9-4b27-bd4e-aecd5fdbe765\") " pod="kube-system/global-pull-secret-syncer-xvmpr" May 29 14:50:45.385984 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:45.385966 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aac4a14b-f4a9-4b27-bd4e-aecd5fdbe765-original-pull-secret\") pod \"global-pull-secret-syncer-xvmpr\" (UID: \"aac4a14b-f4a9-4b27-bd4e-aecd5fdbe765\") " pod="kube-system/global-pull-secret-syncer-xvmpr" May 29 14:50:45.472919 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:45.472827 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xvmpr" May 29 14:50:45.599555 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:45.599519 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xvmpr"] May 29 14:50:45.603490 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:50:45.603462 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaac4a14b_f4a9_4b27_bd4e_aecd5fdbe765.slice/crio-92646b46462f13ed1ca475b44f209a71f923f86c967624fab45855faf9f8ae35 WatchSource:0}: Error finding container 92646b46462f13ed1ca475b44f209a71f923f86c967624fab45855faf9f8ae35: Status 404 returned error can't find the container with id 92646b46462f13ed1ca475b44f209a71f923f86c967624fab45855faf9f8ae35 May 29 14:50:45.697093 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:45.697060 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xvmpr" event={"ID":"aac4a14b-f4a9-4b27-bd4e-aecd5fdbe765","Type":"ContainerStarted","Data":"92646b46462f13ed1ca475b44f209a71f923f86c967624fab45855faf9f8ae35"} May 29 14:50:50.713552 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:50.713514 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xvmpr" event={"ID":"aac4a14b-f4a9-4b27-bd4e-aecd5fdbe765","Type":"ContainerStarted","Data":"deeb24aae856c99cc743fc01394c6cb08852f5ed9bac18ced48da000e10896f5"} May 29 14:50:50.732391 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:50:50.732333 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xvmpr" podStartSLOduration=0.832436055 podStartE2EDuration="5.73231433s" podCreationTimestamp="2026-05-29 14:50:45 +0000 UTC" firstStartedPulling="2026-05-29 14:50:45.605085203 +0000 UTC m=+266.462197128" lastFinishedPulling="2026-05-29 14:50:50.504963478 +0000 UTC m=+271.362075403" observedRunningTime="2026-05-29 14:50:50.731532285 +0000 UTC m=+271.588644425" watchObservedRunningTime="2026-05-29 14:50:50.73231433 +0000 UTC m=+271.589426277" May 29 14:51:19.548020 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:51:19.547992 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gvn49_1300fffd-bfc2-4a5c-95d8-01941a39ca6c/ovn-acl-logging/0.log" May 29 14:51:19.548599 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:51:19.548093 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gvn49_1300fffd-bfc2-4a5c-95d8-01941a39ca6c/ovn-acl-logging/0.log" May 29 14:51:19.552787 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:51:19.552768 2564 kubelet.go:1628] "Image garbage collection succeeded" May 29 14:51:50.143905 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:51:50.143866 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-pmttl"] May 29 14:51:50.146005 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:51:50.145988 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-pmttl" May 29 14:51:50.148299 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:51:50.148272 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 29 14:51:50.148435 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:51:50.148305 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 29 14:51:50.148960 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:51:50.148944 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-cwtxn\"" May 29 14:51:50.156887 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:51:50.156867 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-pmttl"] May 29 14:51:50.249354 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:51:50.249314 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxgv6\" (UniqueName: \"kubernetes.io/projected/de3db96e-234e-429e-a360-92a46d08d140-kube-api-access-vxgv6\") pod \"cert-manager-cainjector-68b757865b-pmttl\" (UID: \"de3db96e-234e-429e-a360-92a46d08d140\") " pod="cert-manager/cert-manager-cainjector-68b757865b-pmttl" May 29 14:51:50.249597 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:51:50.249385 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/de3db96e-234e-429e-a360-92a46d08d140-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-pmttl\" (UID: \"de3db96e-234e-429e-a360-92a46d08d140\") " pod="cert-manager/cert-manager-cainjector-68b757865b-pmttl" May 29 14:51:50.349783 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:51:50.349742 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vxgv6\" (UniqueName: \"kubernetes.io/projected/de3db96e-234e-429e-a360-92a46d08d140-kube-api-access-vxgv6\") pod \"cert-manager-cainjector-68b757865b-pmttl\" (UID: \"de3db96e-234e-429e-a360-92a46d08d140\") " pod="cert-manager/cert-manager-cainjector-68b757865b-pmttl" May 29 14:51:50.349998 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:51:50.349796 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/de3db96e-234e-429e-a360-92a46d08d140-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-pmttl\" (UID: \"de3db96e-234e-429e-a360-92a46d08d140\") " pod="cert-manager/cert-manager-cainjector-68b757865b-pmttl" May 29 14:51:50.358611 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:51:50.358582 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/de3db96e-234e-429e-a360-92a46d08d140-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-pmttl\" (UID: \"de3db96e-234e-429e-a360-92a46d08d140\") " pod="cert-manager/cert-manager-cainjector-68b757865b-pmttl" May 29 14:51:50.358765 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:51:50.358684 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxgv6\" (UniqueName: \"kubernetes.io/projected/de3db96e-234e-429e-a360-92a46d08d140-kube-api-access-vxgv6\") pod \"cert-manager-cainjector-68b757865b-pmttl\" (UID: \"de3db96e-234e-429e-a360-92a46d08d140\") " pod="cert-manager/cert-manager-cainjector-68b757865b-pmttl" May 29 14:51:50.464945 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:51:50.464868 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-pmttl" May 29 14:51:50.596898 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:51:50.596879 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-pmttl"] May 29 14:51:50.599244 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:51:50.599214 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde3db96e_234e_429e_a360_92a46d08d140.slice/crio-119b73b530c6f031b391ded86c6fb20b2d8da2fcc539255be6b7106ae4d2f9bb WatchSource:0}: Error finding container 119b73b530c6f031b391ded86c6fb20b2d8da2fcc539255be6b7106ae4d2f9bb: Status 404 returned error can't find the container with id 119b73b530c6f031b391ded86c6fb20b2d8da2fcc539255be6b7106ae4d2f9bb May 29 14:51:50.601059 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:51:50.601039 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 29 14:51:50.893454 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:51:50.893412 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-pmttl" event={"ID":"de3db96e-234e-429e-a360-92a46d08d140","Type":"ContainerStarted","Data":"119b73b530c6f031b391ded86c6fb20b2d8da2fcc539255be6b7106ae4d2f9bb"} May 29 14:51:53.904385 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:51:53.904347 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-pmttl" event={"ID":"de3db96e-234e-429e-a360-92a46d08d140","Type":"ContainerStarted","Data":"c2cb3583a50d7fd3d856631f13ce87aa97fb0efa920b464ed7eada05e235ad08"} May 29 14:51:53.922678 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:51:53.922620 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-pmttl" podStartSLOduration=1.147963736 podStartE2EDuration="3.922604854s" podCreationTimestamp="2026-05-29 14:51:50 +0000 UTC" firstStartedPulling="2026-05-29 14:51:50.601239943 +0000 UTC m=+331.458351881" lastFinishedPulling="2026-05-29 14:51:53.375881071 +0000 UTC m=+334.232992999" observedRunningTime="2026-05-29 14:51:53.920575467 +0000 UTC m=+334.777687414" watchObservedRunningTime="2026-05-29 14:51:53.922604854 +0000 UTC m=+334.779716801" May 29 14:52:00.126774 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:00.126736 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-w7fr8"] May 29 14:52:00.130239 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:00.130214 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-w7fr8" May 29 14:52:00.132805 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:00.132782 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-8nzk5\"" May 29 14:52:00.140157 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:00.140134 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-w7fr8"] May 29 14:52:00.141569 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:00.141547 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9669e59f-6752-4958-ab4a-6e78f2974db9-bound-sa-token\") pod \"cert-manager-79c8d999ff-w7fr8\" (UID: \"9669e59f-6752-4958-ab4a-6e78f2974db9\") " pod="cert-manager/cert-manager-79c8d999ff-w7fr8" May 29 14:52:00.141672 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:00.141601 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjpb2\" (UniqueName: \"kubernetes.io/projected/9669e59f-6752-4958-ab4a-6e78f2974db9-kube-api-access-hjpb2\") pod \"cert-manager-79c8d999ff-w7fr8\" (UID: \"9669e59f-6752-4958-ab4a-6e78f2974db9\") " pod="cert-manager/cert-manager-79c8d999ff-w7fr8" May 29 14:52:00.242579 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:00.242535 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hjpb2\" (UniqueName: \"kubernetes.io/projected/9669e59f-6752-4958-ab4a-6e78f2974db9-kube-api-access-hjpb2\") pod \"cert-manager-79c8d999ff-w7fr8\" (UID: \"9669e59f-6752-4958-ab4a-6e78f2974db9\") " pod="cert-manager/cert-manager-79c8d999ff-w7fr8" May 29 14:52:00.242762 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:00.242615 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9669e59f-6752-4958-ab4a-6e78f2974db9-bound-sa-token\") pod \"cert-manager-79c8d999ff-w7fr8\" (UID: \"9669e59f-6752-4958-ab4a-6e78f2974db9\") " pod="cert-manager/cert-manager-79c8d999ff-w7fr8" May 29 14:52:00.251760 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:00.251726 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjpb2\" (UniqueName: \"kubernetes.io/projected/9669e59f-6752-4958-ab4a-6e78f2974db9-kube-api-access-hjpb2\") pod \"cert-manager-79c8d999ff-w7fr8\" (UID: \"9669e59f-6752-4958-ab4a-6e78f2974db9\") " pod="cert-manager/cert-manager-79c8d999ff-w7fr8" May 29 14:52:00.252039 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:00.252022 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9669e59f-6752-4958-ab4a-6e78f2974db9-bound-sa-token\") pod \"cert-manager-79c8d999ff-w7fr8\" (UID: \"9669e59f-6752-4958-ab4a-6e78f2974db9\") " pod="cert-manager/cert-manager-79c8d999ff-w7fr8" May 29 14:52:00.439489 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:00.439402 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-w7fr8" May 29 14:52:00.569595 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:00.569528 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-w7fr8"] May 29 14:52:00.571987 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:52:00.571958 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9669e59f_6752_4958_ab4a_6e78f2974db9.slice/crio-634600fee1c005d1fb6e1df7fe733f8d189c65609b597b3177fe95c8229a717b WatchSource:0}: Error finding container 634600fee1c005d1fb6e1df7fe733f8d189c65609b597b3177fe95c8229a717b: Status 404 returned error can't find the container with id 634600fee1c005d1fb6e1df7fe733f8d189c65609b597b3177fe95c8229a717b May 29 14:52:00.926422 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:00.926385 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-w7fr8" event={"ID":"9669e59f-6752-4958-ab4a-6e78f2974db9","Type":"ContainerStarted","Data":"ca17df32b4c030d685c7a7bd47800dfff17cbb2df64e2854281a82788325389f"} May 29 14:52:00.926422 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:00.926418 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-w7fr8" event={"ID":"9669e59f-6752-4958-ab4a-6e78f2974db9","Type":"ContainerStarted","Data":"634600fee1c005d1fb6e1df7fe733f8d189c65609b597b3177fe95c8229a717b"} May 29 14:52:00.949068 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:00.949016 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-w7fr8" podStartSLOduration=0.949001736 podStartE2EDuration="949.001736ms" podCreationTimestamp="2026-05-29 14:52:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 14:52:00.94824952 +0000 UTC m=+341.805361469" watchObservedRunningTime="2026-05-29 14:52:00.949001736 +0000 UTC m=+341.806113683" May 29 14:52:18.075411 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:18.075339 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f4694d4cf-ml9zk"] May 29 14:52:18.078904 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:18.078882 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f4694d4cf-ml9zk" May 29 14:52:18.082004 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:18.081977 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 29 14:52:18.082141 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:18.082047 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 29 14:52:18.082141 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:18.082081 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 29 14:52:18.082387 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:18.082368 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 29 14:52:18.082448 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:18.082434 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8gn2r\"" May 29 14:52:18.101391 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:18.101364 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f4694d4cf-ml9zk"] May 29 14:52:18.190145 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:18.190100 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/63e09d9b-d8a7-4bf2-bf7a-d37f8ddea0ad-webhook-cert\") pod \"opendatahub-operator-controller-manager-f4694d4cf-ml9zk\" (UID: \"63e09d9b-d8a7-4bf2-bf7a-d37f8ddea0ad\") " pod="opendatahub/opendatahub-operator-controller-manager-f4694d4cf-ml9zk" May 29 14:52:18.190145 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:18.190142 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/63e09d9b-d8a7-4bf2-bf7a-d37f8ddea0ad-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f4694d4cf-ml9zk\" (UID: \"63e09d9b-d8a7-4bf2-bf7a-d37f8ddea0ad\") " pod="opendatahub/opendatahub-operator-controller-manager-f4694d4cf-ml9zk" May 29 14:52:18.190501 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:18.190282 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63e09d9b-d8a7-4bf2-bf7a-d37f8ddea0ad-tmp\") pod \"opendatahub-operator-controller-manager-f4694d4cf-ml9zk\" (UID: \"63e09d9b-d8a7-4bf2-bf7a-d37f8ddea0ad\") " pod="opendatahub/opendatahub-operator-controller-manager-f4694d4cf-ml9zk" May 29 14:52:18.190501 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:18.190352 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/63e09d9b-d8a7-4bf2-bf7a-d37f8ddea0ad-manifests\") pod \"opendatahub-operator-controller-manager-f4694d4cf-ml9zk\" (UID: \"63e09d9b-d8a7-4bf2-bf7a-d37f8ddea0ad\") " pod="opendatahub/opendatahub-operator-controller-manager-f4694d4cf-ml9zk" May 29 14:52:18.190501 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:18.190380 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd46d\" (UniqueName: \"kubernetes.io/projected/63e09d9b-d8a7-4bf2-bf7a-d37f8ddea0ad-kube-api-access-jd46d\") pod \"opendatahub-operator-controller-manager-f4694d4cf-ml9zk\" (UID: \"63e09d9b-d8a7-4bf2-bf7a-d37f8ddea0ad\") " pod="opendatahub/opendatahub-operator-controller-manager-f4694d4cf-ml9zk" May 29 14:52:18.291184 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:18.291143 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63e09d9b-d8a7-4bf2-bf7a-d37f8ddea0ad-tmp\") pod \"opendatahub-operator-controller-manager-f4694d4cf-ml9zk\" (UID: \"63e09d9b-d8a7-4bf2-bf7a-d37f8ddea0ad\") " pod="opendatahub/opendatahub-operator-controller-manager-f4694d4cf-ml9zk" May 29 14:52:18.291360 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:18.291247 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/63e09d9b-d8a7-4bf2-bf7a-d37f8ddea0ad-manifests\") pod \"opendatahub-operator-controller-manager-f4694d4cf-ml9zk\" (UID: \"63e09d9b-d8a7-4bf2-bf7a-d37f8ddea0ad\") " pod="opendatahub/opendatahub-operator-controller-manager-f4694d4cf-ml9zk" May 29 14:52:18.291360 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:18.291269 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jd46d\" (UniqueName: \"kubernetes.io/projected/63e09d9b-d8a7-4bf2-bf7a-d37f8ddea0ad-kube-api-access-jd46d\") pod \"opendatahub-operator-controller-manager-f4694d4cf-ml9zk\" (UID: \"63e09d9b-d8a7-4bf2-bf7a-d37f8ddea0ad\") " pod="opendatahub/opendatahub-operator-controller-manager-f4694d4cf-ml9zk" May 29 14:52:18.291360 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:18.291296 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/63e09d9b-d8a7-4bf2-bf7a-d37f8ddea0ad-webhook-cert\") pod \"opendatahub-operator-controller-manager-f4694d4cf-ml9zk\" (UID: \"63e09d9b-d8a7-4bf2-bf7a-d37f8ddea0ad\") " pod="opendatahub/opendatahub-operator-controller-manager-f4694d4cf-ml9zk" May 29 14:52:18.291360 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:18.291311 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/63e09d9b-d8a7-4bf2-bf7a-d37f8ddea0ad-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f4694d4cf-ml9zk\" (UID: \"63e09d9b-d8a7-4bf2-bf7a-d37f8ddea0ad\") " pod="opendatahub/opendatahub-operator-controller-manager-f4694d4cf-ml9zk" May 29 14:52:18.291691 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:18.291667 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/63e09d9b-d8a7-4bf2-bf7a-d37f8ddea0ad-manifests\") pod \"opendatahub-operator-controller-manager-f4694d4cf-ml9zk\" (UID: \"63e09d9b-d8a7-4bf2-bf7a-d37f8ddea0ad\") " pod="opendatahub/opendatahub-operator-controller-manager-f4694d4cf-ml9zk" May 29 14:52:18.293649 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:18.293627 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63e09d9b-d8a7-4bf2-bf7a-d37f8ddea0ad-tmp\") pod \"opendatahub-operator-controller-manager-f4694d4cf-ml9zk\" (UID: \"63e09d9b-d8a7-4bf2-bf7a-d37f8ddea0ad\") " pod="opendatahub/opendatahub-operator-controller-manager-f4694d4cf-ml9zk" May 29 14:52:18.293890 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:18.293871 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/63e09d9b-d8a7-4bf2-bf7a-d37f8ddea0ad-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f4694d4cf-ml9zk\" (UID: \"63e09d9b-d8a7-4bf2-bf7a-d37f8ddea0ad\") " pod="opendatahub/opendatahub-operator-controller-manager-f4694d4cf-ml9zk" May 29 14:52:18.293943 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:18.293875 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/63e09d9b-d8a7-4bf2-bf7a-d37f8ddea0ad-webhook-cert\") pod \"opendatahub-operator-controller-manager-f4694d4cf-ml9zk\" (UID: \"63e09d9b-d8a7-4bf2-bf7a-d37f8ddea0ad\") " pod="opendatahub/opendatahub-operator-controller-manager-f4694d4cf-ml9zk" May 29 14:52:18.300310 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:18.300287 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd46d\" (UniqueName: \"kubernetes.io/projected/63e09d9b-d8a7-4bf2-bf7a-d37f8ddea0ad-kube-api-access-jd46d\") pod \"opendatahub-operator-controller-manager-f4694d4cf-ml9zk\" (UID: \"63e09d9b-d8a7-4bf2-bf7a-d37f8ddea0ad\") " pod="opendatahub/opendatahub-operator-controller-manager-f4694d4cf-ml9zk" May 29 14:52:18.390047 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:18.389950 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f4694d4cf-ml9zk" May 29 14:52:18.528665 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:18.528603 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f4694d4cf-ml9zk"] May 29 14:52:18.531718 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:52:18.531688 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63e09d9b_d8a7_4bf2_bf7a_d37f8ddea0ad.slice/crio-ba0b62758c7ba314b6496b3a4ac24f63ed11a676b38beb47fe316ba0ab04c199 WatchSource:0}: Error finding container ba0b62758c7ba314b6496b3a4ac24f63ed11a676b38beb47fe316ba0ab04c199: Status 404 returned error can't find the container with id ba0b62758c7ba314b6496b3a4ac24f63ed11a676b38beb47fe316ba0ab04c199 May 29 14:52:18.981504 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:18.981467 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f4694d4cf-ml9zk" event={"ID":"63e09d9b-d8a7-4bf2-bf7a-d37f8ddea0ad","Type":"ContainerStarted","Data":"ba0b62758c7ba314b6496b3a4ac24f63ed11a676b38beb47fe316ba0ab04c199"} May 29 14:52:21.993987 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:21.993952 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f4694d4cf-ml9zk" event={"ID":"63e09d9b-d8a7-4bf2-bf7a-d37f8ddea0ad","Type":"ContainerStarted","Data":"dbfcdf49523efb1e92055c3238824029b95982d572ba08c65fa2cc06e39f01d6"} May 29 14:52:22.997909 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:22.997877 2564 generic.go:358] "Generic (PLEG): container finished" podID="63e09d9b-d8a7-4bf2-bf7a-d37f8ddea0ad" containerID="dbfcdf49523efb1e92055c3238824029b95982d572ba08c65fa2cc06e39f01d6" exitCode=0 May 29 14:52:22.998331 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:22.997918 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f4694d4cf-ml9zk" event={"ID":"63e09d9b-d8a7-4bf2-bf7a-d37f8ddea0ad","Type":"ContainerDied","Data":"dbfcdf49523efb1e92055c3238824029b95982d572ba08c65fa2cc06e39f01d6"} May 29 14:52:24.003612 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:24.003578 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f4694d4cf-ml9zk" event={"ID":"63e09d9b-d8a7-4bf2-bf7a-d37f8ddea0ad","Type":"ContainerStarted","Data":"5503fcad25ebbac73f9a24953d2ef0c4c04d0b166cba71f8a4cbbb68c8dfdd45"} May 29 14:52:24.004011 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:24.003686 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-f4694d4cf-ml9zk" May 29 14:52:24.031291 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:24.031230 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-f4694d4cf-ml9zk" podStartSLOduration=1.272921459 podStartE2EDuration="6.031211847s" podCreationTimestamp="2026-05-29 14:52:18 +0000 UTC" firstStartedPulling="2026-05-29 14:52:18.53405931 +0000 UTC m=+359.391171235" lastFinishedPulling="2026-05-29 14:52:23.292349698 +0000 UTC m=+364.149461623" observedRunningTime="2026-05-29 14:52:24.029652609 +0000 UTC m=+364.886764556" watchObservedRunningTime="2026-05-29 14:52:24.031211847 +0000 UTC m=+364.888323797" May 29 14:52:35.009356 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:35.009321 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-f4694d4cf-ml9zk" May 29 14:52:38.188721 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:38.188685 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-95796876-dqsfh"] May 29 14:52:38.191731 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:38.191708 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-95796876-dqsfh" May 29 14:52:38.194794 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:38.194769 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 29 14:52:38.195094 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:38.195080 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 29 14:52:38.195372 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:38.195355 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 29 14:52:38.195622 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:38.195610 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 29 14:52:38.270037 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:38.269996 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-95796876-dqsfh"] May 29 14:52:38.273853 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:38.273826 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64a17acd-8fe0-47cc-93c4-0c79bba4d2b3-tmp\") pod \"kube-auth-proxy-95796876-dqsfh\" (UID: \"64a17acd-8fe0-47cc-93c4-0c79bba4d2b3\") " pod="openshift-ingress/kube-auth-proxy-95796876-dqsfh" May 29 14:52:38.273975 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:38.273880 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64a17acd-8fe0-47cc-93c4-0c79bba4d2b3-tls-certs\") pod \"kube-auth-proxy-95796876-dqsfh\" (UID: \"64a17acd-8fe0-47cc-93c4-0c79bba4d2b3\") " pod="openshift-ingress/kube-auth-proxy-95796876-dqsfh" May 29 14:52:38.273975 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:38.273944 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjq9z\" (UniqueName: \"kubernetes.io/projected/64a17acd-8fe0-47cc-93c4-0c79bba4d2b3-kube-api-access-wjq9z\") pod \"kube-auth-proxy-95796876-dqsfh\" (UID: \"64a17acd-8fe0-47cc-93c4-0c79bba4d2b3\") " pod="openshift-ingress/kube-auth-proxy-95796876-dqsfh" May 29 14:52:38.374639 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:38.374600 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64a17acd-8fe0-47cc-93c4-0c79bba4d2b3-tmp\") pod \"kube-auth-proxy-95796876-dqsfh\" (UID: \"64a17acd-8fe0-47cc-93c4-0c79bba4d2b3\") " pod="openshift-ingress/kube-auth-proxy-95796876-dqsfh" May 29 14:52:38.374821 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:38.374688 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64a17acd-8fe0-47cc-93c4-0c79bba4d2b3-tls-certs\") pod \"kube-auth-proxy-95796876-dqsfh\" (UID: \"64a17acd-8fe0-47cc-93c4-0c79bba4d2b3\") " pod="openshift-ingress/kube-auth-proxy-95796876-dqsfh" May 29 14:52:38.374821 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:38.374750 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wjq9z\" (UniqueName: \"kubernetes.io/projected/64a17acd-8fe0-47cc-93c4-0c79bba4d2b3-kube-api-access-wjq9z\") pod \"kube-auth-proxy-95796876-dqsfh\" (UID: \"64a17acd-8fe0-47cc-93c4-0c79bba4d2b3\") " pod="openshift-ingress/kube-auth-proxy-95796876-dqsfh" May 29 14:52:38.374911 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:52:38.374830 2564 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found May 29 14:52:38.374957 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:52:38.374910 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64a17acd-8fe0-47cc-93c4-0c79bba4d2b3-tls-certs podName:64a17acd-8fe0-47cc-93c4-0c79bba4d2b3 nodeName:}" failed. No retries permitted until 2026-05-29 14:52:38.874887733 +0000 UTC m=+379.731999674 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/64a17acd-8fe0-47cc-93c4-0c79bba4d2b3-tls-certs") pod "kube-auth-proxy-95796876-dqsfh" (UID: "64a17acd-8fe0-47cc-93c4-0c79bba4d2b3") : secret "kube-auth-proxy-tls" not found May 29 14:52:38.377007 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:38.376984 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64a17acd-8fe0-47cc-93c4-0c79bba4d2b3-tmp\") pod \"kube-auth-proxy-95796876-dqsfh\" (UID: \"64a17acd-8fe0-47cc-93c4-0c79bba4d2b3\") " pod="openshift-ingress/kube-auth-proxy-95796876-dqsfh" May 29 14:52:38.400614 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:38.400589 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjq9z\" (UniqueName: \"kubernetes.io/projected/64a17acd-8fe0-47cc-93c4-0c79bba4d2b3-kube-api-access-wjq9z\") pod \"kube-auth-proxy-95796876-dqsfh\" (UID: \"64a17acd-8fe0-47cc-93c4-0c79bba4d2b3\") " pod="openshift-ingress/kube-auth-proxy-95796876-dqsfh" May 29 14:52:38.440113 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:38.440026 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-76588b95-8wht6"] May 29 14:52:38.442101 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:38.442086 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-8wht6" May 29 14:52:38.444504 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:38.444485 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" May 29 14:52:38.444624 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:38.444515 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-588h4\"" May 29 14:52:38.468365 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:38.468331 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-8wht6"] May 29 14:52:38.576501 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:38.576451 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djjs6\" (UniqueName: \"kubernetes.io/projected/04971611-b99d-4d82-9b9e-20ab77bf27e3-kube-api-access-djjs6\") pod \"odh-model-controller-76588b95-8wht6\" (UID: \"04971611-b99d-4d82-9b9e-20ab77bf27e3\") " pod="opendatahub/odh-model-controller-76588b95-8wht6" May 29 14:52:38.576679 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:38.576591 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/04971611-b99d-4d82-9b9e-20ab77bf27e3-cert\") pod \"odh-model-controller-76588b95-8wht6\" (UID: \"04971611-b99d-4d82-9b9e-20ab77bf27e3\") " pod="opendatahub/odh-model-controller-76588b95-8wht6" May 29 14:52:38.677291 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:38.677248 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/04971611-b99d-4d82-9b9e-20ab77bf27e3-cert\") pod \"odh-model-controller-76588b95-8wht6\" (UID: \"04971611-b99d-4d82-9b9e-20ab77bf27e3\") " pod="opendatahub/odh-model-controller-76588b95-8wht6" May 29 14:52:38.677491 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:38.677349 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-djjs6\" (UniqueName: \"kubernetes.io/projected/04971611-b99d-4d82-9b9e-20ab77bf27e3-kube-api-access-djjs6\") pod \"odh-model-controller-76588b95-8wht6\" (UID: \"04971611-b99d-4d82-9b9e-20ab77bf27e3\") " pod="opendatahub/odh-model-controller-76588b95-8wht6" May 29 14:52:38.677491 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:52:38.677389 2564 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found May 29 14:52:38.677491 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:52:38.677466 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04971611-b99d-4d82-9b9e-20ab77bf27e3-cert podName:04971611-b99d-4d82-9b9e-20ab77bf27e3 nodeName:}" failed. No retries permitted until 2026-05-29 14:52:39.177450314 +0000 UTC m=+380.034562239 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/04971611-b99d-4d82-9b9e-20ab77bf27e3-cert") pod "odh-model-controller-76588b95-8wht6" (UID: "04971611-b99d-4d82-9b9e-20ab77bf27e3") : secret "odh-model-controller-webhook-cert" not found May 29 14:52:38.702165 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:38.702094 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djjs6\" (UniqueName: \"kubernetes.io/projected/04971611-b99d-4d82-9b9e-20ab77bf27e3-kube-api-access-djjs6\") pod \"odh-model-controller-76588b95-8wht6\" (UID: \"04971611-b99d-4d82-9b9e-20ab77bf27e3\") " pod="opendatahub/odh-model-controller-76588b95-8wht6" May 29 14:52:38.879463 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:38.879423 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64a17acd-8fe0-47cc-93c4-0c79bba4d2b3-tls-certs\") pod \"kube-auth-proxy-95796876-dqsfh\" (UID: \"64a17acd-8fe0-47cc-93c4-0c79bba4d2b3\") " pod="openshift-ingress/kube-auth-proxy-95796876-dqsfh" May 29 14:52:38.881955 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:38.881934 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64a17acd-8fe0-47cc-93c4-0c79bba4d2b3-tls-certs\") pod \"kube-auth-proxy-95796876-dqsfh\" (UID: \"64a17acd-8fe0-47cc-93c4-0c79bba4d2b3\") " pod="openshift-ingress/kube-auth-proxy-95796876-dqsfh" May 29 14:52:39.101666 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:39.101621 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-95796876-dqsfh" May 29 14:52:39.182863 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:39.182502 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/04971611-b99d-4d82-9b9e-20ab77bf27e3-cert\") pod \"odh-model-controller-76588b95-8wht6\" (UID: \"04971611-b99d-4d82-9b9e-20ab77bf27e3\") " pod="opendatahub/odh-model-controller-76588b95-8wht6" May 29 14:52:39.185726 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:39.185697 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/04971611-b99d-4d82-9b9e-20ab77bf27e3-cert\") pod \"odh-model-controller-76588b95-8wht6\" (UID: \"04971611-b99d-4d82-9b9e-20ab77bf27e3\") " pod="opendatahub/odh-model-controller-76588b95-8wht6" May 29 14:52:39.245581 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:39.245514 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-95796876-dqsfh"] May 29 14:52:39.248552 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:52:39.248519 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64a17acd_8fe0_47cc_93c4_0c79bba4d2b3.slice/crio-84e5c005184f56b9d1fe0d10e7d176830216dd94a80ad339b16c94423291bed8 WatchSource:0}: Error finding container 84e5c005184f56b9d1fe0d10e7d176830216dd94a80ad339b16c94423291bed8: Status 404 returned error can't find the container with id 84e5c005184f56b9d1fe0d10e7d176830216dd94a80ad339b16c94423291bed8 May 29 14:52:39.352668 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:39.352583 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-8wht6" May 29 14:52:39.488022 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:39.487992 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-8wht6"] May 29 14:52:39.490397 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:52:39.490365 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04971611_b99d_4d82_9b9e_20ab77bf27e3.slice/crio-0adeee7ff1d7aedb6c4d404e2d1bcc3db6b745ac3884a5ddad029f0d48c2180c WatchSource:0}: Error finding container 0adeee7ff1d7aedb6c4d404e2d1bcc3db6b745ac3884a5ddad029f0d48c2180c: Status 404 returned error can't find the container with id 0adeee7ff1d7aedb6c4d404e2d1bcc3db6b745ac3884a5ddad029f0d48c2180c May 29 14:52:39.513256 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:39.513228 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-6577596cd5-gbxfp"] May 29 14:52:39.516597 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:39.516578 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-gbxfp" May 29 14:52:39.519102 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:39.519085 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" May 29 14:52:39.533985 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:39.533957 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-gbxfp"] May 29 14:52:39.686512 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:39.686431 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df6e072a-41f6-45b8-babf-eeaff117d399-tls-certs\") pod \"model-serving-api-6577596cd5-gbxfp\" (UID: \"df6e072a-41f6-45b8-babf-eeaff117d399\") " pod="opendatahub/model-serving-api-6577596cd5-gbxfp" May 29 14:52:39.686512 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:39.686480 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcpgl\" (UniqueName: \"kubernetes.io/projected/df6e072a-41f6-45b8-babf-eeaff117d399-kube-api-access-bcpgl\") pod \"model-serving-api-6577596cd5-gbxfp\" (UID: \"df6e072a-41f6-45b8-babf-eeaff117d399\") " pod="opendatahub/model-serving-api-6577596cd5-gbxfp" May 29 14:52:39.786963 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:39.786919 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df6e072a-41f6-45b8-babf-eeaff117d399-tls-certs\") pod \"model-serving-api-6577596cd5-gbxfp\" (UID: \"df6e072a-41f6-45b8-babf-eeaff117d399\") " pod="opendatahub/model-serving-api-6577596cd5-gbxfp" May 29 14:52:39.787208 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:39.786983 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bcpgl\" (UniqueName: \"kubernetes.io/projected/df6e072a-41f6-45b8-babf-eeaff117d399-kube-api-access-bcpgl\") pod \"model-serving-api-6577596cd5-gbxfp\" (UID: \"df6e072a-41f6-45b8-babf-eeaff117d399\") " pod="opendatahub/model-serving-api-6577596cd5-gbxfp" May 29 14:52:39.789570 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:39.789542 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df6e072a-41f6-45b8-babf-eeaff117d399-tls-certs\") pod \"model-serving-api-6577596cd5-gbxfp\" (UID: \"df6e072a-41f6-45b8-babf-eeaff117d399\") " pod="opendatahub/model-serving-api-6577596cd5-gbxfp" May 29 14:52:39.797500 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:39.797466 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcpgl\" (UniqueName: \"kubernetes.io/projected/df6e072a-41f6-45b8-babf-eeaff117d399-kube-api-access-bcpgl\") pod \"model-serving-api-6577596cd5-gbxfp\" (UID: \"df6e072a-41f6-45b8-babf-eeaff117d399\") " pod="opendatahub/model-serving-api-6577596cd5-gbxfp" May 29 14:52:39.827060 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:39.827013 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-gbxfp" May 29 14:52:39.992623 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:39.992594 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-gbxfp"] May 29 14:52:39.995271 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:52:39.995237 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf6e072a_41f6_45b8_babf_eeaff117d399.slice/crio-f1cfc414e86bba7ee3f7388b6633673379620395098b5f7cd5cec89367be9545 WatchSource:0}: Error finding container f1cfc414e86bba7ee3f7388b6633673379620395098b5f7cd5cec89367be9545: Status 404 returned error can't find the container with id f1cfc414e86bba7ee3f7388b6633673379620395098b5f7cd5cec89367be9545 May 29 14:52:40.058932 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:40.058877 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-8wht6" event={"ID":"04971611-b99d-4d82-9b9e-20ab77bf27e3","Type":"ContainerStarted","Data":"0adeee7ff1d7aedb6c4d404e2d1bcc3db6b745ac3884a5ddad029f0d48c2180c"} May 29 14:52:40.060632 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:40.060601 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-gbxfp" event={"ID":"df6e072a-41f6-45b8-babf-eeaff117d399","Type":"ContainerStarted","Data":"f1cfc414e86bba7ee3f7388b6633673379620395098b5f7cd5cec89367be9545"} May 29 14:52:40.061980 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:40.061954 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-95796876-dqsfh" event={"ID":"64a17acd-8fe0-47cc-93c4-0c79bba4d2b3","Type":"ContainerStarted","Data":"84e5c005184f56b9d1fe0d10e7d176830216dd94a80ad339b16c94423291bed8"} May 29 14:52:45.089352 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:45.089311 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-gbxfp" event={"ID":"df6e072a-41f6-45b8-babf-eeaff117d399","Type":"ContainerStarted","Data":"d8c89b3bfa6fb462aae018e04eb23a896d44343e7c9c0d3b64fa31381f028aa2"} May 29 14:52:45.089817 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:45.089389 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-6577596cd5-gbxfp" May 29 14:52:45.091215 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:45.091162 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-95796876-dqsfh" event={"ID":"64a17acd-8fe0-47cc-93c4-0c79bba4d2b3","Type":"ContainerStarted","Data":"784ea0162b82f048f7a8e4de8b7b6df724dc5339aab89438d02eb52b23acf346"} May 29 14:52:45.092785 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:45.092753 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-8wht6" event={"ID":"04971611-b99d-4d82-9b9e-20ab77bf27e3","Type":"ContainerStarted","Data":"24967da1d92a2a87383be38e4516be6f754ee896f27b403d0a1a1054a0390af6"} May 29 14:52:45.113033 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:45.112967 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/model-serving-api-6577596cd5-gbxfp" podStartSLOduration=2.037100059 podStartE2EDuration="6.112949326s" podCreationTimestamp="2026-05-29 14:52:39 +0000 UTC" firstStartedPulling="2026-05-29 14:52:39.997690177 +0000 UTC m=+380.854802105" lastFinishedPulling="2026-05-29 14:52:44.073539434 +0000 UTC m=+384.930651372" observedRunningTime="2026-05-29 14:52:45.112097606 +0000 UTC m=+385.969209564" watchObservedRunningTime="2026-05-29 14:52:45.112949326 +0000 UTC m=+385.970061274" May 29 14:52:45.132019 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:45.131970 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-95796876-dqsfh" podStartSLOduration=2.3177052910000002 podStartE2EDuration="7.131957169s" podCreationTimestamp="2026-05-29 14:52:38 +0000 UTC" firstStartedPulling="2026-05-29 14:52:39.249910593 +0000 UTC m=+380.107022520" lastFinishedPulling="2026-05-29 14:52:44.06416245 +0000 UTC m=+384.921274398" observedRunningTime="2026-05-29 14:52:45.131352859 +0000 UTC m=+385.988464820" watchObservedRunningTime="2026-05-29 14:52:45.131957169 +0000 UTC m=+385.989069155" May 29 14:52:45.152956 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:45.152897 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-76588b95-8wht6" podStartSLOduration=2.559329814 podStartE2EDuration="7.152880916s" podCreationTimestamp="2026-05-29 14:52:38 +0000 UTC" firstStartedPulling="2026-05-29 14:52:39.491758826 +0000 UTC m=+380.348870755" lastFinishedPulling="2026-05-29 14:52:44.085309933 +0000 UTC m=+384.942421857" observedRunningTime="2026-05-29 14:52:45.150002994 +0000 UTC m=+386.007114941" watchObservedRunningTime="2026-05-29 14:52:45.152880916 +0000 UTC m=+386.009993054" May 29 14:52:46.095933 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:46.095901 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-76588b95-8wht6" May 29 14:52:49.442970 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:49.442929 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-72xnl"] May 29 14:52:49.446366 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:49.446349 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-72xnl" May 29 14:52:49.449448 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:49.449423 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" May 29 14:52:49.449448 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:49.449438 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-l29rv\"" May 29 14:52:49.461610 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:49.461586 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-m475d"] May 29 14:52:49.464812 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:49.464798 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-m475d" May 29 14:52:49.467719 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:49.467702 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" May 29 14:52:49.467830 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:49.467812 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-w7t9w\"" May 29 14:52:49.474105 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:49.474080 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-72xnl"] May 29 14:52:49.476412 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:49.476391 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw99s\" (UniqueName: \"kubernetes.io/projected/92f0d89c-a70d-4d35-9299-f054116fefbe-kube-api-access-bw99s\") pod \"kserve-controller-manager-7c99ffcdcd-72xnl\" (UID: \"92f0d89c-a70d-4d35-9299-f054116fefbe\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-72xnl" May 29 14:52:49.476505 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:49.476456 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/92f0d89c-a70d-4d35-9299-f054116fefbe-cert\") pod \"kserve-controller-manager-7c99ffcdcd-72xnl\" (UID: \"92f0d89c-a70d-4d35-9299-f054116fefbe\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-72xnl" May 29 14:52:49.486764 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:49.486741 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-m475d"] May 29 14:52:49.577413 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:49.577379 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzz86\" (UniqueName: \"kubernetes.io/projected/21ff85fd-08e4-4b3f-95dd-86aaa4d154b2-kube-api-access-pzz86\") pod \"llmisvc-controller-manager-c6b9847d7-m475d\" (UID: \"21ff85fd-08e4-4b3f-95dd-86aaa4d154b2\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-m475d" May 29 14:52:49.577603 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:49.577441 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/92f0d89c-a70d-4d35-9299-f054116fefbe-cert\") pod \"kserve-controller-manager-7c99ffcdcd-72xnl\" (UID: \"92f0d89c-a70d-4d35-9299-f054116fefbe\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-72xnl" May 29 14:52:49.577603 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:49.577529 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/21ff85fd-08e4-4b3f-95dd-86aaa4d154b2-cert\") pod \"llmisvc-controller-manager-c6b9847d7-m475d\" (UID: \"21ff85fd-08e4-4b3f-95dd-86aaa4d154b2\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-m475d" May 29 14:52:49.577603 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:49.577589 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bw99s\" (UniqueName: \"kubernetes.io/projected/92f0d89c-a70d-4d35-9299-f054116fefbe-kube-api-access-bw99s\") pod \"kserve-controller-manager-7c99ffcdcd-72xnl\" (UID: \"92f0d89c-a70d-4d35-9299-f054116fefbe\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-72xnl" May 29 14:52:49.580072 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:49.580047 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/92f0d89c-a70d-4d35-9299-f054116fefbe-cert\") pod \"kserve-controller-manager-7c99ffcdcd-72xnl\" (UID: \"92f0d89c-a70d-4d35-9299-f054116fefbe\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-72xnl" May 29 14:52:49.608218 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:49.608168 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw99s\" (UniqueName: \"kubernetes.io/projected/92f0d89c-a70d-4d35-9299-f054116fefbe-kube-api-access-bw99s\") pod \"kserve-controller-manager-7c99ffcdcd-72xnl\" (UID: \"92f0d89c-a70d-4d35-9299-f054116fefbe\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-72xnl" May 29 14:52:49.678223 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:49.678184 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/21ff85fd-08e4-4b3f-95dd-86aaa4d154b2-cert\") pod \"llmisvc-controller-manager-c6b9847d7-m475d\" (UID: \"21ff85fd-08e4-4b3f-95dd-86aaa4d154b2\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-m475d" May 29 14:52:49.678386 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:49.678250 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pzz86\" (UniqueName: \"kubernetes.io/projected/21ff85fd-08e4-4b3f-95dd-86aaa4d154b2-kube-api-access-pzz86\") pod \"llmisvc-controller-manager-c6b9847d7-m475d\" (UID: \"21ff85fd-08e4-4b3f-95dd-86aaa4d154b2\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-m475d" May 29 14:52:49.680686 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:49.680659 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/21ff85fd-08e4-4b3f-95dd-86aaa4d154b2-cert\") pod \"llmisvc-controller-manager-c6b9847d7-m475d\" (UID: \"21ff85fd-08e4-4b3f-95dd-86aaa4d154b2\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-m475d" May 29 14:52:49.699141 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:49.699075 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzz86\" (UniqueName: \"kubernetes.io/projected/21ff85fd-08e4-4b3f-95dd-86aaa4d154b2-kube-api-access-pzz86\") pod \"llmisvc-controller-manager-c6b9847d7-m475d\" (UID: \"21ff85fd-08e4-4b3f-95dd-86aaa4d154b2\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-m475d" May 29 14:52:49.756275 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:49.756233 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-72xnl" May 29 14:52:49.775205 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:49.775128 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-m475d" May 29 14:52:49.910867 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:49.910818 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-72xnl"] May 29 14:52:49.949741 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:49.949713 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-m475d"] May 29 14:52:49.952229 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:52:49.952201 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod21ff85fd_08e4_4b3f_95dd_86aaa4d154b2.slice/crio-43d0268977850c64b2b5d222d8d391ca55ed5ec7d723a85e1c2452ee740713c3 WatchSource:0}: Error finding container 43d0268977850c64b2b5d222d8d391ca55ed5ec7d723a85e1c2452ee740713c3: Status 404 returned error can't find the container with id 43d0268977850c64b2b5d222d8d391ca55ed5ec7d723a85e1c2452ee740713c3 May 29 14:52:50.112054 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:50.112020 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-72xnl" event={"ID":"92f0d89c-a70d-4d35-9299-f054116fefbe","Type":"ContainerStarted","Data":"aac6e8b728a37806f15689cf0b95048673b550d73051243b41d50f2e67caf4a4"} May 29 14:52:50.113023 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:50.112997 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-m475d" event={"ID":"21ff85fd-08e4-4b3f-95dd-86aaa4d154b2","Type":"ContainerStarted","Data":"43d0268977850c64b2b5d222d8d391ca55ed5ec7d723a85e1c2452ee740713c3"} May 29 14:52:54.130235 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:54.130146 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-72xnl" event={"ID":"92f0d89c-a70d-4d35-9299-f054116fefbe","Type":"ContainerStarted","Data":"e0f57d9cec4d899b6a9641b5b0db09e6b330b1ebbf2380f1c17a555f0bbc94a7"} May 29 14:52:54.130235 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:54.130231 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-72xnl" May 29 14:52:54.131751 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:54.131725 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-m475d" event={"ID":"21ff85fd-08e4-4b3f-95dd-86aaa4d154b2","Type":"ContainerStarted","Data":"fb53597c9e3795c6c452390d936bb2b36c9168160360c7b3d76a8d377c016d67"} May 29 14:52:54.131871 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:54.131849 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-m475d" May 29 14:52:54.289733 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:54.289672 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-72xnl" podStartSLOduration=1.59244571 podStartE2EDuration="5.289653488s" podCreationTimestamp="2026-05-29 14:52:49 +0000 UTC" firstStartedPulling="2026-05-29 14:52:49.915120568 +0000 UTC m=+390.772232494" lastFinishedPulling="2026-05-29 14:52:53.612328155 +0000 UTC m=+394.469440272" observedRunningTime="2026-05-29 14:52:54.280214226 +0000 UTC m=+395.137326173" watchObservedRunningTime="2026-05-29 14:52:54.289653488 +0000 UTC m=+395.146765435" May 29 14:52:54.406116 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:54.406000 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-m475d" podStartSLOduration=1.744162881 podStartE2EDuration="5.405980688s" podCreationTimestamp="2026-05-29 14:52:49 +0000 UTC" firstStartedPulling="2026-05-29 14:52:49.953585892 +0000 UTC m=+390.810697835" lastFinishedPulling="2026-05-29 14:52:53.615403718 +0000 UTC m=+394.472515642" observedRunningTime="2026-05-29 14:52:54.40407949 +0000 UTC m=+395.261191429" watchObservedRunningTime="2026-05-29 14:52:54.405980688 +0000 UTC m=+395.263092667" May 29 14:52:56.099892 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:56.099863 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-6577596cd5-gbxfp" May 29 14:52:57.103461 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:57.103381 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-76588b95-8wht6" May 29 14:52:57.398336 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:57.398257 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-fksb8"] May 29 14:52:57.405458 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:57.405435 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-fksb8" May 29 14:52:57.409722 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:57.409690 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-zfxkt\"" May 29 14:52:57.412012 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:57.411988 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" May 29 14:52:57.412500 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:57.412110 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" May 29 14:52:57.419544 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:57.419516 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-fksb8"] May 29 14:52:57.449684 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:57.449651 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dv4fz\" (UniqueName: \"kubernetes.io/projected/e51af810-3acc-4f07-8535-f82f4e7b38f9-kube-api-access-dv4fz\") pod \"servicemesh-operator3-55f49c5f94-fksb8\" (UID: \"e51af810-3acc-4f07-8535-f82f4e7b38f9\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-fksb8" May 29 14:52:57.449851 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:57.449705 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/e51af810-3acc-4f07-8535-f82f4e7b38f9-operator-config\") pod \"servicemesh-operator3-55f49c5f94-fksb8\" (UID: \"e51af810-3acc-4f07-8535-f82f4e7b38f9\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-fksb8" May 29 14:52:57.550654 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:57.550607 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/e51af810-3acc-4f07-8535-f82f4e7b38f9-operator-config\") pod \"servicemesh-operator3-55f49c5f94-fksb8\" (UID: \"e51af810-3acc-4f07-8535-f82f4e7b38f9\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-fksb8" May 29 14:52:57.550858 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:57.550724 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dv4fz\" (UniqueName: \"kubernetes.io/projected/e51af810-3acc-4f07-8535-f82f4e7b38f9-kube-api-access-dv4fz\") pod \"servicemesh-operator3-55f49c5f94-fksb8\" (UID: \"e51af810-3acc-4f07-8535-f82f4e7b38f9\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-fksb8" May 29 14:52:57.553334 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:57.553311 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/e51af810-3acc-4f07-8535-f82f4e7b38f9-operator-config\") pod \"servicemesh-operator3-55f49c5f94-fksb8\" (UID: \"e51af810-3acc-4f07-8535-f82f4e7b38f9\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-fksb8" May 29 14:52:57.565741 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:57.565713 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv4fz\" (UniqueName: \"kubernetes.io/projected/e51af810-3acc-4f07-8535-f82f4e7b38f9-kube-api-access-dv4fz\") pod \"servicemesh-operator3-55f49c5f94-fksb8\" (UID: \"e51af810-3acc-4f07-8535-f82f4e7b38f9\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-fksb8" May 29 14:52:57.715476 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:57.715386 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-fksb8" May 29 14:52:57.887369 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:57.887337 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-fksb8"] May 29 14:52:57.892341 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:52:57.892309 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode51af810_3acc_4f07_8535_f82f4e7b38f9.slice/crio-4c9605c758b0d5990df46e250030fab4e475bae5c2ceb254082966736f98b04a WatchSource:0}: Error finding container 4c9605c758b0d5990df46e250030fab4e475bae5c2ceb254082966736f98b04a: Status 404 returned error can't find the container with id 4c9605c758b0d5990df46e250030fab4e475bae5c2ceb254082966736f98b04a May 29 14:52:58.148881 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:52:58.148845 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-fksb8" event={"ID":"e51af810-3acc-4f07-8535-f82f4e7b38f9","Type":"ContainerStarted","Data":"4c9605c758b0d5990df46e250030fab4e475bae5c2ceb254082966736f98b04a"} May 29 14:53:08.485195 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:08.485142 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-58b448cf8f-qkdks"] May 29 14:53:08.489262 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:08.489241 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-58b448cf8f-qkdks" May 29 14:53:08.493655 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:08.493633 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-6znnm\"" May 29 14:53:08.493802 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:08.493738 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" May 29 14:53:08.502965 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:08.502943 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-58b448cf8f-qkdks"] May 29 14:53:08.560194 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:08.556970 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8psw\" (UniqueName: \"kubernetes.io/projected/e6cf6ec8-2c82-4983-9502-a7c6ecd897a4-kube-api-access-j8psw\") pod \"dashboard-redirect-58b448cf8f-qkdks\" (UID: \"e6cf6ec8-2c82-4983-9502-a7c6ecd897a4\") " pod="opendatahub/dashboard-redirect-58b448cf8f-qkdks" May 29 14:53:08.560194 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:08.557092 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/e6cf6ec8-2c82-4983-9502-a7c6ecd897a4-redirect-config\") pod \"dashboard-redirect-58b448cf8f-qkdks\" (UID: \"e6cf6ec8-2c82-4983-9502-a7c6ecd897a4\") " pod="opendatahub/dashboard-redirect-58b448cf8f-qkdks" May 29 14:53:08.658356 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:08.658316 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j8psw\" (UniqueName: \"kubernetes.io/projected/e6cf6ec8-2c82-4983-9502-a7c6ecd897a4-kube-api-access-j8psw\") pod \"dashboard-redirect-58b448cf8f-qkdks\" (UID: \"e6cf6ec8-2c82-4983-9502-a7c6ecd897a4\") " pod="opendatahub/dashboard-redirect-58b448cf8f-qkdks" May 29 14:53:08.658537 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:08.658367 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/e6cf6ec8-2c82-4983-9502-a7c6ecd897a4-redirect-config\") pod \"dashboard-redirect-58b448cf8f-qkdks\" (UID: \"e6cf6ec8-2c82-4983-9502-a7c6ecd897a4\") " pod="opendatahub/dashboard-redirect-58b448cf8f-qkdks" May 29 14:53:08.658981 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:08.658964 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/e6cf6ec8-2c82-4983-9502-a7c6ecd897a4-redirect-config\") pod \"dashboard-redirect-58b448cf8f-qkdks\" (UID: \"e6cf6ec8-2c82-4983-9502-a7c6ecd897a4\") " pod="opendatahub/dashboard-redirect-58b448cf8f-qkdks" May 29 14:53:08.669145 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:08.669120 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8psw\" (UniqueName: \"kubernetes.io/projected/e6cf6ec8-2c82-4983-9502-a7c6ecd897a4-kube-api-access-j8psw\") pod \"dashboard-redirect-58b448cf8f-qkdks\" (UID: \"e6cf6ec8-2c82-4983-9502-a7c6ecd897a4\") " pod="opendatahub/dashboard-redirect-58b448cf8f-qkdks" May 29 14:53:08.800687 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:08.800652 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-58b448cf8f-qkdks" May 29 14:53:08.933795 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:08.933769 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-58b448cf8f-qkdks"] May 29 14:53:08.936657 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:53:08.936628 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6cf6ec8_2c82_4983_9502_a7c6ecd897a4.slice/crio-b2be57725affa37a037979fc9e058410c4a3415a8fe7f5e1917a04a76dcde1bb WatchSource:0}: Error finding container b2be57725affa37a037979fc9e058410c4a3415a8fe7f5e1917a04a76dcde1bb: Status 404 returned error can't find the container with id b2be57725affa37a037979fc9e058410c4a3415a8fe7f5e1917a04a76dcde1bb May 29 14:53:09.190640 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:09.190554 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-58b448cf8f-qkdks" event={"ID":"e6cf6ec8-2c82-4983-9502-a7c6ecd897a4","Type":"ContainerStarted","Data":"b2be57725affa37a037979fc9e058410c4a3415a8fe7f5e1917a04a76dcde1bb"} May 29 14:53:11.199682 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:11.199599 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-58b448cf8f-qkdks" event={"ID":"e6cf6ec8-2c82-4983-9502-a7c6ecd897a4","Type":"ContainerStarted","Data":"92c13266b0cf29198e31f947083f24d8803907a1e45e6d4eccff7fe0ae8f03f5"} May 29 14:53:11.222599 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:11.222533 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-58b448cf8f-qkdks" podStartSLOduration=1.29403487 podStartE2EDuration="3.222512316s" podCreationTimestamp="2026-05-29 14:53:08 +0000 UTC" firstStartedPulling="2026-05-29 14:53:08.93804105 +0000 UTC m=+409.795152974" lastFinishedPulling="2026-05-29 14:53:10.866518494 +0000 UTC m=+411.723630420" observedRunningTime="2026-05-29 14:53:11.218976746 +0000 UTC m=+412.076088694" watchObservedRunningTime="2026-05-29 14:53:11.222512316 +0000 UTC m=+412.079624266" May 29 14:53:15.221803 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:15.221761 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-fksb8" event={"ID":"e51af810-3acc-4f07-8535-f82f4e7b38f9","Type":"ContainerStarted","Data":"fac250fa767dc8d5278031a678ef1f72ad134e59e699c736bba27decec54ddbe"} May 29 14:53:15.222195 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:15.221919 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-fksb8" May 29 14:53:15.247888 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:15.247834 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-fksb8" podStartSLOduration=1.8239210890000002 podStartE2EDuration="18.247818734s" podCreationTimestamp="2026-05-29 14:52:57 +0000 UTC" firstStartedPulling="2026-05-29 14:52:57.895531351 +0000 UTC m=+398.752643276" lastFinishedPulling="2026-05-29 14:53:14.319428977 +0000 UTC m=+415.176540921" observedRunningTime="2026-05-29 14:53:15.246516567 +0000 UTC m=+416.103628515" watchObservedRunningTime="2026-05-29 14:53:15.247818734 +0000 UTC m=+416.104930680" May 29 14:53:15.619786 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:15.619742 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-q5kjt"] May 29 14:53:15.623991 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:15.623967 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5kjt" May 29 14:53:15.626388 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:15.626365 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" May 29 14:53:15.626528 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:15.626416 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" May 29 14:53:15.626528 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:15.626472 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" May 29 14:53:15.626528 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:15.626501 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-w6wsq\"" May 29 14:53:15.626719 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:15.626701 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 29 14:53:15.633955 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:15.633926 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-q5kjt"] May 29 14:53:15.721842 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:15.721812 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dc7a5bd7-40c5-4b07-a751-f62a1092f779-cacerts\") pod \"istiod-openshift-gateway-798958bb55-q5kjt\" (UID: \"dc7a5bd7-40c5-4b07-a751-f62a1092f779\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5kjt" May 29 14:53:15.722006 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:15.721861 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dc7a5bd7-40c5-4b07-a751-f62a1092f779-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-q5kjt\" (UID: \"dc7a5bd7-40c5-4b07-a751-f62a1092f779\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5kjt" May 29 14:53:15.722006 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:15.721897 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dc7a5bd7-40c5-4b07-a751-f62a1092f779-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-q5kjt\" (UID: \"dc7a5bd7-40c5-4b07-a751-f62a1092f779\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5kjt" May 29 14:53:15.722006 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:15.721929 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc7a5bd7-40c5-4b07-a751-f62a1092f779-istio-token\") pod \"istiod-openshift-gateway-798958bb55-q5kjt\" (UID: \"dc7a5bd7-40c5-4b07-a751-f62a1092f779\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5kjt" May 29 14:53:15.722006 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:15.721949 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dc7a5bd7-40c5-4b07-a751-f62a1092f779-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-q5kjt\" (UID: \"dc7a5bd7-40c5-4b07-a751-f62a1092f779\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5kjt" May 29 14:53:15.722142 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:15.722044 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ss842\" (UniqueName: \"kubernetes.io/projected/dc7a5bd7-40c5-4b07-a751-f62a1092f779-kube-api-access-ss842\") pod \"istiod-openshift-gateway-798958bb55-q5kjt\" (UID: \"dc7a5bd7-40c5-4b07-a751-f62a1092f779\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5kjt" May 29 14:53:15.722142 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:15.722102 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc7a5bd7-40c5-4b07-a751-f62a1092f779-local-certs\") pod \"istiod-openshift-gateway-798958bb55-q5kjt\" (UID: \"dc7a5bd7-40c5-4b07-a751-f62a1092f779\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5kjt" May 29 14:53:15.823694 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:15.823655 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dc7a5bd7-40c5-4b07-a751-f62a1092f779-cacerts\") pod \"istiod-openshift-gateway-798958bb55-q5kjt\" (UID: \"dc7a5bd7-40c5-4b07-a751-f62a1092f779\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5kjt" May 29 14:53:15.823870 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:15.823748 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dc7a5bd7-40c5-4b07-a751-f62a1092f779-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-q5kjt\" (UID: \"dc7a5bd7-40c5-4b07-a751-f62a1092f779\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5kjt" May 29 14:53:15.823870 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:15.823797 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dc7a5bd7-40c5-4b07-a751-f62a1092f779-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-q5kjt\" (UID: \"dc7a5bd7-40c5-4b07-a751-f62a1092f779\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5kjt" May 29 14:53:15.823870 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:15.823831 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc7a5bd7-40c5-4b07-a751-f62a1092f779-istio-token\") pod \"istiod-openshift-gateway-798958bb55-q5kjt\" (UID: \"dc7a5bd7-40c5-4b07-a751-f62a1092f779\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5kjt" May 29 14:53:15.823870 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:15.823862 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dc7a5bd7-40c5-4b07-a751-f62a1092f779-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-q5kjt\" (UID: \"dc7a5bd7-40c5-4b07-a751-f62a1092f779\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5kjt" May 29 14:53:15.824080 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:15.823907 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ss842\" (UniqueName: \"kubernetes.io/projected/dc7a5bd7-40c5-4b07-a751-f62a1092f779-kube-api-access-ss842\") pod \"istiod-openshift-gateway-798958bb55-q5kjt\" (UID: \"dc7a5bd7-40c5-4b07-a751-f62a1092f779\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5kjt" May 29 14:53:15.824080 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:15.823970 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc7a5bd7-40c5-4b07-a751-f62a1092f779-local-certs\") pod \"istiod-openshift-gateway-798958bb55-q5kjt\" (UID: \"dc7a5bd7-40c5-4b07-a751-f62a1092f779\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5kjt" May 29 14:53:15.824697 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:15.824613 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dc7a5bd7-40c5-4b07-a751-f62a1092f779-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-q5kjt\" (UID: \"dc7a5bd7-40c5-4b07-a751-f62a1092f779\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5kjt" May 29 14:53:15.826629 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:15.826514 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dc7a5bd7-40c5-4b07-a751-f62a1092f779-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-q5kjt\" (UID: \"dc7a5bd7-40c5-4b07-a751-f62a1092f779\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5kjt" May 29 14:53:15.826744 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:15.826632 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc7a5bd7-40c5-4b07-a751-f62a1092f779-local-certs\") pod \"istiod-openshift-gateway-798958bb55-q5kjt\" (UID: \"dc7a5bd7-40c5-4b07-a751-f62a1092f779\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5kjt" May 29 14:53:15.827141 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:15.827114 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dc7a5bd7-40c5-4b07-a751-f62a1092f779-cacerts\") pod \"istiod-openshift-gateway-798958bb55-q5kjt\" (UID: \"dc7a5bd7-40c5-4b07-a751-f62a1092f779\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5kjt" May 29 14:53:15.828024 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:15.827994 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dc7a5bd7-40c5-4b07-a751-f62a1092f779-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-q5kjt\" (UID: \"dc7a5bd7-40c5-4b07-a751-f62a1092f779\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5kjt" May 29 14:53:15.834120 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:15.834086 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ss842\" (UniqueName: \"kubernetes.io/projected/dc7a5bd7-40c5-4b07-a751-f62a1092f779-kube-api-access-ss842\") pod \"istiod-openshift-gateway-798958bb55-q5kjt\" (UID: \"dc7a5bd7-40c5-4b07-a751-f62a1092f779\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5kjt" May 29 14:53:15.834647 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:15.834622 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc7a5bd7-40c5-4b07-a751-f62a1092f779-istio-token\") pod \"istiod-openshift-gateway-798958bb55-q5kjt\" (UID: \"dc7a5bd7-40c5-4b07-a751-f62a1092f779\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5kjt" May 29 14:53:15.935908 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:15.934372 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5kjt" May 29 14:53:16.084467 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:16.084434 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-q5kjt"] May 29 14:53:16.086462 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:53:16.086429 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc7a5bd7_40c5_4b07_a751_f62a1092f779.slice/crio-cd28bb69fc92735eed5845e9703358e3454c621b0ad1f77342a0083382369ba5 WatchSource:0}: Error finding container cd28bb69fc92735eed5845e9703358e3454c621b0ad1f77342a0083382369ba5: Status 404 returned error can't find the container with id cd28bb69fc92735eed5845e9703358e3454c621b0ad1f77342a0083382369ba5 May 29 14:53:16.227704 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:16.227613 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5kjt" event={"ID":"dc7a5bd7-40c5-4b07-a751-f62a1092f779","Type":"ContainerStarted","Data":"cd28bb69fc92735eed5845e9703358e3454c621b0ad1f77342a0083382369ba5"} May 29 14:53:19.202790 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:19.202755 2564 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} May 29 14:53:19.203014 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:19.202820 2564 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} May 29 14:53:20.245696 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:20.245654 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5kjt" event={"ID":"dc7a5bd7-40c5-4b07-a751-f62a1092f779","Type":"ContainerStarted","Data":"f08259dd5949062ff3ce4fa305414b24f8c7f5d88504698e203e386796f682c9"} May 29 14:53:20.246230 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:20.245796 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5kjt" May 29 14:53:20.247049 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:20.247023 2564 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-q5kjt container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= May 29 14:53:20.247148 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:20.247072 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5kjt" podUID="dc7a5bd7-40c5-4b07-a751-f62a1092f779" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 29 14:53:20.293811 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:20.293736 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5kjt" podStartSLOduration=2.179725547 podStartE2EDuration="5.293721024s" podCreationTimestamp="2026-05-29 14:53:15 +0000 UTC" firstStartedPulling="2026-05-29 14:53:16.088509536 +0000 UTC m=+416.945621460" lastFinishedPulling="2026-05-29 14:53:19.202505012 +0000 UTC m=+420.059616937" observedRunningTime="2026-05-29 14:53:20.291795513 +0000 UTC m=+421.148907461" watchObservedRunningTime="2026-05-29 14:53:20.293721024 +0000 UTC m=+421.150832970" May 29 14:53:21.249716 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:21.249690 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5kjt" May 29 14:53:25.137603 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:25.137571 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-m475d" May 29 14:53:25.140645 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:25.140623 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-72xnl" May 29 14:53:26.230497 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:53:26.230471 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-fksb8" May 29 14:54:09.456378 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:09.456336 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-z8kp2"] May 29 14:54:09.459528 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:09.459511 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-z8kp2" May 29 14:54:09.463743 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:09.463723 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 29 14:54:09.463866 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:09.463754 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 29 14:54:09.464615 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:09.464600 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-bvnnv\"" May 29 14:54:09.474638 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:09.474614 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-z8kp2"] May 29 14:54:09.635253 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:09.635213 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82bgd\" (UniqueName: \"kubernetes.io/projected/151c2eef-9f71-4eec-adf3-658776d5735d-kube-api-access-82bgd\") pod \"authorino-operator-657f44b778-z8kp2\" (UID: \"151c2eef-9f71-4eec-adf3-658776d5735d\") " pod="kuadrant-system/authorino-operator-657f44b778-z8kp2" May 29 14:54:09.736216 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:09.736089 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-82bgd\" (UniqueName: \"kubernetes.io/projected/151c2eef-9f71-4eec-adf3-658776d5735d-kube-api-access-82bgd\") pod \"authorino-operator-657f44b778-z8kp2\" (UID: \"151c2eef-9f71-4eec-adf3-658776d5735d\") " pod="kuadrant-system/authorino-operator-657f44b778-z8kp2" May 29 14:54:09.752676 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:09.752645 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82bgd\" (UniqueName: \"kubernetes.io/projected/151c2eef-9f71-4eec-adf3-658776d5735d-kube-api-access-82bgd\") pod \"authorino-operator-657f44b778-z8kp2\" (UID: \"151c2eef-9f71-4eec-adf3-658776d5735d\") " pod="kuadrant-system/authorino-operator-657f44b778-z8kp2" May 29 14:54:09.769050 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:09.769020 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-z8kp2" May 29 14:54:09.908746 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:09.908714 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-z8kp2"] May 29 14:54:09.911502 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:54:09.911475 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod151c2eef_9f71_4eec_adf3_658776d5735d.slice/crio-91cfd7a935e8d4d08336b6747ca35738865efe2a43605bbb70d3f811e52e1591 WatchSource:0}: Error finding container 91cfd7a935e8d4d08336b6747ca35738865efe2a43605bbb70d3f811e52e1591: Status 404 returned error can't find the container with id 91cfd7a935e8d4d08336b6747ca35738865efe2a43605bbb70d3f811e52e1591 May 29 14:54:10.423325 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:10.423278 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-z8kp2" event={"ID":"151c2eef-9f71-4eec-adf3-658776d5735d","Type":"ContainerStarted","Data":"91cfd7a935e8d4d08336b6747ca35738865efe2a43605bbb70d3f811e52e1591"} May 29 14:54:12.432478 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:12.432391 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-z8kp2" event={"ID":"151c2eef-9f71-4eec-adf3-658776d5735d","Type":"ContainerStarted","Data":"c445f3160760ecb3b3dd601340af055b7404ff3b764961d705efd2e21eb1bc12"} May 29 14:54:12.432829 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:12.432515 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-z8kp2" May 29 14:54:12.455708 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:12.455654 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-z8kp2" podStartSLOduration=1.244841497 podStartE2EDuration="3.455639939s" podCreationTimestamp="2026-05-29 14:54:09 +0000 UTC" firstStartedPulling="2026-05-29 14:54:09.913498449 +0000 UTC m=+470.770610373" lastFinishedPulling="2026-05-29 14:54:12.124296875 +0000 UTC m=+472.981408815" observedRunningTime="2026-05-29 14:54:12.453763461 +0000 UTC m=+473.310875408" watchObservedRunningTime="2026-05-29 14:54:12.455639939 +0000 UTC m=+473.312751885" May 29 14:54:23.438208 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:23.438157 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-z8kp2" May 29 14:54:33.420298 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:33.420259 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2kcrw"] May 29 14:54:33.424047 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:33.424024 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2kcrw" May 29 14:54:33.434760 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:33.434739 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-w6k7z\"" May 29 14:54:33.450523 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:33.450489 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2kcrw"] May 29 14:54:33.559132 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:33.559079 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6b6c23c-5d8f-474e-b820-dedaa904dd54-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-2kcrw\" (UID: \"e6b6c23c-5d8f-474e-b820-dedaa904dd54\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2kcrw" May 29 14:54:33.559320 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:33.559201 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hg6f\" (UniqueName: \"kubernetes.io/projected/e6b6c23c-5d8f-474e-b820-dedaa904dd54-kube-api-access-9hg6f\") pod \"kuadrant-operator-controller-manager-84b657d985-2kcrw\" (UID: \"e6b6c23c-5d8f-474e-b820-dedaa904dd54\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2kcrw" May 29 14:54:33.598772 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:33.598728 2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2kcrw"] May 29 14:54:33.599027 ip-10-0-129-189 kubenswrapper[2564]: E0529 14:54:33.599008 2564 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-9hg6f], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2kcrw" podUID="e6b6c23c-5d8f-474e-b820-dedaa904dd54" May 29 14:54:33.660537 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:33.660500 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9hg6f\" (UniqueName: \"kubernetes.io/projected/e6b6c23c-5d8f-474e-b820-dedaa904dd54-kube-api-access-9hg6f\") pod \"kuadrant-operator-controller-manager-84b657d985-2kcrw\" (UID: \"e6b6c23c-5d8f-474e-b820-dedaa904dd54\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2kcrw" May 29 14:54:33.660697 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:33.660579 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6b6c23c-5d8f-474e-b820-dedaa904dd54-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-2kcrw\" (UID: \"e6b6c23c-5d8f-474e-b820-dedaa904dd54\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2kcrw" May 29 14:54:33.660889 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:33.660873 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6b6c23c-5d8f-474e-b820-dedaa904dd54-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-2kcrw\" (UID: \"e6b6c23c-5d8f-474e-b820-dedaa904dd54\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2kcrw" May 29 14:54:33.693366 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:33.693285 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hg6f\" (UniqueName: \"kubernetes.io/projected/e6b6c23c-5d8f-474e-b820-dedaa904dd54-kube-api-access-9hg6f\") pod \"kuadrant-operator-controller-manager-84b657d985-2kcrw\" (UID: \"e6b6c23c-5d8f-474e-b820-dedaa904dd54\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2kcrw" May 29 14:54:33.699460 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:33.699427 2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2kcrw"] May 29 14:54:33.715063 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:33.715031 2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2kcrw"] May 29 14:54:33.778041 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:33.777997 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9zmfm"] May 29 14:54:33.780688 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:33.780666 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9zmfm" May 29 14:54:33.787508 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:33.787478 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-lwt59\"" May 29 14:54:33.796871 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:33.796841 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9zmfm"] May 29 14:54:33.862849 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:33.862817 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pm6wz\" (UniqueName: \"kubernetes.io/projected/db911420-1a50-4b60-b5a8-c1c690736677-kube-api-access-pm6wz\") pod \"limitador-operator-controller-manager-85c4996f8c-9zmfm\" (UID: \"db911420-1a50-4b60-b5a8-c1c690736677\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9zmfm" May 29 14:54:33.964097 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:33.963983 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pm6wz\" (UniqueName: \"kubernetes.io/projected/db911420-1a50-4b60-b5a8-c1c690736677-kube-api-access-pm6wz\") pod \"limitador-operator-controller-manager-85c4996f8c-9zmfm\" (UID: \"db911420-1a50-4b60-b5a8-c1c690736677\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9zmfm" May 29 14:54:33.993402 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:33.993364 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pm6wz\" (UniqueName: \"kubernetes.io/projected/db911420-1a50-4b60-b5a8-c1c690736677-kube-api-access-pm6wz\") pod \"limitador-operator-controller-manager-85c4996f8c-9zmfm\" (UID: \"db911420-1a50-4b60-b5a8-c1c690736677\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9zmfm" May 29 14:54:34.091956 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:34.091915 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9zmfm" May 29 14:54:34.241278 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:34.241165 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9zmfm"] May 29 14:54:34.243713 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:54:34.243683 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb911420_1a50_4b60_b5a8_c1c690736677.slice/crio-28671ab9e735141f2528a9f04607221d147173cb117c1bc5e4c986a3cb34bca6 WatchSource:0}: Error finding container 28671ab9e735141f2528a9f04607221d147173cb117c1bc5e4c986a3cb34bca6: Status 404 returned error can't find the container with id 28671ab9e735141f2528a9f04607221d147173cb117c1bc5e4c986a3cb34bca6 May 29 14:54:34.522660 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:34.522572 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9zmfm" event={"ID":"db911420-1a50-4b60-b5a8-c1c690736677","Type":"ContainerStarted","Data":"28671ab9e735141f2528a9f04607221d147173cb117c1bc5e4c986a3cb34bca6"} May 29 14:54:34.522660 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:34.522610 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2kcrw" May 29 14:54:34.525122 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:34.525092 2564 status_manager.go:895] "Failed to get status for pod" podUID="e6b6c23c-5d8f-474e-b820-dedaa904dd54" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2kcrw" err="pods \"kuadrant-operator-controller-manager-84b657d985-2kcrw\" is forbidden: User \"system:node:ip-10-0-129-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-189.ec2.internal' and this object" May 29 14:54:34.527729 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:34.527710 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2kcrw" May 29 14:54:34.532501 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:34.532469 2564 status_manager.go:895] "Failed to get status for pod" podUID="e6b6c23c-5d8f-474e-b820-dedaa904dd54" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2kcrw" err="pods \"kuadrant-operator-controller-manager-84b657d985-2kcrw\" is forbidden: User \"system:node:ip-10-0-129-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-189.ec2.internal' and this object" May 29 14:54:34.671640 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:34.671608 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9hg6f\" (UniqueName: \"kubernetes.io/projected/e6b6c23c-5d8f-474e-b820-dedaa904dd54-kube-api-access-9hg6f\") pod \"e6b6c23c-5d8f-474e-b820-dedaa904dd54\" (UID: \"e6b6c23c-5d8f-474e-b820-dedaa904dd54\") " May 29 14:54:34.671810 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:34.671682 2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6b6c23c-5d8f-474e-b820-dedaa904dd54-extensions-socket-volume\") pod \"e6b6c23c-5d8f-474e-b820-dedaa904dd54\" (UID: \"e6b6c23c-5d8f-474e-b820-dedaa904dd54\") " May 29 14:54:34.671982 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:34.671958 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6b6c23c-5d8f-474e-b820-dedaa904dd54-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e6b6c23c-5d8f-474e-b820-dedaa904dd54" (UID: "e6b6c23c-5d8f-474e-b820-dedaa904dd54"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 14:54:34.673877 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:34.673848 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6b6c23c-5d8f-474e-b820-dedaa904dd54-kube-api-access-9hg6f" (OuterVolumeSpecName: "kube-api-access-9hg6f") pod "e6b6c23c-5d8f-474e-b820-dedaa904dd54" (UID: "e6b6c23c-5d8f-474e-b820-dedaa904dd54"). InnerVolumeSpecName "kube-api-access-9hg6f". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 14:54:34.773056 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:34.772915 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hg6f\" (UniqueName: \"kubernetes.io/projected/e6b6c23c-5d8f-474e-b820-dedaa904dd54-kube-api-access-9hg6f\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:54:34.773236 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:34.773049 2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6b6c23c-5d8f-474e-b820-dedaa904dd54-extensions-socket-volume\") on node \"ip-10-0-129-189.ec2.internal\" DevicePath \"\"" May 29 14:54:35.527707 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:35.527674 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2kcrw" May 29 14:54:35.530004 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:35.529963 2564 status_manager.go:895] "Failed to get status for pod" podUID="e6b6c23c-5d8f-474e-b820-dedaa904dd54" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2kcrw" err="pods \"kuadrant-operator-controller-manager-84b657d985-2kcrw\" is forbidden: User \"system:node:ip-10-0-129-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-189.ec2.internal' and this object" May 29 14:54:35.536360 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:35.536299 2564 status_manager.go:895] "Failed to get status for pod" podUID="e6b6c23c-5d8f-474e-b820-dedaa904dd54" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-2kcrw" err="pods \"kuadrant-operator-controller-manager-84b657d985-2kcrw\" is forbidden: User \"system:node:ip-10-0-129-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-189.ec2.internal' and this object" May 29 14:54:35.661885 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:35.661842 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6b6c23c-5d8f-474e-b820-dedaa904dd54" path="/var/lib/kubelet/pods/e6b6c23c-5d8f-474e-b820-dedaa904dd54/volumes" May 29 14:54:36.533999 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:36.533957 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9zmfm" event={"ID":"db911420-1a50-4b60-b5a8-c1c690736677","Type":"ContainerStarted","Data":"0e3710cab26a29f485c7b62cc4d323278040c0c6fd5c2ec13422886f45751336"} May 29 14:54:36.534484 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:36.534074 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9zmfm" May 29 14:54:36.556753 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:36.556705 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9zmfm" podStartSLOduration=2.118396862 podStartE2EDuration="3.556690798s" podCreationTimestamp="2026-05-29 14:54:33 +0000 UTC" firstStartedPulling="2026-05-29 14:54:34.245719361 +0000 UTC m=+495.102831286" lastFinishedPulling="2026-05-29 14:54:35.684013297 +0000 UTC m=+496.541125222" observedRunningTime="2026-05-29 14:54:36.554966205 +0000 UTC m=+497.412078152" watchObservedRunningTime="2026-05-29 14:54:36.556690798 +0000 UTC m=+497.413802745" May 29 14:54:47.540462 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:54:47.540428 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-9zmfm" May 29 14:55:07.362278 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:55:07.362239 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qs9mm"] May 29 14:55:07.369629 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:55:07.369605 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-qs9mm" May 29 14:55:07.373164 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:55:07.373137 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-tjxwg\"" May 29 14:55:07.373565 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:55:07.373545 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 29 14:55:07.376687 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:55:07.376665 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qs9mm"] May 29 14:55:07.417982 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:55:07.417953 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qs9mm"] May 29 14:55:07.479827 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:55:07.479792 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttjrx\" (UniqueName: \"kubernetes.io/projected/4260d493-315a-41d7-8b5c-1fe398a461a8-kube-api-access-ttjrx\") pod \"limitador-limitador-78c99df468-qs9mm\" (UID: \"4260d493-315a-41d7-8b5c-1fe398a461a8\") " pod="kuadrant-system/limitador-limitador-78c99df468-qs9mm" May 29 14:55:07.480033 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:55:07.479841 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4260d493-315a-41d7-8b5c-1fe398a461a8-config-file\") pod \"limitador-limitador-78c99df468-qs9mm\" (UID: \"4260d493-315a-41d7-8b5c-1fe398a461a8\") " pod="kuadrant-system/limitador-limitador-78c99df468-qs9mm" May 29 14:55:07.580733 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:55:07.580700 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ttjrx\" (UniqueName: \"kubernetes.io/projected/4260d493-315a-41d7-8b5c-1fe398a461a8-kube-api-access-ttjrx\") pod \"limitador-limitador-78c99df468-qs9mm\" (UID: \"4260d493-315a-41d7-8b5c-1fe398a461a8\") " pod="kuadrant-system/limitador-limitador-78c99df468-qs9mm" May 29 14:55:07.580733 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:55:07.580746 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4260d493-315a-41d7-8b5c-1fe398a461a8-config-file\") pod \"limitador-limitador-78c99df468-qs9mm\" (UID: \"4260d493-315a-41d7-8b5c-1fe398a461a8\") " pod="kuadrant-system/limitador-limitador-78c99df468-qs9mm" May 29 14:55:07.581412 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:55:07.581393 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4260d493-315a-41d7-8b5c-1fe398a461a8-config-file\") pod \"limitador-limitador-78c99df468-qs9mm\" (UID: \"4260d493-315a-41d7-8b5c-1fe398a461a8\") " pod="kuadrant-system/limitador-limitador-78c99df468-qs9mm" May 29 14:55:07.589095 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:55:07.589072 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttjrx\" (UniqueName: \"kubernetes.io/projected/4260d493-315a-41d7-8b5c-1fe398a461a8-kube-api-access-ttjrx\") pod \"limitador-limitador-78c99df468-qs9mm\" (UID: \"4260d493-315a-41d7-8b5c-1fe398a461a8\") " pod="kuadrant-system/limitador-limitador-78c99df468-qs9mm" May 29 14:55:07.681560 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:55:07.681472 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-qs9mm" May 29 14:55:07.818036 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:55:07.818011 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qs9mm"] May 29 14:55:07.820250 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:55:07.820220 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4260d493_315a_41d7_8b5c_1fe398a461a8.slice/crio-0a711ad92acb13d8cce9a1a694fcc7053bd723160e55b6c615e50f35f16325d2 WatchSource:0}: Error finding container 0a711ad92acb13d8cce9a1a694fcc7053bd723160e55b6c615e50f35f16325d2: Status 404 returned error can't find the container with id 0a711ad92acb13d8cce9a1a694fcc7053bd723160e55b6c615e50f35f16325d2 May 29 14:55:08.653843 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:55:08.653795 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-qs9mm" event={"ID":"4260d493-315a-41d7-8b5c-1fe398a461a8","Type":"ContainerStarted","Data":"0a711ad92acb13d8cce9a1a694fcc7053bd723160e55b6c615e50f35f16325d2"} May 29 14:55:10.662698 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:55:10.662612 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-qs9mm" event={"ID":"4260d493-315a-41d7-8b5c-1fe398a461a8","Type":"ContainerStarted","Data":"ebb1b2ab38629fb130c6e3aa777c60726efaab36be83524dca3ba8acd43cd8b1"} May 29 14:55:10.663105 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:55:10.662720 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-qs9mm" May 29 14:55:10.683653 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:55:10.683605 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-qs9mm" podStartSLOduration=1.208024371 podStartE2EDuration="3.683590772s" podCreationTimestamp="2026-05-29 14:55:07 +0000 UTC" firstStartedPulling="2026-05-29 14:55:07.821992747 +0000 UTC m=+528.679104671" lastFinishedPulling="2026-05-29 14:55:10.297559145 +0000 UTC m=+531.154671072" observedRunningTime="2026-05-29 14:55:10.681283106 +0000 UTC m=+531.538395056" watchObservedRunningTime="2026-05-29 14:55:10.683590772 +0000 UTC m=+531.540702719" May 29 14:55:21.666712 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:55:21.666683 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-qs9mm" May 29 14:56:19.576117 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:56:19.576086 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gvn49_1300fffd-bfc2-4a5c-95d8-01941a39ca6c/ovn-acl-logging/0.log" May 29 14:56:19.576635 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:56:19.576533 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gvn49_1300fffd-bfc2-4a5c-95d8-01941a39ca6c/ovn-acl-logging/0.log" May 29 14:57:14.896114 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:57:14.896054 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qs9mm"] May 29 14:58:13.686565 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:58:13.686482 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qs9mm"] May 29 14:58:19.516301 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:58:19.516264 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qs9mm"] May 29 14:58:24.302035 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:58:24.302001 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qs9mm"] May 29 14:58:40.107698 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:58:40.107657 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qs9mm"] May 29 14:58:47.836472 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:58:47.836389 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b"] May 29 14:58:47.843986 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:58:47.843960 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b" May 29 14:58:47.846501 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:58:47.846474 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 29 14:58:47.847946 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:58:47.847593 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-db75f\"" May 29 14:58:47.847946 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:58:47.847803 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 29 14:58:47.848122 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:58:47.847970 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" May 29 14:58:47.850387 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:58:47.850361 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b"] May 29 14:58:47.980329 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:58:47.980299 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwmjj\" (UniqueName: \"kubernetes.io/projected/b7c361e2-9b75-4fec-ad2d-8371a2a5bb5e-kube-api-access-hwmjj\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b\" (UID: \"b7c361e2-9b75-4fec-ad2d-8371a2a5bb5e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b" May 29 14:58:47.980500 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:58:47.980335 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b7c361e2-9b75-4fec-ad2d-8371a2a5bb5e-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b\" (UID: \"b7c361e2-9b75-4fec-ad2d-8371a2a5bb5e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b" May 29 14:58:47.980500 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:58:47.980368 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b7c361e2-9b75-4fec-ad2d-8371a2a5bb5e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b\" (UID: \"b7c361e2-9b75-4fec-ad2d-8371a2a5bb5e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b" May 29 14:58:47.980500 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:58:47.980418 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7c361e2-9b75-4fec-ad2d-8371a2a5bb5e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b\" (UID: \"b7c361e2-9b75-4fec-ad2d-8371a2a5bb5e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b" May 29 14:58:47.980500 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:58:47.980457 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b7c361e2-9b75-4fec-ad2d-8371a2a5bb5e-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b\" (UID: \"b7c361e2-9b75-4fec-ad2d-8371a2a5bb5e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b" May 29 14:58:47.980500 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:58:47.980499 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b7c361e2-9b75-4fec-ad2d-8371a2a5bb5e-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b\" (UID: \"b7c361e2-9b75-4fec-ad2d-8371a2a5bb5e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b" May 29 14:58:48.081689 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:58:48.081651 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hwmjj\" (UniqueName: \"kubernetes.io/projected/b7c361e2-9b75-4fec-ad2d-8371a2a5bb5e-kube-api-access-hwmjj\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b\" (UID: \"b7c361e2-9b75-4fec-ad2d-8371a2a5bb5e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b" May 29 14:58:48.081689 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:58:48.081693 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b7c361e2-9b75-4fec-ad2d-8371a2a5bb5e-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b\" (UID: \"b7c361e2-9b75-4fec-ad2d-8371a2a5bb5e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b" May 29 14:58:48.081938 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:58:48.081721 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b7c361e2-9b75-4fec-ad2d-8371a2a5bb5e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b\" (UID: \"b7c361e2-9b75-4fec-ad2d-8371a2a5bb5e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b" May 29 14:58:48.081938 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:58:48.081837 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7c361e2-9b75-4fec-ad2d-8371a2a5bb5e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b\" (UID: \"b7c361e2-9b75-4fec-ad2d-8371a2a5bb5e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b" May 29 14:58:48.081938 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:58:48.081888 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b7c361e2-9b75-4fec-ad2d-8371a2a5bb5e-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b\" (UID: \"b7c361e2-9b75-4fec-ad2d-8371a2a5bb5e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b" May 29 14:58:48.081938 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:58:48.081934 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b7c361e2-9b75-4fec-ad2d-8371a2a5bb5e-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b\" (UID: \"b7c361e2-9b75-4fec-ad2d-8371a2a5bb5e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b" May 29 14:58:48.082123 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:58:48.082013 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b7c361e2-9b75-4fec-ad2d-8371a2a5bb5e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b\" (UID: \"b7c361e2-9b75-4fec-ad2d-8371a2a5bb5e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b" May 29 14:58:48.082123 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:58:48.082113 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b7c361e2-9b75-4fec-ad2d-8371a2a5bb5e-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b\" (UID: \"b7c361e2-9b75-4fec-ad2d-8371a2a5bb5e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b" May 29 14:58:48.082315 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:58:48.082287 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b7c361e2-9b75-4fec-ad2d-8371a2a5bb5e-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b\" (UID: \"b7c361e2-9b75-4fec-ad2d-8371a2a5bb5e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b" May 29 14:58:48.084214 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:58:48.084162 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b7c361e2-9b75-4fec-ad2d-8371a2a5bb5e-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b\" (UID: \"b7c361e2-9b75-4fec-ad2d-8371a2a5bb5e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b" May 29 14:58:48.084491 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:58:48.084473 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7c361e2-9b75-4fec-ad2d-8371a2a5bb5e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b\" (UID: \"b7c361e2-9b75-4fec-ad2d-8371a2a5bb5e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b" May 29 14:58:48.090970 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:58:48.090909 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwmjj\" (UniqueName: \"kubernetes.io/projected/b7c361e2-9b75-4fec-ad2d-8371a2a5bb5e-kube-api-access-hwmjj\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b\" (UID: \"b7c361e2-9b75-4fec-ad2d-8371a2a5bb5e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b" May 29 14:58:48.157616 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:58:48.157578 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b" May 29 14:58:48.294003 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:58:48.293975 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b"] May 29 14:58:48.296240 ip-10-0-129-189 kubenswrapper[2564]: W0529 14:58:48.296204 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7c361e2_9b75_4fec_ad2d_8371a2a5bb5e.slice/crio-49d9ad2b9f4d31fe06406fc99bc717b513dc1f7bbe95faa7e5bd6e1fe3071d26 WatchSource:0}: Error finding container 49d9ad2b9f4d31fe06406fc99bc717b513dc1f7bbe95faa7e5bd6e1fe3071d26: Status 404 returned error can't find the container with id 49d9ad2b9f4d31fe06406fc99bc717b513dc1f7bbe95faa7e5bd6e1fe3071d26 May 29 14:58:48.298527 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:58:48.298510 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 29 14:58:48.484709 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:58:48.484626 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b" event={"ID":"b7c361e2-9b75-4fec-ad2d-8371a2a5bb5e","Type":"ContainerStarted","Data":"49d9ad2b9f4d31fe06406fc99bc717b513dc1f7bbe95faa7e5bd6e1fe3071d26"} May 29 14:58:49.614434 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:58:49.614397 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qs9mm"] May 29 14:58:52.501934 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:58:52.501895 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b" event={"ID":"b7c361e2-9b75-4fec-ad2d-8371a2a5bb5e","Type":"ContainerStarted","Data":"aecc3befc45e583e2781ddb4a986583682ee690cc37c424fd1247ffa6807f89a"} May 29 14:59:21.120251 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:59:21.120151 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qs9mm"] May 29 14:59:21.607678 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:59:21.607643 2564 generic.go:358] "Generic (PLEG): container finished" podID="b7c361e2-9b75-4fec-ad2d-8371a2a5bb5e" containerID="aecc3befc45e583e2781ddb4a986583682ee690cc37c424fd1247ffa6807f89a" exitCode=0 May 29 14:59:21.607854 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:59:21.607716 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b" event={"ID":"b7c361e2-9b75-4fec-ad2d-8371a2a5bb5e","Type":"ContainerDied","Data":"aecc3befc45e583e2781ddb4a986583682ee690cc37c424fd1247ffa6807f89a"} May 29 14:59:23.616524 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:59:23.616486 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b" event={"ID":"b7c361e2-9b75-4fec-ad2d-8371a2a5bb5e","Type":"ContainerStarted","Data":"99c26879da4072a9b52c00635173900d210947bb0deb7e6e078f68f4b39a5cce"} May 29 14:59:23.641332 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:59:23.641281 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b" podStartSLOduration=2.170413488 podStartE2EDuration="36.641265454s" podCreationTimestamp="2026-05-29 14:58:47 +0000 UTC" firstStartedPulling="2026-05-29 14:58:48.298636804 +0000 UTC m=+749.155748729" lastFinishedPulling="2026-05-29 14:59:22.769488767 +0000 UTC m=+783.626600695" observedRunningTime="2026-05-29 14:59:23.639160907 +0000 UTC m=+784.496272854" watchObservedRunningTime="2026-05-29 14:59:23.641265454 +0000 UTC m=+784.498377401" May 29 14:59:28.158009 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:59:28.157973 2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b" May 29 14:59:28.158396 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:59:28.158033 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b" May 29 14:59:28.172039 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:59:28.172016 2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b" May 29 14:59:28.647191 ip-10-0-129-189 kubenswrapper[2564]: I0529 14:59:28.647125 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b" May 29 15:00:53.300616 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:00:53.300584 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-58b448cf8f-qkdks_e6cf6ec8-2c82-4983-9502-a7c6ecd897a4/nginx/0.log" May 29 15:00:53.533796 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:00:53.533768 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-72xnl_92f0d89c-a70d-4d35-9299-f054116fefbe/manager/0.log" May 29 15:00:53.658809 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:00:53.658735 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-m475d_21ff85fd-08e4-4b3f-95dd-86aaa4d154b2/manager/0.log" May 29 15:00:54.144147 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:00:54.144122 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-gbxfp_df6e072a-41f6-45b8-babf-eeaff117d399/server/0.log" May 29 15:00:54.268361 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:00:54.268327 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-8wht6_04971611-b99d-4d82-9b9e-20ab77bf27e3/manager/0.log" May 29 15:00:54.665478 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:00:54.665447 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f4694d4cf-ml9zk_63e09d9b-d8a7-4bf2-bf7a-d37f8ddea0ad/copy-manifests/0.log" May 29 15:00:54.675585 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:00:54.675554 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f4694d4cf-ml9zk_63e09d9b-d8a7-4bf2-bf7a-d37f8ddea0ad/manager/0.log" May 29 15:00:56.245041 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:00:56.245013 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-z8kp2_151c2eef-9f71-4eec-adf3-658776d5735d/manager/0.log" May 29 15:00:56.859373 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:00:56.859345 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-qs9mm_4260d493-315a-41d7-8b5c-1fe398a461a8/limitador/0.log" May 29 15:00:56.983245 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:00:56.983213 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-9zmfm_db911420-1a50-4b60-b5a8-c1c690736677/manager/0.log" May 29 15:00:57.480461 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:00:57.480433 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-q5kjt_dc7a5bd7-40c5-4b07-a751-f62a1092f779/discovery/0.log" May 29 15:00:57.726886 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:00:57.726827 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-95796876-dqsfh_64a17acd-8fe0-47cc-93c4-0c79bba4d2b3/kube-auth-proxy/0.log" May 29 15:00:58.955223 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:00:58.955164 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b_b7c361e2-9b75-4fec-ad2d-8371a2a5bb5e/storage-initializer/0.log" May 29 15:00:58.979129 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:00:58.979100 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-lsj6b_b7c361e2-9b75-4fec-ad2d-8371a2a5bb5e/main/0.log" May 29 15:01:06.771645 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:06.771572 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xvmpr_aac4a14b-f4a9-4b27-bd4e-aecd5fdbe765/global-pull-secret-syncer/0.log" May 29 15:01:06.822861 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:06.822823 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-f48d9_7452a23e-4293-4ee4-9c04-5a0ff4fe08b3/konnectivity-agent/0.log" May 29 15:01:06.906728 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:06.906696 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-189.ec2.internal_33dc9f2399849a35b751db08f0aecf8e/haproxy/0.log" May 29 15:01:11.750822 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:11.750790 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-z8kp2_151c2eef-9f71-4eec-adf3-658776d5735d/manager/0.log" May 29 15:01:11.944535 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:11.944454 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-qs9mm_4260d493-315a-41d7-8b5c-1fe398a461a8/limitador/0.log" May 29 15:01:11.980690 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:11.980662 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-9zmfm_db911420-1a50-4b60-b5a8-c1c690736677/manager/0.log" May 29 15:01:13.463987 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:13.463908 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8b1f7e6f-3c99-414e-8267-47f15d2d875d/alertmanager/0.log" May 29 15:01:13.488140 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:13.488112 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8b1f7e6f-3c99-414e-8267-47f15d2d875d/config-reloader/0.log" May 29 15:01:13.515594 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:13.515563 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8b1f7e6f-3c99-414e-8267-47f15d2d875d/kube-rbac-proxy-web/0.log" May 29 15:01:13.548328 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:13.548304 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8b1f7e6f-3c99-414e-8267-47f15d2d875d/kube-rbac-proxy/0.log" May 29 15:01:13.587121 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:13.587100 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8b1f7e6f-3c99-414e-8267-47f15d2d875d/kube-rbac-proxy-metric/0.log" May 29 15:01:13.639483 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:13.639458 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8b1f7e6f-3c99-414e-8267-47f15d2d875d/prom-label-proxy/0.log" May 29 15:01:13.661828 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:13.661806 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8b1f7e6f-3c99-414e-8267-47f15d2d875d/init-config-reloader/0.log" May 29 15:01:13.744308 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:13.744283 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-k2zpv_a1ae5ad4-c16b-4244-b536-9d440a44a785/kube-state-metrics/0.log" May 29 15:01:13.762409 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:13.762383 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-k2zpv_a1ae5ad4-c16b-4244-b536-9d440a44a785/kube-rbac-proxy-main/0.log" May 29 15:01:13.784928 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:13.784891 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-k2zpv_a1ae5ad4-c16b-4244-b536-9d440a44a785/kube-rbac-proxy-self/0.log" May 29 15:01:13.817024 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:13.817004 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-645dc96fd6-dlm2w_88b389ca-5723-41ad-8b55-c74c2d12dcd3/metrics-server/0.log" May 29 15:01:13.847704 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:13.847661 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5768fcc9dd-qmlnt_6d6f8cb0-b33a-4a5b-b425-11e50099726f/monitoring-plugin/0.log" May 29 15:01:13.985950 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:13.985921 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qplxf_b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289/node-exporter/0.log" May 29 15:01:14.007976 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:14.007914 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qplxf_b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289/kube-rbac-proxy/0.log" May 29 15:01:14.038634 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:14.038609 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qplxf_b5ded3ee-cf3c-4b6f-a5d3-5ad77323f289/init-textfile/0.log" May 29 15:01:14.158331 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:14.158285 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-sbgwg_67041926-c320-411c-aaf3-fde0b869f39f/kube-rbac-proxy-main/0.log" May 29 15:01:14.205541 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:14.205509 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-sbgwg_67041926-c320-411c-aaf3-fde0b869f39f/kube-rbac-proxy-self/0.log" May 29 15:01:14.253004 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:14.252979 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-sbgwg_67041926-c320-411c-aaf3-fde0b869f39f/openshift-state-metrics/0.log" May 29 15:01:14.289012 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:14.288948 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d7545f44-c0b4-4740-82d8-e74e15d9acb7/prometheus/0.log" May 29 15:01:14.313052 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:14.313028 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d7545f44-c0b4-4740-82d8-e74e15d9acb7/config-reloader/0.log" May 29 15:01:14.338297 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:14.338274 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d7545f44-c0b4-4740-82d8-e74e15d9acb7/thanos-sidecar/0.log" May 29 15:01:14.362828 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:14.362804 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d7545f44-c0b4-4740-82d8-e74e15d9acb7/kube-rbac-proxy-web/0.log" May 29 15:01:14.388641 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:14.388615 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d7545f44-c0b4-4740-82d8-e74e15d9acb7/kube-rbac-proxy/0.log" May 29 15:01:14.412007 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:14.411985 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d7545f44-c0b4-4740-82d8-e74e15d9acb7/kube-rbac-proxy-thanos/0.log" May 29 15:01:14.435870 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:14.435850 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d7545f44-c0b4-4740-82d8-e74e15d9acb7/init-config-reloader/0.log" May 29 15:01:14.468134 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:14.468098 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-lmrm8_72fb6b8e-c4c4-45c8-b5fb-8b19adcd23c3/prometheus-operator/0.log" May 29 15:01:14.490627 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:14.490604 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-lmrm8_72fb6b8e-c4c4-45c8-b5fb-8b19adcd23c3/kube-rbac-proxy/0.log" May 29 15:01:14.523063 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:14.523037 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-59b7f8756b-smbnc_e0a7364e-0617-4687-86b9-26102df1792a/prometheus-operator-admission-webhook/0.log" May 29 15:01:14.559413 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:14.559338 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6f59967fc9-wz9l2_4226ae0d-1f62-4077-9a05-484dc5e14808/telemeter-client/0.log" May 29 15:01:14.581652 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:14.581616 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6f59967fc9-wz9l2_4226ae0d-1f62-4077-9a05-484dc5e14808/reload/0.log" May 29 15:01:14.603477 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:14.603456 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6f59967fc9-wz9l2_4226ae0d-1f62-4077-9a05-484dc5e14808/kube-rbac-proxy/0.log" May 29 15:01:14.643028 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:14.643003 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-689c79bcff-gmzwt_d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae/thanos-query/0.log" May 29 15:01:14.667616 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:14.667590 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-689c79bcff-gmzwt_d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae/kube-rbac-proxy-web/0.log" May 29 15:01:14.691607 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:14.691582 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-689c79bcff-gmzwt_d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae/kube-rbac-proxy/0.log" May 29 15:01:14.712964 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:14.712938 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-689c79bcff-gmzwt_d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae/prom-label-proxy/0.log" May 29 15:01:14.737713 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:14.737695 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-689c79bcff-gmzwt_d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae/kube-rbac-proxy-rules/0.log" May 29 15:01:14.764512 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:14.764483 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-689c79bcff-gmzwt_d015aaa8-4890-4a2d-ba5c-5cdfb05a26ae/kube-rbac-proxy-metrics/0.log" May 29 15:01:15.348308 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:15.348276 2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wgj8d/perf-node-gather-daemonset-ms7pr"] May 29 15:01:15.352061 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:15.352046 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wgj8d/perf-node-gather-daemonset-ms7pr" May 29 15:01:15.354483 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:15.354457 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wgj8d\"/\"openshift-service-ca.crt\"" May 29 15:01:15.354483 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:15.354479 2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wgj8d\"/\"kube-root-ca.crt\"" May 29 15:01:15.355059 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:15.355040 2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wgj8d\"/\"default-dockercfg-m9n6p\"" May 29 15:01:15.363473 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:15.363451 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wgj8d/perf-node-gather-daemonset-ms7pr"] May 29 15:01:15.398940 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:15.398910 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b01edee2-1f60-4cb2-8c19-19fd750880a5-podres\") pod \"perf-node-gather-daemonset-ms7pr\" (UID: \"b01edee2-1f60-4cb2-8c19-19fd750880a5\") " pod="openshift-must-gather-wgj8d/perf-node-gather-daemonset-ms7pr" May 29 15:01:15.399089 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:15.398949 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b01edee2-1f60-4cb2-8c19-19fd750880a5-lib-modules\") pod \"perf-node-gather-daemonset-ms7pr\" (UID: \"b01edee2-1f60-4cb2-8c19-19fd750880a5\") " pod="openshift-must-gather-wgj8d/perf-node-gather-daemonset-ms7pr" May 29 15:01:15.399089 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:15.398968 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ts9b\" (UniqueName: \"kubernetes.io/projected/b01edee2-1f60-4cb2-8c19-19fd750880a5-kube-api-access-4ts9b\") pod \"perf-node-gather-daemonset-ms7pr\" (UID: \"b01edee2-1f60-4cb2-8c19-19fd750880a5\") " pod="openshift-must-gather-wgj8d/perf-node-gather-daemonset-ms7pr" May 29 15:01:15.399208 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:15.399096 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b01edee2-1f60-4cb2-8c19-19fd750880a5-proc\") pod \"perf-node-gather-daemonset-ms7pr\" (UID: \"b01edee2-1f60-4cb2-8c19-19fd750880a5\") " pod="openshift-must-gather-wgj8d/perf-node-gather-daemonset-ms7pr" May 29 15:01:15.399208 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:15.399123 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b01edee2-1f60-4cb2-8c19-19fd750880a5-sys\") pod \"perf-node-gather-daemonset-ms7pr\" (UID: \"b01edee2-1f60-4cb2-8c19-19fd750880a5\") " pod="openshift-must-gather-wgj8d/perf-node-gather-daemonset-ms7pr" May 29 15:01:15.500243 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:15.500204 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b01edee2-1f60-4cb2-8c19-19fd750880a5-proc\") pod \"perf-node-gather-daemonset-ms7pr\" (UID: \"b01edee2-1f60-4cb2-8c19-19fd750880a5\") " pod="openshift-must-gather-wgj8d/perf-node-gather-daemonset-ms7pr" May 29 15:01:15.500243 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:15.500249 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b01edee2-1f60-4cb2-8c19-19fd750880a5-sys\") pod \"perf-node-gather-daemonset-ms7pr\" (UID: \"b01edee2-1f60-4cb2-8c19-19fd750880a5\") " pod="openshift-must-gather-wgj8d/perf-node-gather-daemonset-ms7pr" May 29 15:01:15.500631 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:15.500316 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b01edee2-1f60-4cb2-8c19-19fd750880a5-podres\") pod \"perf-node-gather-daemonset-ms7pr\" (UID: \"b01edee2-1f60-4cb2-8c19-19fd750880a5\") " pod="openshift-must-gather-wgj8d/perf-node-gather-daemonset-ms7pr" May 29 15:01:15.500631 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:15.500326 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b01edee2-1f60-4cb2-8c19-19fd750880a5-proc\") pod \"perf-node-gather-daemonset-ms7pr\" (UID: \"b01edee2-1f60-4cb2-8c19-19fd750880a5\") " pod="openshift-must-gather-wgj8d/perf-node-gather-daemonset-ms7pr" May 29 15:01:15.500631 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:15.500351 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b01edee2-1f60-4cb2-8c19-19fd750880a5-lib-modules\") pod \"perf-node-gather-daemonset-ms7pr\" (UID: \"b01edee2-1f60-4cb2-8c19-19fd750880a5\") " pod="openshift-must-gather-wgj8d/perf-node-gather-daemonset-ms7pr" May 29 15:01:15.500631 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:15.500378 2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4ts9b\" (UniqueName: \"kubernetes.io/projected/b01edee2-1f60-4cb2-8c19-19fd750880a5-kube-api-access-4ts9b\") pod \"perf-node-gather-daemonset-ms7pr\" (UID: \"b01edee2-1f60-4cb2-8c19-19fd750880a5\") " pod="openshift-must-gather-wgj8d/perf-node-gather-daemonset-ms7pr" May 29 15:01:15.500631 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:15.500458 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b01edee2-1f60-4cb2-8c19-19fd750880a5-podres\") pod \"perf-node-gather-daemonset-ms7pr\" (UID: \"b01edee2-1f60-4cb2-8c19-19fd750880a5\") " pod="openshift-must-gather-wgj8d/perf-node-gather-daemonset-ms7pr" May 29 15:01:15.500631 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:15.500380 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b01edee2-1f60-4cb2-8c19-19fd750880a5-sys\") pod \"perf-node-gather-daemonset-ms7pr\" (UID: \"b01edee2-1f60-4cb2-8c19-19fd750880a5\") " pod="openshift-must-gather-wgj8d/perf-node-gather-daemonset-ms7pr" May 29 15:01:15.500631 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:15.500459 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b01edee2-1f60-4cb2-8c19-19fd750880a5-lib-modules\") pod \"perf-node-gather-daemonset-ms7pr\" (UID: \"b01edee2-1f60-4cb2-8c19-19fd750880a5\") " pod="openshift-must-gather-wgj8d/perf-node-gather-daemonset-ms7pr" May 29 15:01:15.509577 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:15.509544 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ts9b\" (UniqueName: \"kubernetes.io/projected/b01edee2-1f60-4cb2-8c19-19fd750880a5-kube-api-access-4ts9b\") pod \"perf-node-gather-daemonset-ms7pr\" (UID: \"b01edee2-1f60-4cb2-8c19-19fd750880a5\") " pod="openshift-must-gather-wgj8d/perf-node-gather-daemonset-ms7pr" May 29 15:01:15.662416 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:15.662337 2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wgj8d/perf-node-gather-daemonset-ms7pr" May 29 15:01:15.807154 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:15.807106 2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wgj8d/perf-node-gather-daemonset-ms7pr"] May 29 15:01:15.812152 ip-10-0-129-189 kubenswrapper[2564]: W0529 15:01:15.812125 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb01edee2_1f60_4cb2_8c19_19fd750880a5.slice/crio-a584d3e26fc5f14da61bdac3a6b0544e8f3bfa02be38b2fbe32278b4149782d9 WatchSource:0}: Error finding container a584d3e26fc5f14da61bdac3a6b0544e8f3bfa02be38b2fbe32278b4149782d9: Status 404 returned error can't find the container with id a584d3e26fc5f14da61bdac3a6b0544e8f3bfa02be38b2fbe32278b4149782d9 May 29 15:01:16.040291 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:16.040246 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wgj8d/perf-node-gather-daemonset-ms7pr" event={"ID":"b01edee2-1f60-4cb2-8c19-19fd750880a5","Type":"ContainerStarted","Data":"6b37b7ffd99b25fb626231a3ef250f85ecafde57fd1446a160a4ec4ed57f95b3"} May 29 15:01:16.040291 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:16.040286 2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wgj8d/perf-node-gather-daemonset-ms7pr" event={"ID":"b01edee2-1f60-4cb2-8c19-19fd750880a5","Type":"ContainerStarted","Data":"a584d3e26fc5f14da61bdac3a6b0544e8f3bfa02be38b2fbe32278b4149782d9"} May 29 15:01:16.040546 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:16.040318 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wgj8d/perf-node-gather-daemonset-ms7pr" May 29 15:01:16.058266 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:16.058215 2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-wgj8d/perf-node-gather-daemonset-ms7pr" podStartSLOduration=1.058202064 podStartE2EDuration="1.058202064s" podCreationTimestamp="2026-05-29 15:01:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 15:01:16.057298009 +0000 UTC m=+896.914409981" watchObservedRunningTime="2026-05-29 15:01:16.058202064 +0000 UTC m=+896.915314008" May 29 15:01:17.093790 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:17.093760 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-669fc66b8d-gcgb5_a51f8300-8cc4-4d27-9af9-c868757cc3d1/console/0.log" May 29 15:01:18.541195 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:18.541146 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-m52vf_e3af19b3-9e7c-4ea9-a36f-ac4d8d54a1eb/dns/0.log" May 29 15:01:18.574874 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:18.574842 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-m52vf_e3af19b3-9e7c-4ea9-a36f-ac4d8d54a1eb/kube-rbac-proxy/0.log" May 29 15:01:18.655569 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:18.655541 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-chfzg_65f60412-1c59-4346-bcff-7c9dbf320f2a/dns-node-resolver/0.log" May 29 15:01:19.273874 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:19.273849 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5xdw9_83518164-cbb0-445b-949b-0a9fc521e3e3/node-ca/0.log" May 29 15:01:19.604064 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:19.603992 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gvn49_1300fffd-bfc2-4a5c-95d8-01941a39ca6c/ovn-acl-logging/0.log" May 29 15:01:19.606025 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:19.605991 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gvn49_1300fffd-bfc2-4a5c-95d8-01941a39ca6c/ovn-acl-logging/0.log" May 29 15:01:20.303823 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:20.303786 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-q5kjt_dc7a5bd7-40c5-4b07-a751-f62a1092f779/discovery/0.log" May 29 15:01:20.356104 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:20.356077 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-95796876-dqsfh_64a17acd-8fe0-47cc-93c4-0c79bba4d2b3/kube-auth-proxy/0.log" May 29 15:01:21.058515 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:21.058473 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-l4zs7_2fc9f29c-e5e7-45cd-b787-491b6f5078f0/serve-healthcheck-canary/0.log" May 29 15:01:21.753127 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:21.753085 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kpsnt_59d70ec0-5a9b-4b1e-b369-e1d7633bde79/kube-rbac-proxy/0.log" May 29 15:01:21.773612 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:21.773586 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kpsnt_59d70ec0-5a9b-4b1e-b369-e1d7633bde79/exporter/0.log" May 29 15:01:21.794725 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:21.794705 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kpsnt_59d70ec0-5a9b-4b1e-b369-e1d7633bde79/extractor/0.log" May 29 15:01:22.054407 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:22.054335 2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wgj8d/perf-node-gather-daemonset-ms7pr" May 29 15:01:24.037586 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:24.037550 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-58b448cf8f-qkdks_e6cf6ec8-2c82-4983-9502-a7c6ecd897a4/nginx/0.log" May 29 15:01:24.094105 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:24.094025 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-72xnl_92f0d89c-a70d-4d35-9299-f054116fefbe/manager/0.log" May 29 15:01:24.129069 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:24.129019 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-m475d_21ff85fd-08e4-4b3f-95dd-86aaa4d154b2/manager/0.log" May 29 15:01:24.240281 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:24.240254 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-gbxfp_df6e072a-41f6-45b8-babf-eeaff117d399/server/0.log" May 29 15:01:24.287489 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:24.287459 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-8wht6_04971611-b99d-4d82-9b9e-20ab77bf27e3/manager/0.log" May 29 15:01:24.467655 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:24.467630 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f4694d4cf-ml9zk_63e09d9b-d8a7-4bf2-bf7a-d37f8ddea0ad/manager/0.log" May 29 15:01:24.495042 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:24.495021 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f4694d4cf-ml9zk_63e09d9b-d8a7-4bf2-bf7a-d37f8ddea0ad/copy-manifests/0.log" May 29 15:01:32.768048 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:32.768017 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-skjzp_b3f8a5d9-4cf1-4106-acb5-7191a54c7a16/kube-multus-additional-cni-plugins/0.log" May 29 15:01:32.793052 ip-10-0-129-189 kubenswrapper[2564]: I0529 15:01:32.793019 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-skjzp_b3f8a5d9-4cf1-4106-acb5-7191a54c7a16/egress-router-binary-copy/0.log"