Jun 02 14:36:22.366430 ip-10-0-141-41 systemd[1]: Starting Kubernetes Kubelet... Jun 02 14:36:22.856639 ip-10-0-141-41 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 14:36:22.856639 ip-10-0-141-41 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 02 14:36:22.857244 ip-10-0-141-41 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 14:36:22.857244 ip-10-0-141-41 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 02 14:36:22.857244 ip-10-0-141-41 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 14:36:22.859237 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.859141 2566 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 02 14:36:22.862188 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862174 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 14:36:22.862188 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862188 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 14:36:22.862253 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862191 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 14:36:22.862253 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862194 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 14:36:22.862253 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862198 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 14:36:22.862253 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862202 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 14:36:22.862253 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862204 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 14:36:22.862253 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862207 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 14:36:22.862253 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862210 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 14:36:22.862253 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862212 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 14:36:22.862253 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862215 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 14:36:22.862253 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862218 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 14:36:22.862253 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862220 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 14:36:22.862253 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862223 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 14:36:22.862253 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862225 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 14:36:22.862253 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862228 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 14:36:22.862253 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862231 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 14:36:22.862253 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862233 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 14:36:22.862253 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862236 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 14:36:22.862253 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862238 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 14:36:22.862253 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862240 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 14:36:22.862253 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862243 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 14:36:22.862725 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862245 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 14:36:22.862725 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862248 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 14:36:22.862725 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862257 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 14:36:22.862725 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862260 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 14:36:22.862725 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862263 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 14:36:22.862725 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862266 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 14:36:22.862725 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862269 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 14:36:22.862725 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862271 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 14:36:22.862725 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862274 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 14:36:22.862725 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862276 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 14:36:22.862725 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862279 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 14:36:22.862725 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862281 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 14:36:22.862725 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862284 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 14:36:22.862725 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862286 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 14:36:22.862725 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862289 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 14:36:22.862725 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862292 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 14:36:22.862725 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862294 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 14:36:22.862725 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862297 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 14:36:22.862725 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862299 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 14:36:22.863183 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862302 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 14:36:22.863183 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862304 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 14:36:22.863183 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862307 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 14:36:22.863183 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862309 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 14:36:22.863183 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862311 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 02 14:36:22.863183 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862314 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 14:36:22.863183 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862317 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 14:36:22.863183 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862320 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 14:36:22.863183 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862323 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 14:36:22.863183 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862327 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 14:36:22.863183 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862331 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 14:36:22.863183 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862335 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 14:36:22.863183 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862338 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 14:36:22.863183 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862341 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 14:36:22.863183 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862345 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 14:36:22.863183 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862348 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 14:36:22.863183 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862351 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 14:36:22.863183 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862354 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 14:36:22.863183 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862356 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 14:36:22.863626 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862359 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 14:36:22.863626 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862362 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 14:36:22.863626 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862365 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 14:36:22.863626 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862367 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 14:36:22.863626 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862369 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 14:36:22.863626 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862372 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 14:36:22.863626 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862375 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 14:36:22.863626 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862377 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 14:36:22.863626 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862380 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 14:36:22.863626 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862382 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 14:36:22.863626 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862384 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 14:36:22.863626 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862387 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 14:36:22.863626 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862389 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 14:36:22.863626 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862392 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 14:36:22.863626 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862394 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 14:36:22.863626 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862397 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 14:36:22.863626 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862400 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 14:36:22.863626 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862402 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 14:36:22.863626 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862405 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 14:36:22.863626 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862407 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 14:36:22.864081 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862410 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 14:36:22.864081 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862413 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 14:36:22.864081 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862416 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 14:36:22.864081 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862418 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 14:36:22.864081 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862420 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 14:36:22.864081 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862423 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 14:36:22.864081 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862794 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 14:36:22.864081 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862799 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 14:36:22.864081 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862802 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 14:36:22.864081 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862804 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 14:36:22.864081 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862807 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 14:36:22.864081 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862809 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 14:36:22.864081 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862812 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 14:36:22.864081 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862814 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 14:36:22.864081 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862817 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 14:36:22.864081 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862821 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 14:36:22.864081 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862824 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 14:36:22.864081 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862827 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 14:36:22.864081 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862830 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 14:36:22.864536 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862832 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 14:36:22.864536 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862835 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 14:36:22.864536 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862837 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 14:36:22.864536 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862839 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 14:36:22.864536 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862842 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 14:36:22.864536 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862844 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 14:36:22.864536 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862846 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 14:36:22.864536 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862848 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 14:36:22.864536 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862852 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 14:36:22.864536 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862855 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 14:36:22.864536 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862858 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 14:36:22.864536 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862860 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 14:36:22.864536 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862863 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 14:36:22.864536 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862865 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 14:36:22.864536 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862867 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 14:36:22.864536 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862870 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 14:36:22.864536 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862872 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 14:36:22.864536 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862874 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 14:36:22.864536 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862877 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 14:36:22.864984 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862879 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 14:36:22.864984 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862883 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 14:36:22.864984 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862885 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 14:36:22.864984 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862888 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 14:36:22.864984 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862891 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 14:36:22.864984 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862893 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 14:36:22.864984 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862896 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 14:36:22.864984 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862898 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 14:36:22.864984 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862901 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 14:36:22.864984 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862903 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 14:36:22.864984 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862906 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 14:36:22.864984 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862908 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 14:36:22.864984 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862910 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 14:36:22.864984 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862913 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 14:36:22.864984 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862916 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 14:36:22.864984 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862918 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 14:36:22.864984 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862921 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 14:36:22.864984 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862923 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 14:36:22.864984 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862925 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 14:36:22.864984 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862928 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 14:36:22.865502 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862930 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 14:36:22.865502 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862932 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 14:36:22.865502 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862935 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 14:36:22.865502 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862938 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 14:36:22.865502 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862941 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 14:36:22.865502 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862943 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 02 14:36:22.865502 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862945 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 14:36:22.865502 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862947 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 14:36:22.865502 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862950 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 14:36:22.865502 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862953 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 14:36:22.865502 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862955 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 14:36:22.865502 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862957 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 14:36:22.865502 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862960 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 14:36:22.865502 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862963 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 14:36:22.865502 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862965 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 14:36:22.865502 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862968 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 14:36:22.865502 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862970 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 14:36:22.865502 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862972 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 14:36:22.865502 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862975 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 14:36:22.865502 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862977 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 14:36:22.865987 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862980 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 14:36:22.865987 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862983 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 14:36:22.865987 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862985 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 14:36:22.865987 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862987 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 14:36:22.865987 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862990 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 14:36:22.865987 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862993 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 14:36:22.865987 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862995 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 14:36:22.865987 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862997 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 14:36:22.865987 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.862999 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 14:36:22.865987 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863002 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 14:36:22.865987 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863004 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 14:36:22.865987 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863006 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 14:36:22.865987 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863009 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 14:36:22.865987 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863011 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 14:36:22.865987 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863080 2566 flags.go:64] FLAG: --address="0.0.0.0" Jun 02 14:36:22.865987 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863088 2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 02 14:36:22.865987 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863097 2566 flags.go:64] FLAG: --anonymous-auth="true" Jun 02 14:36:22.865987 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863103 2566 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 02 14:36:22.865987 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863110 2566 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 02 14:36:22.865987 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863115 2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 02 14:36:22.865987 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863121 2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 02 14:36:22.866535 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863139 2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 02 14:36:22.866535 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863143 2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 02 14:36:22.866535 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863146 2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 02 14:36:22.866535 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863149 2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 02 14:36:22.866535 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863152 2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 02 14:36:22.866535 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863155 2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 02 14:36:22.866535 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863158 2566 flags.go:64] FLAG: --cgroup-root="" Jun 02 14:36:22.866535 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863161 2566 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 02 14:36:22.866535 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863164 2566 flags.go:64] FLAG: --client-ca-file="" Jun 02 14:36:22.866535 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863167 2566 flags.go:64] FLAG: --cloud-config="" Jun 02 14:36:22.866535 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863169 2566 flags.go:64] FLAG: --cloud-provider="external" Jun 02 14:36:22.866535 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863172 2566 flags.go:64] FLAG: --cluster-dns="[]" Jun 02 14:36:22.866535 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863175 2566 flags.go:64] FLAG: --cluster-domain="" Jun 02 14:36:22.866535 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863178 2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 02 14:36:22.866535 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863181 2566 flags.go:64] FLAG: --config-dir="" Jun 02 14:36:22.866535 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863184 2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 02 14:36:22.866535 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863187 2566 flags.go:64] FLAG: --container-log-max-files="5" Jun 02 14:36:22.866535 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863191 2566 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 02 14:36:22.866535 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863194 2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 02 14:36:22.866535 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863197 2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 02 14:36:22.866535 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863200 2566 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 02 14:36:22.866535 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863203 2566 flags.go:64] FLAG: --contention-profiling="false" Jun 02 14:36:22.866535 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863206 2566 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 02 14:36:22.866535 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863209 2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 02 14:36:22.867113 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863212 2566 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 02 14:36:22.867113 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863214 2566 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 02 14:36:22.867113 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863218 2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 02 14:36:22.867113 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863222 2566 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 02 14:36:22.867113 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863226 2566 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 02 14:36:22.867113 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863229 2566 flags.go:64] FLAG: --enable-load-reader="false" Jun 02 14:36:22.867113 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863232 2566 flags.go:64] FLAG: --enable-server="true" Jun 02 14:36:22.867113 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863235 2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 02 14:36:22.867113 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863240 2566 flags.go:64] FLAG: --event-burst="100" Jun 02 14:36:22.867113 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863243 2566 flags.go:64] FLAG: --event-qps="50" Jun 02 14:36:22.867113 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863246 2566 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 02 14:36:22.867113 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863249 2566 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 02 14:36:22.867113 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863252 2566 flags.go:64] FLAG: --eviction-hard="" Jun 02 14:36:22.867113 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863256 2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 02 14:36:22.867113 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863258 2566 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 02 14:36:22.867113 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863261 2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 02 14:36:22.867113 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863264 2566 flags.go:64] FLAG: --eviction-soft="" Jun 02 14:36:22.867113 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863267 2566 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 02 14:36:22.867113 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863269 2566 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 02 14:36:22.867113 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863272 2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 02 14:36:22.867113 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863275 2566 flags.go:64] FLAG: --experimental-mounter-path="" Jun 02 14:36:22.867113 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863278 2566 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 02 14:36:22.867113 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863280 2566 flags.go:64] FLAG: --fail-swap-on="true" Jun 02 14:36:22.867113 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863283 2566 flags.go:64] FLAG: --feature-gates="" Jun 02 14:36:22.867113 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863287 2566 flags.go:64] FLAG: --file-check-frequency="20s" Jun 02 14:36:22.867700 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863289 2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 02 14:36:22.867700 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863292 2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 02 14:36:22.867700 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863295 2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 02 14:36:22.867700 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863298 2566 flags.go:64] FLAG: --healthz-port="10248" Jun 02 14:36:22.867700 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863301 2566 flags.go:64] FLAG: --help="false" Jun 02 14:36:22.867700 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863304 2566 flags.go:64] FLAG: --hostname-override="ip-10-0-141-41.ec2.internal" Jun 02 14:36:22.867700 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863306 2566 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 02 14:36:22.867700 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863309 2566 flags.go:64] FLAG: --http-check-frequency="20s" Jun 02 14:36:22.867700 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863312 2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 02 14:36:22.867700 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863315 2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 02 14:36:22.867700 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863319 2566 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 02 14:36:22.867700 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863322 2566 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 02 14:36:22.867700 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863324 2566 flags.go:64] FLAG: --image-service-endpoint="" Jun 02 14:36:22.867700 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863327 2566 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 02 14:36:22.867700 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863330 2566 flags.go:64] FLAG: --kube-api-burst="100" Jun 02 14:36:22.867700 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863333 2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 02 14:36:22.867700 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863336 2566 flags.go:64] FLAG: --kube-api-qps="50" Jun 02 14:36:22.867700 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863339 2566 flags.go:64] FLAG: --kube-reserved="" Jun 02 14:36:22.867700 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863341 2566 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 02 14:36:22.867700 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863344 2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 02 14:36:22.867700 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863347 2566 flags.go:64] FLAG: --kubelet-cgroups="" Jun 02 14:36:22.867700 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863349 2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 02 14:36:22.867700 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863352 2566 flags.go:64] FLAG: --lock-file="" Jun 02 14:36:22.867700 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863355 2566 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 02 14:36:22.868301 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863357 2566 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 02 14:36:22.868301 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863360 2566 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 02 14:36:22.868301 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863365 2566 flags.go:64] FLAG: --log-json-split-stream="false" Jun 02 14:36:22.868301 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863368 2566 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 02 14:36:22.868301 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863370 2566 flags.go:64] FLAG: --log-text-split-stream="false" Jun 02 14:36:22.868301 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863373 2566 flags.go:64] FLAG: --logging-format="text" Jun 02 14:36:22.868301 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863375 2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 02 14:36:22.868301 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863378 2566 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 02 14:36:22.868301 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863381 2566 flags.go:64] FLAG: --manifest-url="" Jun 02 14:36:22.868301 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863384 2566 flags.go:64] FLAG: --manifest-url-header="" Jun 02 14:36:22.868301 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863388 2566 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 02 14:36:22.868301 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863390 2566 flags.go:64] FLAG: --max-open-files="1000000" Jun 02 14:36:22.868301 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863394 2566 flags.go:64] FLAG: --max-pods="110" Jun 02 14:36:22.868301 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863397 2566 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 02 14:36:22.868301 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863400 2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 02 14:36:22.868301 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863402 2566 flags.go:64] FLAG: --memory-manager-policy="None" Jun 02 14:36:22.868301 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863405 2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 02 14:36:22.868301 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863407 2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 02 14:36:22.868301 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863410 2566 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 02 14:36:22.868301 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863413 2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 02 14:36:22.868301 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863420 2566 flags.go:64] FLAG: --node-status-max-images="50" Jun 02 14:36:22.868301 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863423 2566 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 02 14:36:22.868301 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863426 2566 flags.go:64] FLAG: --oom-score-adj="-999" Jun 02 14:36:22.868301 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863430 2566 flags.go:64] FLAG: --pod-cidr="" Jun 02 14:36:22.868849 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863433 2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 02 14:36:22.868849 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863438 2566 flags.go:64] FLAG: --pod-manifest-path="" Jun 02 14:36:22.868849 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863441 2566 flags.go:64] FLAG: --pod-max-pids="-1" Jun 02 14:36:22.868849 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863444 2566 flags.go:64] FLAG: --pods-per-core="0" Jun 02 14:36:22.868849 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863447 2566 flags.go:64] FLAG: --port="10250" Jun 02 14:36:22.868849 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863450 2566 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 02 14:36:22.868849 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863453 2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0926adc22fc60b205" Jun 02 14:36:22.868849 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863456 2566 flags.go:64] FLAG: --qos-reserved="" Jun 02 14:36:22.868849 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863458 2566 flags.go:64] FLAG: --read-only-port="10255" Jun 02 14:36:22.868849 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863461 2566 flags.go:64] FLAG: --register-node="true" Jun 02 14:36:22.868849 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863464 2566 flags.go:64] FLAG: --register-schedulable="true" Jun 02 14:36:22.868849 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863467 2566 flags.go:64] FLAG: --register-with-taints="" Jun 02 14:36:22.868849 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863470 2566 flags.go:64] FLAG: --registry-burst="10" Jun 02 14:36:22.868849 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863473 2566 flags.go:64] FLAG: --registry-qps="5" Jun 02 14:36:22.868849 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863475 2566 flags.go:64] FLAG: --reserved-cpus="" Jun 02 14:36:22.868849 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863478 2566 flags.go:64] FLAG: --reserved-memory="" Jun 02 14:36:22.868849 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863482 2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 02 14:36:22.868849 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863485 2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 02 14:36:22.868849 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863487 2566 flags.go:64] FLAG: --rotate-certificates="false" Jun 02 14:36:22.868849 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863490 2566 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 02 14:36:22.868849 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863492 2566 flags.go:64] FLAG: --runonce="false" Jun 02 14:36:22.868849 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863495 2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 02 14:36:22.868849 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863498 2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 02 14:36:22.868849 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863501 2566 flags.go:64] FLAG: --seccomp-default="false" Jun 02 14:36:22.868849 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863503 2566 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 02 14:36:22.869462 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863506 2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 02 14:36:22.869462 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863509 2566 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 02 14:36:22.869462 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863512 2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 02 14:36:22.869462 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863515 2566 flags.go:64] FLAG: --storage-driver-password="root" Jun 02 14:36:22.869462 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863518 2566 flags.go:64] FLAG: --storage-driver-secure="false" Jun 02 14:36:22.869462 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863521 2566 flags.go:64] FLAG: --storage-driver-table="stats" Jun 02 14:36:22.869462 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863524 2566 flags.go:64] FLAG: --storage-driver-user="root" Jun 02 14:36:22.869462 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863527 2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 02 14:36:22.869462 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863530 2566 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 02 14:36:22.869462 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863533 2566 flags.go:64] FLAG: --system-cgroups="" Jun 02 14:36:22.869462 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863535 2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 02 14:36:22.869462 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863540 2566 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 02 14:36:22.869462 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863543 2566 flags.go:64] FLAG: --tls-cert-file="" Jun 02 14:36:22.869462 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863546 2566 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 02 14:36:22.869462 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863549 2566 flags.go:64] FLAG: --tls-min-version="" Jun 02 14:36:22.869462 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863552 2566 flags.go:64] FLAG: --tls-private-key-file="" Jun 02 14:36:22.869462 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863555 2566 flags.go:64] FLAG: --topology-manager-policy="none" Jun 02 14:36:22.869462 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863557 2566 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 02 14:36:22.869462 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863560 2566 flags.go:64] FLAG: --topology-manager-scope="container" Jun 02 14:36:22.869462 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863562 2566 flags.go:64] FLAG: --v="2" Jun 02 14:36:22.869462 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863566 2566 flags.go:64] FLAG: --version="false" Jun 02 14:36:22.869462 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863571 2566 flags.go:64] FLAG: --vmodule="" Jun 02 14:36:22.869462 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863575 2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 02 14:36:22.869462 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.863578 2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 02 14:36:22.869462 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863667 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 14:36:22.870082 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863670 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 14:36:22.870082 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863672 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 14:36:22.870082 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863675 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 14:36:22.870082 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863678 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 14:36:22.870082 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863680 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 14:36:22.870082 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863682 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 14:36:22.870082 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863685 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 14:36:22.870082 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863687 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 14:36:22.870082 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863691 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 14:36:22.870082 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863694 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 02 14:36:22.870082 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863696 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 14:36:22.870082 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863699 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 14:36:22.870082 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863701 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 14:36:22.870082 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863704 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 14:36:22.870082 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863706 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 14:36:22.870082 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863709 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 14:36:22.870082 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863711 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 14:36:22.870082 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863714 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 14:36:22.870082 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863716 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 14:36:22.870082 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863719 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 14:36:22.870654 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863721 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 14:36:22.870654 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863723 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 14:36:22.870654 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863727 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 14:36:22.870654 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863731 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 14:36:22.870654 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863734 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 14:36:22.870654 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863737 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 14:36:22.870654 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863739 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 14:36:22.870654 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863742 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 14:36:22.870654 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863744 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 14:36:22.870654 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863748 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 14:36:22.870654 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863751 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 14:36:22.870654 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863754 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 14:36:22.870654 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863757 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 14:36:22.870654 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863760 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 14:36:22.870654 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863762 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 14:36:22.870654 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863765 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 14:36:22.870654 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863768 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 14:36:22.870654 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863771 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 14:36:22.870654 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863773 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 14:36:22.870654 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863776 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 14:36:22.871159 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863780 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 14:36:22.871159 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863782 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 14:36:22.871159 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863785 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 14:36:22.871159 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863788 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 14:36:22.871159 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863791 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 14:36:22.871159 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863796 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 14:36:22.871159 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863799 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 14:36:22.871159 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863801 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 14:36:22.871159 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863804 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 14:36:22.871159 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863806 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 14:36:22.871159 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863808 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 14:36:22.871159 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863811 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 14:36:22.871159 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863814 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 14:36:22.871159 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863816 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 14:36:22.871159 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863819 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 14:36:22.871159 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863822 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 14:36:22.871159 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863824 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 14:36:22.871159 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863826 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 14:36:22.871159 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863829 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 14:36:22.871624 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863831 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 14:36:22.871624 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863833 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 14:36:22.871624 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863836 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 14:36:22.871624 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863838 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 14:36:22.871624 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863841 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 14:36:22.871624 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863843 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 14:36:22.871624 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863845 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 14:36:22.871624 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863848 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 14:36:22.871624 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863850 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 14:36:22.871624 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863853 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 14:36:22.871624 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863855 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 14:36:22.871624 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863858 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 14:36:22.871624 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863860 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 14:36:22.871624 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863864 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 14:36:22.871624 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863866 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 14:36:22.871624 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863869 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 14:36:22.871624 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863871 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 14:36:22.871624 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863874 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 14:36:22.871624 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863879 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 14:36:22.871624 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863881 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 14:36:22.872100 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863884 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 14:36:22.872100 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863886 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 14:36:22.872100 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863889 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 14:36:22.872100 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863891 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 14:36:22.872100 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863893 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 14:36:22.872100 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.863896 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 14:36:22.872100 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.864700 2566 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 14:36:22.872100 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.872016 2566 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 02 14:36:22.872100 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.872033 2566 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 02 14:36:22.872100 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872081 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 14:36:22.872100 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872086 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 14:36:22.872100 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872089 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 14:36:22.872100 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872092 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 14:36:22.872100 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872095 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 14:36:22.872100 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872097 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 14:36:22.872100 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872100 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 14:36:22.872500 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872103 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 14:36:22.872500 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872106 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 14:36:22.872500 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872110 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 14:36:22.872500 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872113 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 14:36:22.872500 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872115 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 14:36:22.872500 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872118 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 14:36:22.872500 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872120 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 14:36:22.872500 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872122 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 14:36:22.872500 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872138 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 14:36:22.872500 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872141 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 14:36:22.872500 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872143 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 14:36:22.872500 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872146 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 14:36:22.872500 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872149 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 14:36:22.872500 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872151 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 14:36:22.872500 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872154 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 14:36:22.872500 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872156 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 14:36:22.872500 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872159 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 14:36:22.872500 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872162 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 14:36:22.872500 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872166 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 14:36:22.872946 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872170 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 14:36:22.872946 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872173 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 14:36:22.872946 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872176 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 14:36:22.872946 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872179 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 14:36:22.872946 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872182 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 14:36:22.872946 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872185 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 14:36:22.872946 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872189 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 14:36:22.872946 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872192 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 14:36:22.872946 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872194 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 14:36:22.872946 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872197 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 14:36:22.872946 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872200 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 14:36:22.872946 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872202 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 14:36:22.872946 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872205 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 14:36:22.872946 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872207 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 14:36:22.872946 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872210 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 14:36:22.872946 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872213 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 14:36:22.872946 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872215 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 14:36:22.872946 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872218 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 14:36:22.872946 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872220 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 14:36:22.873435 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872222 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 14:36:22.873435 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872225 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 14:36:22.873435 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872227 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 14:36:22.873435 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872230 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 14:36:22.873435 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872232 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 14:36:22.873435 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872235 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 14:36:22.873435 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872238 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 14:36:22.873435 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872240 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 14:36:22.873435 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872243 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 14:36:22.873435 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872245 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 14:36:22.873435 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872247 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 14:36:22.873435 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872250 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 14:36:22.873435 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872252 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 14:36:22.873435 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872254 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 14:36:22.873435 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872257 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 14:36:22.873435 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872260 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 14:36:22.873435 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872262 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 14:36:22.873435 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872264 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 14:36:22.873435 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872267 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 14:36:22.873435 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872271 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 14:36:22.873917 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872273 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 14:36:22.873917 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872275 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 14:36:22.873917 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872278 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 14:36:22.873917 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872280 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 02 14:36:22.873917 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872283 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 14:36:22.873917 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872285 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 14:36:22.873917 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872287 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 14:36:22.873917 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872290 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 14:36:22.873917 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872292 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 14:36:22.873917 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872295 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 14:36:22.873917 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872297 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 14:36:22.873917 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872300 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 14:36:22.873917 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872302 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 14:36:22.873917 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872305 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 14:36:22.873917 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872307 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 14:36:22.873917 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872310 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 14:36:22.873917 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872312 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 14:36:22.873917 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872314 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 14:36:22.873917 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872317 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 14:36:22.873917 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872319 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 14:36:22.874510 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872321 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 14:36:22.874510 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.872326 2566 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 14:36:22.874510 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872422 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 14:36:22.874510 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872427 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 14:36:22.874510 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872430 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 14:36:22.874510 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872433 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 14:36:22.874510 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872435 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 14:36:22.874510 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872438 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 14:36:22.874510 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872440 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 14:36:22.874510 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872443 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 14:36:22.874510 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872445 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 14:36:22.874510 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872448 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 14:36:22.874510 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872451 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 14:36:22.874510 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872454 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 14:36:22.874510 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872456 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 14:36:22.874510 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872459 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 14:36:22.874886 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872461 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 14:36:22.874886 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872464 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 14:36:22.874886 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872466 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 14:36:22.874886 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872469 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 14:36:22.874886 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872471 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 14:36:22.874886 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872474 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 14:36:22.874886 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872476 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 14:36:22.874886 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872479 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 14:36:22.874886 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872481 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 14:36:22.874886 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872484 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 14:36:22.874886 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872486 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 14:36:22.874886 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872489 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 14:36:22.874886 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872491 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 14:36:22.874886 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872494 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 14:36:22.874886 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872497 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 14:36:22.874886 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872499 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 14:36:22.874886 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872502 2566 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 14:36:22.874886 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872504 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 14:36:22.874886 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872507 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 02 14:36:22.874886 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872510 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 14:36:22.875367 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872512 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 14:36:22.875367 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872515 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 14:36:22.875367 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872517 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 14:36:22.875367 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872519 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 14:36:22.875367 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872522 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 14:36:22.875367 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872524 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 14:36:22.875367 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872527 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 14:36:22.875367 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872530 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 14:36:22.875367 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872532 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 14:36:22.875367 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872535 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 14:36:22.875367 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872538 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 14:36:22.875367 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872541 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 14:36:22.875367 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872543 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 14:36:22.875367 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872546 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 14:36:22.875367 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872548 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 14:36:22.875367 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872550 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 14:36:22.875367 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872553 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 14:36:22.875367 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872556 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 14:36:22.875367 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872558 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 14:36:22.875367 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872561 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 14:36:22.875822 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872563 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 14:36:22.875822 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872566 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 14:36:22.875822 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872568 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 14:36:22.875822 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872570 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 14:36:22.875822 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872573 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 14:36:22.875822 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872575 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 14:36:22.875822 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872577 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 14:36:22.875822 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872580 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 14:36:22.875822 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872582 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 14:36:22.875822 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872585 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 14:36:22.875822 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872587 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 14:36:22.875822 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872589 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 14:36:22.875822 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872592 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 14:36:22.875822 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872594 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 14:36:22.875822 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872597 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 14:36:22.875822 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872599 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 14:36:22.875822 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872602 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 14:36:22.875822 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872604 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 14:36:22.875822 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872607 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 14:36:22.875822 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872609 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 14:36:22.876306 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872611 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 14:36:22.876306 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872614 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 14:36:22.876306 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872617 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 14:36:22.876306 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872620 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 14:36:22.876306 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872623 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 14:36:22.876306 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872627 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 14:36:22.876306 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872630 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 14:36:22.876306 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872632 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 14:36:22.876306 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872636 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 14:36:22.876306 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872638 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 14:36:22.876306 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872641 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 14:36:22.876306 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:22.872643 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 14:36:22.876306 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.872648 2566 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 14:36:22.876306 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.873693 2566 server.go:962] "Client rotation is on, will bootstrap in background" Jun 02 14:36:22.878372 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.878357 2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 02 14:36:22.879459 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.879448 2566 server.go:1019] "Starting client certificate rotation" Jun 02 14:36:22.879568 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.879551 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 14:36:22.879599 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.879594 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 14:36:22.910075 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.910051 2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 14:36:22.913752 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.913726 2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 14:36:22.926763 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.926744 2566 log.go:25] "Validated CRI v1 runtime API" Jun 02 14:36:22.932914 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.932900 2566 log.go:25] "Validated CRI v1 image API" Jun 02 14:36:22.934834 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.934818 2566 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 02 14:36:22.937342 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.937314 2566 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 db6b90e5-7e84-4d0d-ae18-d863572db54e:/dev/nvme0n1p3 f7bad3e9-7e4b-4732-ab49-f4fd29adb03f:/dev/nvme0n1p4] Jun 02 14:36:22.937437 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.937341 2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 02 14:36:22.942167 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.942025 2566 manager.go:217] Machine: {Timestamp:2026-06-02 14:36:22.94152118 +0000 UTC m=+0.445857622 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3199213 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2dff00c7da332948396788093076c5 SystemUUID:ec2dff00-c7da-3329-4839-6788093076c5 BootID:44589479-03de-46a8-b391-b3ca12ce7b17 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:75:1e:e0:39:a9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:75:1e:e0:39:a9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:06:0b:fe:dd:da:de Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 02 14:36:22.942273 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.942221 2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 02 14:36:22.942334 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.942320 2566 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 02 14:36:22.942449 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.942434 2566 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 14:36:22.943425 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.943402 2566 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 02 14:36:22.943566 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.943426 2566 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-41.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 02 14:36:22.943616 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.943576 2566 topology_manager.go:138] "Creating topology manager with none policy" Jun 02 14:36:22.943616 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.943584 2566 container_manager_linux.go:306] "Creating device plugin manager" Jun 02 14:36:22.943616 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.943590 2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 14:36:22.943616 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.943606 2566 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 14:36:22.945094 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.945083 2566 state_mem.go:36] "Initialized new in-memory state store" Jun 02 14:36:22.945224 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.945215 2566 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 02 14:36:22.948218 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.948208 2566 kubelet.go:491] "Attempting to sync node with API server" Jun 02 14:36:22.948258 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.948228 2566 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 02 14:36:22.948258 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.948245 2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 02 14:36:22.948258 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.948256 2566 kubelet.go:397] "Adding apiserver pod source" Jun 02 14:36:22.948335 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.948265 2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 02 14:36:22.949428 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.949413 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 14:36:22.949503 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.949444 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 14:36:22.958630 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.958611 2566 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 02 14:36:22.960929 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.960911 2566 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 02 14:36:22.963040 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.963025 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 02 14:36:22.963040 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.963042 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 02 14:36:22.963173 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.963048 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 02 14:36:22.963173 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.963054 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 02 14:36:22.963173 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.963063 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 02 14:36:22.963173 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.963069 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 02 14:36:22.963173 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.963077 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 02 14:36:22.963173 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.963084 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 02 14:36:22.963173 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.963092 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 02 14:36:22.963173 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.963098 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 02 14:36:22.963173 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.963106 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 02 14:36:22.963173 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.963112 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 02 14:36:22.963173 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.963161 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 02 14:36:22.963173 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.963169 2566 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 02 14:36:22.964012 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.963996 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-487h5" Jun 02 14:36:22.964607 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:22.964582 2566 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-41.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 02 14:36:22.964678 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:22.964588 2566 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 02 14:36:22.966670 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.966657 2566 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 02 14:36:22.966710 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.966697 2566 server.go:1295] "Started kubelet" Jun 02 14:36:22.966830 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.966799 2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 02 14:36:22.966884 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.966798 2566 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 02 14:36:22.966884 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.966859 2566 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 02 14:36:22.967509 ip-10-0-141-41 systemd[1]: Started Kubernetes Kubelet. Jun 02 14:36:22.968033 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.967920 2566 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 02 14:36:22.969297 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.969283 2566 server.go:317] "Adding debug handlers to kubelet server" Jun 02 14:36:22.972501 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.972485 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-487h5" Jun 02 14:36:22.972648 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.972631 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 02 14:36:22.973155 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.973116 2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 02 14:36:22.973608 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.973564 2566 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-41.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 02 14:36:22.973690 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.973616 2566 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 02 14:36:22.973690 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.973639 2566 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 02 14:36:22.973813 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.973786 2566 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 02 14:36:22.973923 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.973910 2566 reconstruct.go:97] "Volume reconstruction finished" Jun 02 14:36:22.973923 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.973922 2566 reconciler.go:26] "Reconciler: start to sync state" Jun 02 14:36:22.974325 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:22.974309 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-41.ec2.internal\" not found" Jun 02 14:36:22.974625 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.974598 2566 factory.go:55] Registering systemd factory Jun 02 14:36:22.974711 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.974669 2566 factory.go:223] Registration of the systemd container factory successfully Jun 02 14:36:22.974916 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.974896 2566 factory.go:153] Registering CRI-O factory Jun 02 14:36:22.974916 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.974918 2566 factory.go:223] Registration of the crio container factory successfully Jun 02 14:36:22.975062 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:22.973695 2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-41.ec2.internal.18b54a5b21eeb45b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-41.ec2.internal,UID:ip-10-0-141-41.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-41.ec2.internal,},FirstTimestamp:2026-06-02 14:36:22.966670427 +0000 UTC m=+0.471006869,LastTimestamp:2026-06-02 14:36:22.966670427 +0000 UTC m=+0.471006869,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-41.ec2.internal,}" Jun 02 14:36:22.975062 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.974974 2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 02 14:36:22.975062 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.974996 2566 factory.go:103] Registering Raw factory Jun 02 14:36:22.975062 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.975025 2566 manager.go:1196] Started watching for new ooms in manager Jun 02 14:36:22.978232 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.978207 2566 manager.go:319] Starting recovery of all containers Jun 02 14:36:22.980281 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:22.980259 2566 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 02 14:36:22.983187 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.983120 2566 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 14:36:22.986455 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:22.986413 2566 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-141-41.ec2.internal\" not found" node="ip-10-0-141-41.ec2.internal" Jun 02 14:36:22.992406 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.992387 2566 manager.go:324] Recovery completed Jun 02 14:36:22.993874 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:22.993854 2566 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 02 14:36:22.997013 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:22.996907 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 14:36:23.001275 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.001258 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-41.ec2.internal" event="NodeHasSufficientMemory" Jun 02 14:36:23.001355 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.001287 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-41.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 14:36:23.001355 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.001297 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-41.ec2.internal" event="NodeHasSufficientPID" Jun 02 14:36:23.001802 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.001788 2566 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 02 14:36:23.001802 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.001802 2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 02 14:36:23.001886 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.001817 2566 state_mem.go:36] "Initialized new in-memory state store" Jun 02 14:36:23.004238 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.004226 2566 policy_none.go:49] "None policy: Start" Jun 02 14:36:23.004273 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.004242 2566 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 02 14:36:23.004273 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.004251 2566 state_mem.go:35] "Initializing new in-memory state store" Jun 02 14:36:23.047830 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.047763 2566 manager.go:341] "Starting Device Plugin manager" Jun 02 14:36:23.047830 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:23.047806 2566 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 02 14:36:23.047995 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.047834 2566 server.go:85] "Starting device plugin registration server" Jun 02 14:36:23.048121 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.048107 2566 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 02 14:36:23.048212 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.048122 2566 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 02 14:36:23.048260 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.048241 2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 02 14:36:23.048339 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.048324 2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 02 14:36:23.048405 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.048341 2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 02 14:36:23.048922 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:23.048900 2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 02 14:36:23.049001 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:23.048948 2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-41.ec2.internal\" not found" Jun 02 14:36:23.104559 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.104515 2566 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 02 14:36:23.105945 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.105921 2566 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 02 14:36:23.105945 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.105947 2566 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 02 14:36:23.106112 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.105975 2566 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 02 14:36:23.106112 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.105983 2566 kubelet.go:2451] "Starting kubelet main sync loop" Jun 02 14:36:23.106112 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:23.106033 2566 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 02 14:36:23.110598 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.110545 2566 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 14:36:23.148624 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.148593 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 14:36:23.149681 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.149648 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-41.ec2.internal" event="NodeHasSufficientMemory" Jun 02 14:36:23.149780 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.149686 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-41.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 14:36:23.149780 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.149701 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-41.ec2.internal" event="NodeHasSufficientPID" Jun 02 14:36:23.149780 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.149730 2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-41.ec2.internal" Jun 02 14:36:23.158998 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.158982 2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-41.ec2.internal" Jun 02 14:36:23.159067 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:23.159008 2566 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-41.ec2.internal\": node \"ip-10-0-141-41.ec2.internal\" not found" Jun 02 14:36:23.173959 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:23.173936 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-41.ec2.internal\" not found" Jun 02 14:36:23.206593 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.206553 2566 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-41.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-41.ec2.internal"] Jun 02 14:36:23.206664 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.206639 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 14:36:23.207621 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.207605 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-41.ec2.internal" event="NodeHasSufficientMemory" Jun 02 14:36:23.207713 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.207632 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-41.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 14:36:23.207713 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.207643 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-41.ec2.internal" event="NodeHasSufficientPID" Jun 02 14:36:23.208804 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.208791 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 14:36:23.208956 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.208941 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-41.ec2.internal" Jun 02 14:36:23.209013 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.208976 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 14:36:23.209586 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.209569 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-41.ec2.internal" event="NodeHasSufficientMemory" Jun 02 14:36:23.209671 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.209602 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-41.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 14:36:23.209671 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.209606 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-41.ec2.internal" event="NodeHasSufficientMemory" Jun 02 14:36:23.209671 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.209616 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-41.ec2.internal" event="NodeHasSufficientPID" Jun 02 14:36:23.209671 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.209622 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-41.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 14:36:23.209671 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.209631 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-41.ec2.internal" event="NodeHasSufficientPID" Jun 02 14:36:23.210735 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.210722 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-41.ec2.internal" Jun 02 14:36:23.210790 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.210745 2566 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 14:36:23.211474 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.211462 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-41.ec2.internal" event="NodeHasSufficientMemory" Jun 02 14:36:23.211561 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.211488 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-41.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 14:36:23.211561 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.211502 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-41.ec2.internal" event="NodeHasSufficientPID" Jun 02 14:36:23.228746 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:23.228723 2566 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-41.ec2.internal\" not found" node="ip-10-0-141-41.ec2.internal" Jun 02 14:36:23.232872 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:23.232856 2566 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-41.ec2.internal\" not found" node="ip-10-0-141-41.ec2.internal" Jun 02 14:36:23.274602 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:23.274562 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-41.ec2.internal\" not found" Jun 02 14:36:23.275352 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.275334 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a408f372d7ad5b16e1233a923c45f22c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-41.ec2.internal\" (UID: \"a408f372d7ad5b16e1233a923c45f22c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-41.ec2.internal" Jun 02 14:36:23.275411 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.275361 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a408f372d7ad5b16e1233a923c45f22c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-41.ec2.internal\" (UID: \"a408f372d7ad5b16e1233a923c45f22c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-41.ec2.internal" Jun 02 14:36:23.275411 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.275377 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ebdc834d789845207510ae66db3efff6-config\") pod \"kube-apiserver-proxy-ip-10-0-141-41.ec2.internal\" (UID: \"ebdc834d789845207510ae66db3efff6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-41.ec2.internal" Jun 02 14:36:23.375271 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:23.375175 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-41.ec2.internal\" not found" Jun 02 14:36:23.376370 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.376351 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a408f372d7ad5b16e1233a923c45f22c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-41.ec2.internal\" (UID: \"a408f372d7ad5b16e1233a923c45f22c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-41.ec2.internal" Jun 02 14:36:23.376370 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.376307 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a408f372d7ad5b16e1233a923c45f22c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-41.ec2.internal\" (UID: \"a408f372d7ad5b16e1233a923c45f22c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-41.ec2.internal" Jun 02 14:36:23.376459 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.376406 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ebdc834d789845207510ae66db3efff6-config\") pod \"kube-apiserver-proxy-ip-10-0-141-41.ec2.internal\" (UID: \"ebdc834d789845207510ae66db3efff6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-41.ec2.internal" Jun 02 14:36:23.376459 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.376424 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a408f372d7ad5b16e1233a923c45f22c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-41.ec2.internal\" (UID: \"a408f372d7ad5b16e1233a923c45f22c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-41.ec2.internal" Jun 02 14:36:23.376459 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.376447 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a408f372d7ad5b16e1233a923c45f22c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-41.ec2.internal\" (UID: \"a408f372d7ad5b16e1233a923c45f22c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-41.ec2.internal" Jun 02 14:36:23.376543 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.376471 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ebdc834d789845207510ae66db3efff6-config\") pod \"kube-apiserver-proxy-ip-10-0-141-41.ec2.internal\" (UID: \"ebdc834d789845207510ae66db3efff6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-41.ec2.internal" Jun 02 14:36:23.475914 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:23.475875 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-41.ec2.internal\" not found" Jun 02 14:36:23.531122 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.531100 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-41.ec2.internal" Jun 02 14:36:23.536022 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.536004 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-41.ec2.internal" Jun 02 14:36:23.577000 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:23.576971 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-41.ec2.internal\" not found" Jun 02 14:36:23.677385 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:23.677358 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-41.ec2.internal\" not found" Jun 02 14:36:23.777726 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:23.777694 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-41.ec2.internal\" not found" Jun 02 14:36:23.878103 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:23.878073 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-41.ec2.internal\" not found" Jun 02 14:36:23.879168 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.879150 2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 02 14:36:23.879297 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.879282 2566 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 14:36:23.879340 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.879317 2566 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 14:36:23.973797 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.973765 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 02 14:36:23.973997 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.973901 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 14:31:22 +0000 UTC" deadline="2027-12-15 05:28:54.091721326 +0000 UTC" Jun 02 14:36:23.973997 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.973937 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13454h52m30.117787379s" Jun 02 14:36:23.978682 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:23.978646 2566 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-41.ec2.internal\" not found" Jun 02 14:36:23.990426 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:23.990401 2566 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 14:36:24.016623 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.016597 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jb8rr" Jun 02 14:36:24.024871 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.024849 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jb8rr" Jun 02 14:36:24.032388 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.032368 2566 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 14:36:24.056556 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:24.056516 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda408f372d7ad5b16e1233a923c45f22c.slice/crio-90b9a1d28154f137485d5a13c54cc45fb802ada563c917bf328bb727b917b463 WatchSource:0}: Error finding container 90b9a1d28154f137485d5a13c54cc45fb802ada563c917bf328bb727b917b463: Status 404 returned error can't find the container with id 90b9a1d28154f137485d5a13c54cc45fb802ada563c917bf328bb727b917b463 Jun 02 14:36:24.056851 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:24.056825 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebdc834d789845207510ae66db3efff6.slice/crio-3919e821ce8e9cf0ccffd1922f46be2e5f560b36da582fbfdbecac3a52357791 WatchSource:0}: Error finding container 3919e821ce8e9cf0ccffd1922f46be2e5f560b36da582fbfdbecac3a52357791: Status 404 returned error can't find the container with id 3919e821ce8e9cf0ccffd1922f46be2e5f560b36da582fbfdbecac3a52357791 Jun 02 14:36:24.060316 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.060304 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 14:36:24.074265 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.074247 2566 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-41.ec2.internal" Jun 02 14:36:24.090001 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.089984 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 14:36:24.091852 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.091840 2566 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-41.ec2.internal" Jun 02 14:36:24.101743 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.101725 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 14:36:24.109771 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.109733 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-41.ec2.internal" event={"ID":"ebdc834d789845207510ae66db3efff6","Type":"ContainerStarted","Data":"3919e821ce8e9cf0ccffd1922f46be2e5f560b36da582fbfdbecac3a52357791"} Jun 02 14:36:24.110654 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.110623 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-41.ec2.internal" event={"ID":"a408f372d7ad5b16e1233a923c45f22c","Type":"ContainerStarted","Data":"90b9a1d28154f137485d5a13c54cc45fb802ada563c917bf328bb727b917b463"} Jun 02 14:36:24.323081 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.322968 2566 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 14:36:24.896653 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.896624 2566 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 14:36:24.948914 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.948874 2566 apiserver.go:52] "Watching apiserver" Jun 02 14:36:24.957504 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.957476 2566 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 02 14:36:24.959159 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.959122 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-979tz","openshift-ovn-kubernetes/ovnkube-node-86rkq","kube-system/konnectivity-agent-bmdkl","kube-system/kube-apiserver-proxy-ip-10-0-141-41.ec2.internal","openshift-cluster-node-tuning-operator/tuned-zqjzv","openshift-dns/node-resolver-h86v6","openshift-multus/multus-28ss6","openshift-multus/network-metrics-daemon-gd9d4","openshift-network-diagnostics/network-check-target-2lz7g","openshift-network-operator/iptables-alerter-5b6hv","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7zjc","openshift-image-registry/node-ca-whmlg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-41.ec2.internal"] Jun 02 14:36:24.960589 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.960567 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5b6hv" Jun 02 14:36:24.961827 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.961809 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:24.963066 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.962901 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bmdkl" Jun 02 14:36:24.963273 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.963258 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 02 14:36:24.963348 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.963311 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 02 14:36:24.963443 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.963420 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 02 14:36:24.963621 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.963605 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-klz8s\"" Jun 02 14:36:24.964053 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.964035 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zqjzv" Jun 02 14:36:24.964252 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.964231 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 02 14:36:24.964529 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.964506 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 02 14:36:24.964687 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.964631 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 02 14:36:24.964776 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.964739 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gbgjn\"" Jun 02 14:36:24.965559 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.965436 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 02 14:36:24.965735 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.965718 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 02 14:36:24.965809 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.965718 2566 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 14:36:24.965809 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.965802 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 02 14:36:24.965924 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.965905 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 02 14:36:24.966035 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.966019 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-x2dtv\"" Jun 02 14:36:24.966147 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.966116 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 02 14:36:24.966698 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.966443 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-h86v6" Jun 02 14:36:24.966698 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.966532 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-28ss6" Jun 02 14:36:24.967322 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.967303 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 02 14:36:24.967875 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.967851 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 02 14:36:24.967973 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.967930 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6lkjx\"" Jun 02 14:36:24.968899 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.968850 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jpd97\"" Jun 02 14:36:24.968899 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.968886 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 02 14:36:24.969287 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.969272 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 02 14:36:24.969495 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.969482 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 02 14:36:24.969931 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.969914 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 02 14:36:24.970009 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.969947 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 02 14:36:24.970009 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.969991 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-sqwns\"" Jun 02 14:36:24.970109 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.970064 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 02 14:36:24.970414 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.970398 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gd9d4" Jun 02 14:36:24.970508 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:24.970487 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gd9d4" podUID="ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c" Jun 02 14:36:24.971800 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.971782 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lz7g" Jun 02 14:36:24.971886 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:24.971848 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lz7g" podUID="20db969a-b67f-4e16-8ec8-549fa5f1ae4b" Jun 02 14:36:24.973206 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.972874 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-979tz" Jun 02 14:36:24.974253 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.974235 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7zjc" Jun 02 14:36:24.974943 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.974922 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 02 14:36:24.975369 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.975209 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 02 14:36:24.975369 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.975209 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zmj5v\"" Jun 02 14:36:24.975500 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.975392 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-whmlg" Jun 02 14:36:24.976434 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.976417 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 02 14:36:24.976524 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.976452 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 02 14:36:24.977779 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.977760 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-t2xqr\"" Jun 02 14:36:24.977910 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.977890 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 02 14:36:24.977988 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.977972 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-99rr5\"" Jun 02 14:36:24.978318 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.978289 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 02 14:36:24.978690 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.978673 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 02 14:36:24.978869 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.978847 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 02 14:36:24.984248 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.984227 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6179e2f2-9fc2-489f-bded-9cfe452097b4-tmp\") pod \"tuned-zqjzv\" (UID: \"6179e2f2-9fc2-489f-bded-9cfe452097b4\") " pod="openshift-cluster-node-tuning-operator/tuned-zqjzv" Jun 02 14:36:24.984390 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.984259 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30c92720-9871-4546-b0d2-0875a4905228-tmp-dir\") pod \"node-resolver-h86v6\" (UID: \"30c92720-9871-4546-b0d2-0875a4905228\") " pod="openshift-dns/node-resolver-h86v6" Jun 02 14:36:24.984390 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.984281 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/39506301-52a8-4516-be1c-9ca7f202ad74-host-slash\") pod \"iptables-alerter-5b6hv\" (UID: \"39506301-52a8-4516-be1c-9ca7f202ad74\") " pod="openshift-network-operator/iptables-alerter-5b6hv" Jun 02 14:36:24.984390 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.984303 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-multus-daemon-config\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:24.984390 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.984324 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-var-lib-openvswitch\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:24.984390 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.984379 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-ovnkube-script-lib\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:24.984571 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.984408 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6179e2f2-9fc2-489f-bded-9cfe452097b4-sys\") pod \"tuned-zqjzv\" (UID: \"6179e2f2-9fc2-489f-bded-9cfe452097b4\") " pod="openshift-cluster-node-tuning-operator/tuned-zqjzv" Jun 02 14:36:24.984571 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.984436 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6179e2f2-9fc2-489f-bded-9cfe452097b4-var-lib-kubelet\") pod \"tuned-zqjzv\" (UID: \"6179e2f2-9fc2-489f-bded-9cfe452097b4\") " pod="openshift-cluster-node-tuning-operator/tuned-zqjzv" Jun 02 14:36:24.984571 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.984457 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6179e2f2-9fc2-489f-bded-9cfe452097b4-lib-modules\") pod \"tuned-zqjzv\" (UID: \"6179e2f2-9fc2-489f-bded-9cfe452097b4\") " pod="openshift-cluster-node-tuning-operator/tuned-zqjzv" Jun 02 14:36:24.984571 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.984480 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-system-cni-dir\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:24.984571 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.984519 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-os-release\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:24.984571 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.984565 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/906e83ac-7d72-4b4a-a0bd-7a4e983c6359-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-979tz\" (UID: \"906e83ac-7d72-4b4a-a0bd-7a4e983c6359\") " pod="openshift-multus/multus-additional-cni-plugins-979tz" Jun 02 14:36:24.984782 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.984588 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-log-socket\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:24.984782 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.984610 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-env-overrides\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:24.984782 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.984636 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/18fc58fe-8823-453c-bc76-bbd8d9359fb2-konnectivity-ca\") pod \"konnectivity-agent-bmdkl\" (UID: \"18fc58fe-8823-453c-bc76-bbd8d9359fb2\") " pod="kube-system/konnectivity-agent-bmdkl" Jun 02 14:36:24.984782 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.984659 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-host-run-k8s-cni-cncf-io\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:24.984782 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.984673 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-host-var-lib-cni-bin\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:24.984782 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.984689 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-host-run-multus-certs\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:24.984782 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.984710 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8eff1deb-e5a9-4c81-a10c-66708ec80f65-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g7zjc\" (UID: \"8eff1deb-e5a9-4c81-a10c-66708ec80f65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7zjc" Jun 02 14:36:24.984782 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.984750 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-run-openvswitch\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:24.985105 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.984791 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6179e2f2-9fc2-489f-bded-9cfe452097b4-etc-systemd\") pod \"tuned-zqjzv\" (UID: \"6179e2f2-9fc2-489f-bded-9cfe452097b4\") " pod="openshift-cluster-node-tuning-operator/tuned-zqjzv" Jun 02 14:36:24.985105 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.984821 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bxgw\" (UniqueName: \"kubernetes.io/projected/20db969a-b67f-4e16-8ec8-549fa5f1ae4b-kube-api-access-9bxgw\") pod \"network-check-target-2lz7g\" (UID: \"20db969a-b67f-4e16-8ec8-549fa5f1ae4b\") " pod="openshift-network-diagnostics/network-check-target-2lz7g" Jun 02 14:36:24.985105 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.984845 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-multus-cni-dir\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:24.985105 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.984867 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-host-run-netns\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:24.985105 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.984890 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6179e2f2-9fc2-489f-bded-9cfe452097b4-etc-modprobe-d\") pod \"tuned-zqjzv\" (UID: \"6179e2f2-9fc2-489f-bded-9cfe452097b4\") " pod="openshift-cluster-node-tuning-operator/tuned-zqjzv" Jun 02 14:36:24.985105 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.984914 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dpj8\" (UniqueName: \"kubernetes.io/projected/ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c-kube-api-access-8dpj8\") pod \"network-metrics-daemon-gd9d4\" (UID: \"ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c\") " pod="openshift-multus/network-metrics-daemon-gd9d4" Jun 02 14:36:24.985105 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.984939 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-host-var-lib-cni-multus\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:24.985105 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.984980 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6179e2f2-9fc2-489f-bded-9cfe452097b4-etc-kubernetes\") pod \"tuned-zqjzv\" (UID: \"6179e2f2-9fc2-489f-bded-9cfe452097b4\") " pod="openshift-cluster-node-tuning-operator/tuned-zqjzv" Jun 02 14:36:24.985105 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.985006 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/18fc58fe-8823-453c-bc76-bbd8d9359fb2-agent-certs\") pod \"konnectivity-agent-bmdkl\" (UID: \"18fc58fe-8823-453c-bc76-bbd8d9359fb2\") " pod="kube-system/konnectivity-agent-bmdkl" Jun 02 14:36:24.985105 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.985038 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-hostroot\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:24.985105 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.985076 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f2p9\" (UniqueName: \"kubernetes.io/projected/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-kube-api-access-8f2p9\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:24.985105 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.985102 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/906e83ac-7d72-4b4a-a0bd-7a4e983c6359-cnibin\") pod \"multus-additional-cni-plugins-979tz\" (UID: \"906e83ac-7d72-4b4a-a0bd-7a4e983c6359\") " pod="openshift-multus/multus-additional-cni-plugins-979tz" Jun 02 14:36:24.985568 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.985146 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/906e83ac-7d72-4b4a-a0bd-7a4e983c6359-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-979tz\" (UID: \"906e83ac-7d72-4b4a-a0bd-7a4e983c6359\") " pod="openshift-multus/multus-additional-cni-plugins-979tz" Jun 02 14:36:24.985568 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.985183 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8eff1deb-e5a9-4c81-a10c-66708ec80f65-device-dir\") pod \"aws-ebs-csi-driver-node-g7zjc\" (UID: \"8eff1deb-e5a9-4c81-a10c-66708ec80f65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7zjc" Jun 02 14:36:24.985568 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.985241 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8eff1deb-e5a9-4c81-a10c-66708ec80f65-sys-fs\") pod \"aws-ebs-csi-driver-node-g7zjc\" (UID: \"8eff1deb-e5a9-4c81-a10c-66708ec80f65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7zjc" Jun 02 14:36:24.985568 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.985267 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-cnibin\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:24.985568 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.985317 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-host-var-lib-kubelet\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:24.985568 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.985356 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-systemd-units\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:24.985568 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.985407 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-host-cni-bin\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:24.985568 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.985446 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-host-run-ovn-kubernetes\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:24.985568 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.985485 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-ovn-node-metrics-cert\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:24.985568 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.985519 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6179e2f2-9fc2-489f-bded-9cfe452097b4-host\") pod \"tuned-zqjzv\" (UID: \"6179e2f2-9fc2-489f-bded-9cfe452097b4\") " pod="openshift-cluster-node-tuning-operator/tuned-zqjzv" Jun 02 14:36:24.985568 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.985548 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/39506301-52a8-4516-be1c-9ca7f202ad74-iptables-alerter-script\") pod \"iptables-alerter-5b6hv\" (UID: \"39506301-52a8-4516-be1c-9ca7f202ad74\") " pod="openshift-network-operator/iptables-alerter-5b6hv" Jun 02 14:36:24.985568 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.985569 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-ovnkube-config\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:24.986090 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.985590 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6179e2f2-9fc2-489f-bded-9cfe452097b4-etc-sysctl-conf\") pod \"tuned-zqjzv\" (UID: \"6179e2f2-9fc2-489f-bded-9cfe452097b4\") " pod="openshift-cluster-node-tuning-operator/tuned-zqjzv" Jun 02 14:36:24.986090 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.985613 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swjpx\" (UniqueName: \"kubernetes.io/projected/6179e2f2-9fc2-489f-bded-9cfe452097b4-kube-api-access-swjpx\") pod \"tuned-zqjzv\" (UID: \"6179e2f2-9fc2-489f-bded-9cfe452097b4\") " pod="openshift-cluster-node-tuning-operator/tuned-zqjzv" Jun 02 14:36:24.986090 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.985672 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/30c92720-9871-4546-b0d2-0875a4905228-hosts-file\") pod \"node-resolver-h86v6\" (UID: \"30c92720-9871-4546-b0d2-0875a4905228\") " pod="openshift-dns/node-resolver-h86v6" Jun 02 14:36:24.986090 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.985703 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c-metrics-certs\") pod \"network-metrics-daemon-gd9d4\" (UID: \"ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c\") " pod="openshift-multus/network-metrics-daemon-gd9d4" Jun 02 14:36:24.986090 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.985751 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8eff1deb-e5a9-4c81-a10c-66708ec80f65-etc-selinux\") pod \"aws-ebs-csi-driver-node-g7zjc\" (UID: \"8eff1deb-e5a9-4c81-a10c-66708ec80f65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7zjc" Jun 02 14:36:24.986090 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.985776 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-host-cni-netd\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:24.986090 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.985797 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6179e2f2-9fc2-489f-bded-9cfe452097b4-run\") pod \"tuned-zqjzv\" (UID: \"6179e2f2-9fc2-489f-bded-9cfe452097b4\") " pod="openshift-cluster-node-tuning-operator/tuned-zqjzv" Jun 02 14:36:24.986090 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.985820 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lt5w\" (UniqueName: \"kubernetes.io/projected/39506301-52a8-4516-be1c-9ca7f202ad74-kube-api-access-9lt5w\") pod \"iptables-alerter-5b6hv\" (UID: \"39506301-52a8-4516-be1c-9ca7f202ad74\") " pod="openshift-network-operator/iptables-alerter-5b6hv" Jun 02 14:36:24.986090 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.985844 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/906e83ac-7d72-4b4a-a0bd-7a4e983c6359-tuning-conf-dir\") pod \"multus-additional-cni-plugins-979tz\" (UID: \"906e83ac-7d72-4b4a-a0bd-7a4e983c6359\") " pod="openshift-multus/multus-additional-cni-plugins-979tz" Jun 02 14:36:24.986090 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.985891 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l29s\" (UniqueName: \"kubernetes.io/projected/8eff1deb-e5a9-4c81-a10c-66708ec80f65-kube-api-access-8l29s\") pod \"aws-ebs-csi-driver-node-g7zjc\" (UID: \"8eff1deb-e5a9-4c81-a10c-66708ec80f65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7zjc" Jun 02 14:36:24.986090 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.985928 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-node-log\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:24.986090 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.985960 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6179e2f2-9fc2-489f-bded-9cfe452097b4-etc-sysconfig\") pod \"tuned-zqjzv\" (UID: \"6179e2f2-9fc2-489f-bded-9cfe452097b4\") " pod="openshift-cluster-node-tuning-operator/tuned-zqjzv" Jun 02 14:36:24.986090 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.985986 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-run-ovn\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:24.986090 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.986012 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-cni-binary-copy\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:24.986090 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.986037 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-host-slash\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:24.986090 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.986060 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6179e2f2-9fc2-489f-bded-9cfe452097b4-etc-sysctl-d\") pod \"tuned-zqjzv\" (UID: \"6179e2f2-9fc2-489f-bded-9cfe452097b4\") " pod="openshift-cluster-node-tuning-operator/tuned-zqjzv" Jun 02 14:36:24.986643 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.986085 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8qw8\" (UniqueName: \"kubernetes.io/projected/30c92720-9871-4546-b0d2-0875a4905228-kube-api-access-r8qw8\") pod \"node-resolver-h86v6\" (UID: \"30c92720-9871-4546-b0d2-0875a4905228\") " pod="openshift-dns/node-resolver-h86v6" Jun 02 14:36:24.986643 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.986110 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/906e83ac-7d72-4b4a-a0bd-7a4e983c6359-system-cni-dir\") pod \"multus-additional-cni-plugins-979tz\" (UID: \"906e83ac-7d72-4b4a-a0bd-7a4e983c6359\") " pod="openshift-multus/multus-additional-cni-plugins-979tz" Jun 02 14:36:24.986643 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.986151 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-host-run-netns\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:24.986643 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.986172 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2whh\" (UniqueName: \"kubernetes.io/projected/906e83ac-7d72-4b4a-a0bd-7a4e983c6359-kube-api-access-v2whh\") pod \"multus-additional-cni-plugins-979tz\" (UID: \"906e83ac-7d72-4b4a-a0bd-7a4e983c6359\") " pod="openshift-multus/multus-additional-cni-plugins-979tz" Jun 02 14:36:24.986643 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.986194 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8eff1deb-e5a9-4c81-a10c-66708ec80f65-socket-dir\") pod \"aws-ebs-csi-driver-node-g7zjc\" (UID: \"8eff1deb-e5a9-4c81-a10c-66708ec80f65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7zjc" Jun 02 14:36:24.986643 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.986215 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-run-systemd\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:24.986643 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.986246 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/906e83ac-7d72-4b4a-a0bd-7a4e983c6359-cni-binary-copy\") pod \"multus-additional-cni-plugins-979tz\" (UID: \"906e83ac-7d72-4b4a-a0bd-7a4e983c6359\") " pod="openshift-multus/multus-additional-cni-plugins-979tz" Jun 02 14:36:24.986643 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.986270 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8eff1deb-e5a9-4c81-a10c-66708ec80f65-registration-dir\") pod \"aws-ebs-csi-driver-node-g7zjc\" (UID: \"8eff1deb-e5a9-4c81-a10c-66708ec80f65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7zjc" Jun 02 14:36:24.986643 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.986305 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-host-kubelet\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:24.986643 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.986336 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:24.986643 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.986365 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpcl5\" (UniqueName: \"kubernetes.io/projected/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-kube-api-access-gpcl5\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:24.986643 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.986392 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-multus-socket-dir-parent\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:24.986643 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.986406 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-multus-conf-dir\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:24.986643 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.986419 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-etc-kubernetes\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:24.986643 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.986436 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/906e83ac-7d72-4b4a-a0bd-7a4e983c6359-os-release\") pod \"multus-additional-cni-plugins-979tz\" (UID: \"906e83ac-7d72-4b4a-a0bd-7a4e983c6359\") " pod="openshift-multus/multus-additional-cni-plugins-979tz" Jun 02 14:36:24.986643 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.986472 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-etc-openvswitch\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:24.987059 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:24.986512 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6179e2f2-9fc2-489f-bded-9cfe452097b4-etc-tuned\") pod \"tuned-zqjzv\" (UID: \"6179e2f2-9fc2-489f-bded-9cfe452097b4\") " pod="openshift-cluster-node-tuning-operator/tuned-zqjzv" Jun 02 14:36:25.026182 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.026148 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 14:31:24 +0000 UTC" deadline="2028-01-28 05:28:01.03274187 +0000 UTC" Jun 02 14:36:25.026182 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.026174 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14510h51m36.006571574s" Jun 02 14:36:25.074800 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.074771 2566 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 02 14:36:25.086907 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.086883 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/18fc58fe-8823-453c-bc76-bbd8d9359fb2-konnectivity-ca\") pod \"konnectivity-agent-bmdkl\" (UID: \"18fc58fe-8823-453c-bc76-bbd8d9359fb2\") " pod="kube-system/konnectivity-agent-bmdkl" Jun 02 14:36:25.087034 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.086918 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-host-run-k8s-cni-cncf-io\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:25.087034 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.086935 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-host-var-lib-cni-bin\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:25.087034 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.086949 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-host-run-multus-certs\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:25.087034 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.086965 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8eff1deb-e5a9-4c81-a10c-66708ec80f65-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g7zjc\" (UID: \"8eff1deb-e5a9-4c81-a10c-66708ec80f65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7zjc" Jun 02 14:36:25.087034 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.086984 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-run-openvswitch\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:25.087034 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087000 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-host-run-k8s-cni-cncf-io\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:25.087034 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087021 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-host-var-lib-cni-bin\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:25.087332 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087040 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6179e2f2-9fc2-489f-bded-9cfe452097b4-etc-systemd\") pod \"tuned-zqjzv\" (UID: \"6179e2f2-9fc2-489f-bded-9cfe452097b4\") " pod="openshift-cluster-node-tuning-operator/tuned-zqjzv" Jun 02 14:36:25.087332 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087069 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-run-openvswitch\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:25.087332 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087071 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9bxgw\" (UniqueName: \"kubernetes.io/projected/20db969a-b67f-4e16-8ec8-549fa5f1ae4b-kube-api-access-9bxgw\") pod \"network-check-target-2lz7g\" (UID: \"20db969a-b67f-4e16-8ec8-549fa5f1ae4b\") " pod="openshift-network-diagnostics/network-check-target-2lz7g" Jun 02 14:36:25.087332 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087041 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-host-run-multus-certs\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:25.087332 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087097 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-multus-cni-dir\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:25.087332 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087046 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8eff1deb-e5a9-4c81-a10c-66708ec80f65-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g7zjc\" (UID: \"8eff1deb-e5a9-4c81-a10c-66708ec80f65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7zjc" Jun 02 14:36:25.087332 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087148 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-host-run-netns\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:25.087332 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087164 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6179e2f2-9fc2-489f-bded-9cfe452097b4-etc-modprobe-d\") pod \"tuned-zqjzv\" (UID: \"6179e2f2-9fc2-489f-bded-9cfe452097b4\") " pod="openshift-cluster-node-tuning-operator/tuned-zqjzv" Jun 02 14:36:25.087332 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087164 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6179e2f2-9fc2-489f-bded-9cfe452097b4-etc-systemd\") pod \"tuned-zqjzv\" (UID: \"6179e2f2-9fc2-489f-bded-9cfe452097b4\") " pod="openshift-cluster-node-tuning-operator/tuned-zqjzv" Jun 02 14:36:25.087332 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087182 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8dpj8\" (UniqueName: \"kubernetes.io/projected/ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c-kube-api-access-8dpj8\") pod \"network-metrics-daemon-gd9d4\" (UID: \"ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c\") " pod="openshift-multus/network-metrics-daemon-gd9d4" Jun 02 14:36:25.087332 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087212 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-host-run-netns\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:25.087332 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087257 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-host-var-lib-cni-multus\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:25.087332 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087263 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-multus-cni-dir\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:25.087332 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087298 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6179e2f2-9fc2-489f-bded-9cfe452097b4-etc-kubernetes\") pod \"tuned-zqjzv\" (UID: \"6179e2f2-9fc2-489f-bded-9cfe452097b4\") " pod="openshift-cluster-node-tuning-operator/tuned-zqjzv" Jun 02 14:36:25.087332 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087315 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6179e2f2-9fc2-489f-bded-9cfe452097b4-etc-modprobe-d\") pod \"tuned-zqjzv\" (UID: \"6179e2f2-9fc2-489f-bded-9cfe452097b4\") " pod="openshift-cluster-node-tuning-operator/tuned-zqjzv" Jun 02 14:36:25.087332 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087328 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/18fc58fe-8823-453c-bc76-bbd8d9359fb2-agent-certs\") pod \"konnectivity-agent-bmdkl\" (UID: \"18fc58fe-8823-453c-bc76-bbd8d9359fb2\") " pod="kube-system/konnectivity-agent-bmdkl" Jun 02 14:36:25.087332 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087353 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-hostroot\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:25.088074 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087352 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-host-var-lib-cni-multus\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:25.088074 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087366 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6179e2f2-9fc2-489f-bded-9cfe452097b4-etc-kubernetes\") pod \"tuned-zqjzv\" (UID: \"6179e2f2-9fc2-489f-bded-9cfe452097b4\") " pod="openshift-cluster-node-tuning-operator/tuned-zqjzv" Jun 02 14:36:25.088074 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087376 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8f2p9\" (UniqueName: \"kubernetes.io/projected/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-kube-api-access-8f2p9\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:25.088074 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087401 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/906e83ac-7d72-4b4a-a0bd-7a4e983c6359-cnibin\") pod \"multus-additional-cni-plugins-979tz\" (UID: \"906e83ac-7d72-4b4a-a0bd-7a4e983c6359\") " pod="openshift-multus/multus-additional-cni-plugins-979tz" Jun 02 14:36:25.088074 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087406 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-hostroot\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:25.088074 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087426 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/906e83ac-7d72-4b4a-a0bd-7a4e983c6359-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-979tz\" (UID: \"906e83ac-7d72-4b4a-a0bd-7a4e983c6359\") " pod="openshift-multus/multus-additional-cni-plugins-979tz" Jun 02 14:36:25.088074 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087449 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/906e83ac-7d72-4b4a-a0bd-7a4e983c6359-cnibin\") pod \"multus-additional-cni-plugins-979tz\" (UID: \"906e83ac-7d72-4b4a-a0bd-7a4e983c6359\") " pod="openshift-multus/multus-additional-cni-plugins-979tz" Jun 02 14:36:25.088074 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087453 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8eff1deb-e5a9-4c81-a10c-66708ec80f65-device-dir\") pod \"aws-ebs-csi-driver-node-g7zjc\" (UID: \"8eff1deb-e5a9-4c81-a10c-66708ec80f65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7zjc" Jun 02 14:36:25.088074 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087477 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8eff1deb-e5a9-4c81-a10c-66708ec80f65-sys-fs\") pod \"aws-ebs-csi-driver-node-g7zjc\" (UID: \"8eff1deb-e5a9-4c81-a10c-66708ec80f65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7zjc" Jun 02 14:36:25.088074 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087485 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/18fc58fe-8823-453c-bc76-bbd8d9359fb2-konnectivity-ca\") pod \"konnectivity-agent-bmdkl\" (UID: \"18fc58fe-8823-453c-bc76-bbd8d9359fb2\") " pod="kube-system/konnectivity-agent-bmdkl" Jun 02 14:36:25.088074 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087504 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-cnibin\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:25.088074 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087529 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-host-var-lib-kubelet\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:25.088074 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087544 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8eff1deb-e5a9-4c81-a10c-66708ec80f65-device-dir\") pod \"aws-ebs-csi-driver-node-g7zjc\" (UID: \"8eff1deb-e5a9-4c81-a10c-66708ec80f65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7zjc" Jun 02 14:36:25.088074 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087555 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-systemd-units\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:25.088074 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087577 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8eff1deb-e5a9-4c81-a10c-66708ec80f65-sys-fs\") pod \"aws-ebs-csi-driver-node-g7zjc\" (UID: \"8eff1deb-e5a9-4c81-a10c-66708ec80f65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7zjc" Jun 02 14:36:25.088074 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087586 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-host-cni-bin\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:25.088074 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087586 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-host-var-lib-kubelet\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:25.088074 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087581 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-cnibin\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:25.088929 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087613 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-systemd-units\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:25.088929 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087625 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-host-run-ovn-kubernetes\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:25.088929 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087636 2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 02 14:36:25.088929 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087654 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-host-run-ovn-kubernetes\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:25.088929 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087651 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-host-cni-bin\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:25.088929 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087657 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-ovn-node-metrics-cert\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:25.088929 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087692 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6179e2f2-9fc2-489f-bded-9cfe452097b4-host\") pod \"tuned-zqjzv\" (UID: \"6179e2f2-9fc2-489f-bded-9cfe452097b4\") " pod="openshift-cluster-node-tuning-operator/tuned-zqjzv" Jun 02 14:36:25.088929 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087708 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/39506301-52a8-4516-be1c-9ca7f202ad74-iptables-alerter-script\") pod \"iptables-alerter-5b6hv\" (UID: \"39506301-52a8-4516-be1c-9ca7f202ad74\") " pod="openshift-network-operator/iptables-alerter-5b6hv" Jun 02 14:36:25.088929 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087726 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-ovnkube-config\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:25.088929 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087773 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6179e2f2-9fc2-489f-bded-9cfe452097b4-etc-sysctl-conf\") pod \"tuned-zqjzv\" (UID: \"6179e2f2-9fc2-489f-bded-9cfe452097b4\") " pod="openshift-cluster-node-tuning-operator/tuned-zqjzv" Jun 02 14:36:25.088929 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087787 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6179e2f2-9fc2-489f-bded-9cfe452097b4-host\") pod \"tuned-zqjzv\" (UID: \"6179e2f2-9fc2-489f-bded-9cfe452097b4\") " pod="openshift-cluster-node-tuning-operator/tuned-zqjzv" Jun 02 14:36:25.088929 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087794 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-swjpx\" (UniqueName: \"kubernetes.io/projected/6179e2f2-9fc2-489f-bded-9cfe452097b4-kube-api-access-swjpx\") pod \"tuned-zqjzv\" (UID: \"6179e2f2-9fc2-489f-bded-9cfe452097b4\") " pod="openshift-cluster-node-tuning-operator/tuned-zqjzv" Jun 02 14:36:25.088929 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087831 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/30c92720-9871-4546-b0d2-0875a4905228-hosts-file\") pod \"node-resolver-h86v6\" (UID: \"30c92720-9871-4546-b0d2-0875a4905228\") " pod="openshift-dns/node-resolver-h86v6" Jun 02 14:36:25.088929 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087860 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c-metrics-certs\") pod \"network-metrics-daemon-gd9d4\" (UID: \"ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c\") " pod="openshift-multus/network-metrics-daemon-gd9d4" Jun 02 14:36:25.088929 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087889 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8eff1deb-e5a9-4c81-a10c-66708ec80f65-etc-selinux\") pod \"aws-ebs-csi-driver-node-g7zjc\" (UID: \"8eff1deb-e5a9-4c81-a10c-66708ec80f65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7zjc" Jun 02 14:36:25.088929 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087896 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/906e83ac-7d72-4b4a-a0bd-7a4e983c6359-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-979tz\" (UID: \"906e83ac-7d72-4b4a-a0bd-7a4e983c6359\") " pod="openshift-multus/multus-additional-cni-plugins-979tz" Jun 02 14:36:25.088929 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087914 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-host-cni-netd\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:25.088929 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087937 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6179e2f2-9fc2-489f-bded-9cfe452097b4-run\") pod \"tuned-zqjzv\" (UID: \"6179e2f2-9fc2-489f-bded-9cfe452097b4\") " pod="openshift-cluster-node-tuning-operator/tuned-zqjzv" Jun 02 14:36:25.089831 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087939 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6179e2f2-9fc2-489f-bded-9cfe452097b4-etc-sysctl-conf\") pod \"tuned-zqjzv\" (UID: \"6179e2f2-9fc2-489f-bded-9cfe452097b4\") " pod="openshift-cluster-node-tuning-operator/tuned-zqjzv" Jun 02 14:36:25.089831 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087984 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6179e2f2-9fc2-489f-bded-9cfe452097b4-run\") pod \"tuned-zqjzv\" (UID: \"6179e2f2-9fc2-489f-bded-9cfe452097b4\") " pod="openshift-cluster-node-tuning-operator/tuned-zqjzv" Jun 02 14:36:25.089831 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.087991 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-host-cni-netd\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:25.089831 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.088009 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9lt5w\" (UniqueName: \"kubernetes.io/projected/39506301-52a8-4516-be1c-9ca7f202ad74-kube-api-access-9lt5w\") pod \"iptables-alerter-5b6hv\" (UID: \"39506301-52a8-4516-be1c-9ca7f202ad74\") " pod="openshift-network-operator/iptables-alerter-5b6hv" Jun 02 14:36:25.089831 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.088034 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8eff1deb-e5a9-4c81-a10c-66708ec80f65-etc-selinux\") pod \"aws-ebs-csi-driver-node-g7zjc\" (UID: \"8eff1deb-e5a9-4c81-a10c-66708ec80f65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7zjc" Jun 02 14:36:25.089831 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.088039 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/906e83ac-7d72-4b4a-a0bd-7a4e983c6359-tuning-conf-dir\") pod \"multus-additional-cni-plugins-979tz\" (UID: \"906e83ac-7d72-4b4a-a0bd-7a4e983c6359\") " pod="openshift-multus/multus-additional-cni-plugins-979tz" Jun 02 14:36:25.089831 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.088045 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/30c92720-9871-4546-b0d2-0875a4905228-hosts-file\") pod \"node-resolver-h86v6\" (UID: \"30c92720-9871-4546-b0d2-0875a4905228\") " pod="openshift-dns/node-resolver-h86v6" Jun 02 14:36:25.089831 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.088072 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8l29s\" (UniqueName: \"kubernetes.io/projected/8eff1deb-e5a9-4c81-a10c-66708ec80f65-kube-api-access-8l29s\") pod \"aws-ebs-csi-driver-node-g7zjc\" (UID: \"8eff1deb-e5a9-4c81-a10c-66708ec80f65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7zjc" Jun 02 14:36:25.089831 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.088096 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-node-log\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:25.089831 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.088120 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6179e2f2-9fc2-489f-bded-9cfe452097b4-etc-sysconfig\") pod \"tuned-zqjzv\" (UID: \"6179e2f2-9fc2-489f-bded-9cfe452097b4\") " pod="openshift-cluster-node-tuning-operator/tuned-zqjzv" Jun 02 14:36:25.089831 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.088162 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-run-ovn\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:25.089831 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.088188 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-cni-binary-copy\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:25.089831 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.088192 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-node-log\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:25.089831 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.088271 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-run-ovn\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:25.089831 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.088286 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-ovnkube-config\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:25.089831 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.088162 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/906e83ac-7d72-4b4a-a0bd-7a4e983c6359-tuning-conf-dir\") pod \"multus-additional-cni-plugins-979tz\" (UID: \"906e83ac-7d72-4b4a-a0bd-7a4e983c6359\") " pod="openshift-multus/multus-additional-cni-plugins-979tz" Jun 02 14:36:25.089831 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.088320 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6179e2f2-9fc2-489f-bded-9cfe452097b4-etc-sysconfig\") pod \"tuned-zqjzv\" (UID: \"6179e2f2-9fc2-489f-bded-9cfe452097b4\") " pod="openshift-cluster-node-tuning-operator/tuned-zqjzv" Jun 02 14:36:25.090616 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.088329 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-host-slash\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:25.090616 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.088353 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6179e2f2-9fc2-489f-bded-9cfe452097b4-etc-sysctl-d\") pod \"tuned-zqjzv\" (UID: \"6179e2f2-9fc2-489f-bded-9cfe452097b4\") " pod="openshift-cluster-node-tuning-operator/tuned-zqjzv" Jun 02 14:36:25.090616 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.088378 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r8qw8\" (UniqueName: \"kubernetes.io/projected/30c92720-9871-4546-b0d2-0875a4905228-kube-api-access-r8qw8\") pod \"node-resolver-h86v6\" (UID: \"30c92720-9871-4546-b0d2-0875a4905228\") " pod="openshift-dns/node-resolver-h86v6" Jun 02 14:36:25.090616 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.088425 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-host-slash\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:25.090616 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.088406 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr6lq\" (UniqueName: \"kubernetes.io/projected/420fe544-ab5c-49d7-ac95-8c30edb13f7c-kube-api-access-fr6lq\") pod \"node-ca-whmlg\" (UID: \"420fe544-ab5c-49d7-ac95-8c30edb13f7c\") " pod="openshift-image-registry/node-ca-whmlg" Jun 02 14:36:25.090616 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.088471 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/906e83ac-7d72-4b4a-a0bd-7a4e983c6359-system-cni-dir\") pod \"multus-additional-cni-plugins-979tz\" (UID: \"906e83ac-7d72-4b4a-a0bd-7a4e983c6359\") " pod="openshift-multus/multus-additional-cni-plugins-979tz" Jun 02 14:36:25.090616 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.088494 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-host-run-netns\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:25.090616 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.088520 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6179e2f2-9fc2-489f-bded-9cfe452097b4-etc-sysctl-d\") pod \"tuned-zqjzv\" (UID: \"6179e2f2-9fc2-489f-bded-9cfe452097b4\") " pod="openshift-cluster-node-tuning-operator/tuned-zqjzv" Jun 02 14:36:25.090616 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.088521 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v2whh\" (UniqueName: \"kubernetes.io/projected/906e83ac-7d72-4b4a-a0bd-7a4e983c6359-kube-api-access-v2whh\") pod \"multus-additional-cni-plugins-979tz\" (UID: \"906e83ac-7d72-4b4a-a0bd-7a4e983c6359\") " pod="openshift-multus/multus-additional-cni-plugins-979tz" Jun 02 14:36:25.090616 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.088559 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8eff1deb-e5a9-4c81-a10c-66708ec80f65-socket-dir\") pod \"aws-ebs-csi-driver-node-g7zjc\" (UID: \"8eff1deb-e5a9-4c81-a10c-66708ec80f65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7zjc" Jun 02 14:36:25.090616 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.088585 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-run-systemd\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:25.090616 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.088609 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/420fe544-ab5c-49d7-ac95-8c30edb13f7c-host\") pod \"node-ca-whmlg\" (UID: \"420fe544-ab5c-49d7-ac95-8c30edb13f7c\") " pod="openshift-image-registry/node-ca-whmlg" Jun 02 14:36:25.090616 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.088635 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/906e83ac-7d72-4b4a-a0bd-7a4e983c6359-cni-binary-copy\") pod \"multus-additional-cni-plugins-979tz\" (UID: \"906e83ac-7d72-4b4a-a0bd-7a4e983c6359\") " pod="openshift-multus/multus-additional-cni-plugins-979tz" Jun 02 14:36:25.090616 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.088684 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/906e83ac-7d72-4b4a-a0bd-7a4e983c6359-system-cni-dir\") pod \"multus-additional-cni-plugins-979tz\" (UID: \"906e83ac-7d72-4b4a-a0bd-7a4e983c6359\") " pod="openshift-multus/multus-additional-cni-plugins-979tz" Jun 02 14:36:25.090616 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.088703 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-cni-binary-copy\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:25.090616 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.088730 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8eff1deb-e5a9-4c81-a10c-66708ec80f65-registration-dir\") pod \"aws-ebs-csi-driver-node-g7zjc\" (UID: \"8eff1deb-e5a9-4c81-a10c-66708ec80f65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7zjc" Jun 02 14:36:25.090616 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.088741 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-host-run-netns\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:25.091083 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.088754 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-run-systemd\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:25.091083 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.088789 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-host-kubelet\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:25.091083 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.088851 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-host-kubelet\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:25.091083 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.088855 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8eff1deb-e5a9-4c81-a10c-66708ec80f65-socket-dir\") pod \"aws-ebs-csi-driver-node-g7zjc\" (UID: \"8eff1deb-e5a9-4c81-a10c-66708ec80f65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7zjc" Jun 02 14:36:25.091083 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.088860 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8eff1deb-e5a9-4c81-a10c-66708ec80f65-registration-dir\") pod \"aws-ebs-csi-driver-node-g7zjc\" (UID: \"8eff1deb-e5a9-4c81-a10c-66708ec80f65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7zjc" Jun 02 14:36:25.091083 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.088892 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:25.091083 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.088930 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gpcl5\" (UniqueName: \"kubernetes.io/projected/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-kube-api-access-gpcl5\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:25.091083 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.088936 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:25.091083 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.088977 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-multus-socket-dir-parent\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:25.091083 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.089007 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-multus-conf-dir\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:25.091083 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.089035 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-etc-kubernetes\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:25.091083 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.089057 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/906e83ac-7d72-4b4a-a0bd-7a4e983c6359-os-release\") pod \"multus-additional-cni-plugins-979tz\" (UID: \"906e83ac-7d72-4b4a-a0bd-7a4e983c6359\") " pod="openshift-multus/multus-additional-cni-plugins-979tz" Jun 02 14:36:25.091083 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:25.089070 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 14:36:25.091083 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.089081 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-etc-openvswitch\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:25.091083 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.089114 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/906e83ac-7d72-4b4a-a0bd-7a4e983c6359-cni-binary-copy\") pod \"multus-additional-cni-plugins-979tz\" (UID: \"906e83ac-7d72-4b4a-a0bd-7a4e983c6359\") " pod="openshift-multus/multus-additional-cni-plugins-979tz" Jun 02 14:36:25.091083 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:25.089174 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c-metrics-certs podName:ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c nodeName:}" failed. No retries permitted until 2026-06-02 14:36:25.589143304 +0000 UTC m=+3.093479751 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c-metrics-certs") pod "network-metrics-daemon-gd9d4" (UID: "ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 14:36:25.091083 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.089217 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-multus-socket-dir-parent\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:25.091597 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.089219 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-etc-kubernetes\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:25.091597 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.089249 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-multus-conf-dir\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:25.091597 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.089116 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6179e2f2-9fc2-489f-bded-9cfe452097b4-etc-tuned\") pod \"tuned-zqjzv\" (UID: \"6179e2f2-9fc2-489f-bded-9cfe452097b4\") " pod="openshift-cluster-node-tuning-operator/tuned-zqjzv" Jun 02 14:36:25.091597 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.089298 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6179e2f2-9fc2-489f-bded-9cfe452097b4-tmp\") pod \"tuned-zqjzv\" (UID: \"6179e2f2-9fc2-489f-bded-9cfe452097b4\") " pod="openshift-cluster-node-tuning-operator/tuned-zqjzv" Jun 02 14:36:25.091597 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.089322 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30c92720-9871-4546-b0d2-0875a4905228-tmp-dir\") pod \"node-resolver-h86v6\" (UID: \"30c92720-9871-4546-b0d2-0875a4905228\") " pod="openshift-dns/node-resolver-h86v6" Jun 02 14:36:25.091597 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.089346 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/39506301-52a8-4516-be1c-9ca7f202ad74-host-slash\") pod \"iptables-alerter-5b6hv\" (UID: \"39506301-52a8-4516-be1c-9ca7f202ad74\") " pod="openshift-network-operator/iptables-alerter-5b6hv" Jun 02 14:36:25.091597 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.089367 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-multus-daemon-config\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:25.091597 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.089369 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/906e83ac-7d72-4b4a-a0bd-7a4e983c6359-os-release\") pod \"multus-additional-cni-plugins-979tz\" (UID: \"906e83ac-7d72-4b4a-a0bd-7a4e983c6359\") " pod="openshift-multus/multus-additional-cni-plugins-979tz" Jun 02 14:36:25.091597 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.089387 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-var-lib-openvswitch\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:25.091597 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.089413 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-ovnkube-script-lib\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:25.091597 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.089438 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6179e2f2-9fc2-489f-bded-9cfe452097b4-sys\") pod \"tuned-zqjzv\" (UID: \"6179e2f2-9fc2-489f-bded-9cfe452097b4\") " pod="openshift-cluster-node-tuning-operator/tuned-zqjzv" Jun 02 14:36:25.091597 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.089455 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/39506301-52a8-4516-be1c-9ca7f202ad74-host-slash\") pod \"iptables-alerter-5b6hv\" (UID: \"39506301-52a8-4516-be1c-9ca7f202ad74\") " pod="openshift-network-operator/iptables-alerter-5b6hv" Jun 02 14:36:25.091597 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.089466 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6179e2f2-9fc2-489f-bded-9cfe452097b4-var-lib-kubelet\") pod \"tuned-zqjzv\" (UID: \"6179e2f2-9fc2-489f-bded-9cfe452097b4\") " pod="openshift-cluster-node-tuning-operator/tuned-zqjzv" Jun 02 14:36:25.091597 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.089488 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6179e2f2-9fc2-489f-bded-9cfe452097b4-lib-modules\") pod \"tuned-zqjzv\" (UID: \"6179e2f2-9fc2-489f-bded-9cfe452097b4\") " pod="openshift-cluster-node-tuning-operator/tuned-zqjzv" Jun 02 14:36:25.091597 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.089545 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/420fe544-ab5c-49d7-ac95-8c30edb13f7c-serviceca\") pod \"node-ca-whmlg\" (UID: \"420fe544-ab5c-49d7-ac95-8c30edb13f7c\") " pod="openshift-image-registry/node-ca-whmlg" Jun 02 14:36:25.091597 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.089415 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-etc-openvswitch\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:25.091597 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.089637 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-system-cni-dir\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:25.091597 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.089663 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-os-release\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:25.092096 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.089690 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/906e83ac-7d72-4b4a-a0bd-7a4e983c6359-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-979tz\" (UID: \"906e83ac-7d72-4b4a-a0bd-7a4e983c6359\") " pod="openshift-multus/multus-additional-cni-plugins-979tz" Jun 02 14:36:25.092096 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.089717 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-log-socket\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:25.092096 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.089742 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-env-overrides\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:25.092096 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.089837 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30c92720-9871-4546-b0d2-0875a4905228-tmp-dir\") pod \"node-resolver-h86v6\" (UID: \"30c92720-9871-4546-b0d2-0875a4905228\") " pod="openshift-dns/node-resolver-h86v6" Jun 02 14:36:25.092096 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.090012 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-os-release\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:25.092096 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.090059 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6179e2f2-9fc2-489f-bded-9cfe452097b4-var-lib-kubelet\") pod \"tuned-zqjzv\" (UID: \"6179e2f2-9fc2-489f-bded-9cfe452097b4\") " pod="openshift-cluster-node-tuning-operator/tuned-zqjzv" Jun 02 14:36:25.092096 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.090093 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-log-socket\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:25.092096 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.090199 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6179e2f2-9fc2-489f-bded-9cfe452097b4-lib-modules\") pod \"tuned-zqjzv\" (UID: \"6179e2f2-9fc2-489f-bded-9cfe452097b4\") " pod="openshift-cluster-node-tuning-operator/tuned-zqjzv" Jun 02 14:36:25.092096 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.090285 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-multus-daemon-config\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:25.092096 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.090522 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-ovnkube-script-lib\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:25.092096 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.090577 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6179e2f2-9fc2-489f-bded-9cfe452097b4-sys\") pod \"tuned-zqjzv\" (UID: \"6179e2f2-9fc2-489f-bded-9cfe452097b4\") " pod="openshift-cluster-node-tuning-operator/tuned-zqjzv" Jun 02 14:36:25.092096 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.090595 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-env-overrides\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:25.092096 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.090613 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-var-lib-openvswitch\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:25.092096 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.090656 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-system-cni-dir\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:25.092096 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.090751 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/906e83ac-7d72-4b4a-a0bd-7a4e983c6359-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-979tz\" (UID: \"906e83ac-7d72-4b4a-a0bd-7a4e983c6359\") " pod="openshift-multus/multus-additional-cni-plugins-979tz" Jun 02 14:36:25.092096 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.090800 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/39506301-52a8-4516-be1c-9ca7f202ad74-iptables-alerter-script\") pod \"iptables-alerter-5b6hv\" (UID: \"39506301-52a8-4516-be1c-9ca7f202ad74\") " pod="openshift-network-operator/iptables-alerter-5b6hv" Jun 02 14:36:25.092096 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.091676 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6179e2f2-9fc2-489f-bded-9cfe452097b4-etc-tuned\") pod \"tuned-zqjzv\" (UID: \"6179e2f2-9fc2-489f-bded-9cfe452097b4\") " pod="openshift-cluster-node-tuning-operator/tuned-zqjzv" Jun 02 14:36:25.092096 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.091789 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6179e2f2-9fc2-489f-bded-9cfe452097b4-tmp\") pod \"tuned-zqjzv\" (UID: \"6179e2f2-9fc2-489f-bded-9cfe452097b4\") " pod="openshift-cluster-node-tuning-operator/tuned-zqjzv" Jun 02 14:36:25.092617 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.091883 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-ovn-node-metrics-cert\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:25.092617 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.091987 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/18fc58fe-8823-453c-bc76-bbd8d9359fb2-agent-certs\") pod \"konnectivity-agent-bmdkl\" (UID: \"18fc58fe-8823-453c-bc76-bbd8d9359fb2\") " pod="kube-system/konnectivity-agent-bmdkl" Jun 02 14:36:25.093717 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:25.093700 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 14:36:25.093833 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:25.093721 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 14:36:25.093833 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:25.093732 2566 projected.go:194] Error preparing data for projected volume kube-api-access-9bxgw for pod openshift-network-diagnostics/network-check-target-2lz7g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 14:36:25.093833 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:25.093772 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20db969a-b67f-4e16-8ec8-549fa5f1ae4b-kube-api-access-9bxgw podName:20db969a-b67f-4e16-8ec8-549fa5f1ae4b nodeName:}" failed. No retries permitted until 2026-06-02 14:36:25.593758272 +0000 UTC m=+3.098094703 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9bxgw" (UniqueName: "kubernetes.io/projected/20db969a-b67f-4e16-8ec8-549fa5f1ae4b-kube-api-access-9bxgw") pod "network-check-target-2lz7g" (UID: "20db969a-b67f-4e16-8ec8-549fa5f1ae4b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 14:36:25.096406 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.096375 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f2p9\" (UniqueName: \"kubernetes.io/projected/98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8-kube-api-access-8f2p9\") pod \"multus-28ss6\" (UID: \"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8\") " pod="openshift-multus/multus-28ss6" Jun 02 14:36:25.096646 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.096625 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dpj8\" (UniqueName: \"kubernetes.io/projected/ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c-kube-api-access-8dpj8\") pod \"network-metrics-daemon-gd9d4\" (UID: \"ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c\") " pod="openshift-multus/network-metrics-daemon-gd9d4" Jun 02 14:36:25.097667 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.097642 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swjpx\" (UniqueName: \"kubernetes.io/projected/6179e2f2-9fc2-489f-bded-9cfe452097b4-kube-api-access-swjpx\") pod \"tuned-zqjzv\" (UID: \"6179e2f2-9fc2-489f-bded-9cfe452097b4\") " pod="openshift-cluster-node-tuning-operator/tuned-zqjzv" Jun 02 14:36:25.097883 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.097858 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lt5w\" (UniqueName: \"kubernetes.io/projected/39506301-52a8-4516-be1c-9ca7f202ad74-kube-api-access-9lt5w\") pod \"iptables-alerter-5b6hv\" (UID: \"39506301-52a8-4516-be1c-9ca7f202ad74\") " pod="openshift-network-operator/iptables-alerter-5b6hv" Jun 02 14:36:25.098113 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.098091 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2whh\" (UniqueName: \"kubernetes.io/projected/906e83ac-7d72-4b4a-a0bd-7a4e983c6359-kube-api-access-v2whh\") pod \"multus-additional-cni-plugins-979tz\" (UID: \"906e83ac-7d72-4b4a-a0bd-7a4e983c6359\") " pod="openshift-multus/multus-additional-cni-plugins-979tz" Jun 02 14:36:25.098213 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.098112 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8qw8\" (UniqueName: \"kubernetes.io/projected/30c92720-9871-4546-b0d2-0875a4905228-kube-api-access-r8qw8\") pod \"node-resolver-h86v6\" (UID: \"30c92720-9871-4546-b0d2-0875a4905228\") " pod="openshift-dns/node-resolver-h86v6" Jun 02 14:36:25.098424 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.098405 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l29s\" (UniqueName: \"kubernetes.io/projected/8eff1deb-e5a9-4c81-a10c-66708ec80f65-kube-api-access-8l29s\") pod \"aws-ebs-csi-driver-node-g7zjc\" (UID: \"8eff1deb-e5a9-4c81-a10c-66708ec80f65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7zjc" Jun 02 14:36:25.100380 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.100359 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpcl5\" (UniqueName: \"kubernetes.io/projected/7446ab1b-b67d-4448-b4b3-5eacdcc9d885-kube-api-access-gpcl5\") pod \"ovnkube-node-86rkq\" (UID: \"7446ab1b-b67d-4448-b4b3-5eacdcc9d885\") " pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:25.191206 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.191165 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/420fe544-ab5c-49d7-ac95-8c30edb13f7c-host\") pod \"node-ca-whmlg\" (UID: \"420fe544-ab5c-49d7-ac95-8c30edb13f7c\") " pod="openshift-image-registry/node-ca-whmlg" Jun 02 14:36:25.191382 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.191215 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/420fe544-ab5c-49d7-ac95-8c30edb13f7c-serviceca\") pod \"node-ca-whmlg\" (UID: \"420fe544-ab5c-49d7-ac95-8c30edb13f7c\") " pod="openshift-image-registry/node-ca-whmlg" Jun 02 14:36:25.191382 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.191286 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/420fe544-ab5c-49d7-ac95-8c30edb13f7c-host\") pod \"node-ca-whmlg\" (UID: \"420fe544-ab5c-49d7-ac95-8c30edb13f7c\") " pod="openshift-image-registry/node-ca-whmlg" Jun 02 14:36:25.191382 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.191296 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fr6lq\" (UniqueName: \"kubernetes.io/projected/420fe544-ab5c-49d7-ac95-8c30edb13f7c-kube-api-access-fr6lq\") pod \"node-ca-whmlg\" (UID: \"420fe544-ab5c-49d7-ac95-8c30edb13f7c\") " pod="openshift-image-registry/node-ca-whmlg" Jun 02 14:36:25.191710 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.191690 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/420fe544-ab5c-49d7-ac95-8c30edb13f7c-serviceca\") pod \"node-ca-whmlg\" (UID: \"420fe544-ab5c-49d7-ac95-8c30edb13f7c\") " pod="openshift-image-registry/node-ca-whmlg" Jun 02 14:36:25.201038 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.201008 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr6lq\" (UniqueName: \"kubernetes.io/projected/420fe544-ab5c-49d7-ac95-8c30edb13f7c-kube-api-access-fr6lq\") pod \"node-ca-whmlg\" (UID: \"420fe544-ab5c-49d7-ac95-8c30edb13f7c\") " pod="openshift-image-registry/node-ca-whmlg" Jun 02 14:36:25.273758 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.273723 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5b6hv" Jun 02 14:36:25.281900 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.281856 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:25.290075 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.290047 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bmdkl" Jun 02 14:36:25.295976 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.295952 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zqjzv" Jun 02 14:36:25.303727 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.303705 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-h86v6" Jun 02 14:36:25.309412 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.309389 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-28ss6" Jun 02 14:36:25.317009 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.316987 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-979tz" Jun 02 14:36:25.327741 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.327717 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7zjc" Jun 02 14:36:25.331289 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.331270 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-whmlg" Jun 02 14:36:25.594751 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.594663 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9bxgw\" (UniqueName: \"kubernetes.io/projected/20db969a-b67f-4e16-8ec8-549fa5f1ae4b-kube-api-access-9bxgw\") pod \"network-check-target-2lz7g\" (UID: \"20db969a-b67f-4e16-8ec8-549fa5f1ae4b\") " pod="openshift-network-diagnostics/network-check-target-2lz7g" Jun 02 14:36:25.594751 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:25.594748 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c-metrics-certs\") pod \"network-metrics-daemon-gd9d4\" (UID: \"ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c\") " pod="openshift-multus/network-metrics-daemon-gd9d4" Jun 02 14:36:25.594944 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:25.594842 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 14:36:25.594944 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:25.594873 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 14:36:25.594944 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:25.594896 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 14:36:25.594944 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:25.594904 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c-metrics-certs podName:ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c nodeName:}" failed. No retries permitted until 2026-06-02 14:36:26.594885072 +0000 UTC m=+4.099221501 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c-metrics-certs") pod "network-metrics-daemon-gd9d4" (UID: "ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 14:36:25.594944 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:25.594910 2566 projected.go:194] Error preparing data for projected volume kube-api-access-9bxgw for pod openshift-network-diagnostics/network-check-target-2lz7g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 14:36:25.595173 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:25.594964 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20db969a-b67f-4e16-8ec8-549fa5f1ae4b-kube-api-access-9bxgw podName:20db969a-b67f-4e16-8ec8-549fa5f1ae4b nodeName:}" failed. No retries permitted until 2026-06-02 14:36:26.594947918 +0000 UTC m=+4.099284364 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9bxgw" (UniqueName: "kubernetes.io/projected/20db969a-b67f-4e16-8ec8-549fa5f1ae4b-kube-api-access-9bxgw") pod "network-check-target-2lz7g" (UID: "20db969a-b67f-4e16-8ec8-549fa5f1ae4b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 14:36:26.027003 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:26.026967 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 14:31:24 +0000 UTC" deadline="2028-01-12 12:33:38.448020532 +0000 UTC" Jun 02 14:36:26.027003 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:26.026999 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14133h57m12.421023649s" Jun 02 14:36:26.038214 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:26.038189 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18fc58fe_8823_453c_bc76_bbd8d9359fb2.slice/crio-dca23bc49cba1a6518b695e14f91442a1a1e2ede0e6112c31f189e26bc3edb86 WatchSource:0}: Error finding container dca23bc49cba1a6518b695e14f91442a1a1e2ede0e6112c31f189e26bc3edb86: Status 404 returned error can't find the container with id dca23bc49cba1a6518b695e14f91442a1a1e2ede0e6112c31f189e26bc3edb86 Jun 02 14:36:26.039251 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:26.039228 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7446ab1b_b67d_4448_b4b3_5eacdcc9d885.slice/crio-158e6cad28e8d240df2cd50586a0f157d253506b9d7aee96f5dfdbd86f755fff WatchSource:0}: Error finding container 158e6cad28e8d240df2cd50586a0f157d253506b9d7aee96f5dfdbd86f755fff: Status 404 returned error can't find the container with id 158e6cad28e8d240df2cd50586a0f157d253506b9d7aee96f5dfdbd86f755fff Jun 02 14:36:26.039871 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:26.039739 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eff1deb_e5a9_4c81_a10c_66708ec80f65.slice/crio-373cbda301eedb77d75cb7881f2a82f28385dc83f45aeb68607a0a1929cef33e WatchSource:0}: Error finding container 373cbda301eedb77d75cb7881f2a82f28385dc83f45aeb68607a0a1929cef33e: Status 404 returned error can't find the container with id 373cbda301eedb77d75cb7881f2a82f28385dc83f45aeb68607a0a1929cef33e Jun 02 14:36:26.042063 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:26.040908 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98dba64e_ba8c_4d20_b3ab_2ba5d90bd3b8.slice/crio-ca2490155631f7a1aeccc9ec69befb122b05677aeb52968e3753238c7cfe3d1b WatchSource:0}: Error finding container ca2490155631f7a1aeccc9ec69befb122b05677aeb52968e3753238c7cfe3d1b: Status 404 returned error can't find the container with id ca2490155631f7a1aeccc9ec69befb122b05677aeb52968e3753238c7cfe3d1b Jun 02 14:36:26.042573 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:26.042553 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39506301_52a8_4516_be1c_9ca7f202ad74.slice/crio-6e89ae354bd66cf95f08b6363a9e9691bd4d77be5d1881f78a4a9aee56eb7942 WatchSource:0}: Error finding container 6e89ae354bd66cf95f08b6363a9e9691bd4d77be5d1881f78a4a9aee56eb7942: Status 404 returned error can't find the container with id 6e89ae354bd66cf95f08b6363a9e9691bd4d77be5d1881f78a4a9aee56eb7942 Jun 02 14:36:26.044901 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:26.044878 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6179e2f2_9fc2_489f_bded_9cfe452097b4.slice/crio-7ae66166f3d3c9744fc989c09e57362bb062fefa8046fe444d9f3dbfe2dbe5e5 WatchSource:0}: Error finding container 7ae66166f3d3c9744fc989c09e57362bb062fefa8046fe444d9f3dbfe2dbe5e5: Status 404 returned error can't find the container with id 7ae66166f3d3c9744fc989c09e57362bb062fefa8046fe444d9f3dbfe2dbe5e5 Jun 02 14:36:26.047016 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:26.046994 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod420fe544_ab5c_49d7_ac95_8c30edb13f7c.slice/crio-90d8a4af177bf71dddeb25fe45016e5db4b7561ce0d5623a0ce100f1d051c5d7 WatchSource:0}: Error finding container 90d8a4af177bf71dddeb25fe45016e5db4b7561ce0d5623a0ce100f1d051c5d7: Status 404 returned error can't find the container with id 90d8a4af177bf71dddeb25fe45016e5db4b7561ce0d5623a0ce100f1d051c5d7 Jun 02 14:36:26.048175 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:36:26.048150 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod906e83ac_7d72_4b4a_a0bd_7a4e983c6359.slice/crio-ca788130f02b6e34b9186b73630235f16244f2d3f816f2c95186929aab6abaff WatchSource:0}: Error finding container ca788130f02b6e34b9186b73630235f16244f2d3f816f2c95186929aab6abaff: Status 404 returned error can't find the container with id ca788130f02b6e34b9186b73630235f16244f2d3f816f2c95186929aab6abaff Jun 02 14:36:26.106425 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:26.106395 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gd9d4" Jun 02 14:36:26.106580 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:26.106515 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gd9d4" podUID="ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c" Jun 02 14:36:26.114394 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:26.114363 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zqjzv" event={"ID":"6179e2f2-9fc2-489f-bded-9cfe452097b4","Type":"ContainerStarted","Data":"7ae66166f3d3c9744fc989c09e57362bb062fefa8046fe444d9f3dbfe2dbe5e5"} Jun 02 14:36:26.115355 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:26.115333 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-28ss6" event={"ID":"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8","Type":"ContainerStarted","Data":"ca2490155631f7a1aeccc9ec69befb122b05677aeb52968e3753238c7cfe3d1b"} Jun 02 14:36:26.116267 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:26.116245 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-h86v6" event={"ID":"30c92720-9871-4546-b0d2-0875a4905228","Type":"ContainerStarted","Data":"033c713cd9fcc56d3e41d01c201b545defd60f941b54a78ad62d86873304a6d0"} Jun 02 14:36:26.117083 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:26.117063 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-979tz" event={"ID":"906e83ac-7d72-4b4a-a0bd-7a4e983c6359","Type":"ContainerStarted","Data":"ca788130f02b6e34b9186b73630235f16244f2d3f816f2c95186929aab6abaff"} Jun 02 14:36:26.118000 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:26.117977 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-whmlg" event={"ID":"420fe544-ab5c-49d7-ac95-8c30edb13f7c","Type":"ContainerStarted","Data":"90d8a4af177bf71dddeb25fe45016e5db4b7561ce0d5623a0ce100f1d051c5d7"} Jun 02 14:36:26.118865 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:26.118845 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5b6hv" event={"ID":"39506301-52a8-4516-be1c-9ca7f202ad74","Type":"ContainerStarted","Data":"6e89ae354bd66cf95f08b6363a9e9691bd4d77be5d1881f78a4a9aee56eb7942"} Jun 02 14:36:26.119734 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:26.119705 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7zjc" event={"ID":"8eff1deb-e5a9-4c81-a10c-66708ec80f65","Type":"ContainerStarted","Data":"373cbda301eedb77d75cb7881f2a82f28385dc83f45aeb68607a0a1929cef33e"} Jun 02 14:36:26.120649 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:26.120626 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bmdkl" event={"ID":"18fc58fe-8823-453c-bc76-bbd8d9359fb2","Type":"ContainerStarted","Data":"dca23bc49cba1a6518b695e14f91442a1a1e2ede0e6112c31f189e26bc3edb86"} Jun 02 14:36:26.121652 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:26.121631 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" event={"ID":"7446ab1b-b67d-4448-b4b3-5eacdcc9d885","Type":"ContainerStarted","Data":"158e6cad28e8d240df2cd50586a0f157d253506b9d7aee96f5dfdbd86f755fff"} Jun 02 14:36:26.602412 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:26.601868 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9bxgw\" (UniqueName: \"kubernetes.io/projected/20db969a-b67f-4e16-8ec8-549fa5f1ae4b-kube-api-access-9bxgw\") pod \"network-check-target-2lz7g\" (UID: \"20db969a-b67f-4e16-8ec8-549fa5f1ae4b\") " pod="openshift-network-diagnostics/network-check-target-2lz7g" Jun 02 14:36:26.602412 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:26.602167 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 14:36:26.602412 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:26.602194 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 14:36:26.602412 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:26.602200 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c-metrics-certs\") pod \"network-metrics-daemon-gd9d4\" (UID: \"ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c\") " pod="openshift-multus/network-metrics-daemon-gd9d4" Jun 02 14:36:26.602412 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:26.602208 2566 projected.go:194] Error preparing data for projected volume kube-api-access-9bxgw for pod openshift-network-diagnostics/network-check-target-2lz7g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 14:36:26.602412 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:26.602283 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 14:36:26.602412 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:26.602339 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20db969a-b67f-4e16-8ec8-549fa5f1ae4b-kube-api-access-9bxgw podName:20db969a-b67f-4e16-8ec8-549fa5f1ae4b nodeName:}" failed. No retries permitted until 2026-06-02 14:36:28.602320061 +0000 UTC m=+6.106656508 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9bxgw" (UniqueName: "kubernetes.io/projected/20db969a-b67f-4e16-8ec8-549fa5f1ae4b-kube-api-access-9bxgw") pod "network-check-target-2lz7g" (UID: "20db969a-b67f-4e16-8ec8-549fa5f1ae4b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 14:36:26.602412 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:26.602358 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c-metrics-certs podName:ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c nodeName:}" failed. No retries permitted until 2026-06-02 14:36:28.602349213 +0000 UTC m=+6.106685650 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c-metrics-certs") pod "network-metrics-daemon-gd9d4" (UID: "ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 14:36:27.107309 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:27.107279 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lz7g" Jun 02 14:36:27.107859 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:27.107411 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lz7g" podUID="20db969a-b67f-4e16-8ec8-549fa5f1ae4b" Jun 02 14:36:27.129261 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:27.129229 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-41.ec2.internal" event={"ID":"ebdc834d789845207510ae66db3efff6","Type":"ContainerStarted","Data":"a739b5d3867cc26f4c36ded05fba4a6bfec379bef707ac9710715db337ec3535"} Jun 02 14:36:27.142005 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:27.141439 2566 generic.go:358] "Generic (PLEG): container finished" podID="a408f372d7ad5b16e1233a923c45f22c" containerID="f3b82be8e4931abea78eb3f24f3a950b8a7ff6d83d1653e7e27d64aafad115be" exitCode=0 Jun 02 14:36:27.142005 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:27.141491 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-41.ec2.internal" event={"ID":"a408f372d7ad5b16e1233a923c45f22c","Type":"ContainerDied","Data":"f3b82be8e4931abea78eb3f24f3a950b8a7ff6d83d1653e7e27d64aafad115be"} Jun 02 14:36:27.148424 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:27.148348 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-41.ec2.internal" podStartSLOduration=3.148331464 podStartE2EDuration="3.148331464s" podCreationTimestamp="2026-06-02 14:36:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 14:36:27.147967889 +0000 UTC m=+4.652304341" watchObservedRunningTime="2026-06-02 14:36:27.148331464 +0000 UTC m=+4.652667915" Jun 02 14:36:28.107071 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:28.107037 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gd9d4" Jun 02 14:36:28.107266 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:28.107190 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gd9d4" podUID="ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c" Jun 02 14:36:28.152544 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:28.152511 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-41.ec2.internal" event={"ID":"a408f372d7ad5b16e1233a923c45f22c","Type":"ContainerStarted","Data":"5c5ac02b41ba98f24e8bdcc0a11628cfea2c9224e36c3b3a751e4f9803509770"} Jun 02 14:36:28.621764 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:28.621626 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9bxgw\" (UniqueName: \"kubernetes.io/projected/20db969a-b67f-4e16-8ec8-549fa5f1ae4b-kube-api-access-9bxgw\") pod \"network-check-target-2lz7g\" (UID: \"20db969a-b67f-4e16-8ec8-549fa5f1ae4b\") " pod="openshift-network-diagnostics/network-check-target-2lz7g" Jun 02 14:36:28.621764 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:28.621696 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c-metrics-certs\") pod \"network-metrics-daemon-gd9d4\" (UID: \"ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c\") " pod="openshift-multus/network-metrics-daemon-gd9d4" Jun 02 14:36:28.622001 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:28.621830 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 14:36:28.622001 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:28.621886 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c-metrics-certs podName:ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c nodeName:}" failed. No retries permitted until 2026-06-02 14:36:32.62186806 +0000 UTC m=+10.126204490 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c-metrics-certs") pod "network-metrics-daemon-gd9d4" (UID: "ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 14:36:28.622336 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:28.622316 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 14:36:28.622414 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:28.622342 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 14:36:28.622414 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:28.622355 2566 projected.go:194] Error preparing data for projected volume kube-api-access-9bxgw for pod openshift-network-diagnostics/network-check-target-2lz7g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 14:36:28.622414 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:28.622399 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20db969a-b67f-4e16-8ec8-549fa5f1ae4b-kube-api-access-9bxgw podName:20db969a-b67f-4e16-8ec8-549fa5f1ae4b nodeName:}" failed. No retries permitted until 2026-06-02 14:36:32.622384496 +0000 UTC m=+10.126720943 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9bxgw" (UniqueName: "kubernetes.io/projected/20db969a-b67f-4e16-8ec8-549fa5f1ae4b-kube-api-access-9bxgw") pod "network-check-target-2lz7g" (UID: "20db969a-b67f-4e16-8ec8-549fa5f1ae4b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 14:36:29.110615 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:29.109906 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lz7g" Jun 02 14:36:29.110615 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:29.110083 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lz7g" podUID="20db969a-b67f-4e16-8ec8-549fa5f1ae4b" Jun 02 14:36:30.107721 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:30.107221 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gd9d4" Jun 02 14:36:30.107721 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:30.107353 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gd9d4" podUID="ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c" Jun 02 14:36:31.106463 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:31.106428 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lz7g" Jun 02 14:36:31.106668 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:31.106556 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lz7g" podUID="20db969a-b67f-4e16-8ec8-549fa5f1ae4b" Jun 02 14:36:32.106842 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:32.106808 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gd9d4" Jun 02 14:36:32.107309 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:32.106982 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gd9d4" podUID="ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c" Jun 02 14:36:32.652592 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:32.652531 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c-metrics-certs\") pod \"network-metrics-daemon-gd9d4\" (UID: \"ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c\") " pod="openshift-multus/network-metrics-daemon-gd9d4" Jun 02 14:36:32.652802 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:32.652622 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9bxgw\" (UniqueName: \"kubernetes.io/projected/20db969a-b67f-4e16-8ec8-549fa5f1ae4b-kube-api-access-9bxgw\") pod \"network-check-target-2lz7g\" (UID: \"20db969a-b67f-4e16-8ec8-549fa5f1ae4b\") " pod="openshift-network-diagnostics/network-check-target-2lz7g" Jun 02 14:36:32.652802 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:32.652759 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 14:36:32.652802 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:32.652779 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 14:36:32.652802 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:32.652792 2566 projected.go:194] Error preparing data for projected volume kube-api-access-9bxgw for pod openshift-network-diagnostics/network-check-target-2lz7g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 14:36:32.653117 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:32.652851 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20db969a-b67f-4e16-8ec8-549fa5f1ae4b-kube-api-access-9bxgw podName:20db969a-b67f-4e16-8ec8-549fa5f1ae4b nodeName:}" failed. No retries permitted until 2026-06-02 14:36:40.652833189 +0000 UTC m=+18.157169634 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9bxgw" (UniqueName: "kubernetes.io/projected/20db969a-b67f-4e16-8ec8-549fa5f1ae4b-kube-api-access-9bxgw") pod "network-check-target-2lz7g" (UID: "20db969a-b67f-4e16-8ec8-549fa5f1ae4b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 14:36:32.653341 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:32.653322 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 14:36:32.653483 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:32.653378 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c-metrics-certs podName:ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c nodeName:}" failed. No retries permitted until 2026-06-02 14:36:40.653363927 +0000 UTC m=+18.157700371 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c-metrics-certs") pod "network-metrics-daemon-gd9d4" (UID: "ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 14:36:33.107467 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:33.107428 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lz7g" Jun 02 14:36:33.107923 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:33.107568 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lz7g" podUID="20db969a-b67f-4e16-8ec8-549fa5f1ae4b" Jun 02 14:36:34.106873 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:34.106785 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gd9d4" Jun 02 14:36:34.107041 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:34.106902 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gd9d4" podUID="ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c" Jun 02 14:36:35.107078 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:35.107049 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lz7g" Jun 02 14:36:35.107494 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:35.107181 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lz7g" podUID="20db969a-b67f-4e16-8ec8-549fa5f1ae4b" Jun 02 14:36:36.106633 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:36.106592 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gd9d4" Jun 02 14:36:36.106797 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:36.106733 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gd9d4" podUID="ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c" Jun 02 14:36:37.107178 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:37.107125 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lz7g" Jun 02 14:36:37.107573 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:37.107267 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lz7g" podUID="20db969a-b67f-4e16-8ec8-549fa5f1ae4b" Jun 02 14:36:38.106571 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:38.106540 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gd9d4" Jun 02 14:36:38.106731 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:38.106684 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gd9d4" podUID="ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c" Jun 02 14:36:39.107032 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:39.107003 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lz7g" Jun 02 14:36:39.107446 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:39.107113 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lz7g" podUID="20db969a-b67f-4e16-8ec8-549fa5f1ae4b" Jun 02 14:36:40.106516 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:40.106481 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gd9d4" Jun 02 14:36:40.106676 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:40.106597 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gd9d4" podUID="ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c" Jun 02 14:36:40.713645 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:40.713597 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c-metrics-certs\") pod \"network-metrics-daemon-gd9d4\" (UID: \"ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c\") " pod="openshift-multus/network-metrics-daemon-gd9d4" Jun 02 14:36:40.714081 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:40.713694 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9bxgw\" (UniqueName: \"kubernetes.io/projected/20db969a-b67f-4e16-8ec8-549fa5f1ae4b-kube-api-access-9bxgw\") pod \"network-check-target-2lz7g\" (UID: \"20db969a-b67f-4e16-8ec8-549fa5f1ae4b\") " pod="openshift-network-diagnostics/network-check-target-2lz7g" Jun 02 14:36:40.714081 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:40.713772 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 14:36:40.714081 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:40.713834 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 14:36:40.714081 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:40.713856 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 14:36:40.714081 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:40.713859 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c-metrics-certs podName:ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c nodeName:}" failed. No retries permitted until 2026-06-02 14:36:56.713836352 +0000 UTC m=+34.218172789 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c-metrics-certs") pod "network-metrics-daemon-gd9d4" (UID: "ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 14:36:40.714081 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:40.713866 2566 projected.go:194] Error preparing data for projected volume kube-api-access-9bxgw for pod openshift-network-diagnostics/network-check-target-2lz7g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 14:36:40.714081 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:40.713912 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20db969a-b67f-4e16-8ec8-549fa5f1ae4b-kube-api-access-9bxgw podName:20db969a-b67f-4e16-8ec8-549fa5f1ae4b nodeName:}" failed. No retries permitted until 2026-06-02 14:36:56.713899102 +0000 UTC m=+34.218235549 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9bxgw" (UniqueName: "kubernetes.io/projected/20db969a-b67f-4e16-8ec8-549fa5f1ae4b-kube-api-access-9bxgw") pod "network-check-target-2lz7g" (UID: "20db969a-b67f-4e16-8ec8-549fa5f1ae4b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 14:36:41.106673 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:41.106589 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lz7g" Jun 02 14:36:41.106832 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:41.106719 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lz7g" podUID="20db969a-b67f-4e16-8ec8-549fa5f1ae4b" Jun 02 14:36:42.106953 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:42.106910 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gd9d4" Jun 02 14:36:42.107539 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:42.107047 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gd9d4" podUID="ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c" Jun 02 14:36:43.107225 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:43.107187 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lz7g" Jun 02 14:36:43.107665 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:43.107300 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lz7g" podUID="20db969a-b67f-4e16-8ec8-549fa5f1ae4b" Jun 02 14:36:44.107076 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:44.107032 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gd9d4" Jun 02 14:36:44.107254 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:44.107166 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gd9d4" podUID="ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c" Jun 02 14:36:45.106945 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:45.106484 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lz7g" Jun 02 14:36:45.107099 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:45.107013 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lz7g" podUID="20db969a-b67f-4e16-8ec8-549fa5f1ae4b" Jun 02 14:36:45.181544 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:45.181501 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-h86v6" event={"ID":"30c92720-9871-4546-b0d2-0875a4905228","Type":"ContainerStarted","Data":"3f73c8c44437959dae6518da6c10b21ac984e5100fe0a80381e932ab32bb4e66"} Jun 02 14:36:45.183108 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:45.183076 2566 generic.go:358] "Generic (PLEG): container finished" podID="906e83ac-7d72-4b4a-a0bd-7a4e983c6359" containerID="c1eb81cdf7364044657fdd7dcc9fdee891066c49d5f2dc28b384ecc37a7f58bb" exitCode=0 Jun 02 14:36:45.183246 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:45.183169 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-979tz" event={"ID":"906e83ac-7d72-4b4a-a0bd-7a4e983c6359","Type":"ContainerDied","Data":"c1eb81cdf7364044657fdd7dcc9fdee891066c49d5f2dc28b384ecc37a7f58bb"} Jun 02 14:36:45.185419 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:45.185373 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-whmlg" event={"ID":"420fe544-ab5c-49d7-ac95-8c30edb13f7c","Type":"ContainerStarted","Data":"7610b261c191710411f7db0f937c4b48ac6f1abf93257dfa0dc81628b9d6d95d"} Jun 02 14:36:45.186773 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:45.186746 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7zjc" event={"ID":"8eff1deb-e5a9-4c81-a10c-66708ec80f65","Type":"ContainerStarted","Data":"09d061ba34ff34b702e2826c5b80c01ef11e04b4eb6f66f06cf4033ffeb47764"} Jun 02 14:36:45.188023 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:45.187994 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bmdkl" event={"ID":"18fc58fe-8823-453c-bc76-bbd8d9359fb2","Type":"ContainerStarted","Data":"e4ea03e6191109f86c692503a9ac85d2b041aba5f5dca87819dd475b0d9e63ff"} Jun 02 14:36:45.190651 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:45.190634 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-86rkq_7446ab1b-b67d-4448-b4b3-5eacdcc9d885/ovn-acl-logging/0.log" Jun 02 14:36:45.190977 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:45.190956 2566 generic.go:358] "Generic (PLEG): container finished" podID="7446ab1b-b67d-4448-b4b3-5eacdcc9d885" containerID="c566300f914e4fc8dd72323e800edbf7e736007d1b3b517108fa738a35131b6c" exitCode=1 Jun 02 14:36:45.191054 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:45.190980 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" event={"ID":"7446ab1b-b67d-4448-b4b3-5eacdcc9d885","Type":"ContainerStarted","Data":"8f10bfaf58acefe8ab41454c953de4025a231ef91920732eb36454e3ea1fbbc9"} Jun 02 14:36:45.191054 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:45.191009 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" event={"ID":"7446ab1b-b67d-4448-b4b3-5eacdcc9d885","Type":"ContainerStarted","Data":"b00ed3cca96d721a30ead1b6178ebe6c4a005d4391c4876b8e169a8580699f8c"} Jun 02 14:36:45.191054 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:45.191023 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" event={"ID":"7446ab1b-b67d-4448-b4b3-5eacdcc9d885","Type":"ContainerStarted","Data":"6b6e4d4bf4698b61f3d9aea83c2f4a1138d126fc4baafdee102ad91651be375c"} Jun 02 14:36:45.191054 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:45.191035 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" event={"ID":"7446ab1b-b67d-4448-b4b3-5eacdcc9d885","Type":"ContainerStarted","Data":"580063e1ca362e3e7eeebebb9fc2a198f9f291ea9cee141ca8e405ca681f7b92"} Jun 02 14:36:45.191054 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:45.191048 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" event={"ID":"7446ab1b-b67d-4448-b4b3-5eacdcc9d885","Type":"ContainerDied","Data":"c566300f914e4fc8dd72323e800edbf7e736007d1b3b517108fa738a35131b6c"} Jun 02 14:36:45.191260 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:45.191061 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" event={"ID":"7446ab1b-b67d-4448-b4b3-5eacdcc9d885","Type":"ContainerStarted","Data":"e7dcdb37cc3a51ae1719af17c021f72d846d6a7412e9564643936a3bb7bc6baa"} Jun 02 14:36:45.192303 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:45.192282 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zqjzv" event={"ID":"6179e2f2-9fc2-489f-bded-9cfe452097b4","Type":"ContainerStarted","Data":"f823aecdd006cb47d0cad4da7d4ef42a94f2514b0a47df3e585cfb65f93469d3"} Jun 02 14:36:45.193681 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:45.193664 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-28ss6" event={"ID":"98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8","Type":"ContainerStarted","Data":"4c549391682c7a74aa5cdf43a9a985ebf3090734fe8ed7a3a47a2e041a82afe0"} Jun 02 14:36:45.197125 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:45.197092 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-h86v6" podStartSLOduration=3.972598436 podStartE2EDuration="22.197082787s" podCreationTimestamp="2026-06-02 14:36:23 +0000 UTC" firstStartedPulling="2026-06-02 14:36:26.034935516 +0000 UTC m=+3.539271946" lastFinishedPulling="2026-06-02 14:36:44.259419853 +0000 UTC m=+21.763756297" observedRunningTime="2026-06-02 14:36:45.196912661 +0000 UTC m=+22.701249113" watchObservedRunningTime="2026-06-02 14:36:45.197082787 +0000 UTC m=+22.701419237" Jun 02 14:36:45.197531 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:45.197499 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-41.ec2.internal" podStartSLOduration=21.197490441 podStartE2EDuration="21.197490441s" podCreationTimestamp="2026-06-02 14:36:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 14:36:28.169030321 +0000 UTC m=+5.673366774" watchObservedRunningTime="2026-06-02 14:36:45.197490441 +0000 UTC m=+22.701826893" Jun 02 14:36:45.212993 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:45.212956 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bmdkl" podStartSLOduration=7.929681413 podStartE2EDuration="22.212945336s" podCreationTimestamp="2026-06-02 14:36:23 +0000 UTC" firstStartedPulling="2026-06-02 14:36:26.041350664 +0000 UTC m=+3.545687095" lastFinishedPulling="2026-06-02 14:36:40.324614571 +0000 UTC m=+17.828951018" observedRunningTime="2026-06-02 14:36:45.212388004 +0000 UTC m=+22.716724454" watchObservedRunningTime="2026-06-02 14:36:45.212945336 +0000 UTC m=+22.717281787" Jun 02 14:36:45.251248 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:45.251209 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zqjzv" podStartSLOduration=4.009713244 podStartE2EDuration="22.251192239s" podCreationTimestamp="2026-06-02 14:36:23 +0000 UTC" firstStartedPulling="2026-06-02 14:36:26.046978631 +0000 UTC m=+3.551315064" lastFinishedPulling="2026-06-02 14:36:44.288457621 +0000 UTC m=+21.792794059" observedRunningTime="2026-06-02 14:36:45.232903357 +0000 UTC m=+22.737239808" watchObservedRunningTime="2026-06-02 14:36:45.251192239 +0000 UTC m=+22.755528689" Jun 02 14:36:45.251449 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:45.251358 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-28ss6" podStartSLOduration=3.969632759 podStartE2EDuration="22.251350617s" podCreationTimestamp="2026-06-02 14:36:23 +0000 UTC" firstStartedPulling="2026-06-02 14:36:26.044202096 +0000 UTC m=+3.548538525" lastFinishedPulling="2026-06-02 14:36:44.325919936 +0000 UTC m=+21.830256383" observedRunningTime="2026-06-02 14:36:45.250577914 +0000 UTC m=+22.754914363" watchObservedRunningTime="2026-06-02 14:36:45.251350617 +0000 UTC m=+22.755687068" Jun 02 14:36:45.379493 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:45.379472 2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 02 14:36:46.063287 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:46.063088 2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T14:36:45.37948974Z","UUID":"67ba4156-804c-471b-9a0f-e14ee4e8ac90","Handler":null,"Name":"","Endpoint":""} Jun 02 14:36:46.066293 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:46.066261 2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 02 14:36:46.066293 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:46.066296 2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 02 14:36:46.106996 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:46.106579 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gd9d4" Jun 02 14:36:46.106996 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:46.106709 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gd9d4" podUID="ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c" Jun 02 14:36:46.197694 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:46.197663 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5b6hv" event={"ID":"39506301-52a8-4516-be1c-9ca7f202ad74","Type":"ContainerStarted","Data":"03fd19b3657c36a5df2a320d189de7836c0954be403def24d97bc83ca71b5a2e"} Jun 02 14:36:46.199756 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:46.199712 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7zjc" event={"ID":"8eff1deb-e5a9-4c81-a10c-66708ec80f65","Type":"ContainerStarted","Data":"e25adb26335e3fbba170da0ebadd83eedc6163fcd963803645d64b46ac57f65d"} Jun 02 14:36:46.219228 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:46.219173 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-whmlg" podStartSLOduration=4.980338344 podStartE2EDuration="23.219114995s" podCreationTimestamp="2026-06-02 14:36:23 +0000 UTC" firstStartedPulling="2026-06-02 14:36:26.049093138 +0000 UTC m=+3.553429583" lastFinishedPulling="2026-06-02 14:36:44.287869804 +0000 UTC m=+21.792206234" observedRunningTime="2026-06-02 14:36:45.286560279 +0000 UTC m=+22.790896730" watchObservedRunningTime="2026-06-02 14:36:46.219114995 +0000 UTC m=+23.723451482" Jun 02 14:36:47.107102 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:47.107071 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lz7g" Jun 02 14:36:47.107245 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:47.107188 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lz7g" podUID="20db969a-b67f-4e16-8ec8-549fa5f1ae4b" Jun 02 14:36:47.204027 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:47.203938 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7zjc" event={"ID":"8eff1deb-e5a9-4c81-a10c-66708ec80f65","Type":"ContainerStarted","Data":"651e068fd84d5107d1fc9c1807d6684ece3d2191e550c70ff73405d853bd3661"} Jun 02 14:36:47.206991 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:47.206967 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-86rkq_7446ab1b-b67d-4448-b4b3-5eacdcc9d885/ovn-acl-logging/0.log" Jun 02 14:36:47.207375 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:47.207350 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" event={"ID":"7446ab1b-b67d-4448-b4b3-5eacdcc9d885","Type":"ContainerStarted","Data":"af451e0c2bc9e26dedc7a5de3b54ceb0eb42bab02cad353830f2d38802fcd067"} Jun 02 14:36:47.230661 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:47.230619 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5b6hv" podStartSLOduration=9.951947121 podStartE2EDuration="24.230605415s" podCreationTimestamp="2026-06-02 14:36:23 +0000 UTC" firstStartedPulling="2026-06-02 14:36:26.045968072 +0000 UTC m=+3.550304517" lastFinishedPulling="2026-06-02 14:36:40.324626371 +0000 UTC m=+17.828962811" observedRunningTime="2026-06-02 14:36:46.219311374 +0000 UTC m=+23.723647822" watchObservedRunningTime="2026-06-02 14:36:47.230605415 +0000 UTC m=+24.734941871" Jun 02 14:36:47.539860 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:47.539786 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bmdkl" Jun 02 14:36:47.540377 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:47.540358 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bmdkl" Jun 02 14:36:47.555005 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:47.554970 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7zjc" podStartSLOduration=4.359206683 podStartE2EDuration="24.554956875s" podCreationTimestamp="2026-06-02 14:36:23 +0000 UTC" firstStartedPulling="2026-06-02 14:36:26.044325537 +0000 UTC m=+3.548661982" lastFinishedPulling="2026-06-02 14:36:46.240075733 +0000 UTC m=+23.744412174" observedRunningTime="2026-06-02 14:36:47.231199272 +0000 UTC m=+24.735535721" watchObservedRunningTime="2026-06-02 14:36:47.554956875 +0000 UTC m=+25.059293326" Jun 02 14:36:48.106884 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:48.106719 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gd9d4" Jun 02 14:36:48.107027 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:48.106963 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gd9d4" podUID="ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c" Jun 02 14:36:48.209432 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:48.209400 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bmdkl" Jun 02 14:36:48.209816 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:48.209802 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bmdkl" Jun 02 14:36:49.106400 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:49.106375 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lz7g" Jun 02 14:36:49.106537 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:49.106517 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lz7g" podUID="20db969a-b67f-4e16-8ec8-549fa5f1ae4b" Jun 02 14:36:49.217850 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:49.217808 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-86rkq_7446ab1b-b67d-4448-b4b3-5eacdcc9d885/ovn-acl-logging/0.log" Jun 02 14:36:49.219514 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:49.219485 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" event={"ID":"7446ab1b-b67d-4448-b4b3-5eacdcc9d885","Type":"ContainerStarted","Data":"60d0ba6b0eabd510f5b681a6157d5825572f097c1ed706f327a12a76fee44d89"} Jun 02 14:36:49.220234 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:49.220215 2566 scope.go:117] "RemoveContainer" containerID="c566300f914e4fc8dd72323e800edbf7e736007d1b3b517108fa738a35131b6c" Jun 02 14:36:49.220323 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:49.220307 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:49.220472 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:49.220440 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:49.220533 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:49.220486 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:49.241575 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:49.241547 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:49.243012 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:49.242989 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:36:50.107348 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:50.107158 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gd9d4" Jun 02 14:36:50.107565 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:50.107458 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gd9d4" podUID="ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c" Jun 02 14:36:50.224608 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:50.224579 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-86rkq_7446ab1b-b67d-4448-b4b3-5eacdcc9d885/ovn-acl-logging/0.log" Jun 02 14:36:50.225018 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:50.224940 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" event={"ID":"7446ab1b-b67d-4448-b4b3-5eacdcc9d885","Type":"ContainerStarted","Data":"cc8815b581f6675a85a0c7e93c7130c39832fbaecb9b0002e9a6bd010dad7f73"} Jun 02 14:36:50.280416 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:50.280366 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" podStartSLOduration=9.013855003 podStartE2EDuration="27.280349841s" podCreationTimestamp="2026-06-02 14:36:23 +0000 UTC" firstStartedPulling="2026-06-02 14:36:26.042325883 +0000 UTC m=+3.546662326" lastFinishedPulling="2026-06-02 14:36:44.308820734 +0000 UTC m=+21.813157164" observedRunningTime="2026-06-02 14:36:50.279816387 +0000 UTC m=+27.784152840" watchObservedRunningTime="2026-06-02 14:36:50.280349841 +0000 UTC m=+27.784686291" Jun 02 14:36:51.106428 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:51.106393 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lz7g" Jun 02 14:36:51.106620 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:51.106546 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lz7g" podUID="20db969a-b67f-4e16-8ec8-549fa5f1ae4b" Jun 02 14:36:52.107074 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:52.107035 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gd9d4" Jun 02 14:36:52.107460 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:52.107163 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gd9d4" podUID="ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c" Jun 02 14:36:52.229613 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:52.229580 2566 generic.go:358] "Generic (PLEG): container finished" podID="906e83ac-7d72-4b4a-a0bd-7a4e983c6359" containerID="57b26c9aea7d0df0de92ddacc6afdfc432228ad632d3ce4dc1d956d93621ef67" exitCode=0 Jun 02 14:36:52.229770 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:52.229619 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-979tz" event={"ID":"906e83ac-7d72-4b4a-a0bd-7a4e983c6359","Type":"ContainerDied","Data":"57b26c9aea7d0df0de92ddacc6afdfc432228ad632d3ce4dc1d956d93621ef67"} Jun 02 14:36:53.107332 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:53.107300 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lz7g" Jun 02 14:36:53.107686 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:53.107383 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lz7g" podUID="20db969a-b67f-4e16-8ec8-549fa5f1ae4b" Jun 02 14:36:54.106967 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:54.106929 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gd9d4" Jun 02 14:36:54.107184 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:54.107059 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gd9d4" podUID="ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c" Jun 02 14:36:54.235042 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:54.235006 2566 generic.go:358] "Generic (PLEG): container finished" podID="906e83ac-7d72-4b4a-a0bd-7a4e983c6359" containerID="16c9cd1333779ebd139abf377198858fef1a417def57e093caee697e7691bcf9" exitCode=0 Jun 02 14:36:54.235399 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:54.235068 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-979tz" event={"ID":"906e83ac-7d72-4b4a-a0bd-7a4e983c6359","Type":"ContainerDied","Data":"16c9cd1333779ebd139abf377198858fef1a417def57e093caee697e7691bcf9"} Jun 02 14:36:55.109246 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:55.109219 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lz7g" Jun 02 14:36:55.109495 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:55.109310 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lz7g" podUID="20db969a-b67f-4e16-8ec8-549fa5f1ae4b" Jun 02 14:36:56.107189 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:56.107155 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gd9d4" Jun 02 14:36:56.107634 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:56.107264 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gd9d4" podUID="ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c" Jun 02 14:36:56.242006 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:56.241975 2566 generic.go:358] "Generic (PLEG): container finished" podID="906e83ac-7d72-4b4a-a0bd-7a4e983c6359" containerID="a17b5ae8285043a8482b796d51e25bf6eb98f529eff9fbc7c1849481d365f08b" exitCode=0 Jun 02 14:36:56.242177 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:56.242020 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-979tz" event={"ID":"906e83ac-7d72-4b4a-a0bd-7a4e983c6359","Type":"ContainerDied","Data":"a17b5ae8285043a8482b796d51e25bf6eb98f529eff9fbc7c1849481d365f08b"} Jun 02 14:36:56.732151 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:56.732091 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c-metrics-certs\") pod \"network-metrics-daemon-gd9d4\" (UID: \"ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c\") " pod="openshift-multus/network-metrics-daemon-gd9d4" Jun 02 14:36:56.732336 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:56.732180 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9bxgw\" (UniqueName: \"kubernetes.io/projected/20db969a-b67f-4e16-8ec8-549fa5f1ae4b-kube-api-access-9bxgw\") pod \"network-check-target-2lz7g\" (UID: \"20db969a-b67f-4e16-8ec8-549fa5f1ae4b\") " pod="openshift-network-diagnostics/network-check-target-2lz7g" Jun 02 14:36:56.732336 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:56.732235 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 14:36:56.732336 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:56.732293 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 14:36:56.732336 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:56.732312 2566 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 14:36:56.732336 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:56.732325 2566 projected.go:194] Error preparing data for projected volume kube-api-access-9bxgw for pod openshift-network-diagnostics/network-check-target-2lz7g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 14:36:56.732530 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:56.732299 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c-metrics-certs podName:ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c nodeName:}" failed. No retries permitted until 2026-06-02 14:37:28.732284926 +0000 UTC m=+66.236621355 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c-metrics-certs") pod "network-metrics-daemon-gd9d4" (UID: "ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 14:36:56.732530 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:56.732389 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20db969a-b67f-4e16-8ec8-549fa5f1ae4b-kube-api-access-9bxgw podName:20db969a-b67f-4e16-8ec8-549fa5f1ae4b nodeName:}" failed. No retries permitted until 2026-06-02 14:37:28.732369509 +0000 UTC m=+66.236705940 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9bxgw" (UniqueName: "kubernetes.io/projected/20db969a-b67f-4e16-8ec8-549fa5f1ae4b-kube-api-access-9bxgw") pod "network-check-target-2lz7g" (UID: "20db969a-b67f-4e16-8ec8-549fa5f1ae4b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 14:36:57.110438 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:57.110358 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lz7g" Jun 02 14:36:57.110854 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:57.110477 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lz7g" podUID="20db969a-b67f-4e16-8ec8-549fa5f1ae4b" Jun 02 14:36:58.106168 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:58.106118 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gd9d4" Jun 02 14:36:58.106343 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:58.106266 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gd9d4" podUID="ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c" Jun 02 14:36:59.106581 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:36:59.106539 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lz7g" Jun 02 14:36:59.107005 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:36:59.106669 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lz7g" podUID="20db969a-b67f-4e16-8ec8-549fa5f1ae4b" Jun 02 14:37:00.106922 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:00.106884 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gd9d4" Jun 02 14:37:00.107341 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:37:00.107005 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gd9d4" podUID="ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c" Jun 02 14:37:01.106583 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:01.106544 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lz7g" Jun 02 14:37:01.106770 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:37:01.106683 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lz7g" podUID="20db969a-b67f-4e16-8ec8-549fa5f1ae4b" Jun 02 14:37:02.107208 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:02.107171 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gd9d4" Jun 02 14:37:02.107605 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:37:02.107324 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gd9d4" podUID="ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c" Jun 02 14:37:03.108622 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:03.108592 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lz7g" Jun 02 14:37:03.109323 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:37:03.109262 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lz7g" podUID="20db969a-b67f-4e16-8ec8-549fa5f1ae4b" Jun 02 14:37:03.258552 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:03.258518 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-979tz" event={"ID":"906e83ac-7d72-4b4a-a0bd-7a4e983c6359","Type":"ContainerStarted","Data":"091ed1e35cf5781695eddde4eac5e27701c1aed58459d6c95c70cf467534bc76"} Jun 02 14:37:04.044771 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:04.044572 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gd9d4"] Jun 02 14:37:04.044989 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:04.044887 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gd9d4" Jun 02 14:37:04.045058 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:37:04.045013 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gd9d4" podUID="ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c" Jun 02 14:37:04.045197 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:04.045171 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2lz7g"] Jun 02 14:37:04.045270 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:04.045258 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lz7g" Jun 02 14:37:04.045400 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:37:04.045364 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lz7g" podUID="20db969a-b67f-4e16-8ec8-549fa5f1ae4b" Jun 02 14:37:04.263231 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:04.263201 2566 generic.go:358] "Generic (PLEG): container finished" podID="906e83ac-7d72-4b4a-a0bd-7a4e983c6359" containerID="091ed1e35cf5781695eddde4eac5e27701c1aed58459d6c95c70cf467534bc76" exitCode=0 Jun 02 14:37:04.263711 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:04.263267 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-979tz" event={"ID":"906e83ac-7d72-4b4a-a0bd-7a4e983c6359","Type":"ContainerDied","Data":"091ed1e35cf5781695eddde4eac5e27701c1aed58459d6c95c70cf467534bc76"} Jun 02 14:37:05.267835 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:05.267800 2566 generic.go:358] "Generic (PLEG): container finished" podID="906e83ac-7d72-4b4a-a0bd-7a4e983c6359" containerID="94efc06c14695eadebc9c466f359a20985f58a2a6a08c9b4338ccbb15cebb4d0" exitCode=0 Jun 02 14:37:05.268414 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:05.267844 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-979tz" event={"ID":"906e83ac-7d72-4b4a-a0bd-7a4e983c6359","Type":"ContainerDied","Data":"94efc06c14695eadebc9c466f359a20985f58a2a6a08c9b4338ccbb15cebb4d0"} Jun 02 14:37:06.106918 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:06.106736 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lz7g" Jun 02 14:37:06.107098 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:06.106805 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gd9d4" Jun 02 14:37:06.107098 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:37:06.107003 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lz7g" podUID="20db969a-b67f-4e16-8ec8-549fa5f1ae4b" Jun 02 14:37:06.107098 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:37:06.107079 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gd9d4" podUID="ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c" Jun 02 14:37:06.272671 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:06.272643 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-979tz" event={"ID":"906e83ac-7d72-4b4a-a0bd-7a4e983c6359","Type":"ContainerStarted","Data":"cbe12dba29ff304a3b652d1e5028647860dcad62f5a8ceb57be57eef6767e854"} Jun 02 14:37:06.300804 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:06.300756 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-979tz" podStartSLOduration=6.27385096 podStartE2EDuration="43.30074282s" podCreationTimestamp="2026-06-02 14:36:23 +0000 UTC" firstStartedPulling="2026-06-02 14:36:26.049498563 +0000 UTC m=+3.553834994" lastFinishedPulling="2026-06-02 14:37:03.076390425 +0000 UTC m=+40.580726854" observedRunningTime="2026-06-02 14:37:06.30056948 +0000 UTC m=+43.804905936" watchObservedRunningTime="2026-06-02 14:37:06.30074282 +0000 UTC m=+43.805079271" Jun 02 14:37:08.106308 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.106261 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lz7g" Jun 02 14:37:08.106705 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.106263 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gd9d4" Jun 02 14:37:08.106705 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:37:08.106371 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lz7g" podUID="20db969a-b67f-4e16-8ec8-549fa5f1ae4b" Jun 02 14:37:08.106705 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:37:08.106447 2566 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gd9d4" podUID="ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c" Jun 02 14:37:08.256580 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.256500 2566 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-41.ec2.internal" event="NodeReady" Jun 02 14:37:08.256712 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.256626 2566 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 02 14:37:08.310761 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.310730 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-z9f8p"] Jun 02 14:37:08.314318 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.314294 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-znvcz"] Jun 02 14:37:08.314466 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.314447 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z9f8p" Jun 02 14:37:08.316087 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.316065 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-znvcz" Jun 02 14:37:08.317203 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.317179 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 02 14:37:08.317298 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.317179 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 02 14:37:08.317298 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.317232 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tx2t8\"" Jun 02 14:37:08.318456 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.318435 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 02 14:37:08.318456 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.318446 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 02 14:37:08.318614 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.318449 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xpbtv\"" Jun 02 14:37:08.318701 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.318680 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 02 14:37:08.324204 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.324187 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z9f8p"] Jun 02 14:37:08.324709 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.324691 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-znvcz"] Jun 02 14:37:08.328867 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.328845 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5l59w"] Jun 02 14:37:08.330753 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.330737 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5l59w" Jun 02 14:37:08.333292 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.333274 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-z7xlf\"" Jun 02 14:37:08.333292 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.333287 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 02 14:37:08.333450 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.333287 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 02 14:37:08.333520 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.333492 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 02 14:37:08.333675 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.333647 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 02 14:37:08.340637 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.340617 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5l59w"] Jun 02 14:37:08.419095 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.419054 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c844ed44-4523-49b9-9826-8fd7ef6c5819-tmp-dir\") pod \"dns-default-z9f8p\" (UID: \"c844ed44-4523-49b9-9826-8fd7ef6c5819\") " pod="openshift-dns/dns-default-z9f8p" Jun 02 14:37:08.419095 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.419093 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8589f6af-377d-4dbb-9560-88edeb2d8fde-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5l59w\" (UID: \"8589f6af-377d-4dbb-9560-88edeb2d8fde\") " pod="openshift-insights/insights-runtime-extractor-5l59w" Jun 02 14:37:08.419314 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.419117 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8589f6af-377d-4dbb-9560-88edeb2d8fde-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5l59w\" (UID: \"8589f6af-377d-4dbb-9560-88edeb2d8fde\") " pod="openshift-insights/insights-runtime-extractor-5l59w" Jun 02 14:37:08.419314 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.419183 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8589f6af-377d-4dbb-9560-88edeb2d8fde-crio-socket\") pod \"insights-runtime-extractor-5l59w\" (UID: \"8589f6af-377d-4dbb-9560-88edeb2d8fde\") " pod="openshift-insights/insights-runtime-extractor-5l59w" Jun 02 14:37:08.419314 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.419223 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c844ed44-4523-49b9-9826-8fd7ef6c5819-metrics-tls\") pod \"dns-default-z9f8p\" (UID: \"c844ed44-4523-49b9-9826-8fd7ef6c5819\") " pod="openshift-dns/dns-default-z9f8p" Jun 02 14:37:08.419314 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.419242 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c872k\" (UniqueName: \"kubernetes.io/projected/c844ed44-4523-49b9-9826-8fd7ef6c5819-kube-api-access-c872k\") pod \"dns-default-z9f8p\" (UID: \"c844ed44-4523-49b9-9826-8fd7ef6c5819\") " pod="openshift-dns/dns-default-z9f8p" Jun 02 14:37:08.419314 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.419291 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8589f6af-377d-4dbb-9560-88edeb2d8fde-data-volume\") pod \"insights-runtime-extractor-5l59w\" (UID: \"8589f6af-377d-4dbb-9560-88edeb2d8fde\") " pod="openshift-insights/insights-runtime-extractor-5l59w" Jun 02 14:37:08.419314 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.419307 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpwj9\" (UniqueName: \"kubernetes.io/projected/8bfd843d-d883-4e3a-a984-1d15495e05bc-kube-api-access-dpwj9\") pod \"ingress-canary-znvcz\" (UID: \"8bfd843d-d883-4e3a-a984-1d15495e05bc\") " pod="openshift-ingress-canary/ingress-canary-znvcz" Jun 02 14:37:08.419518 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.419322 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjkx6\" (UniqueName: \"kubernetes.io/projected/8589f6af-377d-4dbb-9560-88edeb2d8fde-kube-api-access-rjkx6\") pod \"insights-runtime-extractor-5l59w\" (UID: \"8589f6af-377d-4dbb-9560-88edeb2d8fde\") " pod="openshift-insights/insights-runtime-extractor-5l59w" Jun 02 14:37:08.419518 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.419350 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c844ed44-4523-49b9-9826-8fd7ef6c5819-config-volume\") pod \"dns-default-z9f8p\" (UID: \"c844ed44-4523-49b9-9826-8fd7ef6c5819\") " pod="openshift-dns/dns-default-z9f8p" Jun 02 14:37:08.419518 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.419375 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8bfd843d-d883-4e3a-a984-1d15495e05bc-cert\") pod \"ingress-canary-znvcz\" (UID: \"8bfd843d-d883-4e3a-a984-1d15495e05bc\") " pod="openshift-ingress-canary/ingress-canary-znvcz" Jun 02 14:37:08.520571 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.520502 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c844ed44-4523-49b9-9826-8fd7ef6c5819-tmp-dir\") pod \"dns-default-z9f8p\" (UID: \"c844ed44-4523-49b9-9826-8fd7ef6c5819\") " pod="openshift-dns/dns-default-z9f8p" Jun 02 14:37:08.520571 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.520534 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8589f6af-377d-4dbb-9560-88edeb2d8fde-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5l59w\" (UID: \"8589f6af-377d-4dbb-9560-88edeb2d8fde\") " pod="openshift-insights/insights-runtime-extractor-5l59w" Jun 02 14:37:08.520571 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.520556 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8589f6af-377d-4dbb-9560-88edeb2d8fde-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5l59w\" (UID: \"8589f6af-377d-4dbb-9560-88edeb2d8fde\") " pod="openshift-insights/insights-runtime-extractor-5l59w" Jun 02 14:37:08.520804 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.520583 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8589f6af-377d-4dbb-9560-88edeb2d8fde-crio-socket\") pod \"insights-runtime-extractor-5l59w\" (UID: \"8589f6af-377d-4dbb-9560-88edeb2d8fde\") " pod="openshift-insights/insights-runtime-extractor-5l59w" Jun 02 14:37:08.520804 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.520621 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c844ed44-4523-49b9-9826-8fd7ef6c5819-metrics-tls\") pod \"dns-default-z9f8p\" (UID: \"c844ed44-4523-49b9-9826-8fd7ef6c5819\") " pod="openshift-dns/dns-default-z9f8p" Jun 02 14:37:08.520804 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.520645 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c872k\" (UniqueName: \"kubernetes.io/projected/c844ed44-4523-49b9-9826-8fd7ef6c5819-kube-api-access-c872k\") pod \"dns-default-z9f8p\" (UID: \"c844ed44-4523-49b9-9826-8fd7ef6c5819\") " pod="openshift-dns/dns-default-z9f8p" Jun 02 14:37:08.520804 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.520692 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8589f6af-377d-4dbb-9560-88edeb2d8fde-data-volume\") pod \"insights-runtime-extractor-5l59w\" (UID: \"8589f6af-377d-4dbb-9560-88edeb2d8fde\") " pod="openshift-insights/insights-runtime-extractor-5l59w" Jun 02 14:37:08.520804 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.520715 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dpwj9\" (UniqueName: \"kubernetes.io/projected/8bfd843d-d883-4e3a-a984-1d15495e05bc-kube-api-access-dpwj9\") pod \"ingress-canary-znvcz\" (UID: \"8bfd843d-d883-4e3a-a984-1d15495e05bc\") " pod="openshift-ingress-canary/ingress-canary-znvcz" Jun 02 14:37:08.520804 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.520744 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rjkx6\" (UniqueName: \"kubernetes.io/projected/8589f6af-377d-4dbb-9560-88edeb2d8fde-kube-api-access-rjkx6\") pod \"insights-runtime-extractor-5l59w\" (UID: \"8589f6af-377d-4dbb-9560-88edeb2d8fde\") " pod="openshift-insights/insights-runtime-extractor-5l59w" Jun 02 14:37:08.520804 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.520773 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c844ed44-4523-49b9-9826-8fd7ef6c5819-config-volume\") pod \"dns-default-z9f8p\" (UID: \"c844ed44-4523-49b9-9826-8fd7ef6c5819\") " pod="openshift-dns/dns-default-z9f8p" Jun 02 14:37:08.521092 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.520807 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8bfd843d-d883-4e3a-a984-1d15495e05bc-cert\") pod \"ingress-canary-znvcz\" (UID: \"8bfd843d-d883-4e3a-a984-1d15495e05bc\") " pod="openshift-ingress-canary/ingress-canary-znvcz" Jun 02 14:37:08.521092 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.520899 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8589f6af-377d-4dbb-9560-88edeb2d8fde-crio-socket\") pod \"insights-runtime-extractor-5l59w\" (UID: \"8589f6af-377d-4dbb-9560-88edeb2d8fde\") " pod="openshift-insights/insights-runtime-extractor-5l59w" Jun 02 14:37:08.521092 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.520906 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c844ed44-4523-49b9-9826-8fd7ef6c5819-tmp-dir\") pod \"dns-default-z9f8p\" (UID: \"c844ed44-4523-49b9-9826-8fd7ef6c5819\") " pod="openshift-dns/dns-default-z9f8p" Jun 02 14:37:08.521092 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.521015 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8589f6af-377d-4dbb-9560-88edeb2d8fde-data-volume\") pod \"insights-runtime-extractor-5l59w\" (UID: \"8589f6af-377d-4dbb-9560-88edeb2d8fde\") " pod="openshift-insights/insights-runtime-extractor-5l59w" Jun 02 14:37:08.521374 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.521354 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8589f6af-377d-4dbb-9560-88edeb2d8fde-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5l59w\" (UID: \"8589f6af-377d-4dbb-9560-88edeb2d8fde\") " pod="openshift-insights/insights-runtime-extractor-5l59w" Jun 02 14:37:08.521518 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.521502 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c844ed44-4523-49b9-9826-8fd7ef6c5819-config-volume\") pod \"dns-default-z9f8p\" (UID: \"c844ed44-4523-49b9-9826-8fd7ef6c5819\") " pod="openshift-dns/dns-default-z9f8p" Jun 02 14:37:08.524684 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.524661 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c844ed44-4523-49b9-9826-8fd7ef6c5819-metrics-tls\") pod \"dns-default-z9f8p\" (UID: \"c844ed44-4523-49b9-9826-8fd7ef6c5819\") " pod="openshift-dns/dns-default-z9f8p" Jun 02 14:37:08.524807 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.524666 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8589f6af-377d-4dbb-9560-88edeb2d8fde-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5l59w\" (UID: \"8589f6af-377d-4dbb-9560-88edeb2d8fde\") " pod="openshift-insights/insights-runtime-extractor-5l59w" Jun 02 14:37:08.524970 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.524950 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8bfd843d-d883-4e3a-a984-1d15495e05bc-cert\") pod \"ingress-canary-znvcz\" (UID: \"8bfd843d-d883-4e3a-a984-1d15495e05bc\") " pod="openshift-ingress-canary/ingress-canary-znvcz" Jun 02 14:37:08.529584 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.529533 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c872k\" (UniqueName: \"kubernetes.io/projected/c844ed44-4523-49b9-9826-8fd7ef6c5819-kube-api-access-c872k\") pod \"dns-default-z9f8p\" (UID: \"c844ed44-4523-49b9-9826-8fd7ef6c5819\") " pod="openshift-dns/dns-default-z9f8p" Jun 02 14:37:08.529754 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.529729 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjkx6\" (UniqueName: \"kubernetes.io/projected/8589f6af-377d-4dbb-9560-88edeb2d8fde-kube-api-access-rjkx6\") pod \"insights-runtime-extractor-5l59w\" (UID: \"8589f6af-377d-4dbb-9560-88edeb2d8fde\") " pod="openshift-insights/insights-runtime-extractor-5l59w" Jun 02 14:37:08.529864 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.529847 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpwj9\" (UniqueName: \"kubernetes.io/projected/8bfd843d-d883-4e3a-a984-1d15495e05bc-kube-api-access-dpwj9\") pod \"ingress-canary-znvcz\" (UID: \"8bfd843d-d883-4e3a-a984-1d15495e05bc\") " pod="openshift-ingress-canary/ingress-canary-znvcz" Jun 02 14:37:08.624861 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.624830 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z9f8p" Jun 02 14:37:08.630607 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.630586 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-znvcz" Jun 02 14:37:08.640496 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.640474 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5l59w" Jun 02 14:37:08.807975 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.807899 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z9f8p"] Jun 02 14:37:08.809280 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.809252 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-znvcz"] Jun 02 14:37:08.813185 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:37:08.813154 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bfd843d_d883_4e3a_a984_1d15495e05bc.slice/crio-1b3048757909bc2b9016bf8bbe0b0f4765c40cbc815c5296045bed6edba20aea WatchSource:0}: Error finding container 1b3048757909bc2b9016bf8bbe0b0f4765c40cbc815c5296045bed6edba20aea: Status 404 returned error can't find the container with id 1b3048757909bc2b9016bf8bbe0b0f4765c40cbc815c5296045bed6edba20aea Jun 02 14:37:08.813806 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:37:08.813752 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc844ed44_4523_49b9_9826_8fd7ef6c5819.slice/crio-4dfa3200c867754db603529a94fc94b548fc05748eff6572851d91334345b80f WatchSource:0}: Error finding container 4dfa3200c867754db603529a94fc94b548fc05748eff6572851d91334345b80f: Status 404 returned error can't find the container with id 4dfa3200c867754db603529a94fc94b548fc05748eff6572851d91334345b80f Jun 02 14:37:08.821674 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:08.821651 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5l59w"] Jun 02 14:37:08.825319 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:37:08.825299 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8589f6af_377d_4dbb_9560_88edeb2d8fde.slice/crio-138c430c1211b183ebe963166fc366eec6bbdfced2eea528f3090bfdc2b77d36 WatchSource:0}: Error finding container 138c430c1211b183ebe963166fc366eec6bbdfced2eea528f3090bfdc2b77d36: Status 404 returned error can't find the container with id 138c430c1211b183ebe963166fc366eec6bbdfced2eea528f3090bfdc2b77d36 Jun 02 14:37:09.281082 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:09.280821 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-znvcz" event={"ID":"8bfd843d-d883-4e3a-a984-1d15495e05bc","Type":"ContainerStarted","Data":"1b3048757909bc2b9016bf8bbe0b0f4765c40cbc815c5296045bed6edba20aea"} Jun 02 14:37:09.282214 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:09.282183 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z9f8p" event={"ID":"c844ed44-4523-49b9-9826-8fd7ef6c5819","Type":"ContainerStarted","Data":"4dfa3200c867754db603529a94fc94b548fc05748eff6572851d91334345b80f"} Jun 02 14:37:09.283768 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:09.283716 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5l59w" event={"ID":"8589f6af-377d-4dbb-9560-88edeb2d8fde","Type":"ContainerStarted","Data":"42de021b5d2cc48697f3bd21daec776eaf57076a4d0ef5bfcf08ca4529951f6d"} Jun 02 14:37:09.283768 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:09.283744 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5l59w" event={"ID":"8589f6af-377d-4dbb-9560-88edeb2d8fde","Type":"ContainerStarted","Data":"138c430c1211b183ebe963166fc366eec6bbdfced2eea528f3090bfdc2b77d36"} Jun 02 14:37:10.107159 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:10.106897 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gd9d4" Jun 02 14:37:10.107159 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:10.106943 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lz7g" Jun 02 14:37:10.109996 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:10.109966 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 14:37:10.111048 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:10.111027 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-84jzg\"" Jun 02 14:37:10.111174 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:10.111027 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 14:37:10.111174 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:10.111055 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dxvnl\"" Jun 02 14:37:10.111174 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:10.111077 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 14:37:10.287391 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:10.287354 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5l59w" event={"ID":"8589f6af-377d-4dbb-9560-88edeb2d8fde","Type":"ContainerStarted","Data":"29344c8dc6f93457c7c8fe0bcb7439f08ce03f2a3b46ca93c08fbac1084ed703"} Jun 02 14:37:10.786845 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:10.786819 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-jrbf8"] Jun 02 14:37:10.791197 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:10.791174 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jrbf8" Jun 02 14:37:10.798819 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:10.798800 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 02 14:37:10.799014 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:10.798999 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 02 14:37:10.799964 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:10.799941 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 02 14:37:10.800059 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:10.799975 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 02 14:37:10.800572 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:10.800232 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 02 14:37:10.800572 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:10.800430 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-85mf8\"" Jun 02 14:37:10.811989 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:10.811948 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-jrbf8"] Jun 02 14:37:10.939262 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:10.939223 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/bee09843-37f7-49ed-a562-aeeecbc79513-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-jrbf8\" (UID: \"bee09843-37f7-49ed-a562-aeeecbc79513\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jrbf8" Jun 02 14:37:10.939435 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:10.939277 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bee09843-37f7-49ed-a562-aeeecbc79513-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-jrbf8\" (UID: \"bee09843-37f7-49ed-a562-aeeecbc79513\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jrbf8" Jun 02 14:37:10.939435 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:10.939339 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z89bh\" (UniqueName: \"kubernetes.io/projected/bee09843-37f7-49ed-a562-aeeecbc79513-kube-api-access-z89bh\") pod \"prometheus-operator-658bcd8bdf-jrbf8\" (UID: \"bee09843-37f7-49ed-a562-aeeecbc79513\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jrbf8" Jun 02 14:37:10.939435 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:10.939417 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bee09843-37f7-49ed-a562-aeeecbc79513-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-jrbf8\" (UID: \"bee09843-37f7-49ed-a562-aeeecbc79513\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jrbf8" Jun 02 14:37:11.040179 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:11.040076 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bee09843-37f7-49ed-a562-aeeecbc79513-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-jrbf8\" (UID: \"bee09843-37f7-49ed-a562-aeeecbc79513\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jrbf8" Jun 02 14:37:11.040179 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:11.040121 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/bee09843-37f7-49ed-a562-aeeecbc79513-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-jrbf8\" (UID: \"bee09843-37f7-49ed-a562-aeeecbc79513\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jrbf8" Jun 02 14:37:11.040179 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:11.040173 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bee09843-37f7-49ed-a562-aeeecbc79513-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-jrbf8\" (UID: \"bee09843-37f7-49ed-a562-aeeecbc79513\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jrbf8" Jun 02 14:37:11.040465 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:11.040217 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z89bh\" (UniqueName: \"kubernetes.io/projected/bee09843-37f7-49ed-a562-aeeecbc79513-kube-api-access-z89bh\") pod \"prometheus-operator-658bcd8bdf-jrbf8\" (UID: \"bee09843-37f7-49ed-a562-aeeecbc79513\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jrbf8" Jun 02 14:37:11.040465 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:37:11.040304 2566 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 02 14:37:11.040465 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:37:11.040382 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bee09843-37f7-49ed-a562-aeeecbc79513-prometheus-operator-tls podName:bee09843-37f7-49ed-a562-aeeecbc79513 nodeName:}" failed. No retries permitted until 2026-06-02 14:37:11.540361168 +0000 UTC m=+49.044697613 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/bee09843-37f7-49ed-a562-aeeecbc79513-prometheus-operator-tls") pod "prometheus-operator-658bcd8bdf-jrbf8" (UID: "bee09843-37f7-49ed-a562-aeeecbc79513") : secret "prometheus-operator-tls" not found Jun 02 14:37:11.041049 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:11.041023 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bee09843-37f7-49ed-a562-aeeecbc79513-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-jrbf8\" (UID: \"bee09843-37f7-49ed-a562-aeeecbc79513\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jrbf8" Jun 02 14:37:11.044272 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:11.044247 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bee09843-37f7-49ed-a562-aeeecbc79513-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-jrbf8\" (UID: \"bee09843-37f7-49ed-a562-aeeecbc79513\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jrbf8" Jun 02 14:37:11.049262 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:11.049243 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z89bh\" (UniqueName: \"kubernetes.io/projected/bee09843-37f7-49ed-a562-aeeecbc79513-kube-api-access-z89bh\") pod \"prometheus-operator-658bcd8bdf-jrbf8\" (UID: \"bee09843-37f7-49ed-a562-aeeecbc79513\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jrbf8" Jun 02 14:37:11.292074 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:11.291973 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-znvcz" event={"ID":"8bfd843d-d883-4e3a-a984-1d15495e05bc","Type":"ContainerStarted","Data":"a252e7e675ce713cb1b818f5037287362d95c3400d348dd817033f61be816d32"} Jun 02 14:37:11.293522 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:11.293495 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z9f8p" event={"ID":"c844ed44-4523-49b9-9826-8fd7ef6c5819","Type":"ContainerStarted","Data":"bd918028c573c3e95e395af3905dbff140d66f6b326f7289aab71846d3b5a971"} Jun 02 14:37:11.311819 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:11.311763 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-znvcz" podStartSLOduration=1.355278536 podStartE2EDuration="3.311744332s" podCreationTimestamp="2026-06-02 14:37:08 +0000 UTC" firstStartedPulling="2026-06-02 14:37:08.815170133 +0000 UTC m=+46.319506562" lastFinishedPulling="2026-06-02 14:37:10.771635915 +0000 UTC m=+48.275972358" observedRunningTime="2026-06-02 14:37:11.310602422 +0000 UTC m=+48.814938875" watchObservedRunningTime="2026-06-02 14:37:11.311744332 +0000 UTC m=+48.816080778" Jun 02 14:37:11.544975 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:11.544744 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/bee09843-37f7-49ed-a562-aeeecbc79513-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-jrbf8\" (UID: \"bee09843-37f7-49ed-a562-aeeecbc79513\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jrbf8" Jun 02 14:37:11.547873 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:11.547849 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/bee09843-37f7-49ed-a562-aeeecbc79513-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-jrbf8\" (UID: \"bee09843-37f7-49ed-a562-aeeecbc79513\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jrbf8" Jun 02 14:37:11.717706 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:11.717651 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jrbf8" Jun 02 14:37:11.850839 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:11.850807 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-jrbf8"] Jun 02 14:37:11.854807 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:37:11.854781 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbee09843_37f7_49ed_a562_aeeecbc79513.slice/crio-f26f17989ed14a94f0e08a8385b8bd9d692fc46d72426ffa160906ce74f21c72 WatchSource:0}: Error finding container f26f17989ed14a94f0e08a8385b8bd9d692fc46d72426ffa160906ce74f21c72: Status 404 returned error can't find the container with id f26f17989ed14a94f0e08a8385b8bd9d692fc46d72426ffa160906ce74f21c72 Jun 02 14:37:12.298719 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:12.298682 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5l59w" event={"ID":"8589f6af-377d-4dbb-9560-88edeb2d8fde","Type":"ContainerStarted","Data":"0de45ebbe04ef3eabf7563764e861122207c58d643f60086a248ed918df92e4b"} Jun 02 14:37:12.300197 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:12.300169 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z9f8p" event={"ID":"c844ed44-4523-49b9-9826-8fd7ef6c5819","Type":"ContainerStarted","Data":"7d139bedbf84761b1d03ed552c63de5d9798d1b552d1620301c103a9dec490f8"} Jun 02 14:37:12.300318 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:12.300288 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-z9f8p" Jun 02 14:37:12.301074 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:12.301057 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jrbf8" event={"ID":"bee09843-37f7-49ed-a562-aeeecbc79513","Type":"ContainerStarted","Data":"f26f17989ed14a94f0e08a8385b8bd9d692fc46d72426ffa160906ce74f21c72"} Jun 02 14:37:12.318838 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:12.318794 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5l59w" podStartSLOduration=1.806193383 podStartE2EDuration="4.318781327s" podCreationTimestamp="2026-06-02 14:37:08 +0000 UTC" firstStartedPulling="2026-06-02 14:37:08.907014594 +0000 UTC m=+46.411351023" lastFinishedPulling="2026-06-02 14:37:11.419602532 +0000 UTC m=+48.923938967" observedRunningTime="2026-06-02 14:37:12.317440395 +0000 UTC m=+49.821776844" watchObservedRunningTime="2026-06-02 14:37:12.318781327 +0000 UTC m=+49.823117778" Jun 02 14:37:12.335534 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:12.335489 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-z9f8p" podStartSLOduration=2.383814713 podStartE2EDuration="4.335475531s" podCreationTimestamp="2026-06-02 14:37:08 +0000 UTC" firstStartedPulling="2026-06-02 14:37:08.815498044 +0000 UTC m=+46.319834473" lastFinishedPulling="2026-06-02 14:37:10.767158848 +0000 UTC m=+48.271495291" observedRunningTime="2026-06-02 14:37:12.334861373 +0000 UTC m=+49.839197824" watchObservedRunningTime="2026-06-02 14:37:12.335475531 +0000 UTC m=+49.839811982" Jun 02 14:37:13.100562 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:13.100527 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-69d4b46f44-xmfgw"] Jun 02 14:37:13.105848 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:13.105822 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69d4b46f44-xmfgw" Jun 02 14:37:13.108712 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:13.108669 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 02 14:37:13.108925 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:13.108910 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vz4zh\"" Jun 02 14:37:13.109892 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:13.109766 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 02 14:37:13.110033 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:13.110017 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 02 14:37:13.110214 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:13.110192 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 02 14:37:13.110299 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:13.110223 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 02 14:37:13.110299 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:13.110269 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 02 14:37:13.111087 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:13.111070 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 02 14:37:13.118284 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:13.118259 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69d4b46f44-xmfgw"] Jun 02 14:37:13.119938 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:13.119883 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 02 14:37:13.257875 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:13.257827 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00bab28d-d053-4fc2-bae7-a972cd91190e-trusted-ca-bundle\") pod \"console-69d4b46f44-xmfgw\" (UID: \"00bab28d-d053-4fc2-bae7-a972cd91190e\") " pod="openshift-console/console-69d4b46f44-xmfgw" Jun 02 14:37:13.258057 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:13.257910 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00bab28d-d053-4fc2-bae7-a972cd91190e-console-config\") pod \"console-69d4b46f44-xmfgw\" (UID: \"00bab28d-d053-4fc2-bae7-a972cd91190e\") " pod="openshift-console/console-69d4b46f44-xmfgw" Jun 02 14:37:13.258057 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:13.257930 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtcdj\" (UniqueName: \"kubernetes.io/projected/00bab28d-d053-4fc2-bae7-a972cd91190e-kube-api-access-jtcdj\") pod \"console-69d4b46f44-xmfgw\" (UID: \"00bab28d-d053-4fc2-bae7-a972cd91190e\") " pod="openshift-console/console-69d4b46f44-xmfgw" Jun 02 14:37:13.258219 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:13.258048 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00bab28d-d053-4fc2-bae7-a972cd91190e-console-serving-cert\") pod \"console-69d4b46f44-xmfgw\" (UID: \"00bab28d-d053-4fc2-bae7-a972cd91190e\") " pod="openshift-console/console-69d4b46f44-xmfgw" Jun 02 14:37:13.258219 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:13.258089 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00bab28d-d053-4fc2-bae7-a972cd91190e-service-ca\") pod \"console-69d4b46f44-xmfgw\" (UID: \"00bab28d-d053-4fc2-bae7-a972cd91190e\") " pod="openshift-console/console-69d4b46f44-xmfgw" Jun 02 14:37:13.258219 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:13.258119 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00bab28d-d053-4fc2-bae7-a972cd91190e-oauth-serving-cert\") pod \"console-69d4b46f44-xmfgw\" (UID: \"00bab28d-d053-4fc2-bae7-a972cd91190e\") " pod="openshift-console/console-69d4b46f44-xmfgw" Jun 02 14:37:13.258219 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:13.258199 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00bab28d-d053-4fc2-bae7-a972cd91190e-console-oauth-config\") pod \"console-69d4b46f44-xmfgw\" (UID: \"00bab28d-d053-4fc2-bae7-a972cd91190e\") " pod="openshift-console/console-69d4b46f44-xmfgw" Jun 02 14:37:13.358975 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:13.358896 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00bab28d-d053-4fc2-bae7-a972cd91190e-console-config\") pod \"console-69d4b46f44-xmfgw\" (UID: \"00bab28d-d053-4fc2-bae7-a972cd91190e\") " pod="openshift-console/console-69d4b46f44-xmfgw" Jun 02 14:37:13.358975 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:13.358935 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jtcdj\" (UniqueName: \"kubernetes.io/projected/00bab28d-d053-4fc2-bae7-a972cd91190e-kube-api-access-jtcdj\") pod \"console-69d4b46f44-xmfgw\" (UID: \"00bab28d-d053-4fc2-bae7-a972cd91190e\") " pod="openshift-console/console-69d4b46f44-xmfgw" Jun 02 14:37:13.359510 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:13.358985 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00bab28d-d053-4fc2-bae7-a972cd91190e-console-serving-cert\") pod \"console-69d4b46f44-xmfgw\" (UID: \"00bab28d-d053-4fc2-bae7-a972cd91190e\") " pod="openshift-console/console-69d4b46f44-xmfgw" Jun 02 14:37:13.359510 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:13.359012 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00bab28d-d053-4fc2-bae7-a972cd91190e-service-ca\") pod \"console-69d4b46f44-xmfgw\" (UID: \"00bab28d-d053-4fc2-bae7-a972cd91190e\") " pod="openshift-console/console-69d4b46f44-xmfgw" Jun 02 14:37:13.359510 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:13.359035 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00bab28d-d053-4fc2-bae7-a972cd91190e-oauth-serving-cert\") pod \"console-69d4b46f44-xmfgw\" (UID: \"00bab28d-d053-4fc2-bae7-a972cd91190e\") " pod="openshift-console/console-69d4b46f44-xmfgw" Jun 02 14:37:13.359510 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:13.359196 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00bab28d-d053-4fc2-bae7-a972cd91190e-console-oauth-config\") pod \"console-69d4b46f44-xmfgw\" (UID: \"00bab28d-d053-4fc2-bae7-a972cd91190e\") " pod="openshift-console/console-69d4b46f44-xmfgw" Jun 02 14:37:13.359510 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:13.359267 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00bab28d-d053-4fc2-bae7-a972cd91190e-trusted-ca-bundle\") pod \"console-69d4b46f44-xmfgw\" (UID: \"00bab28d-d053-4fc2-bae7-a972cd91190e\") " pod="openshift-console/console-69d4b46f44-xmfgw" Jun 02 14:37:13.359786 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:13.359761 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00bab28d-d053-4fc2-bae7-a972cd91190e-console-config\") pod \"console-69d4b46f44-xmfgw\" (UID: \"00bab28d-d053-4fc2-bae7-a972cd91190e\") " pod="openshift-console/console-69d4b46f44-xmfgw" Jun 02 14:37:13.359846 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:13.359761 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00bab28d-d053-4fc2-bae7-a972cd91190e-oauth-serving-cert\") pod \"console-69d4b46f44-xmfgw\" (UID: \"00bab28d-d053-4fc2-bae7-a972cd91190e\") " pod="openshift-console/console-69d4b46f44-xmfgw" Jun 02 14:37:13.359846 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:13.359766 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00bab28d-d053-4fc2-bae7-a972cd91190e-service-ca\") pod \"console-69d4b46f44-xmfgw\" (UID: \"00bab28d-d053-4fc2-bae7-a972cd91190e\") " pod="openshift-console/console-69d4b46f44-xmfgw" Jun 02 14:37:13.360450 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:13.360429 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00bab28d-d053-4fc2-bae7-a972cd91190e-trusted-ca-bundle\") pod \"console-69d4b46f44-xmfgw\" (UID: \"00bab28d-d053-4fc2-bae7-a972cd91190e\") " pod="openshift-console/console-69d4b46f44-xmfgw" Jun 02 14:37:13.362614 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:13.362595 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00bab28d-d053-4fc2-bae7-a972cd91190e-console-serving-cert\") pod \"console-69d4b46f44-xmfgw\" (UID: \"00bab28d-d053-4fc2-bae7-a972cd91190e\") " pod="openshift-console/console-69d4b46f44-xmfgw" Jun 02 14:37:13.362674 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:13.362615 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00bab28d-d053-4fc2-bae7-a972cd91190e-console-oauth-config\") pod \"console-69d4b46f44-xmfgw\" (UID: \"00bab28d-d053-4fc2-bae7-a972cd91190e\") " pod="openshift-console/console-69d4b46f44-xmfgw" Jun 02 14:37:13.368098 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:13.368081 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtcdj\" (UniqueName: \"kubernetes.io/projected/00bab28d-d053-4fc2-bae7-a972cd91190e-kube-api-access-jtcdj\") pod \"console-69d4b46f44-xmfgw\" (UID: \"00bab28d-d053-4fc2-bae7-a972cd91190e\") " pod="openshift-console/console-69d4b46f44-xmfgw" Jun 02 14:37:13.423286 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:13.423256 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69d4b46f44-xmfgw" Jun 02 14:37:13.576551 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:13.576524 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69d4b46f44-xmfgw"] Jun 02 14:37:13.579775 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:37:13.579749 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00bab28d_d053_4fc2_bae7_a972cd91190e.slice/crio-a652d6ce73f8afee91a3748c80c5df37167987ec04f97c305e40fa232e914ab3 WatchSource:0}: Error finding container a652d6ce73f8afee91a3748c80c5df37167987ec04f97c305e40fa232e914ab3: Status 404 returned error can't find the container with id a652d6ce73f8afee91a3748c80c5df37167987ec04f97c305e40fa232e914ab3 Jun 02 14:37:14.308603 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:14.308558 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jrbf8" event={"ID":"bee09843-37f7-49ed-a562-aeeecbc79513","Type":"ContainerStarted","Data":"343ad583d22dde73a1fadb7d71deccba7ade39e3459c2429bffb67fa652e7d06"} Jun 02 14:37:14.308603 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:14.308607 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jrbf8" event={"ID":"bee09843-37f7-49ed-a562-aeeecbc79513","Type":"ContainerStarted","Data":"59a9312a629e6ad9e417a3dd24ed4be89e12d7d3f08cffa151e778b4417b88f5"} Jun 02 14:37:14.309966 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:14.309943 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69d4b46f44-xmfgw" event={"ID":"00bab28d-d053-4fc2-bae7-a972cd91190e","Type":"ContainerStarted","Data":"a652d6ce73f8afee91a3748c80c5df37167987ec04f97c305e40fa232e914ab3"} Jun 02 14:37:14.326671 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:14.326617 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-jrbf8" podStartSLOduration=2.732577008 podStartE2EDuration="4.326603296s" podCreationTimestamp="2026-06-02 14:37:10 +0000 UTC" firstStartedPulling="2026-06-02 14:37:11.857053541 +0000 UTC m=+49.361389970" lastFinishedPulling="2026-06-02 14:37:13.451079815 +0000 UTC m=+50.955416258" observedRunningTime="2026-06-02 14:37:14.325199076 +0000 UTC m=+51.829535529" watchObservedRunningTime="2026-06-02 14:37:14.326603296 +0000 UTC m=+51.830939746" Jun 02 14:37:16.256974 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.256938 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-dbtw9"] Jun 02 14:37:16.274415 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.274385 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-rkcxt"] Jun 02 14:37:16.274554 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.274505 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-dbtw9" Jun 02 14:37:16.277823 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.277798 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 02 14:37:16.277933 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.277841 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-spvsm\"" Jun 02 14:37:16.278003 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.277986 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 02 14:37:16.287726 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.287704 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-dbtw9"] Jun 02 14:37:16.287830 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.287820 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-rkcxt" Jun 02 14:37:16.290943 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.290903 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wp2wj"] Jun 02 14:37:16.291481 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.291462 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-nr5xf\"" Jun 02 14:37:16.292480 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.292462 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 02 14:37:16.292567 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.292462 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 02 14:37:16.292567 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.292493 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 02 14:37:16.320945 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.320923 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-rkcxt"] Jun 02 14:37:16.321101 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.321039 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wp2wj" Jun 02 14:37:16.323485 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.323457 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 02 14:37:16.323604 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.323519 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-x8bpz\"" Jun 02 14:37:16.323679 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.323662 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 02 14:37:16.324083 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.324068 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 02 14:37:16.380906 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.380873 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/236dbe76-0a9a-44cc-a5a8-f462907ad75d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-dbtw9\" (UID: \"236dbe76-0a9a-44cc-a5a8-f462907ad75d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-dbtw9" Jun 02 14:37:16.381093 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.380915 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/236dbe76-0a9a-44cc-a5a8-f462907ad75d-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-dbtw9\" (UID: \"236dbe76-0a9a-44cc-a5a8-f462907ad75d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-dbtw9" Jun 02 14:37:16.381093 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.380937 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/236dbe76-0a9a-44cc-a5a8-f462907ad75d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-dbtw9\" (UID: \"236dbe76-0a9a-44cc-a5a8-f462907ad75d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-dbtw9" Jun 02 14:37:16.381093 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.381072 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2khml\" (UniqueName: \"kubernetes.io/projected/236dbe76-0a9a-44cc-a5a8-f462907ad75d-kube-api-access-2khml\") pod \"openshift-state-metrics-85658796db-dbtw9\" (UID: \"236dbe76-0a9a-44cc-a5a8-f462907ad75d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-dbtw9" Jun 02 14:37:16.482201 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.482171 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dc7e162a-2c52-470f-a3e8-cc1c911826c7-node-exporter-tls\") pod \"node-exporter-wp2wj\" (UID: \"dc7e162a-2c52-470f-a3e8-cc1c911826c7\") " pod="openshift-monitoring/node-exporter-wp2wj" Jun 02 14:37:16.482201 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.482208 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dc7e162a-2c52-470f-a3e8-cc1c911826c7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wp2wj\" (UID: \"dc7e162a-2c52-470f-a3e8-cc1c911826c7\") " pod="openshift-monitoring/node-exporter-wp2wj" Jun 02 14:37:16.482407 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.482239 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ed1f5bf3-f372-4994-91dc-b31c14958ff4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-rkcxt\" (UID: \"ed1f5bf3-f372-4994-91dc-b31c14958ff4\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-rkcxt" Jun 02 14:37:16.482407 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.482266 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dc7e162a-2c52-470f-a3e8-cc1c911826c7-node-exporter-accelerators-collector-config\") pod \"node-exporter-wp2wj\" (UID: \"dc7e162a-2c52-470f-a3e8-cc1c911826c7\") " pod="openshift-monitoring/node-exporter-wp2wj" Jun 02 14:37:16.482407 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.482289 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/236dbe76-0a9a-44cc-a5a8-f462907ad75d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-dbtw9\" (UID: \"236dbe76-0a9a-44cc-a5a8-f462907ad75d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-dbtw9" Jun 02 14:37:16.482407 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.482308 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ed1f5bf3-f372-4994-91dc-b31c14958ff4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-rkcxt\" (UID: \"ed1f5bf3-f372-4994-91dc-b31c14958ff4\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-rkcxt" Jun 02 14:37:16.482407 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.482382 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zpgl\" (UniqueName: \"kubernetes.io/projected/ed1f5bf3-f372-4994-91dc-b31c14958ff4-kube-api-access-6zpgl\") pod \"kube-state-metrics-8469c486bb-rkcxt\" (UID: \"ed1f5bf3-f372-4994-91dc-b31c14958ff4\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-rkcxt" Jun 02 14:37:16.482407 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.482405 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/236dbe76-0a9a-44cc-a5a8-f462907ad75d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-dbtw9\" (UID: \"236dbe76-0a9a-44cc-a5a8-f462907ad75d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-dbtw9" Jun 02 14:37:16.482611 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:37:16.482419 2566 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 02 14:37:16.482611 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.482430 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed1f5bf3-f372-4994-91dc-b31c14958ff4-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-rkcxt\" (UID: \"ed1f5bf3-f372-4994-91dc-b31c14958ff4\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-rkcxt" Jun 02 14:37:16.482611 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.482449 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dc7e162a-2c52-470f-a3e8-cc1c911826c7-node-exporter-wtmp\") pod \"node-exporter-wp2wj\" (UID: \"dc7e162a-2c52-470f-a3e8-cc1c911826c7\") " pod="openshift-monitoring/node-exporter-wp2wj" Jun 02 14:37:16.482611 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:37:16.482477 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/236dbe76-0a9a-44cc-a5a8-f462907ad75d-openshift-state-metrics-tls podName:236dbe76-0a9a-44cc-a5a8-f462907ad75d nodeName:}" failed. No retries permitted until 2026-06-02 14:37:16.982460467 +0000 UTC m=+54.486796897 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/236dbe76-0a9a-44cc-a5a8-f462907ad75d-openshift-state-metrics-tls") pod "openshift-state-metrics-85658796db-dbtw9" (UID: "236dbe76-0a9a-44cc-a5a8-f462907ad75d") : secret "openshift-state-metrics-tls" not found Jun 02 14:37:16.482611 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.482522 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed1f5bf3-f372-4994-91dc-b31c14958ff4-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-rkcxt\" (UID: \"ed1f5bf3-f372-4994-91dc-b31c14958ff4\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-rkcxt" Jun 02 14:37:16.482611 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.482559 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dc7e162a-2c52-470f-a3e8-cc1c911826c7-root\") pod \"node-exporter-wp2wj\" (UID: \"dc7e162a-2c52-470f-a3e8-cc1c911826c7\") " pod="openshift-monitoring/node-exporter-wp2wj" Jun 02 14:37:16.482611 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.482581 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc7e162a-2c52-470f-a3e8-cc1c911826c7-sys\") pod \"node-exporter-wp2wj\" (UID: \"dc7e162a-2c52-470f-a3e8-cc1c911826c7\") " pod="openshift-monitoring/node-exporter-wp2wj" Jun 02 14:37:16.482832 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.482617 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dc7e162a-2c52-470f-a3e8-cc1c911826c7-node-exporter-textfile\") pod \"node-exporter-wp2wj\" (UID: \"dc7e162a-2c52-470f-a3e8-cc1c911826c7\") " pod="openshift-monitoring/node-exporter-wp2wj" Jun 02 14:37:16.482832 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.482641 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc7e162a-2c52-470f-a3e8-cc1c911826c7-metrics-client-ca\") pod \"node-exporter-wp2wj\" (UID: \"dc7e162a-2c52-470f-a3e8-cc1c911826c7\") " pod="openshift-monitoring/node-exporter-wp2wj" Jun 02 14:37:16.482832 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.482665 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2khml\" (UniqueName: \"kubernetes.io/projected/236dbe76-0a9a-44cc-a5a8-f462907ad75d-kube-api-access-2khml\") pod \"openshift-state-metrics-85658796db-dbtw9\" (UID: \"236dbe76-0a9a-44cc-a5a8-f462907ad75d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-dbtw9" Jun 02 14:37:16.482832 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.482684 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ed1f5bf3-f372-4994-91dc-b31c14958ff4-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-rkcxt\" (UID: \"ed1f5bf3-f372-4994-91dc-b31c14958ff4\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-rkcxt" Jun 02 14:37:16.482832 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.482727 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/236dbe76-0a9a-44cc-a5a8-f462907ad75d-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-dbtw9\" (UID: \"236dbe76-0a9a-44cc-a5a8-f462907ad75d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-dbtw9" Jun 02 14:37:16.482994 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.482833 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqdfm\" (UniqueName: \"kubernetes.io/projected/dc7e162a-2c52-470f-a3e8-cc1c911826c7-kube-api-access-pqdfm\") pod \"node-exporter-wp2wj\" (UID: \"dc7e162a-2c52-470f-a3e8-cc1c911826c7\") " pod="openshift-monitoring/node-exporter-wp2wj" Jun 02 14:37:16.483324 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.483306 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/236dbe76-0a9a-44cc-a5a8-f462907ad75d-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-dbtw9\" (UID: \"236dbe76-0a9a-44cc-a5a8-f462907ad75d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-dbtw9" Jun 02 14:37:16.485423 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.485396 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/236dbe76-0a9a-44cc-a5a8-f462907ad75d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-dbtw9\" (UID: \"236dbe76-0a9a-44cc-a5a8-f462907ad75d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-dbtw9" Jun 02 14:37:16.491404 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.491385 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2khml\" (UniqueName: \"kubernetes.io/projected/236dbe76-0a9a-44cc-a5a8-f462907ad75d-kube-api-access-2khml\") pod \"openshift-state-metrics-85658796db-dbtw9\" (UID: \"236dbe76-0a9a-44cc-a5a8-f462907ad75d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-dbtw9" Jun 02 14:37:16.584101 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.583894 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6zpgl\" (UniqueName: \"kubernetes.io/projected/ed1f5bf3-f372-4994-91dc-b31c14958ff4-kube-api-access-6zpgl\") pod \"kube-state-metrics-8469c486bb-rkcxt\" (UID: \"ed1f5bf3-f372-4994-91dc-b31c14958ff4\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-rkcxt" Jun 02 14:37:16.584227 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.584158 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed1f5bf3-f372-4994-91dc-b31c14958ff4-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-rkcxt\" (UID: \"ed1f5bf3-f372-4994-91dc-b31c14958ff4\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-rkcxt" Jun 02 14:37:16.584227 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.584201 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dc7e162a-2c52-470f-a3e8-cc1c911826c7-node-exporter-wtmp\") pod \"node-exporter-wp2wj\" (UID: \"dc7e162a-2c52-470f-a3e8-cc1c911826c7\") " pod="openshift-monitoring/node-exporter-wp2wj" Jun 02 14:37:16.584323 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.584235 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed1f5bf3-f372-4994-91dc-b31c14958ff4-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-rkcxt\" (UID: \"ed1f5bf3-f372-4994-91dc-b31c14958ff4\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-rkcxt" Jun 02 14:37:16.584323 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.584268 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dc7e162a-2c52-470f-a3e8-cc1c911826c7-root\") pod \"node-exporter-wp2wj\" (UID: \"dc7e162a-2c52-470f-a3e8-cc1c911826c7\") " pod="openshift-monitoring/node-exporter-wp2wj" Jun 02 14:37:16.584323 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.584294 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc7e162a-2c52-470f-a3e8-cc1c911826c7-sys\") pod \"node-exporter-wp2wj\" (UID: \"dc7e162a-2c52-470f-a3e8-cc1c911826c7\") " pod="openshift-monitoring/node-exporter-wp2wj" Jun 02 14:37:16.584323 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.584320 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dc7e162a-2c52-470f-a3e8-cc1c911826c7-node-exporter-textfile\") pod \"node-exporter-wp2wj\" (UID: \"dc7e162a-2c52-470f-a3e8-cc1c911826c7\") " pod="openshift-monitoring/node-exporter-wp2wj" Jun 02 14:37:16.584500 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.584345 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc7e162a-2c52-470f-a3e8-cc1c911826c7-metrics-client-ca\") pod \"node-exporter-wp2wj\" (UID: \"dc7e162a-2c52-470f-a3e8-cc1c911826c7\") " pod="openshift-monitoring/node-exporter-wp2wj" Jun 02 14:37:16.584500 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.584372 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ed1f5bf3-f372-4994-91dc-b31c14958ff4-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-rkcxt\" (UID: \"ed1f5bf3-f372-4994-91dc-b31c14958ff4\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-rkcxt" Jun 02 14:37:16.584500 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.584370 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dc7e162a-2c52-470f-a3e8-cc1c911826c7-node-exporter-wtmp\") pod \"node-exporter-wp2wj\" (UID: \"dc7e162a-2c52-470f-a3e8-cc1c911826c7\") " pod="openshift-monitoring/node-exporter-wp2wj" Jun 02 14:37:16.584500 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.584397 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc7e162a-2c52-470f-a3e8-cc1c911826c7-sys\") pod \"node-exporter-wp2wj\" (UID: \"dc7e162a-2c52-470f-a3e8-cc1c911826c7\") " pod="openshift-monitoring/node-exporter-wp2wj" Jun 02 14:37:16.584500 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.584434 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pqdfm\" (UniqueName: \"kubernetes.io/projected/dc7e162a-2c52-470f-a3e8-cc1c911826c7-kube-api-access-pqdfm\") pod \"node-exporter-wp2wj\" (UID: \"dc7e162a-2c52-470f-a3e8-cc1c911826c7\") " pod="openshift-monitoring/node-exporter-wp2wj" Jun 02 14:37:16.584500 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.584442 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dc7e162a-2c52-470f-a3e8-cc1c911826c7-root\") pod \"node-exporter-wp2wj\" (UID: \"dc7e162a-2c52-470f-a3e8-cc1c911826c7\") " pod="openshift-monitoring/node-exporter-wp2wj" Jun 02 14:37:16.584500 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.584489 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dc7e162a-2c52-470f-a3e8-cc1c911826c7-node-exporter-tls\") pod \"node-exporter-wp2wj\" (UID: \"dc7e162a-2c52-470f-a3e8-cc1c911826c7\") " pod="openshift-monitoring/node-exporter-wp2wj" Jun 02 14:37:16.584813 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.584537 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dc7e162a-2c52-470f-a3e8-cc1c911826c7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wp2wj\" (UID: \"dc7e162a-2c52-470f-a3e8-cc1c911826c7\") " pod="openshift-monitoring/node-exporter-wp2wj" Jun 02 14:37:16.584813 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.584571 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ed1f5bf3-f372-4994-91dc-b31c14958ff4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-rkcxt\" (UID: \"ed1f5bf3-f372-4994-91dc-b31c14958ff4\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-rkcxt" Jun 02 14:37:16.584813 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.584599 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dc7e162a-2c52-470f-a3e8-cc1c911826c7-node-exporter-accelerators-collector-config\") pod \"node-exporter-wp2wj\" (UID: \"dc7e162a-2c52-470f-a3e8-cc1c911826c7\") " pod="openshift-monitoring/node-exporter-wp2wj" Jun 02 14:37:16.584813 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.584643 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ed1f5bf3-f372-4994-91dc-b31c14958ff4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-rkcxt\" (UID: \"ed1f5bf3-f372-4994-91dc-b31c14958ff4\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-rkcxt" Jun 02 14:37:16.584998 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.584886 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed1f5bf3-f372-4994-91dc-b31c14958ff4-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-rkcxt\" (UID: \"ed1f5bf3-f372-4994-91dc-b31c14958ff4\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-rkcxt" Jun 02 14:37:16.585274 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.585222 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dc7e162a-2c52-470f-a3e8-cc1c911826c7-node-exporter-textfile\") pod \"node-exporter-wp2wj\" (UID: \"dc7e162a-2c52-470f-a3e8-cc1c911826c7\") " pod="openshift-monitoring/node-exporter-wp2wj" Jun 02 14:37:16.585376 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.585317 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ed1f5bf3-f372-4994-91dc-b31c14958ff4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-rkcxt\" (UID: \"ed1f5bf3-f372-4994-91dc-b31c14958ff4\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-rkcxt" Jun 02 14:37:16.585462 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.585417 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ed1f5bf3-f372-4994-91dc-b31c14958ff4-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-rkcxt\" (UID: \"ed1f5bf3-f372-4994-91dc-b31c14958ff4\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-rkcxt" Jun 02 14:37:16.585784 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.585741 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc7e162a-2c52-470f-a3e8-cc1c911826c7-metrics-client-ca\") pod \"node-exporter-wp2wj\" (UID: \"dc7e162a-2c52-470f-a3e8-cc1c911826c7\") " pod="openshift-monitoring/node-exporter-wp2wj" Jun 02 14:37:16.585983 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.585948 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dc7e162a-2c52-470f-a3e8-cc1c911826c7-node-exporter-accelerators-collector-config\") pod \"node-exporter-wp2wj\" (UID: \"dc7e162a-2c52-470f-a3e8-cc1c911826c7\") " pod="openshift-monitoring/node-exporter-wp2wj" Jun 02 14:37:16.587213 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.587187 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed1f5bf3-f372-4994-91dc-b31c14958ff4-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-rkcxt\" (UID: \"ed1f5bf3-f372-4994-91dc-b31c14958ff4\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-rkcxt" Jun 02 14:37:16.587561 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.587542 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dc7e162a-2c52-470f-a3e8-cc1c911826c7-node-exporter-tls\") pod \"node-exporter-wp2wj\" (UID: \"dc7e162a-2c52-470f-a3e8-cc1c911826c7\") " pod="openshift-monitoring/node-exporter-wp2wj" Jun 02 14:37:16.588015 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.587995 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ed1f5bf3-f372-4994-91dc-b31c14958ff4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-rkcxt\" (UID: \"ed1f5bf3-f372-4994-91dc-b31c14958ff4\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-rkcxt" Jun 02 14:37:16.588165 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.588124 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dc7e162a-2c52-470f-a3e8-cc1c911826c7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wp2wj\" (UID: \"dc7e162a-2c52-470f-a3e8-cc1c911826c7\") " pod="openshift-monitoring/node-exporter-wp2wj" Jun 02 14:37:16.592798 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.592722 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqdfm\" (UniqueName: \"kubernetes.io/projected/dc7e162a-2c52-470f-a3e8-cc1c911826c7-kube-api-access-pqdfm\") pod \"node-exporter-wp2wj\" (UID: \"dc7e162a-2c52-470f-a3e8-cc1c911826c7\") " pod="openshift-monitoring/node-exporter-wp2wj" Jun 02 14:37:16.594477 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.594337 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zpgl\" (UniqueName: \"kubernetes.io/projected/ed1f5bf3-f372-4994-91dc-b31c14958ff4-kube-api-access-6zpgl\") pod \"kube-state-metrics-8469c486bb-rkcxt\" (UID: \"ed1f5bf3-f372-4994-91dc-b31c14958ff4\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-rkcxt" Jun 02 14:37:16.597985 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.597966 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-rkcxt" Jun 02 14:37:16.629098 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.629074 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wp2wj" Jun 02 14:37:16.732787 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.732757 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-rkcxt"] Jun 02 14:37:16.736256 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:37:16.736228 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded1f5bf3_f372_4994_91dc_b31c14958ff4.slice/crio-c2abafad722268ef385cab76ec5798a3667cb1f30d94cf1c9f4a952992c08d2b WatchSource:0}: Error finding container c2abafad722268ef385cab76ec5798a3667cb1f30d94cf1c9f4a952992c08d2b: Status 404 returned error can't find the container with id c2abafad722268ef385cab76ec5798a3667cb1f30d94cf1c9f4a952992c08d2b Jun 02 14:37:16.988566 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.988531 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/236dbe76-0a9a-44cc-a5a8-f462907ad75d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-dbtw9\" (UID: \"236dbe76-0a9a-44cc-a5a8-f462907ad75d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-dbtw9" Jun 02 14:37:16.991905 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:16.991883 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/236dbe76-0a9a-44cc-a5a8-f462907ad75d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-dbtw9\" (UID: \"236dbe76-0a9a-44cc-a5a8-f462907ad75d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-dbtw9" Jun 02 14:37:17.184481 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.184449 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-dbtw9" Jun 02 14:37:17.320323 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.320274 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69d4b46f44-xmfgw" event={"ID":"00bab28d-d053-4fc2-bae7-a972cd91190e","Type":"ContainerStarted","Data":"5de7f1a858a9d3e99c28bc905a9cf020a46dcc8139ae816acb97e2ff178ea392"} Jun 02 14:37:17.321596 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.321573 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-rkcxt" event={"ID":"ed1f5bf3-f372-4994-91dc-b31c14958ff4","Type":"ContainerStarted","Data":"c2abafad722268ef385cab76ec5798a3667cb1f30d94cf1c9f4a952992c08d2b"} Jun 02 14:37:17.322597 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.322579 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wp2wj" event={"ID":"dc7e162a-2c52-470f-a3e8-cc1c911826c7","Type":"ContainerStarted","Data":"2ac10dc8554b6a55564ff85137d373a10c979c4be45123c4cf04ae750a12444a"} Jun 02 14:37:17.330107 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.330083 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-dbtw9"] Jun 02 14:37:17.346431 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.346385 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-69d4b46f44-xmfgw" podStartSLOduration=1.372833264 podStartE2EDuration="4.346372991s" podCreationTimestamp="2026-06-02 14:37:13 +0000 UTC" firstStartedPulling="2026-06-02 14:37:13.58194327 +0000 UTC m=+51.086279699" lastFinishedPulling="2026-06-02 14:37:16.555482983 +0000 UTC m=+54.059819426" observedRunningTime="2026-06-02 14:37:17.345292012 +0000 UTC m=+54.849628463" watchObservedRunningTime="2026-06-02 14:37:17.346372991 +0000 UTC m=+54.850709443" Jun 02 14:37:17.380376 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.380346 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 14:37:17.400837 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.400809 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 14:37:17.400992 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.400975 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:37:17.403667 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.403642 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 02 14:37:17.403832 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.403810 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 02 14:37:17.404085 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.404066 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 02 14:37:17.404279 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.404261 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 02 14:37:17.404820 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.404800 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 02 14:37:17.405044 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.405028 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 02 14:37:17.405266 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.405248 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 02 14:37:17.405572 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.405544 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 02 14:37:17.405788 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.405772 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 02 14:37:17.406264 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.406249 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-jzfhd\"" Jun 02 14:37:17.495409 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.495321 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/597a9f6c-3e8d-4af7-9923-d112775fbb58-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:37:17.495409 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.495362 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/597a9f6c-3e8d-4af7-9923-d112775fbb58-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:37:17.495409 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.495386 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/597a9f6c-3e8d-4af7-9923-d112775fbb58-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:37:17.495409 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.495407 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/597a9f6c-3e8d-4af7-9923-d112775fbb58-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:37:17.495673 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.495434 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/597a9f6c-3e8d-4af7-9923-d112775fbb58-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:37:17.495673 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.495462 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/597a9f6c-3e8d-4af7-9923-d112775fbb58-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:37:17.495673 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.495513 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/597a9f6c-3e8d-4af7-9923-d112775fbb58-config-volume\") pod \"alertmanager-main-0\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:37:17.495673 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.495528 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc772\" (UniqueName: \"kubernetes.io/projected/597a9f6c-3e8d-4af7-9923-d112775fbb58-kube-api-access-vc772\") pod \"alertmanager-main-0\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:37:17.495673 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.495547 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/597a9f6c-3e8d-4af7-9923-d112775fbb58-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:37:17.495673 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.495564 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/597a9f6c-3e8d-4af7-9923-d112775fbb58-tls-assets\") pod \"alertmanager-main-0\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:37:17.495673 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.495588 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/597a9f6c-3e8d-4af7-9923-d112775fbb58-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:37:17.495673 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.495617 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/597a9f6c-3e8d-4af7-9923-d112775fbb58-config-out\") pod \"alertmanager-main-0\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:37:17.495673 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.495632 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/597a9f6c-3e8d-4af7-9923-d112775fbb58-web-config\") pod \"alertmanager-main-0\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:37:17.597011 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.596973 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/597a9f6c-3e8d-4af7-9923-d112775fbb58-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:37:17.597011 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.597010 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/597a9f6c-3e8d-4af7-9923-d112775fbb58-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:37:17.597359 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.597040 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/597a9f6c-3e8d-4af7-9923-d112775fbb58-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:37:17.597359 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.597069 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/597a9f6c-3e8d-4af7-9923-d112775fbb58-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:37:17.597359 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.597096 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/597a9f6c-3e8d-4af7-9923-d112775fbb58-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:37:17.597359 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.597159 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/597a9f6c-3e8d-4af7-9923-d112775fbb58-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:37:17.597359 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.597210 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/597a9f6c-3e8d-4af7-9923-d112775fbb58-config-volume\") pod \"alertmanager-main-0\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:37:17.597359 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.597233 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vc772\" (UniqueName: \"kubernetes.io/projected/597a9f6c-3e8d-4af7-9923-d112775fbb58-kube-api-access-vc772\") pod \"alertmanager-main-0\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:37:17.597359 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.597260 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/597a9f6c-3e8d-4af7-9923-d112775fbb58-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:37:17.597359 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.597289 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/597a9f6c-3e8d-4af7-9923-d112775fbb58-tls-assets\") pod \"alertmanager-main-0\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:37:17.597359 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.597336 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/597a9f6c-3e8d-4af7-9923-d112775fbb58-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:37:17.597673 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.597410 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/597a9f6c-3e8d-4af7-9923-d112775fbb58-config-out\") pod \"alertmanager-main-0\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:37:17.597673 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.597434 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/597a9f6c-3e8d-4af7-9923-d112775fbb58-web-config\") pod \"alertmanager-main-0\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:37:17.598415 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:37:17.597775 2566 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 02 14:37:17.598415 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:37:17.597852 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/597a9f6c-3e8d-4af7-9923-d112775fbb58-secret-alertmanager-main-tls podName:597a9f6c-3e8d-4af7-9923-d112775fbb58 nodeName:}" failed. No retries permitted until 2026-06-02 14:37:18.097829964 +0000 UTC m=+55.602166414 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/597a9f6c-3e8d-4af7-9923-d112775fbb58-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "597a9f6c-3e8d-4af7-9923-d112775fbb58") : secret "alertmanager-main-tls" not found Jun 02 14:37:17.598794 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.598771 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/597a9f6c-3e8d-4af7-9923-d112775fbb58-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:37:17.599243 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.598904 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/597a9f6c-3e8d-4af7-9923-d112775fbb58-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:37:17.599243 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.598954 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/597a9f6c-3e8d-4af7-9923-d112775fbb58-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:37:17.601075 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.601031 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/597a9f6c-3e8d-4af7-9923-d112775fbb58-web-config\") pod \"alertmanager-main-0\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:37:17.601636 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.601612 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/597a9f6c-3e8d-4af7-9923-d112775fbb58-config-volume\") pod \"alertmanager-main-0\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:37:17.601762 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.601740 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/597a9f6c-3e8d-4af7-9923-d112775fbb58-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:37:17.601982 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.601956 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/597a9f6c-3e8d-4af7-9923-d112775fbb58-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:37:17.602065 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.601965 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/597a9f6c-3e8d-4af7-9923-d112775fbb58-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:37:17.602364 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.602173 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/597a9f6c-3e8d-4af7-9923-d112775fbb58-config-out\") pod \"alertmanager-main-0\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:37:17.602610 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.602563 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/597a9f6c-3e8d-4af7-9923-d112775fbb58-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:37:17.602882 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.602863 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/597a9f6c-3e8d-4af7-9923-d112775fbb58-tls-assets\") pod \"alertmanager-main-0\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:37:17.607225 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:17.607106 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc772\" (UniqueName: \"kubernetes.io/projected/597a9f6c-3e8d-4af7-9923-d112775fbb58-kube-api-access-vc772\") pod \"alertmanager-main-0\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:37:17.620929 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:37:17.620899 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod236dbe76_0a9a_44cc_a5a8_f462907ad75d.slice/crio-4a6484911575406d2599cfb8afe730b5c1e80f3b3b2b572c3155882378046f1c WatchSource:0}: Error finding container 4a6484911575406d2599cfb8afe730b5c1e80f3b3b2b572c3155882378046f1c: Status 404 returned error can't find the container with id 4a6484911575406d2599cfb8afe730b5c1e80f3b3b2b572c3155882378046f1c Jun 02 14:37:18.103468 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:18.103212 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/597a9f6c-3e8d-4af7-9923-d112775fbb58-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:37:18.103468 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:37:18.103381 2566 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 02 14:37:18.103671 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:37:18.103520 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/597a9f6c-3e8d-4af7-9923-d112775fbb58-secret-alertmanager-main-tls podName:597a9f6c-3e8d-4af7-9923-d112775fbb58 nodeName:}" failed. No retries permitted until 2026-06-02 14:37:19.103502566 +0000 UTC m=+56.607839016 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/597a9f6c-3e8d-4af7-9923-d112775fbb58-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "597a9f6c-3e8d-4af7-9923-d112775fbb58") : secret "alertmanager-main-tls" not found Jun 02 14:37:18.330002 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:18.329961 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-dbtw9" event={"ID":"236dbe76-0a9a-44cc-a5a8-f462907ad75d","Type":"ContainerStarted","Data":"8191de110676c78d7af6195ec60445e2de58523888da67554069bb23c22022a9"} Jun 02 14:37:18.330002 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:18.330006 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-dbtw9" event={"ID":"236dbe76-0a9a-44cc-a5a8-f462907ad75d","Type":"ContainerStarted","Data":"5ac497b885b0abce1d3aa5aeade06feb1a077aa4b7528f4d53b3cb60b6c6f4ee"} Jun 02 14:37:18.330407 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:18.330020 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-dbtw9" event={"ID":"236dbe76-0a9a-44cc-a5a8-f462907ad75d","Type":"ContainerStarted","Data":"4a6484911575406d2599cfb8afe730b5c1e80f3b3b2b572c3155882378046f1c"} Jun 02 14:37:19.112682 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:19.112644 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/597a9f6c-3e8d-4af7-9923-d112775fbb58-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:37:19.117193 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:19.117165 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/597a9f6c-3e8d-4af7-9923-d112775fbb58-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:37:19.187184 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:19.187148 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5c84798656-kglwc"] Jun 02 14:37:19.216046 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:19.216017 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:37:19.221069 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:19.221032 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5c84798656-kglwc"] Jun 02 14:37:19.221269 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:19.221256 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5c84798656-kglwc" Jun 02 14:37:19.224385 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:19.224359 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 02 14:37:19.224715 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:19.224697 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-bjh7j\"" Jun 02 14:37:19.224815 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:19.224726 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 02 14:37:19.224815 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:19.224769 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2kdh0lvrt9105\"" Jun 02 14:37:19.225083 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:19.225068 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 02 14:37:19.225265 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:19.225239 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 02 14:37:19.226157 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:19.226113 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 02 14:37:19.314394 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:19.314361 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c78e333f-c32e-4738-8e85-585047ac830f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5c84798656-kglwc\" (UID: \"c78e333f-c32e-4738-8e85-585047ac830f\") " pod="openshift-monitoring/thanos-querier-5c84798656-kglwc" Jun 02 14:37:19.314394 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:19.314396 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mm4w8\" (UniqueName: \"kubernetes.io/projected/c78e333f-c32e-4738-8e85-585047ac830f-kube-api-access-mm4w8\") pod \"thanos-querier-5c84798656-kglwc\" (UID: \"c78e333f-c32e-4738-8e85-585047ac830f\") " pod="openshift-monitoring/thanos-querier-5c84798656-kglwc" Jun 02 14:37:19.314579 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:19.314418 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c78e333f-c32e-4738-8e85-585047ac830f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5c84798656-kglwc\" (UID: \"c78e333f-c32e-4738-8e85-585047ac830f\") " pod="openshift-monitoring/thanos-querier-5c84798656-kglwc" Jun 02 14:37:19.314579 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:19.314483 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c78e333f-c32e-4738-8e85-585047ac830f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5c84798656-kglwc\" (UID: \"c78e333f-c32e-4738-8e85-585047ac830f\") " pod="openshift-monitoring/thanos-querier-5c84798656-kglwc" Jun 02 14:37:19.314579 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:19.314541 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c78e333f-c32e-4738-8e85-585047ac830f-secret-thanos-querier-tls\") pod \"thanos-querier-5c84798656-kglwc\" (UID: \"c78e333f-c32e-4738-8e85-585047ac830f\") " pod="openshift-monitoring/thanos-querier-5c84798656-kglwc" Jun 02 14:37:19.314579 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:19.314561 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c78e333f-c32e-4738-8e85-585047ac830f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5c84798656-kglwc\" (UID: \"c78e333f-c32e-4738-8e85-585047ac830f\") " pod="openshift-monitoring/thanos-querier-5c84798656-kglwc" Jun 02 14:37:19.314691 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:19.314595 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c78e333f-c32e-4738-8e85-585047ac830f-metrics-client-ca\") pod \"thanos-querier-5c84798656-kglwc\" (UID: \"c78e333f-c32e-4738-8e85-585047ac830f\") " pod="openshift-monitoring/thanos-querier-5c84798656-kglwc" Jun 02 14:37:19.314691 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:19.314653 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c78e333f-c32e-4738-8e85-585047ac830f-secret-grpc-tls\") pod \"thanos-querier-5c84798656-kglwc\" (UID: \"c78e333f-c32e-4738-8e85-585047ac830f\") " pod="openshift-monitoring/thanos-querier-5c84798656-kglwc" Jun 02 14:37:19.334237 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:19.334208 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-rkcxt" event={"ID":"ed1f5bf3-f372-4994-91dc-b31c14958ff4","Type":"ContainerStarted","Data":"b9ab1d6303f3213de1bbfb947121550766a6ea98aea1eb3c781500a251db47ad"} Jun 02 14:37:19.334828 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:19.334244 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-rkcxt" event={"ID":"ed1f5bf3-f372-4994-91dc-b31c14958ff4","Type":"ContainerStarted","Data":"4386488673b5522241cd3230a126f774f88dcf854d5bf32f3bbdd66907d8bdfc"} Jun 02 14:37:19.334828 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:19.334258 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-rkcxt" event={"ID":"ed1f5bf3-f372-4994-91dc-b31c14958ff4","Type":"ContainerStarted","Data":"65f5a31f307277bc310cfd966402c983005fe5a88f444a57cc09825f3be4639b"} Jun 02 14:37:19.335849 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:19.335818 2566 generic.go:358] "Generic (PLEG): container finished" podID="dc7e162a-2c52-470f-a3e8-cc1c911826c7" containerID="80485cbec732927f26a743c074e79104203e35f44a2c8362552e98d4cfcddec9" exitCode=0 Jun 02 14:37:19.335993 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:19.335866 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wp2wj" event={"ID":"dc7e162a-2c52-470f-a3e8-cc1c911826c7","Type":"ContainerDied","Data":"80485cbec732927f26a743c074e79104203e35f44a2c8362552e98d4cfcddec9"} Jun 02 14:37:19.356989 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:19.356918 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-8469c486bb-rkcxt" podStartSLOduration=1.570510469 podStartE2EDuration="3.356904939s" podCreationTimestamp="2026-06-02 14:37:16 +0000 UTC" firstStartedPulling="2026-06-02 14:37:16.73804502 +0000 UTC m=+54.242381463" lastFinishedPulling="2026-06-02 14:37:18.524439501 +0000 UTC m=+56.028775933" observedRunningTime="2026-06-02 14:37:19.356401129 +0000 UTC m=+56.860737583" watchObservedRunningTime="2026-06-02 14:37:19.356904939 +0000 UTC m=+56.861241409" Jun 02 14:37:19.414990 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:19.414962 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c78e333f-c32e-4738-8e85-585047ac830f-metrics-client-ca\") pod \"thanos-querier-5c84798656-kglwc\" (UID: \"c78e333f-c32e-4738-8e85-585047ac830f\") " pod="openshift-monitoring/thanos-querier-5c84798656-kglwc" Jun 02 14:37:19.415157 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:19.415013 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c78e333f-c32e-4738-8e85-585047ac830f-secret-grpc-tls\") pod \"thanos-querier-5c84798656-kglwc\" (UID: \"c78e333f-c32e-4738-8e85-585047ac830f\") " pod="openshift-monitoring/thanos-querier-5c84798656-kglwc" Jun 02 14:37:19.415613 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:19.415449 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c78e333f-c32e-4738-8e85-585047ac830f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5c84798656-kglwc\" (UID: \"c78e333f-c32e-4738-8e85-585047ac830f\") " pod="openshift-monitoring/thanos-querier-5c84798656-kglwc" Jun 02 14:37:19.415613 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:19.415491 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mm4w8\" (UniqueName: \"kubernetes.io/projected/c78e333f-c32e-4738-8e85-585047ac830f-kube-api-access-mm4w8\") pod \"thanos-querier-5c84798656-kglwc\" (UID: \"c78e333f-c32e-4738-8e85-585047ac830f\") " pod="openshift-monitoring/thanos-querier-5c84798656-kglwc" Jun 02 14:37:19.415613 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:19.415547 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c78e333f-c32e-4738-8e85-585047ac830f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5c84798656-kglwc\" (UID: \"c78e333f-c32e-4738-8e85-585047ac830f\") " pod="openshift-monitoring/thanos-querier-5c84798656-kglwc" Jun 02 14:37:19.415613 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:19.415598 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c78e333f-c32e-4738-8e85-585047ac830f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5c84798656-kglwc\" (UID: \"c78e333f-c32e-4738-8e85-585047ac830f\") " pod="openshift-monitoring/thanos-querier-5c84798656-kglwc" Jun 02 14:37:19.415945 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:19.415642 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c78e333f-c32e-4738-8e85-585047ac830f-secret-thanos-querier-tls\") pod \"thanos-querier-5c84798656-kglwc\" (UID: \"c78e333f-c32e-4738-8e85-585047ac830f\") " pod="openshift-monitoring/thanos-querier-5c84798656-kglwc" Jun 02 14:37:19.415945 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:19.415667 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c78e333f-c32e-4738-8e85-585047ac830f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5c84798656-kglwc\" (UID: \"c78e333f-c32e-4738-8e85-585047ac830f\") " pod="openshift-monitoring/thanos-querier-5c84798656-kglwc" Jun 02 14:37:19.415945 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:19.415730 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c78e333f-c32e-4738-8e85-585047ac830f-metrics-client-ca\") pod \"thanos-querier-5c84798656-kglwc\" (UID: \"c78e333f-c32e-4738-8e85-585047ac830f\") " pod="openshift-monitoring/thanos-querier-5c84798656-kglwc" Jun 02 14:37:19.418800 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:19.418733 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c78e333f-c32e-4738-8e85-585047ac830f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5c84798656-kglwc\" (UID: \"c78e333f-c32e-4738-8e85-585047ac830f\") " pod="openshift-monitoring/thanos-querier-5c84798656-kglwc" Jun 02 14:37:19.418800 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:19.418765 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c78e333f-c32e-4738-8e85-585047ac830f-secret-thanos-querier-tls\") pod \"thanos-querier-5c84798656-kglwc\" (UID: \"c78e333f-c32e-4738-8e85-585047ac830f\") " pod="openshift-monitoring/thanos-querier-5c84798656-kglwc" Jun 02 14:37:19.419210 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:19.419182 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c78e333f-c32e-4738-8e85-585047ac830f-secret-grpc-tls\") pod \"thanos-querier-5c84798656-kglwc\" (UID: \"c78e333f-c32e-4738-8e85-585047ac830f\") " pod="openshift-monitoring/thanos-querier-5c84798656-kglwc" Jun 02 14:37:19.419332 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:19.419315 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c78e333f-c32e-4738-8e85-585047ac830f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5c84798656-kglwc\" (UID: \"c78e333f-c32e-4738-8e85-585047ac830f\") " pod="openshift-monitoring/thanos-querier-5c84798656-kglwc" Jun 02 14:37:19.419367 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:19.419332 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c78e333f-c32e-4738-8e85-585047ac830f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5c84798656-kglwc\" (UID: \"c78e333f-c32e-4738-8e85-585047ac830f\") " pod="openshift-monitoring/thanos-querier-5c84798656-kglwc" Jun 02 14:37:19.419485 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:19.419469 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c78e333f-c32e-4738-8e85-585047ac830f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5c84798656-kglwc\" (UID: \"c78e333f-c32e-4738-8e85-585047ac830f\") " pod="openshift-monitoring/thanos-querier-5c84798656-kglwc" Jun 02 14:37:19.424418 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:19.424396 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mm4w8\" (UniqueName: \"kubernetes.io/projected/c78e333f-c32e-4738-8e85-585047ac830f-kube-api-access-mm4w8\") pod \"thanos-querier-5c84798656-kglwc\" (UID: \"c78e333f-c32e-4738-8e85-585047ac830f\") " pod="openshift-monitoring/thanos-querier-5c84798656-kglwc" Jun 02 14:37:19.454616 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:19.454543 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 14:37:19.458420 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:37:19.458397 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod597a9f6c_3e8d_4af7_9923_d112775fbb58.slice/crio-d69c0495dce7bde7bf18a30b3c03d6d7df7016e7a2eed6c93c454f444288e1fa WatchSource:0}: Error finding container d69c0495dce7bde7bf18a30b3c03d6d7df7016e7a2eed6c93c454f444288e1fa: Status 404 returned error can't find the container with id d69c0495dce7bde7bf18a30b3c03d6d7df7016e7a2eed6c93c454f444288e1fa Jun 02 14:37:19.533699 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:19.533669 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5c84798656-kglwc" Jun 02 14:37:19.668146 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:19.668100 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5c84798656-kglwc"] Jun 02 14:37:19.712888 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:37:19.712823 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc78e333f_c32e_4738_8e85_585047ac830f.slice/crio-5b203691b6aa456bed851dc659c0bf90e02ca0f3c43cc4afc066288a28b0f7d0 WatchSource:0}: Error finding container 5b203691b6aa456bed851dc659c0bf90e02ca0f3c43cc4afc066288a28b0f7d0: Status 404 returned error can't find the container with id 5b203691b6aa456bed851dc659c0bf90e02ca0f3c43cc4afc066288a28b0f7d0 Jun 02 14:37:20.341714 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:20.341674 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-dbtw9" event={"ID":"236dbe76-0a9a-44cc-a5a8-f462907ad75d","Type":"ContainerStarted","Data":"b78eafdc21c25c412daa238cf3814dff9a115d5951eaf7452f625c95867aae26"} Jun 02 14:37:20.343106 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:20.343078 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c84798656-kglwc" event={"ID":"c78e333f-c32e-4738-8e85-585047ac830f","Type":"ContainerStarted","Data":"5b203691b6aa456bed851dc659c0bf90e02ca0f3c43cc4afc066288a28b0f7d0"} Jun 02 14:37:20.344297 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:20.344265 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"597a9f6c-3e8d-4af7-9923-d112775fbb58","Type":"ContainerStarted","Data":"d69c0495dce7bde7bf18a30b3c03d6d7df7016e7a2eed6c93c454f444288e1fa"} Jun 02 14:37:20.346249 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:20.346222 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wp2wj" event={"ID":"dc7e162a-2c52-470f-a3e8-cc1c911826c7","Type":"ContainerStarted","Data":"05dbc3cc5822ac8c3cd73d3f6b89d5d2c962d496322eb28005de7609aacd9f6e"} Jun 02 14:37:20.346363 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:20.346256 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wp2wj" event={"ID":"dc7e162a-2c52-470f-a3e8-cc1c911826c7","Type":"ContainerStarted","Data":"1e1c6606d6514764fbc46bf7d00047aeb78880e2e51b103ae7b4f5781098de68"} Jun 02 14:37:20.368461 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:20.368418 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-85658796db-dbtw9" podStartSLOduration=2.605421336 podStartE2EDuration="4.368408459s" podCreationTimestamp="2026-06-02 14:37:16 +0000 UTC" firstStartedPulling="2026-06-02 14:37:17.978218349 +0000 UTC m=+55.482554795" lastFinishedPulling="2026-06-02 14:37:19.741205476 +0000 UTC m=+57.245541918" observedRunningTime="2026-06-02 14:37:20.367991228 +0000 UTC m=+57.872327678" watchObservedRunningTime="2026-06-02 14:37:20.368408459 +0000 UTC m=+57.872744909" Jun 02 14:37:20.398176 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:20.398105 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wp2wj" podStartSLOduration=2.667567348 podStartE2EDuration="4.398091565s" podCreationTimestamp="2026-06-02 14:37:16 +0000 UTC" firstStartedPulling="2026-06-02 14:37:16.640619231 +0000 UTC m=+54.144955660" lastFinishedPulling="2026-06-02 14:37:18.371143416 +0000 UTC m=+55.875479877" observedRunningTime="2026-06-02 14:37:20.397026276 +0000 UTC m=+57.901362728" watchObservedRunningTime="2026-06-02 14:37:20.398091565 +0000 UTC m=+57.902428017" Jun 02 14:37:20.607015 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:20.606935 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5d44f8b56b-gg5j2"] Jun 02 14:37:20.630393 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:20.630362 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5d44f8b56b-gg5j2"] Jun 02 14:37:20.630557 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:20.630502 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5d44f8b56b-gg5j2" Jun 02 14:37:20.634087 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:20.634060 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 02 14:37:20.634087 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:20.634076 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 02 14:37:20.634087 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:20.634094 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-fb5ddp9sj7ojb\"" Jun 02 14:37:20.635255 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:20.635057 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 02 14:37:20.635255 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:20.635177 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-drtb7\"" Jun 02 14:37:20.635255 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:20.635186 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 02 14:37:20.728556 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:20.728523 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5nxs\" (UniqueName: \"kubernetes.io/projected/89dcc13d-9cb8-4576-84e2-10f82c5fee23-kube-api-access-j5nxs\") pod \"metrics-server-5d44f8b56b-gg5j2\" (UID: \"89dcc13d-9cb8-4576-84e2-10f82c5fee23\") " pod="openshift-monitoring/metrics-server-5d44f8b56b-gg5j2" Jun 02 14:37:20.728735 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:20.728567 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/89dcc13d-9cb8-4576-84e2-10f82c5fee23-client-ca-bundle\") pod \"metrics-server-5d44f8b56b-gg5j2\" (UID: \"89dcc13d-9cb8-4576-84e2-10f82c5fee23\") " pod="openshift-monitoring/metrics-server-5d44f8b56b-gg5j2" Jun 02 14:37:20.728735 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:20.728597 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/89dcc13d-9cb8-4576-84e2-10f82c5fee23-secret-metrics-server-tls\") pod \"metrics-server-5d44f8b56b-gg5j2\" (UID: \"89dcc13d-9cb8-4576-84e2-10f82c5fee23\") " pod="openshift-monitoring/metrics-server-5d44f8b56b-gg5j2" Jun 02 14:37:20.728735 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:20.728618 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/89dcc13d-9cb8-4576-84e2-10f82c5fee23-metrics-server-audit-profiles\") pod \"metrics-server-5d44f8b56b-gg5j2\" (UID: \"89dcc13d-9cb8-4576-84e2-10f82c5fee23\") " pod="openshift-monitoring/metrics-server-5d44f8b56b-gg5j2" Jun 02 14:37:20.728735 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:20.728676 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89dcc13d-9cb8-4576-84e2-10f82c5fee23-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5d44f8b56b-gg5j2\" (UID: \"89dcc13d-9cb8-4576-84e2-10f82c5fee23\") " pod="openshift-monitoring/metrics-server-5d44f8b56b-gg5j2" Jun 02 14:37:20.728909 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:20.728795 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/89dcc13d-9cb8-4576-84e2-10f82c5fee23-audit-log\") pod \"metrics-server-5d44f8b56b-gg5j2\" (UID: \"89dcc13d-9cb8-4576-84e2-10f82c5fee23\") " pod="openshift-monitoring/metrics-server-5d44f8b56b-gg5j2" Jun 02 14:37:20.728909 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:20.728844 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/89dcc13d-9cb8-4576-84e2-10f82c5fee23-secret-metrics-server-client-certs\") pod \"metrics-server-5d44f8b56b-gg5j2\" (UID: \"89dcc13d-9cb8-4576-84e2-10f82c5fee23\") " pod="openshift-monitoring/metrics-server-5d44f8b56b-gg5j2" Jun 02 14:37:20.830125 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:20.830086 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j5nxs\" (UniqueName: \"kubernetes.io/projected/89dcc13d-9cb8-4576-84e2-10f82c5fee23-kube-api-access-j5nxs\") pod \"metrics-server-5d44f8b56b-gg5j2\" (UID: \"89dcc13d-9cb8-4576-84e2-10f82c5fee23\") " pod="openshift-monitoring/metrics-server-5d44f8b56b-gg5j2" Jun 02 14:37:20.830319 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:20.830161 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/89dcc13d-9cb8-4576-84e2-10f82c5fee23-client-ca-bundle\") pod \"metrics-server-5d44f8b56b-gg5j2\" (UID: \"89dcc13d-9cb8-4576-84e2-10f82c5fee23\") " pod="openshift-monitoring/metrics-server-5d44f8b56b-gg5j2" Jun 02 14:37:20.830319 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:20.830192 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/89dcc13d-9cb8-4576-84e2-10f82c5fee23-secret-metrics-server-tls\") pod \"metrics-server-5d44f8b56b-gg5j2\" (UID: \"89dcc13d-9cb8-4576-84e2-10f82c5fee23\") " pod="openshift-monitoring/metrics-server-5d44f8b56b-gg5j2" Jun 02 14:37:20.830319 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:20.830214 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/89dcc13d-9cb8-4576-84e2-10f82c5fee23-metrics-server-audit-profiles\") pod \"metrics-server-5d44f8b56b-gg5j2\" (UID: \"89dcc13d-9cb8-4576-84e2-10f82c5fee23\") " pod="openshift-monitoring/metrics-server-5d44f8b56b-gg5j2" Jun 02 14:37:20.830319 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:20.830246 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89dcc13d-9cb8-4576-84e2-10f82c5fee23-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5d44f8b56b-gg5j2\" (UID: \"89dcc13d-9cb8-4576-84e2-10f82c5fee23\") " pod="openshift-monitoring/metrics-server-5d44f8b56b-gg5j2" Jun 02 14:37:20.830319 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:20.830292 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/89dcc13d-9cb8-4576-84e2-10f82c5fee23-audit-log\") pod \"metrics-server-5d44f8b56b-gg5j2\" (UID: \"89dcc13d-9cb8-4576-84e2-10f82c5fee23\") " pod="openshift-monitoring/metrics-server-5d44f8b56b-gg5j2" Jun 02 14:37:20.830573 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:20.830325 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/89dcc13d-9cb8-4576-84e2-10f82c5fee23-secret-metrics-server-client-certs\") pod \"metrics-server-5d44f8b56b-gg5j2\" (UID: \"89dcc13d-9cb8-4576-84e2-10f82c5fee23\") " pod="openshift-monitoring/metrics-server-5d44f8b56b-gg5j2" Jun 02 14:37:20.831292 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:20.831266 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/89dcc13d-9cb8-4576-84e2-10f82c5fee23-audit-log\") pod \"metrics-server-5d44f8b56b-gg5j2\" (UID: \"89dcc13d-9cb8-4576-84e2-10f82c5fee23\") " pod="openshift-monitoring/metrics-server-5d44f8b56b-gg5j2" Jun 02 14:37:20.831468 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:20.831449 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89dcc13d-9cb8-4576-84e2-10f82c5fee23-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5d44f8b56b-gg5j2\" (UID: \"89dcc13d-9cb8-4576-84e2-10f82c5fee23\") " pod="openshift-monitoring/metrics-server-5d44f8b56b-gg5j2" Jun 02 14:37:20.832083 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:20.832053 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/89dcc13d-9cb8-4576-84e2-10f82c5fee23-metrics-server-audit-profiles\") pod \"metrics-server-5d44f8b56b-gg5j2\" (UID: \"89dcc13d-9cb8-4576-84e2-10f82c5fee23\") " pod="openshift-monitoring/metrics-server-5d44f8b56b-gg5j2" Jun 02 14:37:20.834042 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:20.833589 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/89dcc13d-9cb8-4576-84e2-10f82c5fee23-secret-metrics-server-tls\") pod \"metrics-server-5d44f8b56b-gg5j2\" (UID: \"89dcc13d-9cb8-4576-84e2-10f82c5fee23\") " pod="openshift-monitoring/metrics-server-5d44f8b56b-gg5j2" Jun 02 14:37:20.834042 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:20.833912 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/89dcc13d-9cb8-4576-84e2-10f82c5fee23-secret-metrics-server-client-certs\") pod \"metrics-server-5d44f8b56b-gg5j2\" (UID: \"89dcc13d-9cb8-4576-84e2-10f82c5fee23\") " pod="openshift-monitoring/metrics-server-5d44f8b56b-gg5j2" Jun 02 14:37:20.834042 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:20.834009 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/89dcc13d-9cb8-4576-84e2-10f82c5fee23-client-ca-bundle\") pod \"metrics-server-5d44f8b56b-gg5j2\" (UID: \"89dcc13d-9cb8-4576-84e2-10f82c5fee23\") " pod="openshift-monitoring/metrics-server-5d44f8b56b-gg5j2" Jun 02 14:37:20.840634 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:20.840612 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5nxs\" (UniqueName: \"kubernetes.io/projected/89dcc13d-9cb8-4576-84e2-10f82c5fee23-kube-api-access-j5nxs\") pod \"metrics-server-5d44f8b56b-gg5j2\" (UID: \"89dcc13d-9cb8-4576-84e2-10f82c5fee23\") " pod="openshift-monitoring/metrics-server-5d44f8b56b-gg5j2" Jun 02 14:37:20.936554 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:20.936515 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-lmr4g"] Jun 02 14:37:20.942349 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:20.942316 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5d44f8b56b-gg5j2" Jun 02 14:37:20.959060 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:20.959032 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-lmr4g"] Jun 02 14:37:20.959206 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:20.959073 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-lmr4g" Jun 02 14:37:20.961622 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:20.961602 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-r8w4f\"" Jun 02 14:37:20.961748 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:20.961607 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 02 14:37:21.033094 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:21.032972 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5940fc5f-4981-409b-9a68-6e8ff643fa7f-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-lmr4g\" (UID: \"5940fc5f-4981-409b-9a68-6e8ff643fa7f\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-lmr4g" Jun 02 14:37:21.134907 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:21.134872 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5940fc5f-4981-409b-9a68-6e8ff643fa7f-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-lmr4g\" (UID: \"5940fc5f-4981-409b-9a68-6e8ff643fa7f\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-lmr4g" Jun 02 14:37:21.135123 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:37:21.135026 2566 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 02 14:37:21.135123 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:37:21.135096 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5940fc5f-4981-409b-9a68-6e8ff643fa7f-monitoring-plugin-cert podName:5940fc5f-4981-409b-9a68-6e8ff643fa7f nodeName:}" failed. No retries permitted until 2026-06-02 14:37:21.635076664 +0000 UTC m=+59.139413114 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/5940fc5f-4981-409b-9a68-6e8ff643fa7f-monitoring-plugin-cert") pod "monitoring-plugin-5768fcc9dd-lmr4g" (UID: "5940fc5f-4981-409b-9a68-6e8ff643fa7f") : secret "monitoring-plugin-cert" not found Jun 02 14:37:21.136221 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:21.136190 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5d44f8b56b-gg5j2"] Jun 02 14:37:21.244307 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:21.244227 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-86rkq" Jun 02 14:37:21.313034 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:37:21.312994 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89dcc13d_9cb8_4576_84e2_10f82c5fee23.slice/crio-67c6e6e1fc4248f6bdbc7bf23deef24529a79d77e7b3a22435aa3d1a695bbf3f WatchSource:0}: Error finding container 67c6e6e1fc4248f6bdbc7bf23deef24529a79d77e7b3a22435aa3d1a695bbf3f: Status 404 returned error can't find the container with id 67c6e6e1fc4248f6bdbc7bf23deef24529a79d77e7b3a22435aa3d1a695bbf3f Jun 02 14:37:21.350312 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:21.350276 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5d44f8b56b-gg5j2" event={"ID":"89dcc13d-9cb8-4576-84e2-10f82c5fee23","Type":"ContainerStarted","Data":"67c6e6e1fc4248f6bdbc7bf23deef24529a79d77e7b3a22435aa3d1a695bbf3f"} Jun 02 14:37:21.640249 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:21.640152 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5940fc5f-4981-409b-9a68-6e8ff643fa7f-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-lmr4g\" (UID: \"5940fc5f-4981-409b-9a68-6e8ff643fa7f\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-lmr4g" Jun 02 14:37:21.643042 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:21.643008 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5940fc5f-4981-409b-9a68-6e8ff643fa7f-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-lmr4g\" (UID: \"5940fc5f-4981-409b-9a68-6e8ff643fa7f\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-lmr4g" Jun 02 14:37:21.867791 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:21.867758 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-lmr4g" Jun 02 14:37:22.305713 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.305683 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-z9f8p" Jun 02 14:37:22.355316 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.355277 2566 generic.go:358] "Generic (PLEG): container finished" podID="597a9f6c-3e8d-4af7-9923-d112775fbb58" containerID="3b42b7630192aed73c0843224594c2e849937d646de4dfe1a367f5d2ed5ea912" exitCode=0 Jun 02 14:37:22.355754 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.355323 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"597a9f6c-3e8d-4af7-9923-d112775fbb58","Type":"ContainerDied","Data":"3b42b7630192aed73c0843224594c2e849937d646de4dfe1a367f5d2ed5ea912"} Jun 02 14:37:22.513927 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.513894 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 14:37:22.531518 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.531489 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.535675 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.535648 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 02 14:37:22.535880 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.535693 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 02 14:37:22.535880 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.535660 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 02 14:37:22.535880 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.535833 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 02 14:37:22.536230 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.535919 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 02 14:37:22.536230 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.535925 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 02 14:37:22.536925 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.536858 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 02 14:37:22.537323 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.537053 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 02 14:37:22.539757 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.539174 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-b6duvgmt1oqtd\"" Jun 02 14:37:22.540105 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.539986 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 02 14:37:22.540482 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.540217 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-dhts6\"" Jun 02 14:37:22.540482 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.540246 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 02 14:37:22.540599 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.540542 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 02 14:37:22.543163 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.543146 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 02 14:37:22.547392 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.547369 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 14:37:22.557832 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.557766 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69d4b46f44-xmfgw"] Jun 02 14:37:22.651905 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.651872 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-web-config\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.652120 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.651922 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.652120 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.651959 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.652120 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.652013 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6c4154b5-7168-4798-8a07-c7524b2dda87-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.652120 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.652058 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjfnm\" (UniqueName: \"kubernetes.io/projected/6c4154b5-7168-4798-8a07-c7524b2dda87-kube-api-access-cjfnm\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.652355 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.652123 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.652355 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.652186 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.652355 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.652242 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c4154b5-7168-4798-8a07-c7524b2dda87-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.652355 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.652297 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6c4154b5-7168-4798-8a07-c7524b2dda87-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.652355 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.652326 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c4154b5-7168-4798-8a07-c7524b2dda87-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.652596 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.652355 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-config\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.652596 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.652381 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6c4154b5-7168-4798-8a07-c7524b2dda87-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.652596 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.652418 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c4154b5-7168-4798-8a07-c7524b2dda87-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.652596 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.652443 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.652596 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.652466 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.652596 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.652559 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6c4154b5-7168-4798-8a07-c7524b2dda87-config-out\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.653036 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.652599 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.653036 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.652632 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c4154b5-7168-4798-8a07-c7524b2dda87-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.753683 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.753643 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6c4154b5-7168-4798-8a07-c7524b2dda87-config-out\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.753868 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.753698 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.753868 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.753733 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c4154b5-7168-4798-8a07-c7524b2dda87-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.753868 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.753768 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-web-config\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.753868 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.753788 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.753868 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.753813 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.753868 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.753836 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6c4154b5-7168-4798-8a07-c7524b2dda87-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.753868 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.753859 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cjfnm\" (UniqueName: \"kubernetes.io/projected/6c4154b5-7168-4798-8a07-c7524b2dda87-kube-api-access-cjfnm\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.754237 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.753893 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.754237 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.753927 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.754237 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.753982 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c4154b5-7168-4798-8a07-c7524b2dda87-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.754237 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.754030 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6c4154b5-7168-4798-8a07-c7524b2dda87-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.754237 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.754059 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c4154b5-7168-4798-8a07-c7524b2dda87-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.754237 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.754089 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-config\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.754237 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.754118 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6c4154b5-7168-4798-8a07-c7524b2dda87-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.754237 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.754187 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c4154b5-7168-4798-8a07-c7524b2dda87-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.754237 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.754214 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.754674 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.754243 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.754773 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.754750 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c4154b5-7168-4798-8a07-c7524b2dda87-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.754856 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.754834 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6c4154b5-7168-4798-8a07-c7524b2dda87-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.757121 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.755935 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c4154b5-7168-4798-8a07-c7524b2dda87-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.758533 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.758510 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6c4154b5-7168-4798-8a07-c7524b2dda87-config-out\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.758654 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.758552 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.759196 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.759174 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.760105 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.759509 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-config\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.760105 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.760063 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c4154b5-7168-4798-8a07-c7524b2dda87-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.760764 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.760737 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.761535 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.761458 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c4154b5-7168-4798-8a07-c7524b2dda87-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.761950 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.761923 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.762415 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.762387 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.762565 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.762399 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.763147 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.762788 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6c4154b5-7168-4798-8a07-c7524b2dda87-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.763678 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.763652 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.763908 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.763886 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-web-config\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.765763 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.765743 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjfnm\" (UniqueName: \"kubernetes.io/projected/6c4154b5-7168-4798-8a07-c7524b2dda87-kube-api-access-cjfnm\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.765880 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.765780 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6c4154b5-7168-4798-8a07-c7524b2dda87-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:22.842918 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:22.842837 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:23.423783 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:23.423738 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69d4b46f44-xmfgw" Jun 02 14:37:23.677523 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:23.677445 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-lmr4g"] Jun 02 14:37:23.681075 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:37:23.681033 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5940fc5f_4981_409b_9a68_6e8ff643fa7f.slice/crio-54486cb5a250ee9c0e35cc8fb37cb415cac18a209c5890c0714bfbb406d731b5 WatchSource:0}: Error finding container 54486cb5a250ee9c0e35cc8fb37cb415cac18a209c5890c0714bfbb406d731b5: Status 404 returned error can't find the container with id 54486cb5a250ee9c0e35cc8fb37cb415cac18a209c5890c0714bfbb406d731b5 Jun 02 14:37:23.713612 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:23.713569 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 14:37:23.718182 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:37:23.718148 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c4154b5_7168_4798_8a07_c7524b2dda87.slice/crio-1c175507771ef9874bee053cf38d5be991dd4bc43438e09d448eaa0bc210faa8 WatchSource:0}: Error finding container 1c175507771ef9874bee053cf38d5be991dd4bc43438e09d448eaa0bc210faa8: Status 404 returned error can't find the container with id 1c175507771ef9874bee053cf38d5be991dd4bc43438e09d448eaa0bc210faa8 Jun 02 14:37:24.364844 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:24.364807 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c84798656-kglwc" event={"ID":"c78e333f-c32e-4738-8e85-585047ac830f","Type":"ContainerStarted","Data":"22dd549005690a64da01c183bda9b501169b82d66e714d25966ae95fd377ec7d"} Jun 02 14:37:24.365029 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:24.364851 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c84798656-kglwc" event={"ID":"c78e333f-c32e-4738-8e85-585047ac830f","Type":"ContainerStarted","Data":"201cc50f01b004978db136acb880afdcea9308dff4f4cadbf92db5f709463767"} Jun 02 14:37:24.365029 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:24.364867 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c84798656-kglwc" event={"ID":"c78e333f-c32e-4738-8e85-585047ac830f","Type":"ContainerStarted","Data":"dc177f5414e67524dc4ba9c2ce761c225b127734fdc21e480fdd15b1584c2d60"} Jun 02 14:37:24.366539 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:24.366505 2566 generic.go:358] "Generic (PLEG): container finished" podID="6c4154b5-7168-4798-8a07-c7524b2dda87" containerID="779ab64a1b9ec118b0d47e5b130d972c3fadad9687f81ac0b91e4199bb5f4d27" exitCode=0 Jun 02 14:37:24.366681 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:24.366571 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6c4154b5-7168-4798-8a07-c7524b2dda87","Type":"ContainerDied","Data":"779ab64a1b9ec118b0d47e5b130d972c3fadad9687f81ac0b91e4199bb5f4d27"} Jun 02 14:37:24.366681 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:24.366601 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6c4154b5-7168-4798-8a07-c7524b2dda87","Type":"ContainerStarted","Data":"1c175507771ef9874bee053cf38d5be991dd4bc43438e09d448eaa0bc210faa8"} Jun 02 14:37:24.368406 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:24.368336 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5d44f8b56b-gg5j2" event={"ID":"89dcc13d-9cb8-4576-84e2-10f82c5fee23","Type":"ContainerStarted","Data":"52598748c82238ef7720dc99c1daef840a0d12362a16e3213bdedcbef93f0139"} Jun 02 14:37:24.369447 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:24.369420 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-lmr4g" event={"ID":"5940fc5f-4981-409b-9a68-6e8ff643fa7f","Type":"ContainerStarted","Data":"54486cb5a250ee9c0e35cc8fb37cb415cac18a209c5890c0714bfbb406d731b5"} Jun 02 14:37:24.546061 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:24.545074 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5d44f8b56b-gg5j2" podStartSLOduration=2.402095748 podStartE2EDuration="4.545053629s" podCreationTimestamp="2026-06-02 14:37:20 +0000 UTC" firstStartedPulling="2026-06-02 14:37:21.342045489 +0000 UTC m=+58.846381919" lastFinishedPulling="2026-06-02 14:37:23.485003355 +0000 UTC m=+60.989339800" observedRunningTime="2026-06-02 14:37:24.543811919 +0000 UTC m=+62.048148382" watchObservedRunningTime="2026-06-02 14:37:24.545053629 +0000 UTC m=+62.049390081" Jun 02 14:37:25.377022 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:25.376984 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"597a9f6c-3e8d-4af7-9923-d112775fbb58","Type":"ContainerStarted","Data":"30f235e9150172a9a82a9d736c05f0631cafaa813e7fc5f3e5c763d0da1db78e"} Jun 02 14:37:25.377022 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:25.377028 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"597a9f6c-3e8d-4af7-9923-d112775fbb58","Type":"ContainerStarted","Data":"d7282366ee5594f66f2145cc4051888499f4e746367a6e0463f2284948ad11c5"} Jun 02 14:37:25.377289 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:25.377042 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"597a9f6c-3e8d-4af7-9923-d112775fbb58","Type":"ContainerStarted","Data":"96a803c378bb861e638b39ce68dc08dd0b2f42682fc725ddb70b2ed185f39e3c"} Jun 02 14:37:26.386608 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:26.386560 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"597a9f6c-3e8d-4af7-9923-d112775fbb58","Type":"ContainerStarted","Data":"dd76df652ada6ccdedcbded5e572f8569013e6542bd1f3e7dede6f87f8ebed84"} Jun 02 14:37:26.387034 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:26.386617 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"597a9f6c-3e8d-4af7-9923-d112775fbb58","Type":"ContainerStarted","Data":"aab062d4ddf982d66bb6b5db66789332dba5f14cc7412ad09b70c4fdd3ecd1d6"} Jun 02 14:37:26.387034 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:26.386632 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"597a9f6c-3e8d-4af7-9923-d112775fbb58","Type":"ContainerStarted","Data":"747c50f631cf80ae56d99dbfac2d88f6467e54f5c1664010baf1ddf8707f458c"} Jun 02 14:37:26.390198 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:26.390169 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c84798656-kglwc" event={"ID":"c78e333f-c32e-4738-8e85-585047ac830f","Type":"ContainerStarted","Data":"068314cffd2d7886ee4147c10eca9cadabd8ca262c5b37784e37fe53b86c0f38"} Jun 02 14:37:26.390334 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:26.390203 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c84798656-kglwc" event={"ID":"c78e333f-c32e-4738-8e85-585047ac830f","Type":"ContainerStarted","Data":"64730ad3685c7f0c0371c285c16e767db859137f9ae585694a29e19b19093d02"} Jun 02 14:37:26.429097 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:26.429046 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.931706616 podStartE2EDuration="9.429029683s" podCreationTimestamp="2026-06-02 14:37:17 +0000 UTC" firstStartedPulling="2026-06-02 14:37:19.460098558 +0000 UTC m=+56.964434987" lastFinishedPulling="2026-06-02 14:37:24.95742161 +0000 UTC m=+62.461758054" observedRunningTime="2026-06-02 14:37:26.428106923 +0000 UTC m=+63.932443422" watchObservedRunningTime="2026-06-02 14:37:26.429029683 +0000 UTC m=+63.933366139" Jun 02 14:37:28.400793 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:28.400765 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-lmr4g" event={"ID":"5940fc5f-4981-409b-9a68-6e8ff643fa7f","Type":"ContainerStarted","Data":"659dea300ece38db68f729d81b40b18036776e089ae982f855580e1e6660fa3b"} Jun 02 14:37:28.401502 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:28.401361 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-lmr4g" Jun 02 14:37:28.404106 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:28.403912 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c84798656-kglwc" event={"ID":"c78e333f-c32e-4738-8e85-585047ac830f","Type":"ContainerStarted","Data":"60d3019bd52744c61f65822b865ddf4f50807c085d36719435eb8f1e77346c23"} Jun 02 14:37:28.404535 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:28.404434 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5c84798656-kglwc" Jun 02 14:37:28.406961 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:28.406942 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6c4154b5-7168-4798-8a07-c7524b2dda87","Type":"ContainerStarted","Data":"084d8a20a3ce09c003a9777f177797ceef5e1482fa9fd4931cff2e340960a274"} Jun 02 14:37:28.407088 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:28.406967 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6c4154b5-7168-4798-8a07-c7524b2dda87","Type":"ContainerStarted","Data":"66f863c14b158a8dc64816adeb7cbf0b30a39c880f92dbe5ffb6338ee88354a2"} Jun 02 14:37:28.407088 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:28.406977 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6c4154b5-7168-4798-8a07-c7524b2dda87","Type":"ContainerStarted","Data":"62209f735f7d103d9016d9fe3b3755e22140db8563017eb4d996b828b31159c9"} Jun 02 14:37:28.407088 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:28.406986 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6c4154b5-7168-4798-8a07-c7524b2dda87","Type":"ContainerStarted","Data":"d8f1fcdcb2393602a42aec5eeb3d43be3a4425ea878eaf61a935c0a5778fbe82"} Jun 02 14:37:28.407330 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:28.407172 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-lmr4g" Jun 02 14:37:28.410421 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:28.410405 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5c84798656-kglwc" Jun 02 14:37:28.421914 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:28.421860 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-lmr4g" podStartSLOduration=4.045019094 podStartE2EDuration="8.421844056s" podCreationTimestamp="2026-06-02 14:37:20 +0000 UTC" firstStartedPulling="2026-06-02 14:37:23.684061618 +0000 UTC m=+61.188398048" lastFinishedPulling="2026-06-02 14:37:28.060886579 +0000 UTC m=+65.565223010" observedRunningTime="2026-06-02 14:37:28.420034113 +0000 UTC m=+65.924370578" watchObservedRunningTime="2026-06-02 14:37:28.421844056 +0000 UTC m=+65.926180509" Jun 02 14:37:28.479232 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:28.479187 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5c84798656-kglwc" podStartSLOduration=3.29683635 podStartE2EDuration="9.479171466s" podCreationTimestamp="2026-06-02 14:37:19 +0000 UTC" firstStartedPulling="2026-06-02 14:37:19.738288175 +0000 UTC m=+57.242624617" lastFinishedPulling="2026-06-02 14:37:25.920623291 +0000 UTC m=+63.424959733" observedRunningTime="2026-06-02 14:37:28.476804403 +0000 UTC m=+65.981140853" watchObservedRunningTime="2026-06-02 14:37:28.479171466 +0000 UTC m=+65.983507911" Jun 02 14:37:28.819979 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:28.819942 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c-metrics-certs\") pod \"network-metrics-daemon-gd9d4\" (UID: \"ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c\") " pod="openshift-multus/network-metrics-daemon-gd9d4" Jun 02 14:37:28.820192 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:28.820017 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9bxgw\" (UniqueName: \"kubernetes.io/projected/20db969a-b67f-4e16-8ec8-549fa5f1ae4b-kube-api-access-9bxgw\") pod \"network-check-target-2lz7g\" (UID: \"20db969a-b67f-4e16-8ec8-549fa5f1ae4b\") " pod="openshift-network-diagnostics/network-check-target-2lz7g" Jun 02 14:37:28.827356 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:28.827334 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 14:37:28.828016 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:28.827873 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 14:37:28.834278 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:28.834255 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c-metrics-certs\") pod \"network-metrics-daemon-gd9d4\" (UID: \"ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c\") " pod="openshift-multus/network-metrics-daemon-gd9d4" Jun 02 14:37:28.837555 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:28.837538 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 14:37:28.844170 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:28.844151 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bxgw\" (UniqueName: \"kubernetes.io/projected/20db969a-b67f-4e16-8ec8-549fa5f1ae4b-kube-api-access-9bxgw\") pod \"network-check-target-2lz7g\" (UID: \"20db969a-b67f-4e16-8ec8-549fa5f1ae4b\") " pod="openshift-network-diagnostics/network-check-target-2lz7g" Jun 02 14:37:29.023115 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:29.023088 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-84jzg\"" Jun 02 14:37:29.029509 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:29.029487 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gd9d4" Jun 02 14:37:29.032256 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:29.032231 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dxvnl\"" Jun 02 14:37:29.039780 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:29.039759 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lz7g" Jun 02 14:37:29.169219 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:29.169191 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gd9d4"] Jun 02 14:37:29.186078 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:29.186051 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2lz7g"] Jun 02 14:37:29.414500 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:29.414405 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6c4154b5-7168-4798-8a07-c7524b2dda87","Type":"ContainerStarted","Data":"84b5ea2d6c190bb71a1118e2ed6701dec501f28da0c225b1cb47db18e052d6e2"} Jun 02 14:37:29.414500 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:29.414444 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6c4154b5-7168-4798-8a07-c7524b2dda87","Type":"ContainerStarted","Data":"1a1e394271f82446f571a35d7ab352b169b7c8161835d5754f36ae347fc5c7e7"} Jun 02 14:37:29.415585 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:29.415562 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2lz7g" event={"ID":"20db969a-b67f-4e16-8ec8-549fa5f1ae4b","Type":"ContainerStarted","Data":"71f73fe3ce7ab4d3c0a0e74504423629023ece313e87e0d28efb658756882ab2"} Jun 02 14:37:29.416680 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:29.416658 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gd9d4" event={"ID":"ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c","Type":"ContainerStarted","Data":"ae4531256bd959dab190260eec8f3dd81c16ab2ca2f56cf7a930012a288eacf0"} Jun 02 14:37:29.447881 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:29.447814 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.7522513699999998 podStartE2EDuration="7.447794692s" podCreationTimestamp="2026-06-02 14:37:22 +0000 UTC" firstStartedPulling="2026-06-02 14:37:24.368024973 +0000 UTC m=+61.872361418" lastFinishedPulling="2026-06-02 14:37:28.063568296 +0000 UTC m=+65.567904740" observedRunningTime="2026-06-02 14:37:29.44561791 +0000 UTC m=+66.949954363" watchObservedRunningTime="2026-06-02 14:37:29.447794692 +0000 UTC m=+66.952131145" Jun 02 14:37:31.424035 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:31.423995 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gd9d4" event={"ID":"ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c","Type":"ContainerStarted","Data":"9c564530ced6fc8f4982170b37718501cb3aeac3120837082c505b8c35421ce3"} Jun 02 14:37:31.424035 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:31.424033 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gd9d4" event={"ID":"ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c","Type":"ContainerStarted","Data":"0468b6d0effa8e307f742d4e1021e766b7d309b4ead669431f7ba5bfb9b156e8"} Jun 02 14:37:31.451884 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:31.451812 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gd9d4" podStartSLOduration=67.2857855 podStartE2EDuration="1m8.451794052s" podCreationTimestamp="2026-06-02 14:36:23 +0000 UTC" firstStartedPulling="2026-06-02 14:37:29.175049403 +0000 UTC m=+66.679385846" lastFinishedPulling="2026-06-02 14:37:30.341057774 +0000 UTC m=+67.845394398" observedRunningTime="2026-06-02 14:37:31.448323875 +0000 UTC m=+68.952660326" watchObservedRunningTime="2026-06-02 14:37:31.451794052 +0000 UTC m=+68.956130505" Jun 02 14:37:32.843840 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:32.843789 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:37:33.432287 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:33.432254 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2lz7g" event={"ID":"20db969a-b67f-4e16-8ec8-549fa5f1ae4b","Type":"ContainerStarted","Data":"c3bc78a50238cd4c6a5e825eaf7764854dce7d8fc94fd7c0f7f4df38833a9ce6"} Jun 02 14:37:33.432448 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:33.432369 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2lz7g" Jun 02 14:37:33.451611 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:33.451543 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2lz7g" podStartSLOduration=66.979181606 podStartE2EDuration="1m10.451529683s" podCreationTimestamp="2026-06-02 14:36:23 +0000 UTC" firstStartedPulling="2026-06-02 14:37:29.192591459 +0000 UTC m=+66.696927903" lastFinishedPulling="2026-06-02 14:37:32.664939536 +0000 UTC m=+70.169275980" observedRunningTime="2026-06-02 14:37:33.450483933 +0000 UTC m=+70.954820386" watchObservedRunningTime="2026-06-02 14:37:33.451529683 +0000 UTC m=+70.955866132" Jun 02 14:37:40.943112 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:40.942976 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5d44f8b56b-gg5j2" Jun 02 14:37:40.943112 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:40.943039 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5d44f8b56b-gg5j2" Jun 02 14:37:47.581773 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:47.581711 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-69d4b46f44-xmfgw" podUID="00bab28d-d053-4fc2-bae7-a972cd91190e" containerName="console" containerID="cri-o://5de7f1a858a9d3e99c28bc905a9cf020a46dcc8139ae816acb97e2ff178ea392" gracePeriod=15 Jun 02 14:37:47.830003 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:47.829977 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-69d4b46f44-xmfgw_00bab28d-d053-4fc2-bae7-a972cd91190e/console/0.log" Jun 02 14:37:47.830152 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:47.830056 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69d4b46f44-xmfgw" Jun 02 14:37:47.998928 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:47.998900 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00bab28d-d053-4fc2-bae7-a972cd91190e-console-oauth-config\") pod \"00bab28d-d053-4fc2-bae7-a972cd91190e\" (UID: \"00bab28d-d053-4fc2-bae7-a972cd91190e\") " Jun 02 14:37:47.999121 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:47.998943 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtcdj\" (UniqueName: \"kubernetes.io/projected/00bab28d-d053-4fc2-bae7-a972cd91190e-kube-api-access-jtcdj\") pod \"00bab28d-d053-4fc2-bae7-a972cd91190e\" (UID: \"00bab28d-d053-4fc2-bae7-a972cd91190e\") " Jun 02 14:37:47.999121 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:47.998978 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00bab28d-d053-4fc2-bae7-a972cd91190e-service-ca\") pod \"00bab28d-d053-4fc2-bae7-a972cd91190e\" (UID: \"00bab28d-d053-4fc2-bae7-a972cd91190e\") " Jun 02 14:37:47.999121 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:47.999114 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00bab28d-d053-4fc2-bae7-a972cd91190e-console-config\") pod \"00bab28d-d053-4fc2-bae7-a972cd91190e\" (UID: \"00bab28d-d053-4fc2-bae7-a972cd91190e\") " Jun 02 14:37:47.999312 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:47.999176 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00bab28d-d053-4fc2-bae7-a972cd91190e-trusted-ca-bundle\") pod \"00bab28d-d053-4fc2-bae7-a972cd91190e\" (UID: \"00bab28d-d053-4fc2-bae7-a972cd91190e\") " Jun 02 14:37:47.999312 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:47.999208 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00bab28d-d053-4fc2-bae7-a972cd91190e-console-serving-cert\") pod \"00bab28d-d053-4fc2-bae7-a972cd91190e\" (UID: \"00bab28d-d053-4fc2-bae7-a972cd91190e\") " Jun 02 14:37:47.999312 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:47.999232 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00bab28d-d053-4fc2-bae7-a972cd91190e-oauth-serving-cert\") pod \"00bab28d-d053-4fc2-bae7-a972cd91190e\" (UID: \"00bab28d-d053-4fc2-bae7-a972cd91190e\") " Jun 02 14:37:47.999437 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:47.999368 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00bab28d-d053-4fc2-bae7-a972cd91190e-service-ca" (OuterVolumeSpecName: "service-ca") pod "00bab28d-d053-4fc2-bae7-a972cd91190e" (UID: "00bab28d-d053-4fc2-bae7-a972cd91190e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 14:37:47.999523 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:47.999493 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00bab28d-d053-4fc2-bae7-a972cd91190e-console-config" (OuterVolumeSpecName: "console-config") pod "00bab28d-d053-4fc2-bae7-a972cd91190e" (UID: "00bab28d-d053-4fc2-bae7-a972cd91190e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 14:37:47.999572 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:47.999517 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00bab28d-d053-4fc2-bae7-a972cd91190e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "00bab28d-d053-4fc2-bae7-a972cd91190e" (UID: "00bab28d-d053-4fc2-bae7-a972cd91190e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 14:37:47.999619 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:47.999594 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00bab28d-d053-4fc2-bae7-a972cd91190e-service-ca\") on node \"ip-10-0-141-41.ec2.internal\" DevicePath \"\"" Jun 02 14:37:47.999619 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:47.999612 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00bab28d-d053-4fc2-bae7-a972cd91190e-console-config\") on node \"ip-10-0-141-41.ec2.internal\" DevicePath \"\"" Jun 02 14:37:47.999706 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:47.999625 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00bab28d-d053-4fc2-bae7-a972cd91190e-trusted-ca-bundle\") on node \"ip-10-0-141-41.ec2.internal\" DevicePath \"\"" Jun 02 14:37:47.999706 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:47.999614 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00bab28d-d053-4fc2-bae7-a972cd91190e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "00bab28d-d053-4fc2-bae7-a972cd91190e" (UID: "00bab28d-d053-4fc2-bae7-a972cd91190e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 14:37:48.001317 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:48.001291 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00bab28d-d053-4fc2-bae7-a972cd91190e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "00bab28d-d053-4fc2-bae7-a972cd91190e" (UID: "00bab28d-d053-4fc2-bae7-a972cd91190e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 14:37:48.001480 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:48.001402 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00bab28d-d053-4fc2-bae7-a972cd91190e-kube-api-access-jtcdj" (OuterVolumeSpecName: "kube-api-access-jtcdj") pod "00bab28d-d053-4fc2-bae7-a972cd91190e" (UID: "00bab28d-d053-4fc2-bae7-a972cd91190e"). InnerVolumeSpecName "kube-api-access-jtcdj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 14:37:48.001480 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:48.001408 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00bab28d-d053-4fc2-bae7-a972cd91190e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "00bab28d-d053-4fc2-bae7-a972cd91190e" (UID: "00bab28d-d053-4fc2-bae7-a972cd91190e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 14:37:48.100753 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:48.100718 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00bab28d-d053-4fc2-bae7-a972cd91190e-console-oauth-config\") on node \"ip-10-0-141-41.ec2.internal\" DevicePath \"\"" Jun 02 14:37:48.100753 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:48.100746 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtcdj\" (UniqueName: \"kubernetes.io/projected/00bab28d-d053-4fc2-bae7-a972cd91190e-kube-api-access-jtcdj\") on node \"ip-10-0-141-41.ec2.internal\" DevicePath \"\"" Jun 02 14:37:48.100753 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:48.100756 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00bab28d-d053-4fc2-bae7-a972cd91190e-console-serving-cert\") on node \"ip-10-0-141-41.ec2.internal\" DevicePath \"\"" Jun 02 14:37:48.100969 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:48.100765 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00bab28d-d053-4fc2-bae7-a972cd91190e-oauth-serving-cert\") on node \"ip-10-0-141-41.ec2.internal\" DevicePath \"\"" Jun 02 14:37:48.477375 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:48.477345 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-69d4b46f44-xmfgw_00bab28d-d053-4fc2-bae7-a972cd91190e/console/0.log" Jun 02 14:37:48.477561 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:48.477396 2566 generic.go:358] "Generic (PLEG): container finished" podID="00bab28d-d053-4fc2-bae7-a972cd91190e" containerID="5de7f1a858a9d3e99c28bc905a9cf020a46dcc8139ae816acb97e2ff178ea392" exitCode=2 Jun 02 14:37:48.477561 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:48.477449 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69d4b46f44-xmfgw" event={"ID":"00bab28d-d053-4fc2-bae7-a972cd91190e","Type":"ContainerDied","Data":"5de7f1a858a9d3e99c28bc905a9cf020a46dcc8139ae816acb97e2ff178ea392"} Jun 02 14:37:48.477561 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:48.477497 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69d4b46f44-xmfgw" event={"ID":"00bab28d-d053-4fc2-bae7-a972cd91190e","Type":"ContainerDied","Data":"a652d6ce73f8afee91a3748c80c5df37167987ec04f97c305e40fa232e914ab3"} Jun 02 14:37:48.477561 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:48.477511 2566 scope.go:117] "RemoveContainer" containerID="5de7f1a858a9d3e99c28bc905a9cf020a46dcc8139ae816acb97e2ff178ea392" Jun 02 14:37:48.477561 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:48.477527 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69d4b46f44-xmfgw" Jun 02 14:37:48.486384 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:48.486356 2566 scope.go:117] "RemoveContainer" containerID="5de7f1a858a9d3e99c28bc905a9cf020a46dcc8139ae816acb97e2ff178ea392" Jun 02 14:37:48.486674 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:37:48.486653 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5de7f1a858a9d3e99c28bc905a9cf020a46dcc8139ae816acb97e2ff178ea392\": container with ID starting with 5de7f1a858a9d3e99c28bc905a9cf020a46dcc8139ae816acb97e2ff178ea392 not found: ID does not exist" containerID="5de7f1a858a9d3e99c28bc905a9cf020a46dcc8139ae816acb97e2ff178ea392" Jun 02 14:37:48.486747 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:48.486685 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5de7f1a858a9d3e99c28bc905a9cf020a46dcc8139ae816acb97e2ff178ea392"} err="failed to get container status \"5de7f1a858a9d3e99c28bc905a9cf020a46dcc8139ae816acb97e2ff178ea392\": rpc error: code = NotFound desc = could not find container \"5de7f1a858a9d3e99c28bc905a9cf020a46dcc8139ae816acb97e2ff178ea392\": container with ID starting with 5de7f1a858a9d3e99c28bc905a9cf020a46dcc8139ae816acb97e2ff178ea392 not found: ID does not exist" Jun 02 14:37:48.502859 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:48.502832 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69d4b46f44-xmfgw"] Jun 02 14:37:48.508662 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:48.508640 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69d4b46f44-xmfgw"] Jun 02 14:37:49.111288 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:37:49.111255 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00bab28d-d053-4fc2-bae7-a972cd91190e" path="/var/lib/kubelet/pods/00bab28d-d053-4fc2-bae7-a972cd91190e/volumes" Jun 02 14:38:00.948262 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:00.948232 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5d44f8b56b-gg5j2" Jun 02 14:38:00.952302 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:00.952278 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5d44f8b56b-gg5j2" Jun 02 14:38:04.438047 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:04.438015 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2lz7g" Jun 02 14:38:08.431653 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:08.431617 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:08.451273 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:08.451247 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:08.558236 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:08.558205 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:16.439902 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:16.439863 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 14:38:16.440840 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:16.440778 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="597a9f6c-3e8d-4af7-9923-d112775fbb58" containerName="alertmanager" containerID="cri-o://96a803c378bb861e638b39ce68dc08dd0b2f42682fc725ddb70b2ed185f39e3c" gracePeriod=120 Jun 02 14:38:16.441052 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:16.440998 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="597a9f6c-3e8d-4af7-9923-d112775fbb58" containerName="kube-rbac-proxy" containerID="cri-o://747c50f631cf80ae56d99dbfac2d88f6467e54f5c1664010baf1ddf8707f458c" gracePeriod=120 Jun 02 14:38:16.441507 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:16.441122 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="597a9f6c-3e8d-4af7-9923-d112775fbb58" containerName="prom-label-proxy" containerID="cri-o://dd76df652ada6ccdedcbded5e572f8569013e6542bd1f3e7dede6f87f8ebed84" gracePeriod=120 Jun 02 14:38:16.441507 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:16.441193 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="597a9f6c-3e8d-4af7-9923-d112775fbb58" containerName="config-reloader" containerID="cri-o://d7282366ee5594f66f2145cc4051888499f4e746367a6e0463f2284948ad11c5" gracePeriod=120 Jun 02 14:38:16.441507 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:16.441242 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="597a9f6c-3e8d-4af7-9923-d112775fbb58" containerName="kube-rbac-proxy-web" containerID="cri-o://30f235e9150172a9a82a9d736c05f0631cafaa813e7fc5f3e5c763d0da1db78e" gracePeriod=120 Jun 02 14:38:16.446766 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:16.446550 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="597a9f6c-3e8d-4af7-9923-d112775fbb58" containerName="kube-rbac-proxy-metric" containerID="cri-o://aab062d4ddf982d66bb6b5db66789332dba5f14cc7412ad09b70c4fdd3ecd1d6" gracePeriod=120 Jun 02 14:38:16.570116 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:16.570089 2566 generic.go:358] "Generic (PLEG): container finished" podID="597a9f6c-3e8d-4af7-9923-d112775fbb58" containerID="dd76df652ada6ccdedcbded5e572f8569013e6542bd1f3e7dede6f87f8ebed84" exitCode=0 Jun 02 14:38:16.570116 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:16.570111 2566 generic.go:358] "Generic (PLEG): container finished" podID="597a9f6c-3e8d-4af7-9923-d112775fbb58" containerID="aab062d4ddf982d66bb6b5db66789332dba5f14cc7412ad09b70c4fdd3ecd1d6" exitCode=0 Jun 02 14:38:16.570116 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:16.570117 2566 generic.go:358] "Generic (PLEG): container finished" podID="597a9f6c-3e8d-4af7-9923-d112775fbb58" containerID="747c50f631cf80ae56d99dbfac2d88f6467e54f5c1664010baf1ddf8707f458c" exitCode=0 Jun 02 14:38:16.570327 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:16.570124 2566 generic.go:358] "Generic (PLEG): container finished" podID="597a9f6c-3e8d-4af7-9923-d112775fbb58" containerID="d7282366ee5594f66f2145cc4051888499f4e746367a6e0463f2284948ad11c5" exitCode=0 Jun 02 14:38:16.570327 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:16.570157 2566 generic.go:358] "Generic (PLEG): container finished" podID="597a9f6c-3e8d-4af7-9923-d112775fbb58" containerID="96a803c378bb861e638b39ce68dc08dd0b2f42682fc725ddb70b2ed185f39e3c" exitCode=0 Jun 02 14:38:16.570327 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:16.570172 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"597a9f6c-3e8d-4af7-9923-d112775fbb58","Type":"ContainerDied","Data":"dd76df652ada6ccdedcbded5e572f8569013e6542bd1f3e7dede6f87f8ebed84"} Jun 02 14:38:16.570327 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:16.570206 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"597a9f6c-3e8d-4af7-9923-d112775fbb58","Type":"ContainerDied","Data":"aab062d4ddf982d66bb6b5db66789332dba5f14cc7412ad09b70c4fdd3ecd1d6"} Jun 02 14:38:16.570327 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:16.570216 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"597a9f6c-3e8d-4af7-9923-d112775fbb58","Type":"ContainerDied","Data":"747c50f631cf80ae56d99dbfac2d88f6467e54f5c1664010baf1ddf8707f458c"} Jun 02 14:38:16.570327 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:16.570225 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"597a9f6c-3e8d-4af7-9923-d112775fbb58","Type":"ContainerDied","Data":"d7282366ee5594f66f2145cc4051888499f4e746367a6e0463f2284948ad11c5"} Jun 02 14:38:16.570327 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:16.570233 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"597a9f6c-3e8d-4af7-9923-d112775fbb58","Type":"ContainerDied","Data":"96a803c378bb861e638b39ce68dc08dd0b2f42682fc725ddb70b2ed185f39e3c"} Jun 02 14:38:17.577465 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:17.577433 2566 generic.go:358] "Generic (PLEG): container finished" podID="597a9f6c-3e8d-4af7-9923-d112775fbb58" containerID="30f235e9150172a9a82a9d736c05f0631cafaa813e7fc5f3e5c763d0da1db78e" exitCode=0 Jun 02 14:38:17.577845 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:17.577514 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"597a9f6c-3e8d-4af7-9923-d112775fbb58","Type":"ContainerDied","Data":"30f235e9150172a9a82a9d736c05f0631cafaa813e7fc5f3e5c763d0da1db78e"} Jun 02 14:38:17.689935 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:17.689911 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:38:17.721382 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:17.721353 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vc772\" (UniqueName: \"kubernetes.io/projected/597a9f6c-3e8d-4af7-9923-d112775fbb58-kube-api-access-vc772\") pod \"597a9f6c-3e8d-4af7-9923-d112775fbb58\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " Jun 02 14:38:17.721382 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:17.721385 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/597a9f6c-3e8d-4af7-9923-d112775fbb58-tls-assets\") pod \"597a9f6c-3e8d-4af7-9923-d112775fbb58\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " Jun 02 14:38:17.721626 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:17.721413 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/597a9f6c-3e8d-4af7-9923-d112775fbb58-secret-alertmanager-main-tls\") pod \"597a9f6c-3e8d-4af7-9923-d112775fbb58\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " Jun 02 14:38:17.721626 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:17.721430 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/597a9f6c-3e8d-4af7-9923-d112775fbb58-metrics-client-ca\") pod \"597a9f6c-3e8d-4af7-9923-d112775fbb58\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " Jun 02 14:38:17.721626 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:17.721456 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/597a9f6c-3e8d-4af7-9923-d112775fbb58-secret-alertmanager-kube-rbac-proxy\") pod \"597a9f6c-3e8d-4af7-9923-d112775fbb58\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " Jun 02 14:38:17.721626 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:17.721484 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/597a9f6c-3e8d-4af7-9923-d112775fbb58-alertmanager-trusted-ca-bundle\") pod \"597a9f6c-3e8d-4af7-9923-d112775fbb58\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " Jun 02 14:38:17.721626 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:17.721563 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/597a9f6c-3e8d-4af7-9923-d112775fbb58-secret-alertmanager-kube-rbac-proxy-metric\") pod \"597a9f6c-3e8d-4af7-9923-d112775fbb58\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " Jun 02 14:38:17.721626 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:17.721590 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/597a9f6c-3e8d-4af7-9923-d112775fbb58-config-volume\") pod \"597a9f6c-3e8d-4af7-9923-d112775fbb58\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " Jun 02 14:38:17.721626 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:17.721614 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/597a9f6c-3e8d-4af7-9923-d112775fbb58-alertmanager-main-db\") pod \"597a9f6c-3e8d-4af7-9923-d112775fbb58\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " Jun 02 14:38:17.721966 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:17.721652 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/597a9f6c-3e8d-4af7-9923-d112775fbb58-cluster-tls-config\") pod \"597a9f6c-3e8d-4af7-9923-d112775fbb58\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " Jun 02 14:38:17.721966 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:17.721685 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/597a9f6c-3e8d-4af7-9923-d112775fbb58-web-config\") pod \"597a9f6c-3e8d-4af7-9923-d112775fbb58\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " Jun 02 14:38:17.721966 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:17.721712 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/597a9f6c-3e8d-4af7-9923-d112775fbb58-config-out\") pod \"597a9f6c-3e8d-4af7-9923-d112775fbb58\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " Jun 02 14:38:17.721966 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:17.721743 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/597a9f6c-3e8d-4af7-9923-d112775fbb58-secret-alertmanager-kube-rbac-proxy-web\") pod \"597a9f6c-3e8d-4af7-9923-d112775fbb58\" (UID: \"597a9f6c-3e8d-4af7-9923-d112775fbb58\") " Jun 02 14:38:17.721966 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:17.721849 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/597a9f6c-3e8d-4af7-9923-d112775fbb58-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "597a9f6c-3e8d-4af7-9923-d112775fbb58" (UID: "597a9f6c-3e8d-4af7-9923-d112775fbb58"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 14:38:17.722395 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:17.722078 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/597a9f6c-3e8d-4af7-9923-d112775fbb58-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "597a9f6c-3e8d-4af7-9923-d112775fbb58" (UID: "597a9f6c-3e8d-4af7-9923-d112775fbb58"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 14:38:17.722454 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:17.722397 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/597a9f6c-3e8d-4af7-9923-d112775fbb58-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "597a9f6c-3e8d-4af7-9923-d112775fbb58" (UID: "597a9f6c-3e8d-4af7-9923-d112775fbb58"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 14:38:17.722846 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:17.722615 2566 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/597a9f6c-3e8d-4af7-9923-d112775fbb58-metrics-client-ca\") on node \"ip-10-0-141-41.ec2.internal\" DevicePath \"\"" Jun 02 14:38:17.722846 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:17.722746 2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/597a9f6c-3e8d-4af7-9923-d112775fbb58-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-41.ec2.internal\" DevicePath \"\"" Jun 02 14:38:17.722846 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:17.722812 2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/597a9f6c-3e8d-4af7-9923-d112775fbb58-alertmanager-main-db\") on node \"ip-10-0-141-41.ec2.internal\" DevicePath \"\"" Jun 02 14:38:17.727123 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:17.727081 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/597a9f6c-3e8d-4af7-9923-d112775fbb58-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "597a9f6c-3e8d-4af7-9923-d112775fbb58" (UID: "597a9f6c-3e8d-4af7-9923-d112775fbb58"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 14:38:17.728226 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:17.728099 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/597a9f6c-3e8d-4af7-9923-d112775fbb58-config-out" (OuterVolumeSpecName: "config-out") pod "597a9f6c-3e8d-4af7-9923-d112775fbb58" (UID: "597a9f6c-3e8d-4af7-9923-d112775fbb58"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 14:38:17.728226 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:17.728109 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/597a9f6c-3e8d-4af7-9923-d112775fbb58-kube-api-access-vc772" (OuterVolumeSpecName: "kube-api-access-vc772") pod "597a9f6c-3e8d-4af7-9923-d112775fbb58" (UID: "597a9f6c-3e8d-4af7-9923-d112775fbb58"). InnerVolumeSpecName "kube-api-access-vc772". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 14:38:17.728226 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:17.728213 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/597a9f6c-3e8d-4af7-9923-d112775fbb58-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "597a9f6c-3e8d-4af7-9923-d112775fbb58" (UID: "597a9f6c-3e8d-4af7-9923-d112775fbb58"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 14:38:17.728580 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:17.728540 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/597a9f6c-3e8d-4af7-9923-d112775fbb58-config-volume" (OuterVolumeSpecName: "config-volume") pod "597a9f6c-3e8d-4af7-9923-d112775fbb58" (UID: "597a9f6c-3e8d-4af7-9923-d112775fbb58"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 14:38:17.729291 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:17.729119 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/597a9f6c-3e8d-4af7-9923-d112775fbb58-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "597a9f6c-3e8d-4af7-9923-d112775fbb58" (UID: "597a9f6c-3e8d-4af7-9923-d112775fbb58"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 14:38:17.729291 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:17.729250 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/597a9f6c-3e8d-4af7-9923-d112775fbb58-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "597a9f6c-3e8d-4af7-9923-d112775fbb58" (UID: "597a9f6c-3e8d-4af7-9923-d112775fbb58"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 14:38:17.729291 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:17.729269 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/597a9f6c-3e8d-4af7-9923-d112775fbb58-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "597a9f6c-3e8d-4af7-9923-d112775fbb58" (UID: "597a9f6c-3e8d-4af7-9923-d112775fbb58"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 14:38:17.733488 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:17.733461 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/597a9f6c-3e8d-4af7-9923-d112775fbb58-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "597a9f6c-3e8d-4af7-9923-d112775fbb58" (UID: "597a9f6c-3e8d-4af7-9923-d112775fbb58"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 14:38:17.745192 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:17.745154 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/597a9f6c-3e8d-4af7-9923-d112775fbb58-web-config" (OuterVolumeSpecName: "web-config") pod "597a9f6c-3e8d-4af7-9923-d112775fbb58" (UID: "597a9f6c-3e8d-4af7-9923-d112775fbb58"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 14:38:17.823861 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:17.823766 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vc772\" (UniqueName: \"kubernetes.io/projected/597a9f6c-3e8d-4af7-9923-d112775fbb58-kube-api-access-vc772\") on node \"ip-10-0-141-41.ec2.internal\" DevicePath \"\"" Jun 02 14:38:17.823861 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:17.823801 2566 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/597a9f6c-3e8d-4af7-9923-d112775fbb58-tls-assets\") on node \"ip-10-0-141-41.ec2.internal\" DevicePath \"\"" Jun 02 14:38:17.823861 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:17.823813 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/597a9f6c-3e8d-4af7-9923-d112775fbb58-secret-alertmanager-main-tls\") on node \"ip-10-0-141-41.ec2.internal\" DevicePath \"\"" Jun 02 14:38:17.823861 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:17.823828 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/597a9f6c-3e8d-4af7-9923-d112775fbb58-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-41.ec2.internal\" DevicePath \"\"" Jun 02 14:38:17.823861 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:17.823841 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/597a9f6c-3e8d-4af7-9923-d112775fbb58-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-41.ec2.internal\" DevicePath \"\"" Jun 02 14:38:17.823861 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:17.823854 2566 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/597a9f6c-3e8d-4af7-9923-d112775fbb58-config-volume\") on node \"ip-10-0-141-41.ec2.internal\" DevicePath \"\"" Jun 02 14:38:17.824176 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:17.823867 2566 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/597a9f6c-3e8d-4af7-9923-d112775fbb58-cluster-tls-config\") on node \"ip-10-0-141-41.ec2.internal\" DevicePath \"\"" Jun 02 14:38:17.824176 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:17.823880 2566 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/597a9f6c-3e8d-4af7-9923-d112775fbb58-web-config\") on node \"ip-10-0-141-41.ec2.internal\" DevicePath \"\"" Jun 02 14:38:17.824176 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:17.823890 2566 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/597a9f6c-3e8d-4af7-9923-d112775fbb58-config-out\") on node \"ip-10-0-141-41.ec2.internal\" DevicePath \"\"" Jun 02 14:38:17.824176 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:17.823900 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/597a9f6c-3e8d-4af7-9923-d112775fbb58-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-41.ec2.internal\" DevicePath \"\"" Jun 02 14:38:18.583190 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.583157 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"597a9f6c-3e8d-4af7-9923-d112775fbb58","Type":"ContainerDied","Data":"d69c0495dce7bde7bf18a30b3c03d6d7df7016e7a2eed6c93c454f444288e1fa"} Jun 02 14:38:18.583190 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.583186 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:38:18.583600 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.583202 2566 scope.go:117] "RemoveContainer" containerID="dd76df652ada6ccdedcbded5e572f8569013e6542bd1f3e7dede6f87f8ebed84" Jun 02 14:38:18.591674 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.591570 2566 scope.go:117] "RemoveContainer" containerID="aab062d4ddf982d66bb6b5db66789332dba5f14cc7412ad09b70c4fdd3ecd1d6" Jun 02 14:38:18.598428 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.598410 2566 scope.go:117] "RemoveContainer" containerID="747c50f631cf80ae56d99dbfac2d88f6467e54f5c1664010baf1ddf8707f458c" Jun 02 14:38:18.605946 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.605922 2566 scope.go:117] "RemoveContainer" containerID="30f235e9150172a9a82a9d736c05f0631cafaa813e7fc5f3e5c763d0da1db78e" Jun 02 14:38:18.607869 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.607844 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 14:38:18.612873 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.612849 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 14:38:18.614874 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.614856 2566 scope.go:117] "RemoveContainer" containerID="d7282366ee5594f66f2145cc4051888499f4e746367a6e0463f2284948ad11c5" Jun 02 14:38:18.622231 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.622211 2566 scope.go:117] "RemoveContainer" containerID="96a803c378bb861e638b39ce68dc08dd0b2f42682fc725ddb70b2ed185f39e3c" Jun 02 14:38:18.629320 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.629285 2566 scope.go:117] "RemoveContainer" containerID="3b42b7630192aed73c0843224594c2e849937d646de4dfe1a367f5d2ed5ea912" Jun 02 14:38:18.638221 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.638200 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 14:38:18.638478 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.638466 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00bab28d-d053-4fc2-bae7-a972cd91190e" containerName="console" Jun 02 14:38:18.638478 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.638478 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="00bab28d-d053-4fc2-bae7-a972cd91190e" containerName="console" Jun 02 14:38:18.638594 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.638492 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="597a9f6c-3e8d-4af7-9923-d112775fbb58" containerName="init-config-reloader" Jun 02 14:38:18.638594 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.638498 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="597a9f6c-3e8d-4af7-9923-d112775fbb58" containerName="init-config-reloader" Jun 02 14:38:18.638594 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.638508 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="597a9f6c-3e8d-4af7-9923-d112775fbb58" containerName="prom-label-proxy" Jun 02 14:38:18.638594 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.638514 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="597a9f6c-3e8d-4af7-9923-d112775fbb58" containerName="prom-label-proxy" Jun 02 14:38:18.638594 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.638521 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="597a9f6c-3e8d-4af7-9923-d112775fbb58" containerName="kube-rbac-proxy-web" Jun 02 14:38:18.638594 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.638526 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="597a9f6c-3e8d-4af7-9923-d112775fbb58" containerName="kube-rbac-proxy-web" Jun 02 14:38:18.638594 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.638533 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="597a9f6c-3e8d-4af7-9923-d112775fbb58" containerName="kube-rbac-proxy-metric" Jun 02 14:38:18.638594 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.638539 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="597a9f6c-3e8d-4af7-9923-d112775fbb58" containerName="kube-rbac-proxy-metric" Jun 02 14:38:18.638594 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.638545 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="597a9f6c-3e8d-4af7-9923-d112775fbb58" containerName="kube-rbac-proxy" Jun 02 14:38:18.638594 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.638550 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="597a9f6c-3e8d-4af7-9923-d112775fbb58" containerName="kube-rbac-proxy" Jun 02 14:38:18.638594 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.638562 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="597a9f6c-3e8d-4af7-9923-d112775fbb58" containerName="config-reloader" Jun 02 14:38:18.638594 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.638566 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="597a9f6c-3e8d-4af7-9923-d112775fbb58" containerName="config-reloader" Jun 02 14:38:18.638594 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.638572 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="597a9f6c-3e8d-4af7-9923-d112775fbb58" containerName="alertmanager" Jun 02 14:38:18.638594 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.638576 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="597a9f6c-3e8d-4af7-9923-d112775fbb58" containerName="alertmanager" Jun 02 14:38:18.639280 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.638617 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="597a9f6c-3e8d-4af7-9923-d112775fbb58" containerName="kube-rbac-proxy" Jun 02 14:38:18.639280 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.638624 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="597a9f6c-3e8d-4af7-9923-d112775fbb58" containerName="kube-rbac-proxy-web" Jun 02 14:38:18.639280 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.638631 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="597a9f6c-3e8d-4af7-9923-d112775fbb58" containerName="kube-rbac-proxy-metric" Jun 02 14:38:18.639280 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.638639 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="597a9f6c-3e8d-4af7-9923-d112775fbb58" containerName="prom-label-proxy" Jun 02 14:38:18.639280 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.638645 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="597a9f6c-3e8d-4af7-9923-d112775fbb58" containerName="alertmanager" Jun 02 14:38:18.639280 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.638653 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="00bab28d-d053-4fc2-bae7-a972cd91190e" containerName="console" Jun 02 14:38:18.639280 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.638671 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="597a9f6c-3e8d-4af7-9923-d112775fbb58" containerName="config-reloader" Jun 02 14:38:18.642259 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.642239 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:38:18.644497 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.644475 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 02 14:38:18.644605 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.644581 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 02 14:38:18.644804 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.644757 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 02 14:38:18.644804 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.644771 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-jzfhd\"" Jun 02 14:38:18.644804 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.644795 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 02 14:38:18.645448 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.645244 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 02 14:38:18.645448 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.645305 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 02 14:38:18.645448 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.645307 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 02 14:38:18.645448 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.645356 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 02 14:38:18.657105 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.657072 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 14:38:18.660145 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.658488 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 02 14:38:18.730320 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.730283 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b825488e-9025-44e4-84c9-8c0205feb29e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b825488e-9025-44e4-84c9-8c0205feb29e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:38:18.730488 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.730331 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b825488e-9025-44e4-84c9-8c0205feb29e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b825488e-9025-44e4-84c9-8c0205feb29e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:38:18.730488 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.730349 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b825488e-9025-44e4-84c9-8c0205feb29e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b825488e-9025-44e4-84c9-8c0205feb29e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:38:18.730488 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.730367 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b825488e-9025-44e4-84c9-8c0205feb29e-web-config\") pod \"alertmanager-main-0\" (UID: \"b825488e-9025-44e4-84c9-8c0205feb29e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:38:18.730488 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.730395 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxjtv\" (UniqueName: \"kubernetes.io/projected/b825488e-9025-44e4-84c9-8c0205feb29e-kube-api-access-rxjtv\") pod \"alertmanager-main-0\" (UID: \"b825488e-9025-44e4-84c9-8c0205feb29e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:38:18.730488 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.730473 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b825488e-9025-44e4-84c9-8c0205feb29e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b825488e-9025-44e4-84c9-8c0205feb29e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:38:18.730646 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.730512 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b825488e-9025-44e4-84c9-8c0205feb29e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b825488e-9025-44e4-84c9-8c0205feb29e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:38:18.730646 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.730541 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b825488e-9025-44e4-84c9-8c0205feb29e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b825488e-9025-44e4-84c9-8c0205feb29e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:38:18.730646 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.730570 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b825488e-9025-44e4-84c9-8c0205feb29e-config-volume\") pod \"alertmanager-main-0\" (UID: \"b825488e-9025-44e4-84c9-8c0205feb29e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:38:18.730646 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.730589 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b825488e-9025-44e4-84c9-8c0205feb29e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b825488e-9025-44e4-84c9-8c0205feb29e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:38:18.730646 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.730633 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b825488e-9025-44e4-84c9-8c0205feb29e-config-out\") pod \"alertmanager-main-0\" (UID: \"b825488e-9025-44e4-84c9-8c0205feb29e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:38:18.730819 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.730653 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b825488e-9025-44e4-84c9-8c0205feb29e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b825488e-9025-44e4-84c9-8c0205feb29e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:38:18.730819 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.730668 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b825488e-9025-44e4-84c9-8c0205feb29e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b825488e-9025-44e4-84c9-8c0205feb29e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:38:18.831986 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.831904 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b825488e-9025-44e4-84c9-8c0205feb29e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b825488e-9025-44e4-84c9-8c0205feb29e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:38:18.831986 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.831940 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b825488e-9025-44e4-84c9-8c0205feb29e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b825488e-9025-44e4-84c9-8c0205feb29e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:38:18.831986 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.831957 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b825488e-9025-44e4-84c9-8c0205feb29e-web-config\") pod \"alertmanager-main-0\" (UID: \"b825488e-9025-44e4-84c9-8c0205feb29e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:38:18.832276 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.831996 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rxjtv\" (UniqueName: \"kubernetes.io/projected/b825488e-9025-44e4-84c9-8c0205feb29e-kube-api-access-rxjtv\") pod \"alertmanager-main-0\" (UID: \"b825488e-9025-44e4-84c9-8c0205feb29e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:38:18.832276 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.832026 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b825488e-9025-44e4-84c9-8c0205feb29e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b825488e-9025-44e4-84c9-8c0205feb29e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:38:18.832276 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.832050 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b825488e-9025-44e4-84c9-8c0205feb29e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b825488e-9025-44e4-84c9-8c0205feb29e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:38:18.832276 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.832088 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b825488e-9025-44e4-84c9-8c0205feb29e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b825488e-9025-44e4-84c9-8c0205feb29e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:38:18.832276 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.832124 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b825488e-9025-44e4-84c9-8c0205feb29e-config-volume\") pod \"alertmanager-main-0\" (UID: \"b825488e-9025-44e4-84c9-8c0205feb29e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:38:18.832276 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.832181 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b825488e-9025-44e4-84c9-8c0205feb29e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b825488e-9025-44e4-84c9-8c0205feb29e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:38:18.832276 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.832217 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b825488e-9025-44e4-84c9-8c0205feb29e-config-out\") pod \"alertmanager-main-0\" (UID: \"b825488e-9025-44e4-84c9-8c0205feb29e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:38:18.832276 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.832253 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b825488e-9025-44e4-84c9-8c0205feb29e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b825488e-9025-44e4-84c9-8c0205feb29e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:38:18.832672 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.832281 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b825488e-9025-44e4-84c9-8c0205feb29e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b825488e-9025-44e4-84c9-8c0205feb29e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:38:18.832672 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.832371 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b825488e-9025-44e4-84c9-8c0205feb29e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b825488e-9025-44e4-84c9-8c0205feb29e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:38:18.832672 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.832491 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b825488e-9025-44e4-84c9-8c0205feb29e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b825488e-9025-44e4-84c9-8c0205feb29e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:38:18.832843 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.832820 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b825488e-9025-44e4-84c9-8c0205feb29e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b825488e-9025-44e4-84c9-8c0205feb29e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:38:18.833943 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.833890 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b825488e-9025-44e4-84c9-8c0205feb29e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b825488e-9025-44e4-84c9-8c0205feb29e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:38:18.835302 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.835276 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b825488e-9025-44e4-84c9-8c0205feb29e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b825488e-9025-44e4-84c9-8c0205feb29e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:38:18.835522 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.835500 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b825488e-9025-44e4-84c9-8c0205feb29e-config-out\") pod \"alertmanager-main-0\" (UID: \"b825488e-9025-44e4-84c9-8c0205feb29e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:38:18.835821 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.835797 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b825488e-9025-44e4-84c9-8c0205feb29e-web-config\") pod \"alertmanager-main-0\" (UID: \"b825488e-9025-44e4-84c9-8c0205feb29e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:38:18.835946 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.835919 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b825488e-9025-44e4-84c9-8c0205feb29e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b825488e-9025-44e4-84c9-8c0205feb29e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:38:18.836205 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.836185 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b825488e-9025-44e4-84c9-8c0205feb29e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b825488e-9025-44e4-84c9-8c0205feb29e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:38:18.836299 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.836278 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b825488e-9025-44e4-84c9-8c0205feb29e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b825488e-9025-44e4-84c9-8c0205feb29e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:38:18.836352 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.836338 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b825488e-9025-44e4-84c9-8c0205feb29e-config-volume\") pod \"alertmanager-main-0\" (UID: \"b825488e-9025-44e4-84c9-8c0205feb29e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:38:18.836385 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.836347 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b825488e-9025-44e4-84c9-8c0205feb29e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b825488e-9025-44e4-84c9-8c0205feb29e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:38:18.837077 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.837054 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b825488e-9025-44e4-84c9-8c0205feb29e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b825488e-9025-44e4-84c9-8c0205feb29e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:38:18.840876 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.840856 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxjtv\" (UniqueName: \"kubernetes.io/projected/b825488e-9025-44e4-84c9-8c0205feb29e-kube-api-access-rxjtv\") pod \"alertmanager-main-0\" (UID: \"b825488e-9025-44e4-84c9-8c0205feb29e\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:38:18.954381 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:18.954343 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 14:38:19.088991 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:19.088964 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 14:38:19.091393 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:38:19.091363 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb825488e_9025_44e4_84c9_8c0205feb29e.slice/crio-ff78e134621d9712d63354d0c8ea9a385cd62a395e3e5c71f495be2e8bc8e659 WatchSource:0}: Error finding container ff78e134621d9712d63354d0c8ea9a385cd62a395e3e5c71f495be2e8bc8e659: Status 404 returned error can't find the container with id ff78e134621d9712d63354d0c8ea9a385cd62a395e3e5c71f495be2e8bc8e659 Jun 02 14:38:19.111434 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:19.111410 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="597a9f6c-3e8d-4af7-9923-d112775fbb58" path="/var/lib/kubelet/pods/597a9f6c-3e8d-4af7-9923-d112775fbb58/volumes" Jun 02 14:38:19.590936 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:19.590901 2566 generic.go:358] "Generic (PLEG): container finished" podID="b825488e-9025-44e4-84c9-8c0205feb29e" containerID="244b95b2acb5ae46a254ec1dff479c1a51a8a2036cb980a702001b0dc8f1d03c" exitCode=0 Jun 02 14:38:19.591425 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:19.590943 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b825488e-9025-44e4-84c9-8c0205feb29e","Type":"ContainerDied","Data":"244b95b2acb5ae46a254ec1dff479c1a51a8a2036cb980a702001b0dc8f1d03c"} Jun 02 14:38:19.591425 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:19.590964 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b825488e-9025-44e4-84c9-8c0205feb29e","Type":"ContainerStarted","Data":"ff78e134621d9712d63354d0c8ea9a385cd62a395e3e5c71f495be2e8bc8e659"} Jun 02 14:38:20.476565 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.476527 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-d75b4fc4f-5rjbt"] Jun 02 14:38:20.479308 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.479286 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-d75b4fc4f-5rjbt" Jun 02 14:38:20.481807 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.481786 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 02 14:38:20.481932 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.481808 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-pgdcz\"" Jun 02 14:38:20.482106 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.482088 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 02 14:38:20.482371 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.482353 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 02 14:38:20.482634 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.482614 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 02 14:38:20.483008 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.482980 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 02 14:38:20.486843 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.486821 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 02 14:38:20.495260 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.495212 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-d75b4fc4f-5rjbt"] Jun 02 14:38:20.548348 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.548311 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9c41962f-8deb-4a4a-83b5-733293323fd0-federate-client-tls\") pod \"telemeter-client-d75b4fc4f-5rjbt\" (UID: \"9c41962f-8deb-4a4a-83b5-733293323fd0\") " pod="openshift-monitoring/telemeter-client-d75b4fc4f-5rjbt" Jun 02 14:38:20.548488 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.548356 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9c41962f-8deb-4a4a-83b5-733293323fd0-telemeter-client-tls\") pod \"telemeter-client-d75b4fc4f-5rjbt\" (UID: \"9c41962f-8deb-4a4a-83b5-733293323fd0\") " pod="openshift-monitoring/telemeter-client-d75b4fc4f-5rjbt" Jun 02 14:38:20.548488 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.548415 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c41962f-8deb-4a4a-83b5-733293323fd0-metrics-client-ca\") pod \"telemeter-client-d75b4fc4f-5rjbt\" (UID: \"9c41962f-8deb-4a4a-83b5-733293323fd0\") " pod="openshift-monitoring/telemeter-client-d75b4fc4f-5rjbt" Jun 02 14:38:20.548488 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.548429 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzcb6\" (UniqueName: \"kubernetes.io/projected/9c41962f-8deb-4a4a-83b5-733293323fd0-kube-api-access-xzcb6\") pod \"telemeter-client-d75b4fc4f-5rjbt\" (UID: \"9c41962f-8deb-4a4a-83b5-733293323fd0\") " pod="openshift-monitoring/telemeter-client-d75b4fc4f-5rjbt" Jun 02 14:38:20.548488 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.548484 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9c41962f-8deb-4a4a-83b5-733293323fd0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d75b4fc4f-5rjbt\" (UID: \"9c41962f-8deb-4a4a-83b5-733293323fd0\") " pod="openshift-monitoring/telemeter-client-d75b4fc4f-5rjbt" Jun 02 14:38:20.548627 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.548501 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c41962f-8deb-4a4a-83b5-733293323fd0-serving-certs-ca-bundle\") pod \"telemeter-client-d75b4fc4f-5rjbt\" (UID: \"9c41962f-8deb-4a4a-83b5-733293323fd0\") " pod="openshift-monitoring/telemeter-client-d75b4fc4f-5rjbt" Jun 02 14:38:20.548627 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.548531 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c41962f-8deb-4a4a-83b5-733293323fd0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d75b4fc4f-5rjbt\" (UID: \"9c41962f-8deb-4a4a-83b5-733293323fd0\") " pod="openshift-monitoring/telemeter-client-d75b4fc4f-5rjbt" Jun 02 14:38:20.548627 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.548576 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9c41962f-8deb-4a4a-83b5-733293323fd0-secret-telemeter-client\") pod \"telemeter-client-d75b4fc4f-5rjbt\" (UID: \"9c41962f-8deb-4a4a-83b5-733293323fd0\") " pod="openshift-monitoring/telemeter-client-d75b4fc4f-5rjbt" Jun 02 14:38:20.598047 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.598014 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b825488e-9025-44e4-84c9-8c0205feb29e","Type":"ContainerStarted","Data":"8f164a85851d26f058e43a68bd28c7c3c9b5c67bf7064802d76dbd60fbd57989"} Jun 02 14:38:20.598047 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.598051 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b825488e-9025-44e4-84c9-8c0205feb29e","Type":"ContainerStarted","Data":"31bbc5838d7aa98edcdba91b4c48b5891e727a8379b8813bb274f30aa397ae84"} Jun 02 14:38:20.598484 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.598061 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b825488e-9025-44e4-84c9-8c0205feb29e","Type":"ContainerStarted","Data":"ae4c3854acfc86655912c11424afef81587d28dbe790d0cea6fdd391761afb20"} Jun 02 14:38:20.598484 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.598071 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b825488e-9025-44e4-84c9-8c0205feb29e","Type":"ContainerStarted","Data":"db560c17a072617b4654f27d276bc84f18428c2d3045ad0cee309c5e1822b712"} Jun 02 14:38:20.598484 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.598085 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b825488e-9025-44e4-84c9-8c0205feb29e","Type":"ContainerStarted","Data":"2c6c38b05923375af0450f0aecfc993f8c23f169ca73c90578b09db13a11d3a8"} Jun 02 14:38:20.598484 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.598095 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b825488e-9025-44e4-84c9-8c0205feb29e","Type":"ContainerStarted","Data":"619b073742933562fefbddcaaefc844be355125d653d1f07d31cab49a6e3af15"} Jun 02 14:38:20.624680 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.624617 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.624597992 podStartE2EDuration="2.624597992s" podCreationTimestamp="2026-06-02 14:38:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 14:38:20.622622642 +0000 UTC m=+118.126959094" watchObservedRunningTime="2026-06-02 14:38:20.624597992 +0000 UTC m=+118.128934444" Jun 02 14:38:20.649831 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.649800 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9c41962f-8deb-4a4a-83b5-733293323fd0-secret-telemeter-client\") pod \"telemeter-client-d75b4fc4f-5rjbt\" (UID: \"9c41962f-8deb-4a4a-83b5-733293323fd0\") " pod="openshift-monitoring/telemeter-client-d75b4fc4f-5rjbt" Jun 02 14:38:20.649998 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.649845 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9c41962f-8deb-4a4a-83b5-733293323fd0-federate-client-tls\") pod \"telemeter-client-d75b4fc4f-5rjbt\" (UID: \"9c41962f-8deb-4a4a-83b5-733293323fd0\") " pod="openshift-monitoring/telemeter-client-d75b4fc4f-5rjbt" Jun 02 14:38:20.649998 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.649955 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9c41962f-8deb-4a4a-83b5-733293323fd0-telemeter-client-tls\") pod \"telemeter-client-d75b4fc4f-5rjbt\" (UID: \"9c41962f-8deb-4a4a-83b5-733293323fd0\") " pod="openshift-monitoring/telemeter-client-d75b4fc4f-5rjbt" Jun 02 14:38:20.650161 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.650145 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c41962f-8deb-4a4a-83b5-733293323fd0-metrics-client-ca\") pod \"telemeter-client-d75b4fc4f-5rjbt\" (UID: \"9c41962f-8deb-4a4a-83b5-733293323fd0\") " pod="openshift-monitoring/telemeter-client-d75b4fc4f-5rjbt" Jun 02 14:38:20.650208 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.650181 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xzcb6\" (UniqueName: \"kubernetes.io/projected/9c41962f-8deb-4a4a-83b5-733293323fd0-kube-api-access-xzcb6\") pod \"telemeter-client-d75b4fc4f-5rjbt\" (UID: \"9c41962f-8deb-4a4a-83b5-733293323fd0\") " pod="openshift-monitoring/telemeter-client-d75b4fc4f-5rjbt" Jun 02 14:38:20.650724 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.650698 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9c41962f-8deb-4a4a-83b5-733293323fd0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d75b4fc4f-5rjbt\" (UID: \"9c41962f-8deb-4a4a-83b5-733293323fd0\") " pod="openshift-monitoring/telemeter-client-d75b4fc4f-5rjbt" Jun 02 14:38:20.650902 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.650883 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c41962f-8deb-4a4a-83b5-733293323fd0-serving-certs-ca-bundle\") pod \"telemeter-client-d75b4fc4f-5rjbt\" (UID: \"9c41962f-8deb-4a4a-83b5-733293323fd0\") " pod="openshift-monitoring/telemeter-client-d75b4fc4f-5rjbt" Jun 02 14:38:20.651070 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.651052 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c41962f-8deb-4a4a-83b5-733293323fd0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d75b4fc4f-5rjbt\" (UID: \"9c41962f-8deb-4a4a-83b5-733293323fd0\") " pod="openshift-monitoring/telemeter-client-d75b4fc4f-5rjbt" Jun 02 14:38:20.651212 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.651184 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c41962f-8deb-4a4a-83b5-733293323fd0-metrics-client-ca\") pod \"telemeter-client-d75b4fc4f-5rjbt\" (UID: \"9c41962f-8deb-4a4a-83b5-733293323fd0\") " pod="openshift-monitoring/telemeter-client-d75b4fc4f-5rjbt" Jun 02 14:38:20.651805 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.651764 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c41962f-8deb-4a4a-83b5-733293323fd0-serving-certs-ca-bundle\") pod \"telemeter-client-d75b4fc4f-5rjbt\" (UID: \"9c41962f-8deb-4a4a-83b5-733293323fd0\") " pod="openshift-monitoring/telemeter-client-d75b4fc4f-5rjbt" Jun 02 14:38:20.652601 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.652574 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c41962f-8deb-4a4a-83b5-733293323fd0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-d75b4fc4f-5rjbt\" (UID: \"9c41962f-8deb-4a4a-83b5-733293323fd0\") " pod="openshift-monitoring/telemeter-client-d75b4fc4f-5rjbt" Jun 02 14:38:20.653180 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.653159 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9c41962f-8deb-4a4a-83b5-733293323fd0-secret-telemeter-client\") pod \"telemeter-client-d75b4fc4f-5rjbt\" (UID: \"9c41962f-8deb-4a4a-83b5-733293323fd0\") " pod="openshift-monitoring/telemeter-client-d75b4fc4f-5rjbt" Jun 02 14:38:20.653342 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.653318 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9c41962f-8deb-4a4a-83b5-733293323fd0-federate-client-tls\") pod \"telemeter-client-d75b4fc4f-5rjbt\" (UID: \"9c41962f-8deb-4a4a-83b5-733293323fd0\") " pod="openshift-monitoring/telemeter-client-d75b4fc4f-5rjbt" Jun 02 14:38:20.653621 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.653576 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9c41962f-8deb-4a4a-83b5-733293323fd0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-d75b4fc4f-5rjbt\" (UID: \"9c41962f-8deb-4a4a-83b5-733293323fd0\") " pod="openshift-monitoring/telemeter-client-d75b4fc4f-5rjbt" Jun 02 14:38:20.654305 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.654284 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9c41962f-8deb-4a4a-83b5-733293323fd0-telemeter-client-tls\") pod \"telemeter-client-d75b4fc4f-5rjbt\" (UID: \"9c41962f-8deb-4a4a-83b5-733293323fd0\") " pod="openshift-monitoring/telemeter-client-d75b4fc4f-5rjbt" Jun 02 14:38:20.660731 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.660709 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzcb6\" (UniqueName: \"kubernetes.io/projected/9c41962f-8deb-4a4a-83b5-733293323fd0-kube-api-access-xzcb6\") pod \"telemeter-client-d75b4fc4f-5rjbt\" (UID: \"9c41962f-8deb-4a4a-83b5-733293323fd0\") " pod="openshift-monitoring/telemeter-client-d75b4fc4f-5rjbt" Jun 02 14:38:20.788107 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.788017 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 14:38:20.788699 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.788642 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6c4154b5-7168-4798-8a07-c7524b2dda87" containerName="prometheus" containerID="cri-o://d8f1fcdcb2393602a42aec5eeb3d43be3a4425ea878eaf61a935c0a5778fbe82" gracePeriod=600 Jun 02 14:38:20.788994 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.788964 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6c4154b5-7168-4798-8a07-c7524b2dda87" containerName="kube-rbac-proxy-thanos" containerID="cri-o://1a1e394271f82446f571a35d7ab352b169b7c8161835d5754f36ae347fc5c7e7" gracePeriod=600 Jun 02 14:38:20.789072 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.789055 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6c4154b5-7168-4798-8a07-c7524b2dda87" containerName="kube-rbac-proxy" containerID="cri-o://84b5ea2d6c190bb71a1118e2ed6701dec501f28da0c225b1cb47db18e052d6e2" gracePeriod=600 Jun 02 14:38:20.789117 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.789107 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6c4154b5-7168-4798-8a07-c7524b2dda87" containerName="kube-rbac-proxy-web" containerID="cri-o://084d8a20a3ce09c003a9777f177797ceef5e1482fa9fd4931cff2e340960a274" gracePeriod=600 Jun 02 14:38:20.789203 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.789177 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6c4154b5-7168-4798-8a07-c7524b2dda87" containerName="thanos-sidecar" containerID="cri-o://66f863c14b158a8dc64816adeb7cbf0b30a39c880f92dbe5ffb6338ee88354a2" gracePeriod=600 Jun 02 14:38:20.789250 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.789226 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6c4154b5-7168-4798-8a07-c7524b2dda87" containerName="config-reloader" containerID="cri-o://62209f735f7d103d9016d9fe3b3755e22140db8563017eb4d996b828b31159c9" gracePeriod=600 Jun 02 14:38:20.794715 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.794692 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-d75b4fc4f-5rjbt" Jun 02 14:38:20.963384 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:20.963267 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-d75b4fc4f-5rjbt"] Jun 02 14:38:20.966026 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:38:20.965992 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c41962f_8deb_4a4a_83b5_733293323fd0.slice/crio-0f16a5316ff575b9706c144d859d14e069858c81e9642c7111144bb747c2c116 WatchSource:0}: Error finding container 0f16a5316ff575b9706c144d859d14e069858c81e9642c7111144bb747c2c116: Status 404 returned error can't find the container with id 0f16a5316ff575b9706c144d859d14e069858c81e9642c7111144bb747c2c116 Jun 02 14:38:21.602482 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:21.602448 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d75b4fc4f-5rjbt" event={"ID":"9c41962f-8deb-4a4a-83b5-733293323fd0","Type":"ContainerStarted","Data":"0f16a5316ff575b9706c144d859d14e069858c81e9642c7111144bb747c2c116"} Jun 02 14:38:21.604871 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:21.604848 2566 generic.go:358] "Generic (PLEG): container finished" podID="6c4154b5-7168-4798-8a07-c7524b2dda87" containerID="1a1e394271f82446f571a35d7ab352b169b7c8161835d5754f36ae347fc5c7e7" exitCode=0 Jun 02 14:38:21.604871 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:21.604869 2566 generic.go:358] "Generic (PLEG): container finished" podID="6c4154b5-7168-4798-8a07-c7524b2dda87" containerID="84b5ea2d6c190bb71a1118e2ed6701dec501f28da0c225b1cb47db18e052d6e2" exitCode=0 Jun 02 14:38:21.605023 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:21.604876 2566 generic.go:358] "Generic (PLEG): container finished" podID="6c4154b5-7168-4798-8a07-c7524b2dda87" containerID="66f863c14b158a8dc64816adeb7cbf0b30a39c880f92dbe5ffb6338ee88354a2" exitCode=0 Jun 02 14:38:21.605023 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:21.604882 2566 generic.go:358] "Generic (PLEG): container finished" podID="6c4154b5-7168-4798-8a07-c7524b2dda87" containerID="62209f735f7d103d9016d9fe3b3755e22140db8563017eb4d996b828b31159c9" exitCode=0 Jun 02 14:38:21.605023 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:21.604886 2566 generic.go:358] "Generic (PLEG): container finished" podID="6c4154b5-7168-4798-8a07-c7524b2dda87" containerID="d8f1fcdcb2393602a42aec5eeb3d43be3a4425ea878eaf61a935c0a5778fbe82" exitCode=0 Jun 02 14:38:21.605023 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:21.604925 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6c4154b5-7168-4798-8a07-c7524b2dda87","Type":"ContainerDied","Data":"1a1e394271f82446f571a35d7ab352b169b7c8161835d5754f36ae347fc5c7e7"} Jun 02 14:38:21.605023 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:21.604952 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6c4154b5-7168-4798-8a07-c7524b2dda87","Type":"ContainerDied","Data":"84b5ea2d6c190bb71a1118e2ed6701dec501f28da0c225b1cb47db18e052d6e2"} Jun 02 14:38:21.605023 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:21.604966 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6c4154b5-7168-4798-8a07-c7524b2dda87","Type":"ContainerDied","Data":"66f863c14b158a8dc64816adeb7cbf0b30a39c880f92dbe5ffb6338ee88354a2"} Jun 02 14:38:21.605023 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:21.604978 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6c4154b5-7168-4798-8a07-c7524b2dda87","Type":"ContainerDied","Data":"62209f735f7d103d9016d9fe3b3755e22140db8563017eb4d996b828b31159c9"} Jun 02 14:38:21.605023 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:21.604990 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6c4154b5-7168-4798-8a07-c7524b2dda87","Type":"ContainerDied","Data":"d8f1fcdcb2393602a42aec5eeb3d43be3a4425ea878eaf61a935c0a5778fbe82"} Jun 02 14:38:22.054269 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.054242 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.164733 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.164655 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c4154b5-7168-4798-8a07-c7524b2dda87-configmap-serving-certs-ca-bundle\") pod \"6c4154b5-7168-4798-8a07-c7524b2dda87\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " Jun 02 14:38:22.164733 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.164697 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"6c4154b5-7168-4798-8a07-c7524b2dda87\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " Jun 02 14:38:22.164942 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.164738 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-secret-metrics-client-certs\") pod \"6c4154b5-7168-4798-8a07-c7524b2dda87\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " Jun 02 14:38:22.164942 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.164774 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-secret-grpc-tls\") pod \"6c4154b5-7168-4798-8a07-c7524b2dda87\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " Jun 02 14:38:22.164942 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.164812 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-config\") pod \"6c4154b5-7168-4798-8a07-c7524b2dda87\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " Jun 02 14:38:22.164942 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.164841 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c4154b5-7168-4798-8a07-c7524b2dda87-prometheus-trusted-ca-bundle\") pod \"6c4154b5-7168-4798-8a07-c7524b2dda87\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " Jun 02 14:38:22.164942 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.164869 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6c4154b5-7168-4798-8a07-c7524b2dda87-tls-assets\") pod \"6c4154b5-7168-4798-8a07-c7524b2dda87\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " Jun 02 14:38:22.164942 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.164897 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-web-config\") pod \"6c4154b5-7168-4798-8a07-c7524b2dda87\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " Jun 02 14:38:22.164942 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.164922 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c4154b5-7168-4798-8a07-c7524b2dda87-configmap-metrics-client-ca\") pod \"6c4154b5-7168-4798-8a07-c7524b2dda87\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " Jun 02 14:38:22.165304 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.164950 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-secret-kube-rbac-proxy\") pod \"6c4154b5-7168-4798-8a07-c7524b2dda87\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " Jun 02 14:38:22.165304 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.164986 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6c4154b5-7168-4798-8a07-c7524b2dda87-prometheus-k8s-db\") pod \"6c4154b5-7168-4798-8a07-c7524b2dda87\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " Jun 02 14:38:22.165304 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.165027 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"6c4154b5-7168-4798-8a07-c7524b2dda87\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " Jun 02 14:38:22.165304 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.165061 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-thanos-prometheus-http-client-file\") pod \"6c4154b5-7168-4798-8a07-c7524b2dda87\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " Jun 02 14:38:22.165304 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.165101 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c4154b5-7168-4798-8a07-c7524b2dda87-configmap-kubelet-serving-ca-bundle\") pod \"6c4154b5-7168-4798-8a07-c7524b2dda87\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " Jun 02 14:38:22.165304 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.165155 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cjfnm\" (UniqueName: \"kubernetes.io/projected/6c4154b5-7168-4798-8a07-c7524b2dda87-kube-api-access-cjfnm\") pod \"6c4154b5-7168-4798-8a07-c7524b2dda87\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " Jun 02 14:38:22.165304 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.165153 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c4154b5-7168-4798-8a07-c7524b2dda87-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "6c4154b5-7168-4798-8a07-c7524b2dda87" (UID: "6c4154b5-7168-4798-8a07-c7524b2dda87"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 14:38:22.165304 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.165179 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6c4154b5-7168-4798-8a07-c7524b2dda87-prometheus-k8s-rulefiles-0\") pod \"6c4154b5-7168-4798-8a07-c7524b2dda87\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " Jun 02 14:38:22.165304 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.165205 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-secret-prometheus-k8s-tls\") pod \"6c4154b5-7168-4798-8a07-c7524b2dda87\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " Jun 02 14:38:22.165304 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.165229 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6c4154b5-7168-4798-8a07-c7524b2dda87-config-out\") pod \"6c4154b5-7168-4798-8a07-c7524b2dda87\" (UID: \"6c4154b5-7168-4798-8a07-c7524b2dda87\") " Jun 02 14:38:22.166391 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.165581 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c4154b5-7168-4798-8a07-c7524b2dda87-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-41.ec2.internal\" DevicePath \"\"" Jun 02 14:38:22.166391 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.165579 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c4154b5-7168-4798-8a07-c7524b2dda87-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "6c4154b5-7168-4798-8a07-c7524b2dda87" (UID: "6c4154b5-7168-4798-8a07-c7524b2dda87"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 14:38:22.167283 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.167101 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c4154b5-7168-4798-8a07-c7524b2dda87-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "6c4154b5-7168-4798-8a07-c7524b2dda87" (UID: "6c4154b5-7168-4798-8a07-c7524b2dda87"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 14:38:22.167831 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.167413 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "6c4154b5-7168-4798-8a07-c7524b2dda87" (UID: "6c4154b5-7168-4798-8a07-c7524b2dda87"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 14:38:22.171345 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.167663 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "6c4154b5-7168-4798-8a07-c7524b2dda87" (UID: "6c4154b5-7168-4798-8a07-c7524b2dda87"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 14:38:22.171345 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.167677 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-config" (OuterVolumeSpecName: "config") pod "6c4154b5-7168-4798-8a07-c7524b2dda87" (UID: "6c4154b5-7168-4798-8a07-c7524b2dda87"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 14:38:22.171345 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.168307 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c4154b5-7168-4798-8a07-c7524b2dda87-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "6c4154b5-7168-4798-8a07-c7524b2dda87" (UID: "6c4154b5-7168-4798-8a07-c7524b2dda87"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 14:38:22.171345 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.168694 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c4154b5-7168-4798-8a07-c7524b2dda87-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "6c4154b5-7168-4798-8a07-c7524b2dda87" (UID: "6c4154b5-7168-4798-8a07-c7524b2dda87"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 14:38:22.171345 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.168781 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "6c4154b5-7168-4798-8a07-c7524b2dda87" (UID: "6c4154b5-7168-4798-8a07-c7524b2dda87"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 14:38:22.171345 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.168881 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c4154b5-7168-4798-8a07-c7524b2dda87-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "6c4154b5-7168-4798-8a07-c7524b2dda87" (UID: "6c4154b5-7168-4798-8a07-c7524b2dda87"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 14:38:22.171345 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.169050 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c4154b5-7168-4798-8a07-c7524b2dda87-kube-api-access-cjfnm" (OuterVolumeSpecName: "kube-api-access-cjfnm") pod "6c4154b5-7168-4798-8a07-c7524b2dda87" (UID: "6c4154b5-7168-4798-8a07-c7524b2dda87"). InnerVolumeSpecName "kube-api-access-cjfnm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 14:38:22.171345 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.169813 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "6c4154b5-7168-4798-8a07-c7524b2dda87" (UID: "6c4154b5-7168-4798-8a07-c7524b2dda87"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 14:38:22.171345 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.169998 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "6c4154b5-7168-4798-8a07-c7524b2dda87" (UID: "6c4154b5-7168-4798-8a07-c7524b2dda87"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 14:38:22.171345 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.170022 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c4154b5-7168-4798-8a07-c7524b2dda87-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "6c4154b5-7168-4798-8a07-c7524b2dda87" (UID: "6c4154b5-7168-4798-8a07-c7524b2dda87"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 14:38:22.172034 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.171981 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c4154b5-7168-4798-8a07-c7524b2dda87-config-out" (OuterVolumeSpecName: "config-out") pod "6c4154b5-7168-4798-8a07-c7524b2dda87" (UID: "6c4154b5-7168-4798-8a07-c7524b2dda87"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 14:38:22.172034 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.171982 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "6c4154b5-7168-4798-8a07-c7524b2dda87" (UID: "6c4154b5-7168-4798-8a07-c7524b2dda87"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 14:38:22.176741 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.175539 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "6c4154b5-7168-4798-8a07-c7524b2dda87" (UID: "6c4154b5-7168-4798-8a07-c7524b2dda87"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 14:38:22.187097 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.187063 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-web-config" (OuterVolumeSpecName: "web-config") pod "6c4154b5-7168-4798-8a07-c7524b2dda87" (UID: "6c4154b5-7168-4798-8a07-c7524b2dda87"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 14:38:22.266888 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.266850 2566 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6c4154b5-7168-4798-8a07-c7524b2dda87-config-out\") on node \"ip-10-0-141-41.ec2.internal\" DevicePath \"\"" Jun 02 14:38:22.266888 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.266885 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-41.ec2.internal\" DevicePath \"\"" Jun 02 14:38:22.266888 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.266899 2566 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-secret-metrics-client-certs\") on node \"ip-10-0-141-41.ec2.internal\" DevicePath \"\"" Jun 02 14:38:22.267108 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.266909 2566 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-secret-grpc-tls\") on node \"ip-10-0-141-41.ec2.internal\" DevicePath \"\"" Jun 02 14:38:22.267108 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.266925 2566 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-config\") on node \"ip-10-0-141-41.ec2.internal\" DevicePath \"\"" Jun 02 14:38:22.267108 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.266936 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c4154b5-7168-4798-8a07-c7524b2dda87-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-41.ec2.internal\" DevicePath \"\"" Jun 02 14:38:22.267108 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.266945 2566 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6c4154b5-7168-4798-8a07-c7524b2dda87-tls-assets\") on node \"ip-10-0-141-41.ec2.internal\" DevicePath \"\"" Jun 02 14:38:22.267108 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.266953 2566 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-web-config\") on node \"ip-10-0-141-41.ec2.internal\" DevicePath \"\"" Jun 02 14:38:22.267108 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.266960 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c4154b5-7168-4798-8a07-c7524b2dda87-configmap-metrics-client-ca\") on node \"ip-10-0-141-41.ec2.internal\" DevicePath \"\"" Jun 02 14:38:22.267108 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.266968 2566 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-secret-kube-rbac-proxy\") on node \"ip-10-0-141-41.ec2.internal\" DevicePath \"\"" Jun 02 14:38:22.267108 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.266977 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6c4154b5-7168-4798-8a07-c7524b2dda87-prometheus-k8s-db\") on node \"ip-10-0-141-41.ec2.internal\" DevicePath \"\"" Jun 02 14:38:22.267108 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.266986 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-41.ec2.internal\" DevicePath \"\"" Jun 02 14:38:22.267108 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.266996 2566 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-41.ec2.internal\" DevicePath \"\"" Jun 02 14:38:22.267108 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.267011 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c4154b5-7168-4798-8a07-c7524b2dda87-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-41.ec2.internal\" DevicePath \"\"" Jun 02 14:38:22.267108 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.267021 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cjfnm\" (UniqueName: \"kubernetes.io/projected/6c4154b5-7168-4798-8a07-c7524b2dda87-kube-api-access-cjfnm\") on node \"ip-10-0-141-41.ec2.internal\" DevicePath \"\"" Jun 02 14:38:22.267108 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.267029 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6c4154b5-7168-4798-8a07-c7524b2dda87-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-41.ec2.internal\" DevicePath \"\"" Jun 02 14:38:22.267108 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.267037 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6c4154b5-7168-4798-8a07-c7524b2dda87-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-41.ec2.internal\" DevicePath \"\"" Jun 02 14:38:22.611852 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.611812 2566 generic.go:358] "Generic (PLEG): container finished" podID="6c4154b5-7168-4798-8a07-c7524b2dda87" containerID="084d8a20a3ce09c003a9777f177797ceef5e1482fa9fd4931cff2e340960a274" exitCode=0 Jun 02 14:38:22.612297 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.611890 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6c4154b5-7168-4798-8a07-c7524b2dda87","Type":"ContainerDied","Data":"084d8a20a3ce09c003a9777f177797ceef5e1482fa9fd4931cff2e340960a274"} Jun 02 14:38:22.612297 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.611930 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6c4154b5-7168-4798-8a07-c7524b2dda87","Type":"ContainerDied","Data":"1c175507771ef9874bee053cf38d5be991dd4bc43438e09d448eaa0bc210faa8"} Jun 02 14:38:22.612297 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.611946 2566 scope.go:117] "RemoveContainer" containerID="1a1e394271f82446f571a35d7ab352b169b7c8161835d5754f36ae347fc5c7e7" Jun 02 14:38:22.612297 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.611965 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.620901 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.620880 2566 scope.go:117] "RemoveContainer" containerID="84b5ea2d6c190bb71a1118e2ed6701dec501f28da0c225b1cb47db18e052d6e2" Jun 02 14:38:22.628878 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.628858 2566 scope.go:117] "RemoveContainer" containerID="084d8a20a3ce09c003a9777f177797ceef5e1482fa9fd4931cff2e340960a274" Jun 02 14:38:22.636408 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.636273 2566 scope.go:117] "RemoveContainer" containerID="66f863c14b158a8dc64816adeb7cbf0b30a39c880f92dbe5ffb6338ee88354a2" Jun 02 14:38:22.638577 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.638554 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 14:38:22.643239 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.643204 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 14:38:22.645992 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.645971 2566 scope.go:117] "RemoveContainer" containerID="62209f735f7d103d9016d9fe3b3755e22140db8563017eb4d996b828b31159c9" Jun 02 14:38:22.653292 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.653273 2566 scope.go:117] "RemoveContainer" containerID="d8f1fcdcb2393602a42aec5eeb3d43be3a4425ea878eaf61a935c0a5778fbe82" Jun 02 14:38:22.661967 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.661943 2566 scope.go:117] "RemoveContainer" containerID="779ab64a1b9ec118b0d47e5b130d972c3fadad9687f81ac0b91e4199bb5f4d27" Jun 02 14:38:22.669075 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.669043 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 14:38:22.669558 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.669522 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c4154b5-7168-4798-8a07-c7524b2dda87" containerName="kube-rbac-proxy-thanos" Jun 02 14:38:22.669644 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.669561 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c4154b5-7168-4798-8a07-c7524b2dda87" containerName="kube-rbac-proxy-thanos" Jun 02 14:38:22.669644 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.669573 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c4154b5-7168-4798-8a07-c7524b2dda87" containerName="prometheus" Jun 02 14:38:22.669644 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.669584 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c4154b5-7168-4798-8a07-c7524b2dda87" containerName="prometheus" Jun 02 14:38:22.669644 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.669592 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c4154b5-7168-4798-8a07-c7524b2dda87" containerName="kube-rbac-proxy" Jun 02 14:38:22.669644 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.669598 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c4154b5-7168-4798-8a07-c7524b2dda87" containerName="kube-rbac-proxy" Jun 02 14:38:22.669644 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.669605 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c4154b5-7168-4798-8a07-c7524b2dda87" containerName="config-reloader" Jun 02 14:38:22.669644 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.669609 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c4154b5-7168-4798-8a07-c7524b2dda87" containerName="config-reloader" Jun 02 14:38:22.669644 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.669631 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c4154b5-7168-4798-8a07-c7524b2dda87" containerName="thanos-sidecar" Jun 02 14:38:22.669644 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.669639 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c4154b5-7168-4798-8a07-c7524b2dda87" containerName="thanos-sidecar" Jun 02 14:38:22.670067 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.669651 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c4154b5-7168-4798-8a07-c7524b2dda87" containerName="kube-rbac-proxy-web" Jun 02 14:38:22.670067 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.669657 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c4154b5-7168-4798-8a07-c7524b2dda87" containerName="kube-rbac-proxy-web" Jun 02 14:38:22.670067 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.669664 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c4154b5-7168-4798-8a07-c7524b2dda87" containerName="init-config-reloader" Jun 02 14:38:22.670067 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.669669 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c4154b5-7168-4798-8a07-c7524b2dda87" containerName="init-config-reloader" Jun 02 14:38:22.670067 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.669729 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="6c4154b5-7168-4798-8a07-c7524b2dda87" containerName="kube-rbac-proxy" Jun 02 14:38:22.670067 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.669743 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="6c4154b5-7168-4798-8a07-c7524b2dda87" containerName="kube-rbac-proxy-web" Jun 02 14:38:22.670067 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.669753 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="6c4154b5-7168-4798-8a07-c7524b2dda87" containerName="thanos-sidecar" Jun 02 14:38:22.670067 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.669764 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="6c4154b5-7168-4798-8a07-c7524b2dda87" containerName="kube-rbac-proxy-thanos" Jun 02 14:38:22.670067 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.669773 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="6c4154b5-7168-4798-8a07-c7524b2dda87" containerName="prometheus" Jun 02 14:38:22.670067 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.669783 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="6c4154b5-7168-4798-8a07-c7524b2dda87" containerName="config-reloader" Jun 02 14:38:22.671859 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.671840 2566 scope.go:117] "RemoveContainer" containerID="1a1e394271f82446f571a35d7ab352b169b7c8161835d5754f36ae347fc5c7e7" Jun 02 14:38:22.672173 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:38:22.672152 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a1e394271f82446f571a35d7ab352b169b7c8161835d5754f36ae347fc5c7e7\": container with ID starting with 1a1e394271f82446f571a35d7ab352b169b7c8161835d5754f36ae347fc5c7e7 not found: ID does not exist" containerID="1a1e394271f82446f571a35d7ab352b169b7c8161835d5754f36ae347fc5c7e7" Jun 02 14:38:22.672257 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.672184 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a1e394271f82446f571a35d7ab352b169b7c8161835d5754f36ae347fc5c7e7"} err="failed to get container status \"1a1e394271f82446f571a35d7ab352b169b7c8161835d5754f36ae347fc5c7e7\": rpc error: code = NotFound desc = could not find container \"1a1e394271f82446f571a35d7ab352b169b7c8161835d5754f36ae347fc5c7e7\": container with ID starting with 1a1e394271f82446f571a35d7ab352b169b7c8161835d5754f36ae347fc5c7e7 not found: ID does not exist" Jun 02 14:38:22.672257 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.672205 2566 scope.go:117] "RemoveContainer" containerID="84b5ea2d6c190bb71a1118e2ed6701dec501f28da0c225b1cb47db18e052d6e2" Jun 02 14:38:22.672501 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:38:22.672476 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84b5ea2d6c190bb71a1118e2ed6701dec501f28da0c225b1cb47db18e052d6e2\": container with ID starting with 84b5ea2d6c190bb71a1118e2ed6701dec501f28da0c225b1cb47db18e052d6e2 not found: ID does not exist" containerID="84b5ea2d6c190bb71a1118e2ed6701dec501f28da0c225b1cb47db18e052d6e2" Jun 02 14:38:22.672592 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.672512 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84b5ea2d6c190bb71a1118e2ed6701dec501f28da0c225b1cb47db18e052d6e2"} err="failed to get container status \"84b5ea2d6c190bb71a1118e2ed6701dec501f28da0c225b1cb47db18e052d6e2\": rpc error: code = NotFound desc = could not find container \"84b5ea2d6c190bb71a1118e2ed6701dec501f28da0c225b1cb47db18e052d6e2\": container with ID starting with 84b5ea2d6c190bb71a1118e2ed6701dec501f28da0c225b1cb47db18e052d6e2 not found: ID does not exist" Jun 02 14:38:22.672592 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.672535 2566 scope.go:117] "RemoveContainer" containerID="084d8a20a3ce09c003a9777f177797ceef5e1482fa9fd4931cff2e340960a274" Jun 02 14:38:22.672831 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:38:22.672809 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"084d8a20a3ce09c003a9777f177797ceef5e1482fa9fd4931cff2e340960a274\": container with ID starting with 084d8a20a3ce09c003a9777f177797ceef5e1482fa9fd4931cff2e340960a274 not found: ID does not exist" containerID="084d8a20a3ce09c003a9777f177797ceef5e1482fa9fd4931cff2e340960a274" Jun 02 14:38:22.672905 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.672836 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"084d8a20a3ce09c003a9777f177797ceef5e1482fa9fd4931cff2e340960a274"} err="failed to get container status \"084d8a20a3ce09c003a9777f177797ceef5e1482fa9fd4931cff2e340960a274\": rpc error: code = NotFound desc = could not find container \"084d8a20a3ce09c003a9777f177797ceef5e1482fa9fd4931cff2e340960a274\": container with ID starting with 084d8a20a3ce09c003a9777f177797ceef5e1482fa9fd4931cff2e340960a274 not found: ID does not exist" Jun 02 14:38:22.672905 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.672855 2566 scope.go:117] "RemoveContainer" containerID="66f863c14b158a8dc64816adeb7cbf0b30a39c880f92dbe5ffb6338ee88354a2" Jun 02 14:38:22.673113 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:38:22.673088 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66f863c14b158a8dc64816adeb7cbf0b30a39c880f92dbe5ffb6338ee88354a2\": container with ID starting with 66f863c14b158a8dc64816adeb7cbf0b30a39c880f92dbe5ffb6338ee88354a2 not found: ID does not exist" containerID="66f863c14b158a8dc64816adeb7cbf0b30a39c880f92dbe5ffb6338ee88354a2" Jun 02 14:38:22.673203 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.673121 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66f863c14b158a8dc64816adeb7cbf0b30a39c880f92dbe5ffb6338ee88354a2"} err="failed to get container status \"66f863c14b158a8dc64816adeb7cbf0b30a39c880f92dbe5ffb6338ee88354a2\": rpc error: code = NotFound desc = could not find container \"66f863c14b158a8dc64816adeb7cbf0b30a39c880f92dbe5ffb6338ee88354a2\": container with ID starting with 66f863c14b158a8dc64816adeb7cbf0b30a39c880f92dbe5ffb6338ee88354a2 not found: ID does not exist" Jun 02 14:38:22.673203 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.673160 2566 scope.go:117] "RemoveContainer" containerID="62209f735f7d103d9016d9fe3b3755e22140db8563017eb4d996b828b31159c9" Jun 02 14:38:22.673420 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:38:22.673405 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62209f735f7d103d9016d9fe3b3755e22140db8563017eb4d996b828b31159c9\": container with ID starting with 62209f735f7d103d9016d9fe3b3755e22140db8563017eb4d996b828b31159c9 not found: ID does not exist" containerID="62209f735f7d103d9016d9fe3b3755e22140db8563017eb4d996b828b31159c9" Jun 02 14:38:22.673474 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.673423 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62209f735f7d103d9016d9fe3b3755e22140db8563017eb4d996b828b31159c9"} err="failed to get container status \"62209f735f7d103d9016d9fe3b3755e22140db8563017eb4d996b828b31159c9\": rpc error: code = NotFound desc = could not find container \"62209f735f7d103d9016d9fe3b3755e22140db8563017eb4d996b828b31159c9\": container with ID starting with 62209f735f7d103d9016d9fe3b3755e22140db8563017eb4d996b828b31159c9 not found: ID does not exist" Jun 02 14:38:22.673474 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.673437 2566 scope.go:117] "RemoveContainer" containerID="d8f1fcdcb2393602a42aec5eeb3d43be3a4425ea878eaf61a935c0a5778fbe82" Jun 02 14:38:22.673734 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:38:22.673705 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8f1fcdcb2393602a42aec5eeb3d43be3a4425ea878eaf61a935c0a5778fbe82\": container with ID starting with d8f1fcdcb2393602a42aec5eeb3d43be3a4425ea878eaf61a935c0a5778fbe82 not found: ID does not exist" containerID="d8f1fcdcb2393602a42aec5eeb3d43be3a4425ea878eaf61a935c0a5778fbe82" Jun 02 14:38:22.673833 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.673737 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8f1fcdcb2393602a42aec5eeb3d43be3a4425ea878eaf61a935c0a5778fbe82"} err="failed to get container status \"d8f1fcdcb2393602a42aec5eeb3d43be3a4425ea878eaf61a935c0a5778fbe82\": rpc error: code = NotFound desc = could not find container \"d8f1fcdcb2393602a42aec5eeb3d43be3a4425ea878eaf61a935c0a5778fbe82\": container with ID starting with d8f1fcdcb2393602a42aec5eeb3d43be3a4425ea878eaf61a935c0a5778fbe82 not found: ID does not exist" Jun 02 14:38:22.673833 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.673751 2566 scope.go:117] "RemoveContainer" containerID="779ab64a1b9ec118b0d47e5b130d972c3fadad9687f81ac0b91e4199bb5f4d27" Jun 02 14:38:22.674022 ip-10-0-141-41 kubenswrapper[2566]: E0602 14:38:22.673997 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"779ab64a1b9ec118b0d47e5b130d972c3fadad9687f81ac0b91e4199bb5f4d27\": container with ID starting with 779ab64a1b9ec118b0d47e5b130d972c3fadad9687f81ac0b91e4199bb5f4d27 not found: ID does not exist" containerID="779ab64a1b9ec118b0d47e5b130d972c3fadad9687f81ac0b91e4199bb5f4d27" Jun 02 14:38:22.674083 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.674030 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"779ab64a1b9ec118b0d47e5b130d972c3fadad9687f81ac0b91e4199bb5f4d27"} err="failed to get container status \"779ab64a1b9ec118b0d47e5b130d972c3fadad9687f81ac0b91e4199bb5f4d27\": rpc error: code = NotFound desc = could not find container \"779ab64a1b9ec118b0d47e5b130d972c3fadad9687f81ac0b91e4199bb5f4d27\": container with ID starting with 779ab64a1b9ec118b0d47e5b130d972c3fadad9687f81ac0b91e4199bb5f4d27 not found: ID does not exist" Jun 02 14:38:22.674083 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.674075 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.676795 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.676776 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 02 14:38:22.676932 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.676914 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 02 14:38:22.677687 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.677088 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 02 14:38:22.677687 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.677176 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 02 14:38:22.677687 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.677454 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 02 14:38:22.677933 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.677744 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 02 14:38:22.677933 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.677797 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 02 14:38:22.677933 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.677810 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-dhts6\"" Jun 02 14:38:22.678207 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.677974 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 02 14:38:22.678207 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.677983 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-b6duvgmt1oqtd\"" Jun 02 14:38:22.678207 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.678079 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 02 14:38:22.678352 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.678294 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 02 14:38:22.680887 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.680865 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 02 14:38:22.686093 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.686067 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 02 14:38:22.686794 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.686771 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 14:38:22.772530 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.772445 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d177106-c59f-461d-8e09-f579a8cfe3aa-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.772530 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.772479 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8d177106-c59f-461d-8e09-f579a8cfe3aa-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.772530 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.772495 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d177106-c59f-461d-8e09-f579a8cfe3aa-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.772728 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.772550 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8d177106-c59f-461d-8e09-f579a8cfe3aa-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.772728 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.772587 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8d177106-c59f-461d-8e09-f579a8cfe3aa-config\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.772728 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.772605 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d177106-c59f-461d-8e09-f579a8cfe3aa-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.772728 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.772622 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8d177106-c59f-461d-8e09-f579a8cfe3aa-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.772728 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.772641 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d177106-c59f-461d-8e09-f579a8cfe3aa-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.772728 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.772690 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d177106-c59f-461d-8e09-f579a8cfe3aa-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.772891 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.772740 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d177106-c59f-461d-8e09-f579a8cfe3aa-config-out\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.772891 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.772764 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d177106-c59f-461d-8e09-f579a8cfe3aa-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.772891 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.772829 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d177106-c59f-461d-8e09-f579a8cfe3aa-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.772891 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.772844 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8d177106-c59f-461d-8e09-f579a8cfe3aa-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.772891 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.772870 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8d177106-c59f-461d-8e09-f579a8cfe3aa-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.773036 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.772894 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-547xw\" (UniqueName: \"kubernetes.io/projected/8d177106-c59f-461d-8e09-f579a8cfe3aa-kube-api-access-547xw\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.773036 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.772914 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8d177106-c59f-461d-8e09-f579a8cfe3aa-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.773036 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.772942 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d177106-c59f-461d-8e09-f579a8cfe3aa-web-config\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.773036 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.772961 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8d177106-c59f-461d-8e09-f579a8cfe3aa-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.873942 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.873901 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d177106-c59f-461d-8e09-f579a8cfe3aa-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.873942 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.873938 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8d177106-c59f-461d-8e09-f579a8cfe3aa-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.874202 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.873964 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8d177106-c59f-461d-8e09-f579a8cfe3aa-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.874202 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.873988 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-547xw\" (UniqueName: \"kubernetes.io/projected/8d177106-c59f-461d-8e09-f579a8cfe3aa-kube-api-access-547xw\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.874202 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.874017 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8d177106-c59f-461d-8e09-f579a8cfe3aa-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.874202 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.874045 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d177106-c59f-461d-8e09-f579a8cfe3aa-web-config\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.874202 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.874070 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8d177106-c59f-461d-8e09-f579a8cfe3aa-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.874202 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.874107 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d177106-c59f-461d-8e09-f579a8cfe3aa-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.874202 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.874194 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8d177106-c59f-461d-8e09-f579a8cfe3aa-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.874528 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.874225 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d177106-c59f-461d-8e09-f579a8cfe3aa-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.874528 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.874253 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8d177106-c59f-461d-8e09-f579a8cfe3aa-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.874528 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.874282 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8d177106-c59f-461d-8e09-f579a8cfe3aa-config\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.874528 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.874310 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d177106-c59f-461d-8e09-f579a8cfe3aa-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.874528 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.874334 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8d177106-c59f-461d-8e09-f579a8cfe3aa-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.874528 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.874361 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d177106-c59f-461d-8e09-f579a8cfe3aa-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.874528 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.874411 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8d177106-c59f-461d-8e09-f579a8cfe3aa-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.875089 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.874995 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d177106-c59f-461d-8e09-f579a8cfe3aa-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.877189 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.877160 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8d177106-c59f-461d-8e09-f579a8cfe3aa-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.877760 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.877443 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d177106-c59f-461d-8e09-f579a8cfe3aa-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.877760 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.877511 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8d177106-c59f-461d-8e09-f579a8cfe3aa-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.877760 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.877748 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d177106-c59f-461d-8e09-f579a8cfe3aa-web-config\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.877760 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.877753 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8d177106-c59f-461d-8e09-f579a8cfe3aa-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.878006 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.877781 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8d177106-c59f-461d-8e09-f579a8cfe3aa-config\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.878006 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.877794 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d177106-c59f-461d-8e09-f579a8cfe3aa-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.878006 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.877848 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d177106-c59f-461d-8e09-f579a8cfe3aa-config-out\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.878006 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.877883 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d177106-c59f-461d-8e09-f579a8cfe3aa-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.878700 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.878395 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8d177106-c59f-461d-8e09-f579a8cfe3aa-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.878700 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.878628 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d177106-c59f-461d-8e09-f579a8cfe3aa-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.878845 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.878759 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d177106-c59f-461d-8e09-f579a8cfe3aa-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.879220 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.879037 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d177106-c59f-461d-8e09-f579a8cfe3aa-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.879431 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.879409 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d177106-c59f-461d-8e09-f579a8cfe3aa-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.880061 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.880036 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d177106-c59f-461d-8e09-f579a8cfe3aa-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.880061 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.880056 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8d177106-c59f-461d-8e09-f579a8cfe3aa-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.880320 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.880303 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8d177106-c59f-461d-8e09-f579a8cfe3aa-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.880543 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.880527 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d177106-c59f-461d-8e09-f579a8cfe3aa-config-out\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.882373 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.882353 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-547xw\" (UniqueName: \"kubernetes.io/projected/8d177106-c59f-461d-8e09-f579a8cfe3aa-kube-api-access-547xw\") pod \"prometheus-k8s-0\" (UID: \"8d177106-c59f-461d-8e09-f579a8cfe3aa\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:22.990632 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.990602 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-dhts6\"" Jun 02 14:38:22.998006 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:22.997983 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:38:23.112166 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:23.112024 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c4154b5-7168-4798-8a07-c7524b2dda87" path="/var/lib/kubelet/pods/6c4154b5-7168-4798-8a07-c7524b2dda87/volumes" Jun 02 14:38:23.146406 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:23.146375 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 14:38:23.527754 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:38:23.527713 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d177106_c59f_461d_8e09_f579a8cfe3aa.slice/crio-5e94a915781fbe3e26ecca042806a08b116dbe312b2ae0581bd1d16dd2795db9 WatchSource:0}: Error finding container 5e94a915781fbe3e26ecca042806a08b116dbe312b2ae0581bd1d16dd2795db9: Status 404 returned error can't find the container with id 5e94a915781fbe3e26ecca042806a08b116dbe312b2ae0581bd1d16dd2795db9 Jun 02 14:38:23.617636 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:23.617599 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d177106-c59f-461d-8e09-f579a8cfe3aa","Type":"ContainerStarted","Data":"5e94a915781fbe3e26ecca042806a08b116dbe312b2ae0581bd1d16dd2795db9"} Jun 02 14:38:24.622521 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:24.622484 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d75b4fc4f-5rjbt" event={"ID":"9c41962f-8deb-4a4a-83b5-733293323fd0","Type":"ContainerStarted","Data":"a0a3c82a1ecba2b6cff241c2eae07ad625231f69bc35b5df37af841722d560e3"} Jun 02 14:38:24.622521 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:24.622522 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d75b4fc4f-5rjbt" event={"ID":"9c41962f-8deb-4a4a-83b5-733293323fd0","Type":"ContainerStarted","Data":"0e125d762b7d15eae5a1d99dc690aa2954cc48e3b02d7219ab99a1826450cf55"} Jun 02 14:38:24.623018 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:24.622536 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-d75b4fc4f-5rjbt" event={"ID":"9c41962f-8deb-4a4a-83b5-733293323fd0","Type":"ContainerStarted","Data":"99781701d14a91bc9559ed42491ceb9e5f50287cf9e4bdaa5f5e14e0627a0a14"} Jun 02 14:38:24.623977 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:24.623942 2566 generic.go:358] "Generic (PLEG): container finished" podID="8d177106-c59f-461d-8e09-f579a8cfe3aa" containerID="3dec51667c2cede27d5339a52209b4532cb798b9bf5ca93b05cb477668dd5593" exitCode=0 Jun 02 14:38:24.624062 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:24.623982 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d177106-c59f-461d-8e09-f579a8cfe3aa","Type":"ContainerDied","Data":"3dec51667c2cede27d5339a52209b4532cb798b9bf5ca93b05cb477668dd5593"} Jun 02 14:38:24.653752 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:24.653699 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-d75b4fc4f-5rjbt" podStartSLOduration=2.062359894 podStartE2EDuration="4.653680937s" podCreationTimestamp="2026-06-02 14:38:20 +0000 UTC" firstStartedPulling="2026-06-02 14:38:20.967881876 +0000 UTC m=+118.472218308" lastFinishedPulling="2026-06-02 14:38:23.559202905 +0000 UTC m=+121.063539351" observedRunningTime="2026-06-02 14:38:24.652416412 +0000 UTC m=+122.156752863" watchObservedRunningTime="2026-06-02 14:38:24.653680937 +0000 UTC m=+122.158017390" Jun 02 14:38:25.632236 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:25.632185 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d177106-c59f-461d-8e09-f579a8cfe3aa","Type":"ContainerStarted","Data":"f35b072adddfab34898fcad4d0df0367f1feb7ae372bd4ad778633eb709a3729"} Jun 02 14:38:25.632236 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:25.632236 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d177106-c59f-461d-8e09-f579a8cfe3aa","Type":"ContainerStarted","Data":"e88ceee03be3b8d7eb38eb831d2d6c8a44ef38d568cb19863839cd27e71e68b3"} Jun 02 14:38:25.632725 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:25.632249 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d177106-c59f-461d-8e09-f579a8cfe3aa","Type":"ContainerStarted","Data":"39bbc05ac1e505eeb33045e4169180e5f842184e57c144eac08df823cbdd525b"} Jun 02 14:38:25.632725 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:25.632262 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d177106-c59f-461d-8e09-f579a8cfe3aa","Type":"ContainerStarted","Data":"74080958f11c8c56d7e25bb6b07e75a7e08ad355791ebc5e5be0ec37b83a38c5"} Jun 02 14:38:25.632725 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:25.632273 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d177106-c59f-461d-8e09-f579a8cfe3aa","Type":"ContainerStarted","Data":"7dbbc1d1e42569249b3005d1cce52a4f086e5ce0ae9d390f01d19b1e0dbd6a6e"} Jun 02 14:38:25.632725 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:25.632286 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d177106-c59f-461d-8e09-f579a8cfe3aa","Type":"ContainerStarted","Data":"b4b22888fd5d963507b6f89fc0e4920d323c7c967be61eac38e13718ab5aa2da"} Jun 02 14:38:25.660920 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:25.660864 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.660847285 podStartE2EDuration="3.660847285s" podCreationTimestamp="2026-06-02 14:38:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 14:38:25.659239292 +0000 UTC m=+123.163575739" watchObservedRunningTime="2026-06-02 14:38:25.660847285 +0000 UTC m=+123.165183729" Jun 02 14:38:27.998753 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:38:27.998719 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:39:22.998792 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:39:22.998753 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:39:23.015028 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:39:23.015004 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:39:23.822247 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:39:23.822221 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 14:39:36.970433 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:39:36.970398 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d69f587-zfj4w"] Jun 02 14:39:36.974996 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:39:36.974979 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d69f587-zfj4w" Jun 02 14:39:36.981910 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:39:36.981891 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 02 14:39:36.982179 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:39:36.982125 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 02 14:39:36.982301 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:39:36.982200 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 02 14:39:36.982471 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:39:36.982343 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vz4zh\"" Jun 02 14:39:36.982548 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:39:36.982477 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 02 14:39:36.982608 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:39:36.982582 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 02 14:39:36.983350 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:39:36.983330 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 02 14:39:36.983350 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:39:36.983355 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 02 14:39:36.986603 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:39:36.986583 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 02 14:39:36.992481 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:39:36.992461 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d69f587-zfj4w"] Jun 02 14:39:37.031666 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:39:37.031628 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/069eb23f-8e88-4142-a132-83202b7b4c7e-service-ca\") pod \"console-5d69f587-zfj4w\" (UID: \"069eb23f-8e88-4142-a132-83202b7b4c7e\") " pod="openshift-console/console-5d69f587-zfj4w" Jun 02 14:39:37.031666 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:39:37.031677 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/069eb23f-8e88-4142-a132-83202b7b4c7e-console-serving-cert\") pod \"console-5d69f587-zfj4w\" (UID: \"069eb23f-8e88-4142-a132-83202b7b4c7e\") " pod="openshift-console/console-5d69f587-zfj4w" Jun 02 14:39:37.031920 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:39:37.031699 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/069eb23f-8e88-4142-a132-83202b7b4c7e-console-config\") pod \"console-5d69f587-zfj4w\" (UID: \"069eb23f-8e88-4142-a132-83202b7b4c7e\") " pod="openshift-console/console-5d69f587-zfj4w" Jun 02 14:39:37.031920 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:39:37.031803 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/069eb23f-8e88-4142-a132-83202b7b4c7e-console-oauth-config\") pod \"console-5d69f587-zfj4w\" (UID: \"069eb23f-8e88-4142-a132-83202b7b4c7e\") " pod="openshift-console/console-5d69f587-zfj4w" Jun 02 14:39:37.031920 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:39:37.031858 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/069eb23f-8e88-4142-a132-83202b7b4c7e-oauth-serving-cert\") pod \"console-5d69f587-zfj4w\" (UID: \"069eb23f-8e88-4142-a132-83202b7b4c7e\") " pod="openshift-console/console-5d69f587-zfj4w" Jun 02 14:39:37.031920 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:39:37.031914 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/069eb23f-8e88-4142-a132-83202b7b4c7e-trusted-ca-bundle\") pod \"console-5d69f587-zfj4w\" (UID: \"069eb23f-8e88-4142-a132-83202b7b4c7e\") " pod="openshift-console/console-5d69f587-zfj4w" Jun 02 14:39:37.032049 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:39:37.031939 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9k2t\" (UniqueName: \"kubernetes.io/projected/069eb23f-8e88-4142-a132-83202b7b4c7e-kube-api-access-h9k2t\") pod \"console-5d69f587-zfj4w\" (UID: \"069eb23f-8e88-4142-a132-83202b7b4c7e\") " pod="openshift-console/console-5d69f587-zfj4w" Jun 02 14:39:37.132373 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:39:37.132337 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/069eb23f-8e88-4142-a132-83202b7b4c7e-console-oauth-config\") pod \"console-5d69f587-zfj4w\" (UID: \"069eb23f-8e88-4142-a132-83202b7b4c7e\") " pod="openshift-console/console-5d69f587-zfj4w" Jun 02 14:39:37.132373 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:39:37.132375 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/069eb23f-8e88-4142-a132-83202b7b4c7e-oauth-serving-cert\") pod \"console-5d69f587-zfj4w\" (UID: \"069eb23f-8e88-4142-a132-83202b7b4c7e\") " pod="openshift-console/console-5d69f587-zfj4w" Jun 02 14:39:37.132584 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:39:37.132419 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/069eb23f-8e88-4142-a132-83202b7b4c7e-trusted-ca-bundle\") pod \"console-5d69f587-zfj4w\" (UID: \"069eb23f-8e88-4142-a132-83202b7b4c7e\") " pod="openshift-console/console-5d69f587-zfj4w" Jun 02 14:39:37.132584 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:39:37.132453 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h9k2t\" (UniqueName: \"kubernetes.io/projected/069eb23f-8e88-4142-a132-83202b7b4c7e-kube-api-access-h9k2t\") pod \"console-5d69f587-zfj4w\" (UID: \"069eb23f-8e88-4142-a132-83202b7b4c7e\") " pod="openshift-console/console-5d69f587-zfj4w" Jun 02 14:39:37.132584 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:39:37.132491 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/069eb23f-8e88-4142-a132-83202b7b4c7e-service-ca\") pod \"console-5d69f587-zfj4w\" (UID: \"069eb23f-8e88-4142-a132-83202b7b4c7e\") " pod="openshift-console/console-5d69f587-zfj4w" Jun 02 14:39:37.132584 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:39:37.132534 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/069eb23f-8e88-4142-a132-83202b7b4c7e-console-serving-cert\") pod \"console-5d69f587-zfj4w\" (UID: \"069eb23f-8e88-4142-a132-83202b7b4c7e\") " pod="openshift-console/console-5d69f587-zfj4w" Jun 02 14:39:37.132584 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:39:37.132554 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/069eb23f-8e88-4142-a132-83202b7b4c7e-console-config\") pod \"console-5d69f587-zfj4w\" (UID: \"069eb23f-8e88-4142-a132-83202b7b4c7e\") " pod="openshift-console/console-5d69f587-zfj4w" Jun 02 14:39:37.133313 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:39:37.133284 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/069eb23f-8e88-4142-a132-83202b7b4c7e-service-ca\") pod \"console-5d69f587-zfj4w\" (UID: \"069eb23f-8e88-4142-a132-83202b7b4c7e\") " pod="openshift-console/console-5d69f587-zfj4w" Jun 02 14:39:37.133432 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:39:37.133304 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/069eb23f-8e88-4142-a132-83202b7b4c7e-console-config\") pod \"console-5d69f587-zfj4w\" (UID: \"069eb23f-8e88-4142-a132-83202b7b4c7e\") " pod="openshift-console/console-5d69f587-zfj4w" Jun 02 14:39:37.133475 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:39:37.133430 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/069eb23f-8e88-4142-a132-83202b7b4c7e-oauth-serving-cert\") pod \"console-5d69f587-zfj4w\" (UID: \"069eb23f-8e88-4142-a132-83202b7b4c7e\") " pod="openshift-console/console-5d69f587-zfj4w" Jun 02 14:39:37.133475 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:39:37.133430 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/069eb23f-8e88-4142-a132-83202b7b4c7e-trusted-ca-bundle\") pod \"console-5d69f587-zfj4w\" (UID: \"069eb23f-8e88-4142-a132-83202b7b4c7e\") " pod="openshift-console/console-5d69f587-zfj4w" Jun 02 14:39:37.135013 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:39:37.134992 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/069eb23f-8e88-4142-a132-83202b7b4c7e-console-oauth-config\") pod \"console-5d69f587-zfj4w\" (UID: \"069eb23f-8e88-4142-a132-83202b7b4c7e\") " pod="openshift-console/console-5d69f587-zfj4w" Jun 02 14:39:37.135078 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:39:37.135064 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/069eb23f-8e88-4142-a132-83202b7b4c7e-console-serving-cert\") pod \"console-5d69f587-zfj4w\" (UID: \"069eb23f-8e88-4142-a132-83202b7b4c7e\") " pod="openshift-console/console-5d69f587-zfj4w" Jun 02 14:39:37.141380 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:39:37.141355 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9k2t\" (UniqueName: \"kubernetes.io/projected/069eb23f-8e88-4142-a132-83202b7b4c7e-kube-api-access-h9k2t\") pod \"console-5d69f587-zfj4w\" (UID: \"069eb23f-8e88-4142-a132-83202b7b4c7e\") " pod="openshift-console/console-5d69f587-zfj4w" Jun 02 14:39:37.284551 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:39:37.284457 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d69f587-zfj4w" Jun 02 14:39:37.411895 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:39:37.411871 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d69f587-zfj4w"] Jun 02 14:39:37.413978 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:39:37.413950 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod069eb23f_8e88_4142_a132_83202b7b4c7e.slice/crio-951a2e90ee3ff75b7dc777c79fac3c3a0832d564223f6b1ca57901b2d7b27224 WatchSource:0}: Error finding container 951a2e90ee3ff75b7dc777c79fac3c3a0832d564223f6b1ca57901b2d7b27224: Status 404 returned error can't find the container with id 951a2e90ee3ff75b7dc777c79fac3c3a0832d564223f6b1ca57901b2d7b27224 Jun 02 14:39:37.847418 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:39:37.847373 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d69f587-zfj4w" event={"ID":"069eb23f-8e88-4142-a132-83202b7b4c7e","Type":"ContainerStarted","Data":"1000434cd5664ae8ba63a97b82bdd7bd018fc634712108e5c82829420a76618c"} Jun 02 14:39:37.847418 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:39:37.847417 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d69f587-zfj4w" event={"ID":"069eb23f-8e88-4142-a132-83202b7b4c7e","Type":"ContainerStarted","Data":"951a2e90ee3ff75b7dc777c79fac3c3a0832d564223f6b1ca57901b2d7b27224"} Jun 02 14:39:37.868272 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:39:37.868217 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5d69f587-zfj4w" podStartSLOduration=1.8682024529999999 podStartE2EDuration="1.868202453s" podCreationTimestamp="2026-06-02 14:39:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 14:39:37.866832087 +0000 UTC m=+195.371168549" watchObservedRunningTime="2026-06-02 14:39:37.868202453 +0000 UTC m=+195.372538912" Jun 02 14:39:47.285024 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:39:47.284984 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d69f587-zfj4w" Jun 02 14:39:47.285024 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:39:47.285026 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d69f587-zfj4w" Jun 02 14:39:47.289909 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:39:47.289887 2566 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d69f587-zfj4w" Jun 02 14:39:47.880000 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:39:47.879972 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d69f587-zfj4w" Jun 02 14:40:16.177489 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:40:16.177452 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-x9pkn"] Jun 02 14:40:16.180893 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:40:16.180874 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9pkn" Jun 02 14:40:16.183565 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:40:16.183543 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 14:40:16.192425 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:40:16.192405 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x9pkn"] Jun 02 14:40:16.282268 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:40:16.282231 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cadb7d1e-e530-4e59-9024-75235aa46d75-original-pull-secret\") pod \"global-pull-secret-syncer-x9pkn\" (UID: \"cadb7d1e-e530-4e59-9024-75235aa46d75\") " pod="kube-system/global-pull-secret-syncer-x9pkn" Jun 02 14:40:16.282458 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:40:16.282290 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cadb7d1e-e530-4e59-9024-75235aa46d75-dbus\") pod \"global-pull-secret-syncer-x9pkn\" (UID: \"cadb7d1e-e530-4e59-9024-75235aa46d75\") " pod="kube-system/global-pull-secret-syncer-x9pkn" Jun 02 14:40:16.282458 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:40:16.282316 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cadb7d1e-e530-4e59-9024-75235aa46d75-kubelet-config\") pod \"global-pull-secret-syncer-x9pkn\" (UID: \"cadb7d1e-e530-4e59-9024-75235aa46d75\") " pod="kube-system/global-pull-secret-syncer-x9pkn" Jun 02 14:40:16.383287 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:40:16.383240 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cadb7d1e-e530-4e59-9024-75235aa46d75-original-pull-secret\") pod \"global-pull-secret-syncer-x9pkn\" (UID: \"cadb7d1e-e530-4e59-9024-75235aa46d75\") " pod="kube-system/global-pull-secret-syncer-x9pkn" Jun 02 14:40:16.383487 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:40:16.383305 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cadb7d1e-e530-4e59-9024-75235aa46d75-dbus\") pod \"global-pull-secret-syncer-x9pkn\" (UID: \"cadb7d1e-e530-4e59-9024-75235aa46d75\") " pod="kube-system/global-pull-secret-syncer-x9pkn" Jun 02 14:40:16.383487 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:40:16.383327 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cadb7d1e-e530-4e59-9024-75235aa46d75-kubelet-config\") pod \"global-pull-secret-syncer-x9pkn\" (UID: \"cadb7d1e-e530-4e59-9024-75235aa46d75\") " pod="kube-system/global-pull-secret-syncer-x9pkn" Jun 02 14:40:16.383487 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:40:16.383441 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cadb7d1e-e530-4e59-9024-75235aa46d75-kubelet-config\") pod \"global-pull-secret-syncer-x9pkn\" (UID: \"cadb7d1e-e530-4e59-9024-75235aa46d75\") " pod="kube-system/global-pull-secret-syncer-x9pkn" Jun 02 14:40:16.383646 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:40:16.383503 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cadb7d1e-e530-4e59-9024-75235aa46d75-dbus\") pod \"global-pull-secret-syncer-x9pkn\" (UID: \"cadb7d1e-e530-4e59-9024-75235aa46d75\") " pod="kube-system/global-pull-secret-syncer-x9pkn" Jun 02 14:40:16.385771 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:40:16.385746 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cadb7d1e-e530-4e59-9024-75235aa46d75-original-pull-secret\") pod \"global-pull-secret-syncer-x9pkn\" (UID: \"cadb7d1e-e530-4e59-9024-75235aa46d75\") " pod="kube-system/global-pull-secret-syncer-x9pkn" Jun 02 14:40:16.490117 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:40:16.490039 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9pkn" Jun 02 14:40:16.617391 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:40:16.617361 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x9pkn"] Jun 02 14:40:16.620952 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:40:16.620922 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcadb7d1e_e530_4e59_9024_75235aa46d75.slice/crio-51caf9bd547125bc31fe5b0db0bb09ec9ac7879acd9708f6416481253edc46e7 WatchSource:0}: Error finding container 51caf9bd547125bc31fe5b0db0bb09ec9ac7879acd9708f6416481253edc46e7: Status 404 returned error can't find the container with id 51caf9bd547125bc31fe5b0db0bb09ec9ac7879acd9708f6416481253edc46e7 Jun 02 14:40:16.966058 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:40:16.966025 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x9pkn" event={"ID":"cadb7d1e-e530-4e59-9024-75235aa46d75","Type":"ContainerStarted","Data":"51caf9bd547125bc31fe5b0db0bb09ec9ac7879acd9708f6416481253edc46e7"} Jun 02 14:40:20.980091 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:40:20.980061 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x9pkn" event={"ID":"cadb7d1e-e530-4e59-9024-75235aa46d75","Type":"ContainerStarted","Data":"aca3ec6a05d33f4cb40ea678db841b5db45b2f10f05a83abea0a06670027852f"} Jun 02 14:40:20.997360 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:40:20.997303 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-x9pkn" podStartSLOduration=1.225168258 podStartE2EDuration="4.997287953s" podCreationTimestamp="2026-06-02 14:40:16 +0000 UTC" firstStartedPulling="2026-06-02 14:40:16.622607187 +0000 UTC m=+234.126943616" lastFinishedPulling="2026-06-02 14:40:20.394726874 +0000 UTC m=+237.899063311" observedRunningTime="2026-06-02 14:40:20.996793973 +0000 UTC m=+238.501130435" watchObservedRunningTime="2026-06-02 14:40:20.997287953 +0000 UTC m=+238.501624403" Jun 02 14:41:23.003846 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:41:23.003815 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-86rkq_7446ab1b-b67d-4448-b4b3-5eacdcc9d885/ovn-acl-logging/0.log" Jun 02 14:41:23.004380 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:41:23.003938 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-86rkq_7446ab1b-b67d-4448-b4b3-5eacdcc9d885/ovn-acl-logging/0.log" Jun 02 14:41:23.007021 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:41:23.007000 2566 kubelet.go:1628] "Image garbage collection succeeded" Jun 02 14:41:41.624152 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:41:41.624102 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-n8d9v"] Jun 02 14:41:41.627257 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:41:41.627231 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-n8d9v" Jun 02 14:41:41.629829 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:41:41.629809 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 02 14:41:41.629921 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:41:41.629809 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-55lv8\"" Jun 02 14:41:41.629921 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:41:41.629814 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 02 14:41:41.634833 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:41:41.634499 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ndx5\" (UniqueName: \"kubernetes.io/projected/5300a1a5-3855-411e-a632-e1985880ea6a-kube-api-access-9ndx5\") pod \"cert-manager-79c8d999ff-n8d9v\" (UID: \"5300a1a5-3855-411e-a632-e1985880ea6a\") " pod="cert-manager/cert-manager-79c8d999ff-n8d9v" Jun 02 14:41:41.634833 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:41:41.634591 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5300a1a5-3855-411e-a632-e1985880ea6a-bound-sa-token\") pod \"cert-manager-79c8d999ff-n8d9v\" (UID: \"5300a1a5-3855-411e-a632-e1985880ea6a\") " pod="cert-manager/cert-manager-79c8d999ff-n8d9v" Jun 02 14:41:41.634964 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:41:41.634931 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-n8d9v"] Jun 02 14:41:41.735420 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:41:41.735378 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5300a1a5-3855-411e-a632-e1985880ea6a-bound-sa-token\") pod \"cert-manager-79c8d999ff-n8d9v\" (UID: \"5300a1a5-3855-411e-a632-e1985880ea6a\") " pod="cert-manager/cert-manager-79c8d999ff-n8d9v" Jun 02 14:41:41.735615 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:41:41.735453 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9ndx5\" (UniqueName: \"kubernetes.io/projected/5300a1a5-3855-411e-a632-e1985880ea6a-kube-api-access-9ndx5\") pod \"cert-manager-79c8d999ff-n8d9v\" (UID: \"5300a1a5-3855-411e-a632-e1985880ea6a\") " pod="cert-manager/cert-manager-79c8d999ff-n8d9v" Jun 02 14:41:41.744233 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:41:41.744209 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ndx5\" (UniqueName: \"kubernetes.io/projected/5300a1a5-3855-411e-a632-e1985880ea6a-kube-api-access-9ndx5\") pod \"cert-manager-79c8d999ff-n8d9v\" (UID: \"5300a1a5-3855-411e-a632-e1985880ea6a\") " pod="cert-manager/cert-manager-79c8d999ff-n8d9v" Jun 02 14:41:41.744393 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:41:41.744210 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5300a1a5-3855-411e-a632-e1985880ea6a-bound-sa-token\") pod \"cert-manager-79c8d999ff-n8d9v\" (UID: \"5300a1a5-3855-411e-a632-e1985880ea6a\") " pod="cert-manager/cert-manager-79c8d999ff-n8d9v" Jun 02 14:41:41.949522 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:41:41.949487 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-n8d9v" Jun 02 14:41:42.075891 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:41:42.075734 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-n8d9v"] Jun 02 14:41:42.078030 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:41:42.078001 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5300a1a5_3855_411e_a632_e1985880ea6a.slice/crio-5224a90eac08d7b8032adece81ced36e60e1f491da0b828daae5df1bce100343 WatchSource:0}: Error finding container 5224a90eac08d7b8032adece81ced36e60e1f491da0b828daae5df1bce100343: Status 404 returned error can't find the container with id 5224a90eac08d7b8032adece81ced36e60e1f491da0b828daae5df1bce100343 Jun 02 14:41:42.079745 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:41:42.079729 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 14:41:42.221685 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:41:42.221570 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-n8d9v" event={"ID":"5300a1a5-3855-411e-a632-e1985880ea6a","Type":"ContainerStarted","Data":"5224a90eac08d7b8032adece81ced36e60e1f491da0b828daae5df1bce100343"} Jun 02 14:41:45.231659 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:41:45.231624 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-n8d9v" event={"ID":"5300a1a5-3855-411e-a632-e1985880ea6a","Type":"ContainerStarted","Data":"2570d41bdb30e42c47bdd4feffcd85323d48d8c33183ddb874720d40ce5ab8f6"} Jun 02 14:41:45.249178 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:41:45.249096 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-n8d9v" podStartSLOduration=1.233770764 podStartE2EDuration="4.249082176s" podCreationTimestamp="2026-06-02 14:41:41 +0000 UTC" firstStartedPulling="2026-06-02 14:41:42.079854306 +0000 UTC m=+319.584190735" lastFinishedPulling="2026-06-02 14:41:45.095165718 +0000 UTC m=+322.599502147" observedRunningTime="2026-06-02 14:41:45.248532238 +0000 UTC m=+322.752868690" watchObservedRunningTime="2026-06-02 14:41:45.249082176 +0000 UTC m=+322.753418627" Jun 02 14:42:02.286047 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:42:02.286011 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-747c5859c7-4v5nx"] Jun 02 14:42:02.289874 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:42:02.289858 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-747c5859c7-4v5nx" Jun 02 14:42:02.293544 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:42:02.293522 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-csrn6\"" Jun 02 14:42:02.293544 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:42:02.293534 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Jun 02 14:42:02.293701 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:42:02.293525 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Jun 02 14:42:02.297944 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:42:02.297920 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-747c5859c7-4v5nx"] Jun 02 14:42:02.412213 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:42:02.412170 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8193ce02-5b3c-49ef-9170-33b054566aa3-tmp\") pod \"jobset-operator-747c5859c7-4v5nx\" (UID: \"8193ce02-5b3c-49ef-9170-33b054566aa3\") " pod="openshift-jobset-operator/jobset-operator-747c5859c7-4v5nx" Jun 02 14:42:02.412395 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:42:02.412241 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wqcp\" (UniqueName: \"kubernetes.io/projected/8193ce02-5b3c-49ef-9170-33b054566aa3-kube-api-access-9wqcp\") pod \"jobset-operator-747c5859c7-4v5nx\" (UID: \"8193ce02-5b3c-49ef-9170-33b054566aa3\") " pod="openshift-jobset-operator/jobset-operator-747c5859c7-4v5nx" Jun 02 14:42:02.513339 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:42:02.513298 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8193ce02-5b3c-49ef-9170-33b054566aa3-tmp\") pod \"jobset-operator-747c5859c7-4v5nx\" (UID: \"8193ce02-5b3c-49ef-9170-33b054566aa3\") " pod="openshift-jobset-operator/jobset-operator-747c5859c7-4v5nx" Jun 02 14:42:02.513565 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:42:02.513358 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9wqcp\" (UniqueName: \"kubernetes.io/projected/8193ce02-5b3c-49ef-9170-33b054566aa3-kube-api-access-9wqcp\") pod \"jobset-operator-747c5859c7-4v5nx\" (UID: \"8193ce02-5b3c-49ef-9170-33b054566aa3\") " pod="openshift-jobset-operator/jobset-operator-747c5859c7-4v5nx" Jun 02 14:42:02.513766 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:42:02.513743 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8193ce02-5b3c-49ef-9170-33b054566aa3-tmp\") pod \"jobset-operator-747c5859c7-4v5nx\" (UID: \"8193ce02-5b3c-49ef-9170-33b054566aa3\") " pod="openshift-jobset-operator/jobset-operator-747c5859c7-4v5nx" Jun 02 14:42:02.523429 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:42:02.523394 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wqcp\" (UniqueName: \"kubernetes.io/projected/8193ce02-5b3c-49ef-9170-33b054566aa3-kube-api-access-9wqcp\") pod \"jobset-operator-747c5859c7-4v5nx\" (UID: \"8193ce02-5b3c-49ef-9170-33b054566aa3\") " pod="openshift-jobset-operator/jobset-operator-747c5859c7-4v5nx" Jun 02 14:42:02.599270 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:42:02.599182 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-747c5859c7-4v5nx" Jun 02 14:42:02.741847 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:42:02.741820 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-747c5859c7-4v5nx"] Jun 02 14:42:02.744267 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:42:02.744238 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8193ce02_5b3c_49ef_9170_33b054566aa3.slice/crio-09515181696c5cf01d01b3f39b5c5e62c4f72ebdf6273268172f827df6be6b39 WatchSource:0}: Error finding container 09515181696c5cf01d01b3f39b5c5e62c4f72ebdf6273268172f827df6be6b39: Status 404 returned error can't find the container with id 09515181696c5cf01d01b3f39b5c5e62c4f72ebdf6273268172f827df6be6b39 Jun 02 14:42:03.287499 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:42:03.287469 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-747c5859c7-4v5nx" event={"ID":"8193ce02-5b3c-49ef-9170-33b054566aa3","Type":"ContainerStarted","Data":"09515181696c5cf01d01b3f39b5c5e62c4f72ebdf6273268172f827df6be6b39"} Jun 02 14:42:07.302476 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:42:07.302441 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-747c5859c7-4v5nx" event={"ID":"8193ce02-5b3c-49ef-9170-33b054566aa3","Type":"ContainerStarted","Data":"a48537954151f31263f20b8719ae4835672a1659de3ab70e0bba4735512794e6"} Jun 02 14:42:07.321964 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:42:07.321917 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-747c5859c7-4v5nx" podStartSLOduration=1.440798979 podStartE2EDuration="5.321901117s" podCreationTimestamp="2026-06-02 14:42:02 +0000 UTC" firstStartedPulling="2026-06-02 14:42:02.745866697 +0000 UTC m=+340.250203127" lastFinishedPulling="2026-06-02 14:42:06.626968833 +0000 UTC m=+344.131305265" observedRunningTime="2026-06-02 14:42:07.320442088 +0000 UTC m=+344.824778540" watchObservedRunningTime="2026-06-02 14:42:07.321901117 +0000 UTC m=+344.826237568" Jun 02 14:44:05.894282 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:44:05.894202 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d69f587-zfj4w"] Jun 02 14:44:27.680465 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:44:27.680426 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-cjm2d/test-trainjob-92nxt-node-0-0-lgbg7"] Jun 02 14:44:27.683682 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:44:27.683663 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-cjm2d/test-trainjob-92nxt-node-0-0-lgbg7" Jun 02 14:44:27.686478 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:44:27.686454 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-cjm2d\"/\"kube-root-ca.crt\"" Jun 02 14:44:27.686478 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:44:27.686471 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-cjm2d\"/\"openshift-service-ca.crt\"" Jun 02 14:44:27.687236 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:44:27.687224 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-cjm2d\"/\"default-dockercfg-874pf\"" Jun 02 14:44:27.691474 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:44:27.691454 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-cjm2d/test-trainjob-92nxt-node-0-0-lgbg7"] Jun 02 14:44:27.761954 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:44:27.761912 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwkz2\" (UniqueName: \"kubernetes.io/projected/3130975b-d4a7-4ec7-8bea-541ecd25c1f3-kube-api-access-rwkz2\") pod \"test-trainjob-92nxt-node-0-0-lgbg7\" (UID: \"3130975b-d4a7-4ec7-8bea-541ecd25c1f3\") " pod="test-ns-cjm2d/test-trainjob-92nxt-node-0-0-lgbg7" Jun 02 14:44:27.862893 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:44:27.862849 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rwkz2\" (UniqueName: \"kubernetes.io/projected/3130975b-d4a7-4ec7-8bea-541ecd25c1f3-kube-api-access-rwkz2\") pod \"test-trainjob-92nxt-node-0-0-lgbg7\" (UID: \"3130975b-d4a7-4ec7-8bea-541ecd25c1f3\") " pod="test-ns-cjm2d/test-trainjob-92nxt-node-0-0-lgbg7" Jun 02 14:44:27.873190 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:44:27.873162 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwkz2\" (UniqueName: \"kubernetes.io/projected/3130975b-d4a7-4ec7-8bea-541ecd25c1f3-kube-api-access-rwkz2\") pod \"test-trainjob-92nxt-node-0-0-lgbg7\" (UID: \"3130975b-d4a7-4ec7-8bea-541ecd25c1f3\") " pod="test-ns-cjm2d/test-trainjob-92nxt-node-0-0-lgbg7" Jun 02 14:44:27.993947 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:44:27.993861 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-cjm2d/test-trainjob-92nxt-node-0-0-lgbg7" Jun 02 14:44:28.127017 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:44:28.126986 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-cjm2d/test-trainjob-92nxt-node-0-0-lgbg7"] Jun 02 14:44:28.130460 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:44:28.130430 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3130975b_d4a7_4ec7_8bea_541ecd25c1f3.slice/crio-795e86451aafc926311aa0dbb65bfda8431a15839cf4427c0b9403ce2d4f9b6f WatchSource:0}: Error finding container 795e86451aafc926311aa0dbb65bfda8431a15839cf4427c0b9403ce2d4f9b6f: Status 404 returned error can't find the container with id 795e86451aafc926311aa0dbb65bfda8431a15839cf4427c0b9403ce2d4f9b6f Jun 02 14:44:28.730821 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:44:28.730781 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-cjm2d/test-trainjob-92nxt-node-0-0-lgbg7" event={"ID":"3130975b-d4a7-4ec7-8bea-541ecd25c1f3","Type":"ContainerStarted","Data":"795e86451aafc926311aa0dbb65bfda8431a15839cf4427c0b9403ce2d4f9b6f"} Jun 02 14:44:30.917323 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:44:30.917271 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5d69f587-zfj4w" podUID="069eb23f-8e88-4142-a132-83202b7b4c7e" containerName="console" containerID="cri-o://1000434cd5664ae8ba63a97b82bdd7bd018fc634712108e5c82829420a76618c" gracePeriod=15 Jun 02 14:44:31.741997 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:44:31.741965 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5d69f587-zfj4w_069eb23f-8e88-4142-a132-83202b7b4c7e/console/0.log" Jun 02 14:44:31.742223 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:44:31.742017 2566 generic.go:358] "Generic (PLEG): container finished" podID="069eb23f-8e88-4142-a132-83202b7b4c7e" containerID="1000434cd5664ae8ba63a97b82bdd7bd018fc634712108e5c82829420a76618c" exitCode=2 Jun 02 14:44:31.742223 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:44:31.742059 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d69f587-zfj4w" event={"ID":"069eb23f-8e88-4142-a132-83202b7b4c7e","Type":"ContainerDied","Data":"1000434cd5664ae8ba63a97b82bdd7bd018fc634712108e5c82829420a76618c"} Jun 02 14:44:33.492484 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:44:33.492457 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5d69f587-zfj4w_069eb23f-8e88-4142-a132-83202b7b4c7e/console/0.log" Jun 02 14:44:33.492819 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:44:33.492538 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d69f587-zfj4w" Jun 02 14:44:33.622750 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:44:33.622714 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9k2t\" (UniqueName: \"kubernetes.io/projected/069eb23f-8e88-4142-a132-83202b7b4c7e-kube-api-access-h9k2t\") pod \"069eb23f-8e88-4142-a132-83202b7b4c7e\" (UID: \"069eb23f-8e88-4142-a132-83202b7b4c7e\") " Jun 02 14:44:33.622935 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:44:33.622787 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/069eb23f-8e88-4142-a132-83202b7b4c7e-console-serving-cert\") pod \"069eb23f-8e88-4142-a132-83202b7b4c7e\" (UID: \"069eb23f-8e88-4142-a132-83202b7b4c7e\") " Jun 02 14:44:33.622935 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:44:33.622808 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/069eb23f-8e88-4142-a132-83202b7b4c7e-service-ca\") pod \"069eb23f-8e88-4142-a132-83202b7b4c7e\" (UID: \"069eb23f-8e88-4142-a132-83202b7b4c7e\") " Jun 02 14:44:33.622935 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:44:33.622824 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/069eb23f-8e88-4142-a132-83202b7b4c7e-oauth-serving-cert\") pod \"069eb23f-8e88-4142-a132-83202b7b4c7e\" (UID: \"069eb23f-8e88-4142-a132-83202b7b4c7e\") " Jun 02 14:44:33.622935 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:44:33.622880 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/069eb23f-8e88-4142-a132-83202b7b4c7e-console-oauth-config\") pod \"069eb23f-8e88-4142-a132-83202b7b4c7e\" (UID: \"069eb23f-8e88-4142-a132-83202b7b4c7e\") " Jun 02 14:44:33.622935 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:44:33.622899 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/069eb23f-8e88-4142-a132-83202b7b4c7e-console-config\") pod \"069eb23f-8e88-4142-a132-83202b7b4c7e\" (UID: \"069eb23f-8e88-4142-a132-83202b7b4c7e\") " Jun 02 14:44:33.622935 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:44:33.622936 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/069eb23f-8e88-4142-a132-83202b7b4c7e-trusted-ca-bundle\") pod \"069eb23f-8e88-4142-a132-83202b7b4c7e\" (UID: \"069eb23f-8e88-4142-a132-83202b7b4c7e\") " Jun 02 14:44:33.623380 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:44:33.623345 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/069eb23f-8e88-4142-a132-83202b7b4c7e-service-ca" (OuterVolumeSpecName: "service-ca") pod "069eb23f-8e88-4142-a132-83202b7b4c7e" (UID: "069eb23f-8e88-4142-a132-83202b7b4c7e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 14:44:33.623380 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:44:33.623354 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/069eb23f-8e88-4142-a132-83202b7b4c7e-console-config" (OuterVolumeSpecName: "console-config") pod "069eb23f-8e88-4142-a132-83202b7b4c7e" (UID: "069eb23f-8e88-4142-a132-83202b7b4c7e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 14:44:33.623380 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:44:33.623377 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/069eb23f-8e88-4142-a132-83202b7b4c7e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "069eb23f-8e88-4142-a132-83202b7b4c7e" (UID: "069eb23f-8e88-4142-a132-83202b7b4c7e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 14:44:33.623775 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:44:33.623425 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/069eb23f-8e88-4142-a132-83202b7b4c7e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "069eb23f-8e88-4142-a132-83202b7b4c7e" (UID: "069eb23f-8e88-4142-a132-83202b7b4c7e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 14:44:33.625176 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:44:33.625154 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/069eb23f-8e88-4142-a132-83202b7b4c7e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "069eb23f-8e88-4142-a132-83202b7b4c7e" (UID: "069eb23f-8e88-4142-a132-83202b7b4c7e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 14:44:33.625736 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:44:33.625704 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/069eb23f-8e88-4142-a132-83202b7b4c7e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "069eb23f-8e88-4142-a132-83202b7b4c7e" (UID: "069eb23f-8e88-4142-a132-83202b7b4c7e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 14:44:33.625736 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:44:33.625712 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/069eb23f-8e88-4142-a132-83202b7b4c7e-kube-api-access-h9k2t" (OuterVolumeSpecName: "kube-api-access-h9k2t") pod "069eb23f-8e88-4142-a132-83202b7b4c7e" (UID: "069eb23f-8e88-4142-a132-83202b7b4c7e"). InnerVolumeSpecName "kube-api-access-h9k2t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 14:44:33.723994 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:44:33.723896 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/069eb23f-8e88-4142-a132-83202b7b4c7e-console-oauth-config\") on node \"ip-10-0-141-41.ec2.internal\" DevicePath \"\"" Jun 02 14:44:33.723994 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:44:33.723936 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/069eb23f-8e88-4142-a132-83202b7b4c7e-console-config\") on node \"ip-10-0-141-41.ec2.internal\" DevicePath \"\"" Jun 02 14:44:33.723994 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:44:33.723951 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/069eb23f-8e88-4142-a132-83202b7b4c7e-trusted-ca-bundle\") on node \"ip-10-0-141-41.ec2.internal\" DevicePath \"\"" Jun 02 14:44:33.723994 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:44:33.723966 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9k2t\" (UniqueName: \"kubernetes.io/projected/069eb23f-8e88-4142-a132-83202b7b4c7e-kube-api-access-h9k2t\") on node \"ip-10-0-141-41.ec2.internal\" DevicePath \"\"" Jun 02 14:44:33.723994 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:44:33.723980 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/069eb23f-8e88-4142-a132-83202b7b4c7e-console-serving-cert\") on node \"ip-10-0-141-41.ec2.internal\" DevicePath \"\"" Jun 02 14:44:33.723994 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:44:33.723995 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/069eb23f-8e88-4142-a132-83202b7b4c7e-service-ca\") on node \"ip-10-0-141-41.ec2.internal\" DevicePath \"\"" Jun 02 14:44:33.724471 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:44:33.724008 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/069eb23f-8e88-4142-a132-83202b7b4c7e-oauth-serving-cert\") on node \"ip-10-0-141-41.ec2.internal\" DevicePath \"\"" Jun 02 14:44:33.753249 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:44:33.753048 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5d69f587-zfj4w_069eb23f-8e88-4142-a132-83202b7b4c7e/console/0.log" Jun 02 14:44:33.753249 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:44:33.753176 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d69f587-zfj4w" event={"ID":"069eb23f-8e88-4142-a132-83202b7b4c7e","Type":"ContainerDied","Data":"951a2e90ee3ff75b7dc777c79fac3c3a0832d564223f6b1ca57901b2d7b27224"} Jun 02 14:44:33.753249 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:44:33.753216 2566 scope.go:117] "RemoveContainer" containerID="1000434cd5664ae8ba63a97b82bdd7bd018fc634712108e5c82829420a76618c" Jun 02 14:44:33.753484 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:44:33.753350 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d69f587-zfj4w" Jun 02 14:44:33.780903 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:44:33.780874 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d69f587-zfj4w"] Jun 02 14:44:33.784258 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:44:33.784232 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d69f587-zfj4w"] Jun 02 14:44:35.111140 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:44:35.111102 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="069eb23f-8e88-4142-a132-83202b7b4c7e" path="/var/lib/kubelet/pods/069eb23f-8e88-4142-a132-83202b7b4c7e/volumes" Jun 02 14:46:23.034160 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:46:23.034107 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-86rkq_7446ab1b-b67d-4448-b4b3-5eacdcc9d885/ovn-acl-logging/0.log" Jun 02 14:46:23.035773 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:46:23.035748 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-86rkq_7446ab1b-b67d-4448-b4b3-5eacdcc9d885/ovn-acl-logging/0.log" Jun 02 14:51:35.056946 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:51:35.056914 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-86rkq_7446ab1b-b67d-4448-b4b3-5eacdcc9d885/ovn-acl-logging/0.log" Jun 02 14:51:35.057485 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:51:35.056914 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-86rkq_7446ab1b-b67d-4448-b4b3-5eacdcc9d885/ovn-acl-logging/0.log" Jun 02 14:51:36.102043 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:51:36.102015 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-cjm2d/test-trainjob-92nxt-node-0-0-lgbg7" event={"ID":"3130975b-d4a7-4ec7-8bea-541ecd25c1f3","Type":"ContainerStarted","Data":"cf9e4d4659d57cea17d46e9b10fbcf9434e15572b719bc2fe49976a0b75588e1"} Jun 02 14:51:36.104595 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:51:36.104575 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-cjm2d\"/\"default-dockercfg-874pf\"" Jun 02 14:51:36.128307 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:51:36.128083 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-cjm2d/test-trainjob-92nxt-node-0-0-lgbg7" podStartSLOduration=1.276570519 podStartE2EDuration="7m9.12806536s" podCreationTimestamp="2026-06-02 14:44:27 +0000 UTC" firstStartedPulling="2026-06-02 14:44:28.132257692 +0000 UTC m=+485.636594122" lastFinishedPulling="2026-06-02 14:51:35.983752517 +0000 UTC m=+913.488088963" observedRunningTime="2026-06-02 14:51:36.127261418 +0000 UTC m=+913.631597874" watchObservedRunningTime="2026-06-02 14:51:36.12806536 +0000 UTC m=+913.632401814" Jun 02 14:51:36.192345 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:51:36.192313 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-cjm2d\"/\"kube-root-ca.crt\"" Jun 02 14:51:36.202757 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:51:36.202726 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-cjm2d\"/\"openshift-service-ca.crt\"" Jun 02 14:51:36.529446 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:51:36.529411 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cjm2d_test-trainjob-92nxt-node-0-0-lgbg7_3130975b-d4a7-4ec7-8bea-541ecd25c1f3/node/0.log" Jun 02 14:51:39.529723 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:51:39.529699 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cjm2d_test-trainjob-92nxt-node-0-0-lgbg7_3130975b-d4a7-4ec7-8bea-541ecd25c1f3/node/0.log" Jun 02 14:51:40.116376 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:51:40.116345 2566 generic.go:358] "Generic (PLEG): container finished" podID="3130975b-d4a7-4ec7-8bea-541ecd25c1f3" containerID="cf9e4d4659d57cea17d46e9b10fbcf9434e15572b719bc2fe49976a0b75588e1" exitCode=0 Jun 02 14:51:40.116574 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:51:40.116422 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-cjm2d/test-trainjob-92nxt-node-0-0-lgbg7" event={"ID":"3130975b-d4a7-4ec7-8bea-541ecd25c1f3","Type":"ContainerDied","Data":"cf9e4d4659d57cea17d46e9b10fbcf9434e15572b719bc2fe49976a0b75588e1"} Jun 02 14:51:41.257565 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:51:41.257544 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-cjm2d/test-trainjob-92nxt-node-0-0-lgbg7" Jun 02 14:51:41.332211 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:51:41.332166 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwkz2\" (UniqueName: \"kubernetes.io/projected/3130975b-d4a7-4ec7-8bea-541ecd25c1f3-kube-api-access-rwkz2\") pod \"3130975b-d4a7-4ec7-8bea-541ecd25c1f3\" (UID: \"3130975b-d4a7-4ec7-8bea-541ecd25c1f3\") " Jun 02 14:51:41.334611 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:51:41.334579 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3130975b-d4a7-4ec7-8bea-541ecd25c1f3-kube-api-access-rwkz2" (OuterVolumeSpecName: "kube-api-access-rwkz2") pod "3130975b-d4a7-4ec7-8bea-541ecd25c1f3" (UID: "3130975b-d4a7-4ec7-8bea-541ecd25c1f3"). InnerVolumeSpecName "kube-api-access-rwkz2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 14:51:41.433195 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:51:41.433159 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwkz2\" (UniqueName: \"kubernetes.io/projected/3130975b-d4a7-4ec7-8bea-541ecd25c1f3-kube-api-access-rwkz2\") on node \"ip-10-0-141-41.ec2.internal\" DevicePath \"\"" Jun 02 14:51:42.123631 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:51:42.123596 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-cjm2d/test-trainjob-92nxt-node-0-0-lgbg7" Jun 02 14:51:42.123631 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:51:42.123607 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-cjm2d/test-trainjob-92nxt-node-0-0-lgbg7" event={"ID":"3130975b-d4a7-4ec7-8bea-541ecd25c1f3","Type":"ContainerDied","Data":"795e86451aafc926311aa0dbb65bfda8431a15839cf4427c0b9403ce2d4f9b6f"} Jun 02 14:51:42.123631 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:51:42.123635 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="795e86451aafc926311aa0dbb65bfda8431a15839cf4427c0b9403ce2d4f9b6f" Jun 02 14:51:42.530041 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:51:42.530012 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cjm2d_test-trainjob-92nxt-node-0-0-lgbg7_3130975b-d4a7-4ec7-8bea-541ecd25c1f3/node/0.log" Jun 02 14:51:42.609395 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:51:42.609357 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-cjm2d_test-trainjob-92nxt-node-0-0-lgbg7_3130975b-d4a7-4ec7-8bea-541ecd25c1f3/node/0.log" Jun 02 14:51:43.875695 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:51:43.875651 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2jq4t/must-gather-6gwrj"] Jun 02 14:51:43.876091 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:51:43.876004 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3130975b-d4a7-4ec7-8bea-541ecd25c1f3" containerName="node" Jun 02 14:51:43.876091 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:51:43.876014 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="3130975b-d4a7-4ec7-8bea-541ecd25c1f3" containerName="node" Jun 02 14:51:43.876091 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:51:43.876027 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="069eb23f-8e88-4142-a132-83202b7b4c7e" containerName="console" Jun 02 14:51:43.876091 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:51:43.876032 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="069eb23f-8e88-4142-a132-83202b7b4c7e" containerName="console" Jun 02 14:51:43.876091 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:51:43.876085 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="3130975b-d4a7-4ec7-8bea-541ecd25c1f3" containerName="node" Jun 02 14:51:43.876091 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:51:43.876096 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="069eb23f-8e88-4142-a132-83202b7b4c7e" containerName="console" Jun 02 14:51:43.899378 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:51:43.899344 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2jq4t/must-gather-6gwrj"] Jun 02 14:51:43.899537 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:51:43.899465 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2jq4t/must-gather-6gwrj" Jun 02 14:51:43.902282 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:51:43.902237 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2jq4t\"/\"kube-root-ca.crt\"" Jun 02 14:51:43.902427 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:51:43.902358 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2jq4t\"/\"default-dockercfg-dwgn6\"" Jun 02 14:51:43.903223 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:51:43.903204 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2jq4t\"/\"openshift-service-ca.crt\"" Jun 02 14:51:43.955143 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:51:43.955100 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/96fb6a26-717a-4650-b42e-b1ee9aff9e1f-must-gather-output\") pod \"must-gather-6gwrj\" (UID: \"96fb6a26-717a-4650-b42e-b1ee9aff9e1f\") " pod="openshift-must-gather-2jq4t/must-gather-6gwrj" Jun 02 14:51:43.955356 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:51:43.955312 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5pmg\" (UniqueName: \"kubernetes.io/projected/96fb6a26-717a-4650-b42e-b1ee9aff9e1f-kube-api-access-r5pmg\") pod \"must-gather-6gwrj\" (UID: \"96fb6a26-717a-4650-b42e-b1ee9aff9e1f\") " pod="openshift-must-gather-2jq4t/must-gather-6gwrj" Jun 02 14:51:44.055999 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:51:44.055959 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r5pmg\" (UniqueName: \"kubernetes.io/projected/96fb6a26-717a-4650-b42e-b1ee9aff9e1f-kube-api-access-r5pmg\") pod \"must-gather-6gwrj\" (UID: \"96fb6a26-717a-4650-b42e-b1ee9aff9e1f\") " pod="openshift-must-gather-2jq4t/must-gather-6gwrj" Jun 02 14:51:44.056197 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:51:44.056010 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/96fb6a26-717a-4650-b42e-b1ee9aff9e1f-must-gather-output\") pod \"must-gather-6gwrj\" (UID: \"96fb6a26-717a-4650-b42e-b1ee9aff9e1f\") " pod="openshift-must-gather-2jq4t/must-gather-6gwrj" Jun 02 14:51:44.056371 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:51:44.056353 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/96fb6a26-717a-4650-b42e-b1ee9aff9e1f-must-gather-output\") pod \"must-gather-6gwrj\" (UID: \"96fb6a26-717a-4650-b42e-b1ee9aff9e1f\") " pod="openshift-must-gather-2jq4t/must-gather-6gwrj" Jun 02 14:51:44.064816 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:51:44.064791 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5pmg\" (UniqueName: \"kubernetes.io/projected/96fb6a26-717a-4650-b42e-b1ee9aff9e1f-kube-api-access-r5pmg\") pod \"must-gather-6gwrj\" (UID: \"96fb6a26-717a-4650-b42e-b1ee9aff9e1f\") " pod="openshift-must-gather-2jq4t/must-gather-6gwrj" Jun 02 14:51:44.209771 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:51:44.209734 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2jq4t/must-gather-6gwrj" Jun 02 14:51:44.339875 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:51:44.339822 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2jq4t/must-gather-6gwrj"] Jun 02 14:51:44.342749 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:51:44.342719 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod96fb6a26_717a_4650_b42e_b1ee9aff9e1f.slice/crio-2556c31c611b01e43c94b650390229e0ec36115fd5ca9b0a502e0dc4ce42b073 WatchSource:0}: Error finding container 2556c31c611b01e43c94b650390229e0ec36115fd5ca9b0a502e0dc4ce42b073: Status 404 returned error can't find the container with id 2556c31c611b01e43c94b650390229e0ec36115fd5ca9b0a502e0dc4ce42b073 Jun 02 14:51:44.344989 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:51:44.344969 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 14:51:45.133184 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:51:45.133155 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2jq4t/must-gather-6gwrj" event={"ID":"96fb6a26-717a-4650-b42e-b1ee9aff9e1f","Type":"ContainerStarted","Data":"2556c31c611b01e43c94b650390229e0ec36115fd5ca9b0a502e0dc4ce42b073"} Jun 02 14:51:47.640711 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:51:47.640651 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-cjm2d/test-trainjob-92nxt-node-0-0-lgbg7"] Jun 02 14:51:47.644261 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:51:47.644231 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-cjm2d/test-trainjob-92nxt-node-0-0-lgbg7"] Jun 02 14:51:49.113201 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:51:49.113168 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3130975b-d4a7-4ec7-8bea-541ecd25c1f3" path="/var/lib/kubelet/pods/3130975b-d4a7-4ec7-8bea-541ecd25c1f3/volumes" Jun 02 14:51:52.158178 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:51:52.158076 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2jq4t/must-gather-6gwrj" event={"ID":"96fb6a26-717a-4650-b42e-b1ee9aff9e1f","Type":"ContainerStarted","Data":"d10a29d23031a2cc5005376d0c35ed626af7d5b8da522a0eb06ca43eb4b7d5a0"} Jun 02 14:51:53.162720 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:51:53.162688 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2jq4t/must-gather-6gwrj" event={"ID":"96fb6a26-717a-4650-b42e-b1ee9aff9e1f","Type":"ContainerStarted","Data":"6db8bde9e4eeb29bc4e26bcbf51540026031f2d72bd08b54dbc642061239073f"} Jun 02 14:51:53.181610 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:51:53.181558 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-2jq4t/must-gather-6gwrj" podStartSLOduration=2.63196107 podStartE2EDuration="10.181540559s" podCreationTimestamp="2026-06-02 14:51:43 +0000 UTC" firstStartedPulling="2026-06-02 14:51:44.345158852 +0000 UTC m=+921.849495281" lastFinishedPulling="2026-06-02 14:51:51.894738326 +0000 UTC m=+929.399074770" observedRunningTime="2026-06-02 14:51:53.179360879 +0000 UTC m=+930.683697338" watchObservedRunningTime="2026-06-02 14:51:53.181540559 +0000 UTC m=+930.685877065" Jun 02 14:52:43.325357 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:43.325320 2566 generic.go:358] "Generic (PLEG): container finished" podID="96fb6a26-717a-4650-b42e-b1ee9aff9e1f" containerID="d10a29d23031a2cc5005376d0c35ed626af7d5b8da522a0eb06ca43eb4b7d5a0" exitCode=0 Jun 02 14:52:43.325779 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:43.325361 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2jq4t/must-gather-6gwrj" event={"ID":"96fb6a26-717a-4650-b42e-b1ee9aff9e1f","Type":"ContainerDied","Data":"d10a29d23031a2cc5005376d0c35ed626af7d5b8da522a0eb06ca43eb4b7d5a0"} Jun 02 14:52:43.325779 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:43.325728 2566 scope.go:117] "RemoveContainer" containerID="d10a29d23031a2cc5005376d0c35ed626af7d5b8da522a0eb06ca43eb4b7d5a0" Jun 02 14:52:43.801218 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:43.801185 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-2jq4t_must-gather-6gwrj_96fb6a26-717a-4650-b42e-b1ee9aff9e1f/gather/0.log" Jun 02 14:52:44.305392 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:44.305360 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9tbvl/must-gather-h8854"] Jun 02 14:52:44.307824 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:44.307804 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9tbvl/must-gather-h8854" Jun 02 14:52:44.310422 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:44.310401 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9tbvl\"/\"kube-root-ca.crt\"" Jun 02 14:52:44.310517 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:44.310453 2566 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9tbvl\"/\"default-dockercfg-dd6jk\"" Jun 02 14:52:44.311341 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:44.311320 2566 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9tbvl\"/\"openshift-service-ca.crt\"" Jun 02 14:52:44.315945 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:44.315927 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9tbvl/must-gather-h8854"] Jun 02 14:52:44.389907 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:44.389873 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cfsq\" (UniqueName: \"kubernetes.io/projected/c28096ab-17e5-44ea-a255-59a9d5c963e2-kube-api-access-6cfsq\") pod \"must-gather-h8854\" (UID: \"c28096ab-17e5-44ea-a255-59a9d5c963e2\") " pod="openshift-must-gather-9tbvl/must-gather-h8854" Jun 02 14:52:44.390330 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:44.389919 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c28096ab-17e5-44ea-a255-59a9d5c963e2-must-gather-output\") pod \"must-gather-h8854\" (UID: \"c28096ab-17e5-44ea-a255-59a9d5c963e2\") " pod="openshift-must-gather-9tbvl/must-gather-h8854" Jun 02 14:52:44.490602 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:44.490548 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6cfsq\" (UniqueName: \"kubernetes.io/projected/c28096ab-17e5-44ea-a255-59a9d5c963e2-kube-api-access-6cfsq\") pod \"must-gather-h8854\" (UID: \"c28096ab-17e5-44ea-a255-59a9d5c963e2\") " pod="openshift-must-gather-9tbvl/must-gather-h8854" Jun 02 14:52:44.490602 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:44.490613 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c28096ab-17e5-44ea-a255-59a9d5c963e2-must-gather-output\") pod \"must-gather-h8854\" (UID: \"c28096ab-17e5-44ea-a255-59a9d5c963e2\") " pod="openshift-must-gather-9tbvl/must-gather-h8854" Jun 02 14:52:44.490957 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:44.490942 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c28096ab-17e5-44ea-a255-59a9d5c963e2-must-gather-output\") pod \"must-gather-h8854\" (UID: \"c28096ab-17e5-44ea-a255-59a9d5c963e2\") " pod="openshift-must-gather-9tbvl/must-gather-h8854" Jun 02 14:52:44.500749 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:44.500715 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cfsq\" (UniqueName: \"kubernetes.io/projected/c28096ab-17e5-44ea-a255-59a9d5c963e2-kube-api-access-6cfsq\") pod \"must-gather-h8854\" (UID: \"c28096ab-17e5-44ea-a255-59a9d5c963e2\") " pod="openshift-must-gather-9tbvl/must-gather-h8854" Jun 02 14:52:44.617631 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:44.617551 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9tbvl/must-gather-h8854" Jun 02 14:52:44.744429 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:44.744395 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9tbvl/must-gather-h8854"] Jun 02 14:52:44.747411 ip-10-0-141-41 kubenswrapper[2566]: W0602 14:52:44.747380 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc28096ab_17e5_44ea_a255_59a9d5c963e2.slice/crio-7af6ee948ab87887416ac2954506d13525b31a6227a541d01d5727fcede7387d WatchSource:0}: Error finding container 7af6ee948ab87887416ac2954506d13525b31a6227a541d01d5727fcede7387d: Status 404 returned error can't find the container with id 7af6ee948ab87887416ac2954506d13525b31a6227a541d01d5727fcede7387d Jun 02 14:52:45.333041 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:45.333006 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9tbvl/must-gather-h8854" event={"ID":"c28096ab-17e5-44ea-a255-59a9d5c963e2","Type":"ContainerStarted","Data":"7af6ee948ab87887416ac2954506d13525b31a6227a541d01d5727fcede7387d"} Jun 02 14:52:46.338198 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:46.338161 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9tbvl/must-gather-h8854" event={"ID":"c28096ab-17e5-44ea-a255-59a9d5c963e2","Type":"ContainerStarted","Data":"a3001a45197f12f11876fbee200e824a0738037dfed442e02f569f5b192d45f4"} Jun 02 14:52:46.338198 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:46.338194 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9tbvl/must-gather-h8854" event={"ID":"c28096ab-17e5-44ea-a255-59a9d5c963e2","Type":"ContainerStarted","Data":"0a253441081dbc86d0b25d2cd852b39fa8064d2cf7444b7b3f599b38090ffd4d"} Jun 02 14:52:46.356844 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:46.356797 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-9tbvl/must-gather-h8854" podStartSLOduration=1.533143472 podStartE2EDuration="2.356782412s" podCreationTimestamp="2026-06-02 14:52:44 +0000 UTC" firstStartedPulling="2026-06-02 14:52:44.752201478 +0000 UTC m=+982.256537908" lastFinishedPulling="2026-06-02 14:52:45.575840417 +0000 UTC m=+983.080176848" observedRunningTime="2026-06-02 14:52:46.355772159 +0000 UTC m=+983.860108624" watchObservedRunningTime="2026-06-02 14:52:46.356782412 +0000 UTC m=+983.861118863" Jun 02 14:52:49.142585 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:49.142552 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-x9pkn_cadb7d1e-e530-4e59-9024-75235aa46d75/global-pull-secret-syncer/0.log" Jun 02 14:52:49.148620 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:49.148594 2566 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-2jq4t/must-gather-6gwrj"] Jun 02 14:52:49.148855 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:49.148833 2566 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-must-gather-2jq4t/must-gather-6gwrj" podUID="96fb6a26-717a-4650-b42e-b1ee9aff9e1f" containerName="copy" containerID="cri-o://6db8bde9e4eeb29bc4e26bcbf51540026031f2d72bd08b54dbc642061239073f" gracePeriod=2 Jun 02 14:52:49.153578 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:49.153549 2566 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-2jq4t/must-gather-6gwrj"] Jun 02 14:52:49.231216 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:49.231167 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bmdkl_18fc58fe-8823-453c-bc76-bbd8d9359fb2/konnectivity-agent/0.log" Jun 02 14:52:49.352029 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:49.351960 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-41.ec2.internal_ebdc834d789845207510ae66db3efff6/haproxy/0.log" Jun 02 14:52:49.353457 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:49.353418 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-2jq4t_must-gather-6gwrj_96fb6a26-717a-4650-b42e-b1ee9aff9e1f/copy/0.log" Jun 02 14:52:49.353818 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:49.353786 2566 generic.go:358] "Generic (PLEG): container finished" podID="96fb6a26-717a-4650-b42e-b1ee9aff9e1f" containerID="6db8bde9e4eeb29bc4e26bcbf51540026031f2d72bd08b54dbc642061239073f" exitCode=143 Jun 02 14:52:49.416371 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:49.416344 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-2jq4t_must-gather-6gwrj_96fb6a26-717a-4650-b42e-b1ee9aff9e1f/copy/0.log" Jun 02 14:52:49.416777 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:49.416756 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2jq4t/must-gather-6gwrj" Jun 02 14:52:49.419414 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:49.419372 2566 status_manager.go:895] "Failed to get status for pod" podUID="96fb6a26-717a-4650-b42e-b1ee9aff9e1f" pod="openshift-must-gather-2jq4t/must-gather-6gwrj" err="pods \"must-gather-6gwrj\" is forbidden: User \"system:node:ip-10-0-141-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-2jq4t\": no relationship found between node 'ip-10-0-141-41.ec2.internal' and this object" Jun 02 14:52:49.537854 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:49.537822 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5pmg\" (UniqueName: \"kubernetes.io/projected/96fb6a26-717a-4650-b42e-b1ee9aff9e1f-kube-api-access-r5pmg\") pod \"96fb6a26-717a-4650-b42e-b1ee9aff9e1f\" (UID: \"96fb6a26-717a-4650-b42e-b1ee9aff9e1f\") " Jun 02 14:52:49.538032 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:49.537926 2566 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/96fb6a26-717a-4650-b42e-b1ee9aff9e1f-must-gather-output\") pod \"96fb6a26-717a-4650-b42e-b1ee9aff9e1f\" (UID: \"96fb6a26-717a-4650-b42e-b1ee9aff9e1f\") " Jun 02 14:52:49.539359 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:49.539335 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96fb6a26-717a-4650-b42e-b1ee9aff9e1f-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "96fb6a26-717a-4650-b42e-b1ee9aff9e1f" (UID: "96fb6a26-717a-4650-b42e-b1ee9aff9e1f"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 14:52:49.540183 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:49.540163 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96fb6a26-717a-4650-b42e-b1ee9aff9e1f-kube-api-access-r5pmg" (OuterVolumeSpecName: "kube-api-access-r5pmg") pod "96fb6a26-717a-4650-b42e-b1ee9aff9e1f" (UID: "96fb6a26-717a-4650-b42e-b1ee9aff9e1f"). InnerVolumeSpecName "kube-api-access-r5pmg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 14:52:49.638971 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:49.638935 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5pmg\" (UniqueName: \"kubernetes.io/projected/96fb6a26-717a-4650-b42e-b1ee9aff9e1f-kube-api-access-r5pmg\") on node \"ip-10-0-141-41.ec2.internal\" DevicePath \"\"" Jun 02 14:52:49.638971 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:49.638967 2566 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/96fb6a26-717a-4650-b42e-b1ee9aff9e1f-must-gather-output\") on node \"ip-10-0-141-41.ec2.internal\" DevicePath \"\"" Jun 02 14:52:50.360202 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:50.360167 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-2jq4t_must-gather-6gwrj_96fb6a26-717a-4650-b42e-b1ee9aff9e1f/copy/0.log" Jun 02 14:52:50.360752 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:50.360737 2566 scope.go:117] "RemoveContainer" containerID="6db8bde9e4eeb29bc4e26bcbf51540026031f2d72bd08b54dbc642061239073f" Jun 02 14:52:50.364172 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:50.360878 2566 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2jq4t/must-gather-6gwrj" Jun 02 14:52:50.368913 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:50.368873 2566 status_manager.go:895] "Failed to get status for pod" podUID="96fb6a26-717a-4650-b42e-b1ee9aff9e1f" pod="openshift-must-gather-2jq4t/must-gather-6gwrj" err="pods \"must-gather-6gwrj\" is forbidden: User \"system:node:ip-10-0-141-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-2jq4t\": no relationship found between node 'ip-10-0-141-41.ec2.internal' and this object" Jun 02 14:52:50.380924 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:50.380879 2566 status_manager.go:895] "Failed to get status for pod" podUID="96fb6a26-717a-4650-b42e-b1ee9aff9e1f" pod="openshift-must-gather-2jq4t/must-gather-6gwrj" err="pods \"must-gather-6gwrj\" is forbidden: User \"system:node:ip-10-0-141-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-2jq4t\": no relationship found between node 'ip-10-0-141-41.ec2.internal' and this object" Jun 02 14:52:50.400304 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:50.398573 2566 scope.go:117] "RemoveContainer" containerID="d10a29d23031a2cc5005376d0c35ed626af7d5b8da522a0eb06ca43eb4b7d5a0" Jun 02 14:52:51.113001 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:51.112963 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96fb6a26-717a-4650-b42e-b1ee9aff9e1f" path="/var/lib/kubelet/pods/96fb6a26-717a-4650-b42e-b1ee9aff9e1f/volumes" Jun 02 14:52:52.662744 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:52.662711 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b825488e-9025-44e4-84c9-8c0205feb29e/alertmanager/0.log" Jun 02 14:52:52.690507 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:52.690476 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b825488e-9025-44e4-84c9-8c0205feb29e/config-reloader/0.log" Jun 02 14:52:52.716514 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:52.716473 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b825488e-9025-44e4-84c9-8c0205feb29e/kube-rbac-proxy-web/0.log" Jun 02 14:52:52.743768 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:52.743741 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b825488e-9025-44e4-84c9-8c0205feb29e/kube-rbac-proxy/0.log" Jun 02 14:52:52.772304 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:52.772230 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b825488e-9025-44e4-84c9-8c0205feb29e/kube-rbac-proxy-metric/0.log" Jun 02 14:52:52.802115 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:52.802087 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b825488e-9025-44e4-84c9-8c0205feb29e/prom-label-proxy/0.log" Jun 02 14:52:52.828178 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:52.828148 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b825488e-9025-44e4-84c9-8c0205feb29e/init-config-reloader/0.log" Jun 02 14:52:52.903650 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:52.903576 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-rkcxt_ed1f5bf3-f372-4994-91dc-b31c14958ff4/kube-state-metrics/0.log" Jun 02 14:52:52.926673 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:52.926641 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-rkcxt_ed1f5bf3-f372-4994-91dc-b31c14958ff4/kube-rbac-proxy-main/0.log" Jun 02 14:52:52.948890 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:52.948860 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-rkcxt_ed1f5bf3-f372-4994-91dc-b31c14958ff4/kube-rbac-proxy-self/0.log" Jun 02 14:52:52.980767 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:52.980736 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5d44f8b56b-gg5j2_89dcc13d-9cb8-4576-84e2-10f82c5fee23/metrics-server/0.log" Jun 02 14:52:53.010122 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:53.010093 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5768fcc9dd-lmr4g_5940fc5f-4981-409b-9a68-6e8ff643fa7f/monitoring-plugin/0.log" Jun 02 14:52:53.202289 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:53.202261 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wp2wj_dc7e162a-2c52-470f-a3e8-cc1c911826c7/node-exporter/0.log" Jun 02 14:52:53.224742 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:53.224712 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wp2wj_dc7e162a-2c52-470f-a3e8-cc1c911826c7/kube-rbac-proxy/0.log" Jun 02 14:52:53.249575 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:53.249542 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wp2wj_dc7e162a-2c52-470f-a3e8-cc1c911826c7/init-textfile/0.log" Jun 02 14:52:53.279174 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:53.279142 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-dbtw9_236dbe76-0a9a-44cc-a5a8-f462907ad75d/kube-rbac-proxy-main/0.log" Jun 02 14:52:53.306671 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:53.306642 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-dbtw9_236dbe76-0a9a-44cc-a5a8-f462907ad75d/kube-rbac-proxy-self/0.log" Jun 02 14:52:53.331641 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:53.331611 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-dbtw9_236dbe76-0a9a-44cc-a5a8-f462907ad75d/openshift-state-metrics/0.log" Jun 02 14:52:53.376800 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:53.376773 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8d177106-c59f-461d-8e09-f579a8cfe3aa/prometheus/0.log" Jun 02 14:52:53.399626 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:53.399596 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8d177106-c59f-461d-8e09-f579a8cfe3aa/config-reloader/0.log" Jun 02 14:52:53.422579 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:53.422439 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8d177106-c59f-461d-8e09-f579a8cfe3aa/thanos-sidecar/0.log" Jun 02 14:52:53.447620 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:53.447592 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8d177106-c59f-461d-8e09-f579a8cfe3aa/kube-rbac-proxy-web/0.log" Jun 02 14:52:53.472085 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:53.471995 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8d177106-c59f-461d-8e09-f579a8cfe3aa/kube-rbac-proxy/0.log" Jun 02 14:52:53.500147 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:53.500097 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8d177106-c59f-461d-8e09-f579a8cfe3aa/kube-rbac-proxy-thanos/0.log" Jun 02 14:52:53.525893 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:53.525856 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8d177106-c59f-461d-8e09-f579a8cfe3aa/init-config-reloader/0.log" Jun 02 14:52:53.560098 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:53.560063 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-jrbf8_bee09843-37f7-49ed-a562-aeeecbc79513/prometheus-operator/0.log" Jun 02 14:52:53.588364 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:53.588336 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-jrbf8_bee09843-37f7-49ed-a562-aeeecbc79513/kube-rbac-proxy/0.log" Jun 02 14:52:53.658656 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:53.658624 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d75b4fc4f-5rjbt_9c41962f-8deb-4a4a-83b5-733293323fd0/telemeter-client/0.log" Jun 02 14:52:53.688901 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:53.688869 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d75b4fc4f-5rjbt_9c41962f-8deb-4a4a-83b5-733293323fd0/reload/0.log" Jun 02 14:52:53.715538 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:53.715506 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-d75b4fc4f-5rjbt_9c41962f-8deb-4a4a-83b5-733293323fd0/kube-rbac-proxy/0.log" Jun 02 14:52:53.755087 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:53.754994 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c84798656-kglwc_c78e333f-c32e-4738-8e85-585047ac830f/thanos-query/0.log" Jun 02 14:52:53.800425 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:53.800394 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c84798656-kglwc_c78e333f-c32e-4738-8e85-585047ac830f/kube-rbac-proxy-web/0.log" Jun 02 14:52:53.852168 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:53.852086 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c84798656-kglwc_c78e333f-c32e-4738-8e85-585047ac830f/kube-rbac-proxy/0.log" Jun 02 14:52:53.890311 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:53.890280 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c84798656-kglwc_c78e333f-c32e-4738-8e85-585047ac830f/prom-label-proxy/0.log" Jun 02 14:52:53.914579 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:53.914544 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c84798656-kglwc_c78e333f-c32e-4738-8e85-585047ac830f/kube-rbac-proxy-rules/0.log" Jun 02 14:52:53.945787 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:53.945747 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c84798656-kglwc_c78e333f-c32e-4738-8e85-585047ac830f/kube-rbac-proxy-metrics/0.log" Jun 02 14:52:55.769597 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:55.769563 2566 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9tbvl/perf-node-gather-daemonset-x7xvp"] Jun 02 14:52:55.770030 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:55.769892 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96fb6a26-717a-4650-b42e-b1ee9aff9e1f" containerName="copy" Jun 02 14:52:55.770030 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:55.769903 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="96fb6a26-717a-4650-b42e-b1ee9aff9e1f" containerName="copy" Jun 02 14:52:55.770030 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:55.769918 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96fb6a26-717a-4650-b42e-b1ee9aff9e1f" containerName="gather" Jun 02 14:52:55.770030 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:55.769924 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="96fb6a26-717a-4650-b42e-b1ee9aff9e1f" containerName="gather" Jun 02 14:52:55.770030 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:55.769975 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="96fb6a26-717a-4650-b42e-b1ee9aff9e1f" containerName="copy" Jun 02 14:52:55.770030 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:55.769987 2566 memory_manager.go:356] "RemoveStaleState removing state" podUID="96fb6a26-717a-4650-b42e-b1ee9aff9e1f" containerName="gather" Jun 02 14:52:55.772907 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:55.772879 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9tbvl/perf-node-gather-daemonset-x7xvp" Jun 02 14:52:55.783287 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:55.783262 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9tbvl/perf-node-gather-daemonset-x7xvp"] Jun 02 14:52:55.900867 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:55.900835 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8fcb7c7f-16eb-40b6-afa3-09d9f149dae7-lib-modules\") pod \"perf-node-gather-daemonset-x7xvp\" (UID: \"8fcb7c7f-16eb-40b6-afa3-09d9f149dae7\") " pod="openshift-must-gather-9tbvl/perf-node-gather-daemonset-x7xvp" Jun 02 14:52:55.900867 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:55.900866 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8fcb7c7f-16eb-40b6-afa3-09d9f149dae7-proc\") pod \"perf-node-gather-daemonset-x7xvp\" (UID: \"8fcb7c7f-16eb-40b6-afa3-09d9f149dae7\") " pod="openshift-must-gather-9tbvl/perf-node-gather-daemonset-x7xvp" Jun 02 14:52:55.901080 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:55.900900 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8fcb7c7f-16eb-40b6-afa3-09d9f149dae7-podres\") pod \"perf-node-gather-daemonset-x7xvp\" (UID: \"8fcb7c7f-16eb-40b6-afa3-09d9f149dae7\") " pod="openshift-must-gather-9tbvl/perf-node-gather-daemonset-x7xvp" Jun 02 14:52:55.901080 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:55.900925 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wv6t\" (UniqueName: \"kubernetes.io/projected/8fcb7c7f-16eb-40b6-afa3-09d9f149dae7-kube-api-access-5wv6t\") pod \"perf-node-gather-daemonset-x7xvp\" (UID: \"8fcb7c7f-16eb-40b6-afa3-09d9f149dae7\") " pod="openshift-must-gather-9tbvl/perf-node-gather-daemonset-x7xvp" Jun 02 14:52:55.901080 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:55.900976 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8fcb7c7f-16eb-40b6-afa3-09d9f149dae7-sys\") pod \"perf-node-gather-daemonset-x7xvp\" (UID: \"8fcb7c7f-16eb-40b6-afa3-09d9f149dae7\") " pod="openshift-must-gather-9tbvl/perf-node-gather-daemonset-x7xvp" Jun 02 14:52:56.001965 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:56.001921 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8fcb7c7f-16eb-40b6-afa3-09d9f149dae7-sys\") pod \"perf-node-gather-daemonset-x7xvp\" (UID: \"8fcb7c7f-16eb-40b6-afa3-09d9f149dae7\") " pod="openshift-must-gather-9tbvl/perf-node-gather-daemonset-x7xvp" Jun 02 14:52:56.002159 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:56.002033 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8fcb7c7f-16eb-40b6-afa3-09d9f149dae7-lib-modules\") pod \"perf-node-gather-daemonset-x7xvp\" (UID: \"8fcb7c7f-16eb-40b6-afa3-09d9f149dae7\") " pod="openshift-must-gather-9tbvl/perf-node-gather-daemonset-x7xvp" Jun 02 14:52:56.002159 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:56.002046 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8fcb7c7f-16eb-40b6-afa3-09d9f149dae7-sys\") pod \"perf-node-gather-daemonset-x7xvp\" (UID: \"8fcb7c7f-16eb-40b6-afa3-09d9f149dae7\") " pod="openshift-must-gather-9tbvl/perf-node-gather-daemonset-x7xvp" Jun 02 14:52:56.002159 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:56.002064 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8fcb7c7f-16eb-40b6-afa3-09d9f149dae7-proc\") pod \"perf-node-gather-daemonset-x7xvp\" (UID: \"8fcb7c7f-16eb-40b6-afa3-09d9f149dae7\") " pod="openshift-must-gather-9tbvl/perf-node-gather-daemonset-x7xvp" Jun 02 14:52:56.002159 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:56.002097 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8fcb7c7f-16eb-40b6-afa3-09d9f149dae7-podres\") pod \"perf-node-gather-daemonset-x7xvp\" (UID: \"8fcb7c7f-16eb-40b6-afa3-09d9f149dae7\") " pod="openshift-must-gather-9tbvl/perf-node-gather-daemonset-x7xvp" Jun 02 14:52:56.002358 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:56.002156 2566 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5wv6t\" (UniqueName: \"kubernetes.io/projected/8fcb7c7f-16eb-40b6-afa3-09d9f149dae7-kube-api-access-5wv6t\") pod \"perf-node-gather-daemonset-x7xvp\" (UID: \"8fcb7c7f-16eb-40b6-afa3-09d9f149dae7\") " pod="openshift-must-gather-9tbvl/perf-node-gather-daemonset-x7xvp" Jun 02 14:52:56.002358 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:56.002176 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8fcb7c7f-16eb-40b6-afa3-09d9f149dae7-proc\") pod \"perf-node-gather-daemonset-x7xvp\" (UID: \"8fcb7c7f-16eb-40b6-afa3-09d9f149dae7\") " pod="openshift-must-gather-9tbvl/perf-node-gather-daemonset-x7xvp" Jun 02 14:52:56.002358 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:56.002178 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8fcb7c7f-16eb-40b6-afa3-09d9f149dae7-lib-modules\") pod \"perf-node-gather-daemonset-x7xvp\" (UID: \"8fcb7c7f-16eb-40b6-afa3-09d9f149dae7\") " pod="openshift-must-gather-9tbvl/perf-node-gather-daemonset-x7xvp" Jun 02 14:52:56.002358 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:56.002294 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8fcb7c7f-16eb-40b6-afa3-09d9f149dae7-podres\") pod \"perf-node-gather-daemonset-x7xvp\" (UID: \"8fcb7c7f-16eb-40b6-afa3-09d9f149dae7\") " pod="openshift-must-gather-9tbvl/perf-node-gather-daemonset-x7xvp" Jun 02 14:52:56.011363 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:56.011335 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wv6t\" (UniqueName: \"kubernetes.io/projected/8fcb7c7f-16eb-40b6-afa3-09d9f149dae7-kube-api-access-5wv6t\") pod \"perf-node-gather-daemonset-x7xvp\" (UID: \"8fcb7c7f-16eb-40b6-afa3-09d9f149dae7\") " pod="openshift-must-gather-9tbvl/perf-node-gather-daemonset-x7xvp" Jun 02 14:52:56.085361 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:56.085263 2566 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9tbvl/perf-node-gather-daemonset-x7xvp" Jun 02 14:52:56.232173 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:56.232113 2566 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9tbvl/perf-node-gather-daemonset-x7xvp"] Jun 02 14:52:56.385212 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:56.385175 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9tbvl/perf-node-gather-daemonset-x7xvp" event={"ID":"8fcb7c7f-16eb-40b6-afa3-09d9f149dae7","Type":"ContainerStarted","Data":"581db2c9e8edaf8088a6d9c0e5cea253471e483f774bfa0f4dadeb8506e06f16"} Jun 02 14:52:56.971742 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:56.971711 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z9f8p_c844ed44-4523-49b9-9826-8fd7ef6c5819/dns/0.log" Jun 02 14:52:56.996525 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:56.996500 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z9f8p_c844ed44-4523-49b9-9826-8fd7ef6c5819/kube-rbac-proxy/0.log" Jun 02 14:52:57.022847 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:57.022814 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h86v6_30c92720-9871-4546-b0d2-0875a4905228/dns-node-resolver/0.log" Jun 02 14:52:57.391505 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:57.391416 2566 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9tbvl/perf-node-gather-daemonset-x7xvp" event={"ID":"8fcb7c7f-16eb-40b6-afa3-09d9f149dae7","Type":"ContainerStarted","Data":"ff843f8183ea1f064335a981fa97d44cc46b8d07f543e921c2461c273cbdeb05"} Jun 02 14:52:57.391741 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:57.391722 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9tbvl/perf-node-gather-daemonset-x7xvp" Jun 02 14:52:57.410269 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:57.410223 2566 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-9tbvl/perf-node-gather-daemonset-x7xvp" podStartSLOduration=2.410207898 podStartE2EDuration="2.410207898s" podCreationTimestamp="2026-06-02 14:52:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 14:52:57.408460143 +0000 UTC m=+994.912796597" watchObservedRunningTime="2026-06-02 14:52:57.410207898 +0000 UTC m=+994.914544349" Jun 02 14:52:57.514455 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:57.514425 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-whmlg_420fe544-ab5c-49d7-ac95-8c30edb13f7c/node-ca/0.log" Jun 02 14:52:58.604257 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:58.604228 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-znvcz_8bfd843d-d883-4e3a-a984-1d15495e05bc/serve-healthcheck-canary/0.log" Jun 02 14:52:58.973765 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:58.973740 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5l59w_8589f6af-377d-4dbb-9560-88edeb2d8fde/kube-rbac-proxy/0.log" Jun 02 14:52:58.996800 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:58.996768 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5l59w_8589f6af-377d-4dbb-9560-88edeb2d8fde/exporter/0.log" Jun 02 14:52:59.021875 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:52:59.021845 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5l59w_8589f6af-377d-4dbb-9560-88edeb2d8fde/extractor/0.log" Jun 02 14:53:00.798549 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:53:00.798521 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-747c5859c7-4v5nx_8193ce02-5b3c-49ef-9170-33b054566aa3/jobset-operator/0.log" Jun 02 14:53:03.408452 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:53:03.407742 2566 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9tbvl/perf-node-gather-daemonset-x7xvp" Jun 02 14:53:05.670233 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:53:05.670203 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-28ss6_98dba64e-ba8c-4d20-b3ab-2ba5d90bd3b8/kube-multus/0.log" Jun 02 14:53:05.704742 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:53:05.704721 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-979tz_906e83ac-7d72-4b4a-a0bd-7a4e983c6359/kube-multus-additional-cni-plugins/0.log" Jun 02 14:53:05.735219 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:53:05.735124 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-979tz_906e83ac-7d72-4b4a-a0bd-7a4e983c6359/egress-router-binary-copy/0.log" Jun 02 14:53:05.757794 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:53:05.757767 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-979tz_906e83ac-7d72-4b4a-a0bd-7a4e983c6359/cni-plugins/0.log" Jun 02 14:53:05.780811 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:53:05.780778 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-979tz_906e83ac-7d72-4b4a-a0bd-7a4e983c6359/bond-cni-plugin/0.log" Jun 02 14:53:05.805059 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:53:05.805028 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-979tz_906e83ac-7d72-4b4a-a0bd-7a4e983c6359/routeoverride-cni/0.log" Jun 02 14:53:05.826853 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:53:05.826827 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-979tz_906e83ac-7d72-4b4a-a0bd-7a4e983c6359/whereabouts-cni-bincopy/0.log" Jun 02 14:53:05.849719 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:53:05.849697 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-979tz_906e83ac-7d72-4b4a-a0bd-7a4e983c6359/whereabouts-cni/0.log" Jun 02 14:53:06.306203 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:53:06.306168 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gd9d4_ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c/network-metrics-daemon/0.log" Jun 02 14:53:06.329874 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:53:06.329842 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gd9d4_ae51e4dc-9d2a-46d1-81c2-c0ef1935c61c/kube-rbac-proxy/0.log" Jun 02 14:53:07.190989 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:53:07.190957 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-86rkq_7446ab1b-b67d-4448-b4b3-5eacdcc9d885/ovn-controller/0.log" Jun 02 14:53:07.211013 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:53:07.210984 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-86rkq_7446ab1b-b67d-4448-b4b3-5eacdcc9d885/ovn-acl-logging/0.log" Jun 02 14:53:07.220945 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:53:07.220906 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-86rkq_7446ab1b-b67d-4448-b4b3-5eacdcc9d885/ovn-acl-logging/1.log" Jun 02 14:53:07.240689 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:53:07.240663 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-86rkq_7446ab1b-b67d-4448-b4b3-5eacdcc9d885/kube-rbac-proxy-node/0.log" Jun 02 14:53:07.263973 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:53:07.263933 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-86rkq_7446ab1b-b67d-4448-b4b3-5eacdcc9d885/kube-rbac-proxy-ovn-metrics/0.log" Jun 02 14:53:07.289528 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:53:07.289482 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-86rkq_7446ab1b-b67d-4448-b4b3-5eacdcc9d885/northd/0.log" Jun 02 14:53:07.314361 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:53:07.314331 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-86rkq_7446ab1b-b67d-4448-b4b3-5eacdcc9d885/nbdb/0.log" Jun 02 14:53:07.337090 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:53:07.337061 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-86rkq_7446ab1b-b67d-4448-b4b3-5eacdcc9d885/sbdb/0.log" Jun 02 14:53:07.519192 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:53:07.519164 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-86rkq_7446ab1b-b67d-4448-b4b3-5eacdcc9d885/ovnkube-controller/0.log" Jun 02 14:53:09.113051 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:53:09.113023 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-2lz7g_20db969a-b67f-4e16-8ec8-549fa5f1ae4b/network-check-target-container/0.log" Jun 02 14:53:10.103550 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:53:10.103523 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-5b6hv_39506301-52a8-4516-be1c-9ca7f202ad74/iptables-alerter/0.log" Jun 02 14:53:10.817832 ip-10-0-141-41 kubenswrapper[2566]: I0602 14:53:10.817786 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-zqjzv_6179e2f2-9fc2-489f-bded-9cfe452097b4/tuned/0.log"