May 25 12:12:46.873471 ip-10-0-132-116 systemd[1]: Starting Kubernetes Kubelet... May 25 12:12:47.318710 ip-10-0-132-116 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 25 12:12:47.318710 ip-10-0-132-116 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 25 12:12:47.318710 ip-10-0-132-116 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 25 12:12:47.318710 ip-10-0-132-116 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 25 12:12:47.318710 ip-10-0-132-116 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 25 12:12:47.320890 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.320797 2558 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 25 12:12:47.324365 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324350 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 25 12:12:47.324365 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324365 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 25 12:12:47.324427 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324368 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 25 12:12:47.324427 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324372 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 25 12:12:47.324427 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324375 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 25 12:12:47.324427 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324378 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 25 12:12:47.324427 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324382 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 25 12:12:47.324427 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324385 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 25 12:12:47.324427 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324388 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 25 12:12:47.324427 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324390 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 25 12:12:47.324427 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324393 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 25 12:12:47.324427 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324396 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 25 12:12:47.324427 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324398 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 25 12:12:47.324427 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324401 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 25 12:12:47.324427 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324404 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 25 12:12:47.324427 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324406 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 25 12:12:47.324427 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324409 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 25 12:12:47.324427 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324412 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 25 12:12:47.324427 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324414 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 25 12:12:47.324427 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324417 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 25 12:12:47.324427 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324419 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 25 12:12:47.324427 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324421 2558 feature_gate.go:328] unrecognized feature gate: Example2 May 25 12:12:47.324905 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324425 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 25 12:12:47.324905 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324428 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 25 12:12:47.324905 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324430 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 25 12:12:47.324905 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324433 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 25 12:12:47.324905 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324436 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 25 12:12:47.324905 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324439 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 25 12:12:47.324905 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324441 2558 feature_gate.go:328] unrecognized feature gate: DualReplica May 25 12:12:47.324905 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324444 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 25 12:12:47.324905 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324446 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 25 12:12:47.324905 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324449 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 25 12:12:47.324905 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324451 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 25 12:12:47.324905 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324454 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 25 12:12:47.324905 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324456 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 25 12:12:47.324905 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324459 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 25 12:12:47.324905 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324462 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 25 12:12:47.324905 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324464 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 25 12:12:47.324905 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324466 2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 25 12:12:47.324905 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324469 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 25 12:12:47.324905 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324472 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 25 12:12:47.324905 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324474 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 25 12:12:47.325408 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324476 2558 feature_gate.go:328] unrecognized feature gate: NewOLM May 25 12:12:47.325408 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324479 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 25 12:12:47.325408 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324490 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 25 12:12:47.325408 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324492 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 25 12:12:47.325408 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324495 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 25 12:12:47.325408 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324498 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages May 25 12:12:47.325408 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324500 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 25 12:12:47.325408 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324503 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 25 12:12:47.325408 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324505 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 25 12:12:47.325408 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324508 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 25 12:12:47.325408 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324510 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 25 12:12:47.325408 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324513 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 25 12:12:47.325408 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324515 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 25 12:12:47.325408 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324520 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 25 12:12:47.325408 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324524 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 25 12:12:47.325408 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324527 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 25 12:12:47.325408 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324530 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 25 12:12:47.325408 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324533 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 25 12:12:47.325408 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324535 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 25 12:12:47.325886 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324538 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 25 12:12:47.325886 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324540 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 25 12:12:47.325886 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324543 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 25 12:12:47.325886 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324552 2558 feature_gate.go:328] unrecognized feature gate: Example May 25 12:12:47.325886 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324554 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 25 12:12:47.325886 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324558 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 25 12:12:47.325886 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324563 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 25 12:12:47.325886 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324566 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 25 12:12:47.325886 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324569 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 25 12:12:47.325886 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324571 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 25 12:12:47.325886 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324574 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 25 12:12:47.325886 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324576 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 25 12:12:47.325886 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324579 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 25 12:12:47.325886 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324581 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 25 12:12:47.325886 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324585 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 25 12:12:47.325886 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324587 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 25 12:12:47.325886 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324590 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability May 25 12:12:47.325886 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324592 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 25 12:12:47.325886 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324595 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 25 12:12:47.326366 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324597 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 25 12:12:47.326366 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324599 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 25 12:12:47.326366 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324602 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 25 12:12:47.326366 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324604 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 25 12:12:47.326366 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324607 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores May 25 12:12:47.326366 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.324609 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 25 12:12:47.326366 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325726 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 25 12:12:47.326366 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325733 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 25 12:12:47.326366 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325736 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 25 12:12:47.326366 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325739 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 25 12:12:47.326366 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325742 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 25 12:12:47.326366 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325745 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 25 12:12:47.326366 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325748 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 25 12:12:47.326366 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325750 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 25 12:12:47.326366 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325754 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 25 12:12:47.326366 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325757 2558 feature_gate.go:328] unrecognized feature gate: NewOLM May 25 12:12:47.326366 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325760 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 25 12:12:47.326366 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325763 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 25 12:12:47.326366 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325766 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 25 12:12:47.326821 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325768 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 25 12:12:47.326821 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325771 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 25 12:12:47.326821 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325773 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 25 12:12:47.326821 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325776 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 25 12:12:47.326821 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325778 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 25 12:12:47.326821 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325781 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 25 12:12:47.326821 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325786 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 25 12:12:47.326821 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325789 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 25 12:12:47.326821 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325792 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 25 12:12:47.326821 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325795 2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 25 12:12:47.326821 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325798 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 25 12:12:47.326821 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325801 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 25 12:12:47.326821 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325803 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 25 12:12:47.326821 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325805 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 25 12:12:47.326821 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325808 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 25 12:12:47.326821 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325810 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 25 12:12:47.326821 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325813 2558 feature_gate.go:328] unrecognized feature gate: DualReplica May 25 12:12:47.326821 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325815 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 25 12:12:47.326821 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325817 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 25 12:12:47.327336 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325820 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 25 12:12:47.327336 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325822 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 25 12:12:47.327336 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325825 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 25 12:12:47.327336 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325827 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 25 12:12:47.327336 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325829 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 25 12:12:47.327336 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325832 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 25 12:12:47.327336 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325835 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 25 12:12:47.327336 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325838 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 25 12:12:47.327336 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325841 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 25 12:12:47.327336 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325844 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 25 12:12:47.327336 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325846 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 25 12:12:47.327336 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325849 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 25 12:12:47.327336 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325851 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 25 12:12:47.327336 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325854 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 25 12:12:47.327336 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325858 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 25 12:12:47.327336 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325861 2558 feature_gate.go:328] unrecognized feature gate: Example May 25 12:12:47.327336 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325863 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 25 12:12:47.327336 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325866 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 25 12:12:47.327336 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325869 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 25 12:12:47.327336 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325871 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 25 12:12:47.327870 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325874 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 25 12:12:47.327870 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325876 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 25 12:12:47.327870 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325879 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 25 12:12:47.327870 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325882 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 25 12:12:47.327870 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325885 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 25 12:12:47.327870 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325887 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability May 25 12:12:47.327870 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325890 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 25 12:12:47.327870 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325892 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 25 12:12:47.327870 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325895 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 25 12:12:47.327870 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325897 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 25 12:12:47.327870 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325899 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 25 12:12:47.327870 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325902 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 25 12:12:47.327870 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325904 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 25 12:12:47.327870 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325906 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 25 12:12:47.327870 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325909 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores May 25 12:12:47.327870 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325911 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 25 12:12:47.327870 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325914 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 25 12:12:47.327870 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325916 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 25 12:12:47.327870 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325918 2558 feature_gate.go:328] unrecognized feature gate: Example2 May 25 12:12:47.327870 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325921 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 25 12:12:47.328380 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325924 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 25 12:12:47.328380 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325927 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 25 12:12:47.328380 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325929 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 25 12:12:47.328380 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325932 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 25 12:12:47.328380 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325934 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 25 12:12:47.328380 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325936 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 25 12:12:47.328380 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325939 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 25 12:12:47.328380 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325941 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 25 12:12:47.328380 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325944 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 25 12:12:47.328380 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325946 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 25 12:12:47.328380 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325949 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 25 12:12:47.328380 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325951 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages May 25 12:12:47.328380 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325954 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 25 12:12:47.328380 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.325956 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 25 12:12:47.328380 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326032 2558 flags.go:64] FLAG: --address="0.0.0.0" May 25 12:12:47.328380 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326041 2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 25 12:12:47.328380 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326051 2558 flags.go:64] FLAG: --anonymous-auth="true" May 25 12:12:47.328380 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326057 2558 flags.go:64] FLAG: --application-metrics-count-limit="100" May 25 12:12:47.328380 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326064 2558 flags.go:64] FLAG: --authentication-token-webhook="false" May 25 12:12:47.328380 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326069 2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 25 12:12:47.328380 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326075 2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 25 12:12:47.328890 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326081 2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 25 12:12:47.328890 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326085 2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 25 12:12:47.328890 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326101 2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 25 12:12:47.328890 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326104 2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 25 12:12:47.328890 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326107 2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 25 12:12:47.328890 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326110 2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 25 12:12:47.328890 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326113 2558 flags.go:64] FLAG: --cgroup-root="" May 25 12:12:47.328890 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326116 2558 flags.go:64] FLAG: --cgroups-per-qos="true" May 25 12:12:47.328890 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326120 2558 flags.go:64] FLAG: --client-ca-file="" May 25 12:12:47.328890 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326123 2558 flags.go:64] FLAG: --cloud-config="" May 25 12:12:47.328890 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326126 2558 flags.go:64] FLAG: --cloud-provider="external" May 25 12:12:47.328890 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326129 2558 flags.go:64] FLAG: --cluster-dns="[]" May 25 12:12:47.328890 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326135 2558 flags.go:64] FLAG: --cluster-domain="" May 25 12:12:47.328890 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326138 2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 25 12:12:47.328890 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326142 2558 flags.go:64] FLAG: --config-dir="" May 25 12:12:47.328890 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326144 2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 25 12:12:47.328890 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326148 2558 flags.go:64] FLAG: --container-log-max-files="5" May 25 12:12:47.328890 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326152 2558 flags.go:64] FLAG: --container-log-max-size="10Mi" May 25 12:12:47.328890 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326154 2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 25 12:12:47.328890 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326157 2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 25 12:12:47.328890 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326161 2558 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 25 12:12:47.328890 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326164 2558 flags.go:64] FLAG: --contention-profiling="false" May 25 12:12:47.328890 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326167 2558 flags.go:64] FLAG: --cpu-cfs-quota="true" May 25 12:12:47.328890 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326170 2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 25 12:12:47.329499 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326173 2558 flags.go:64] FLAG: --cpu-manager-policy="none" May 25 12:12:47.329499 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326176 2558 flags.go:64] FLAG: --cpu-manager-policy-options="" May 25 12:12:47.329499 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326180 2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 25 12:12:47.329499 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326183 2558 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 25 12:12:47.329499 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326186 2558 flags.go:64] FLAG: --enable-debugging-handlers="true" May 25 12:12:47.329499 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326189 2558 flags.go:64] FLAG: --enable-load-reader="false" May 25 12:12:47.329499 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326192 2558 flags.go:64] FLAG: --enable-server="true" May 25 12:12:47.329499 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326194 2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 25 12:12:47.329499 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326199 2558 flags.go:64] FLAG: --event-burst="100" May 25 12:12:47.329499 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326202 2558 flags.go:64] FLAG: --event-qps="50" May 25 12:12:47.329499 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326205 2558 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 25 12:12:47.329499 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326208 2558 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 25 12:12:47.329499 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326210 2558 flags.go:64] FLAG: --eviction-hard="" May 25 12:12:47.329499 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326214 2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 25 12:12:47.329499 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326217 2558 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 25 12:12:47.329499 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326220 2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 25 12:12:47.329499 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326223 2558 flags.go:64] FLAG: --eviction-soft="" May 25 12:12:47.329499 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326227 2558 flags.go:64] FLAG: --eviction-soft-grace-period="" May 25 12:12:47.329499 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326230 2558 flags.go:64] FLAG: --exit-on-lock-contention="false" May 25 12:12:47.329499 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326233 2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 25 12:12:47.329499 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326236 2558 flags.go:64] FLAG: --experimental-mounter-path="" May 25 12:12:47.329499 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326239 2558 flags.go:64] FLAG: --fail-cgroupv1="false" May 25 12:12:47.329499 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326241 2558 flags.go:64] FLAG: --fail-swap-on="true" May 25 12:12:47.329499 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326244 2558 flags.go:64] FLAG: --feature-gates="" May 25 12:12:47.329499 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326248 2558 flags.go:64] FLAG: --file-check-frequency="20s" May 25 12:12:47.330104 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326251 2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 25 12:12:47.330104 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326253 2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 25 12:12:47.330104 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326256 2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 25 12:12:47.330104 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326260 2558 flags.go:64] FLAG: --healthz-port="10248" May 25 12:12:47.330104 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326263 2558 flags.go:64] FLAG: --help="false" May 25 12:12:47.330104 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326265 2558 flags.go:64] FLAG: --hostname-override="ip-10-0-132-116.ec2.internal" May 25 12:12:47.330104 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326268 2558 flags.go:64] FLAG: --housekeeping-interval="10s" May 25 12:12:47.330104 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326271 2558 flags.go:64] FLAG: --http-check-frequency="20s" May 25 12:12:47.330104 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326274 2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 25 12:12:47.330104 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326278 2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 25 12:12:47.330104 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326281 2558 flags.go:64] FLAG: --image-gc-high-threshold="85" May 25 12:12:47.330104 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326284 2558 flags.go:64] FLAG: --image-gc-low-threshold="80" May 25 12:12:47.330104 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326287 2558 flags.go:64] FLAG: --image-service-endpoint="" May 25 12:12:47.330104 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326289 2558 flags.go:64] FLAG: --kernel-memcg-notification="false" May 25 12:12:47.330104 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326292 2558 flags.go:64] FLAG: --kube-api-burst="100" May 25 12:12:47.330104 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326295 2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 25 12:12:47.330104 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326298 2558 flags.go:64] FLAG: --kube-api-qps="50" May 25 12:12:47.330104 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326300 2558 flags.go:64] FLAG: --kube-reserved="" May 25 12:12:47.330104 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326303 2558 flags.go:64] FLAG: --kube-reserved-cgroup="" May 25 12:12:47.330104 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326306 2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 25 12:12:47.330104 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326309 2558 flags.go:64] FLAG: --kubelet-cgroups="" May 25 12:12:47.330104 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326312 2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 25 12:12:47.330104 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326314 2558 flags.go:64] FLAG: --lock-file="" May 25 12:12:47.330104 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326317 2558 flags.go:64] FLAG: --log-cadvisor-usage="false" May 25 12:12:47.330694 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326320 2558 flags.go:64] FLAG: --log-flush-frequency="5s" May 25 12:12:47.330694 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326323 2558 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 25 12:12:47.330694 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326329 2558 flags.go:64] FLAG: --log-json-split-stream="false" May 25 12:12:47.330694 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326331 2558 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 25 12:12:47.330694 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326334 2558 flags.go:64] FLAG: --log-text-split-stream="false" May 25 12:12:47.330694 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326337 2558 flags.go:64] FLAG: --logging-format="text" May 25 12:12:47.330694 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326339 2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 25 12:12:47.330694 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326343 2558 flags.go:64] FLAG: --make-iptables-util-chains="true" May 25 12:12:47.330694 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326346 2558 flags.go:64] FLAG: --manifest-url="" May 25 12:12:47.330694 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326348 2558 flags.go:64] FLAG: --manifest-url-header="" May 25 12:12:47.330694 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326352 2558 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 25 12:12:47.330694 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326355 2558 flags.go:64] FLAG: --max-open-files="1000000" May 25 12:12:47.330694 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326359 2558 flags.go:64] FLAG: --max-pods="110" May 25 12:12:47.330694 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326362 2558 flags.go:64] FLAG: --maximum-dead-containers="-1" May 25 12:12:47.330694 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326365 2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 25 12:12:47.330694 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326368 2558 flags.go:64] FLAG: --memory-manager-policy="None" May 25 12:12:47.330694 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326371 2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 25 12:12:47.330694 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326374 2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 25 12:12:47.330694 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326378 2558 flags.go:64] FLAG: --node-ip="0.0.0.0" May 25 12:12:47.330694 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326381 2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 25 12:12:47.330694 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326388 2558 flags.go:64] FLAG: --node-status-max-images="50" May 25 12:12:47.330694 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326391 2558 flags.go:64] FLAG: --node-status-update-frequency="10s" May 25 12:12:47.330694 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326394 2558 flags.go:64] FLAG: --oom-score-adj="-999" May 25 12:12:47.330694 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326397 2558 flags.go:64] FLAG: --pod-cidr="" May 25 12:12:47.331287 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326400 2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 25 12:12:47.331287 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326405 2558 flags.go:64] FLAG: --pod-manifest-path="" May 25 12:12:47.331287 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326408 2558 flags.go:64] FLAG: --pod-max-pids="-1" May 25 12:12:47.331287 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326412 2558 flags.go:64] FLAG: --pods-per-core="0" May 25 12:12:47.331287 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326414 2558 flags.go:64] FLAG: --port="10250" May 25 12:12:47.331287 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326417 2558 flags.go:64] FLAG: --protect-kernel-defaults="false" May 25 12:12:47.331287 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326420 2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04dd0b6e34d57fe23" May 25 12:12:47.331287 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326423 2558 flags.go:64] FLAG: --qos-reserved="" May 25 12:12:47.331287 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326426 2558 flags.go:64] FLAG: --read-only-port="10255" May 25 12:12:47.331287 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326430 2558 flags.go:64] FLAG: --register-node="true" May 25 12:12:47.331287 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326433 2558 flags.go:64] FLAG: --register-schedulable="true" May 25 12:12:47.331287 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326436 2558 flags.go:64] FLAG: --register-with-taints="" May 25 12:12:47.331287 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326439 2558 flags.go:64] FLAG: --registry-burst="10" May 25 12:12:47.331287 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326442 2558 flags.go:64] FLAG: --registry-qps="5" May 25 12:12:47.331287 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326445 2558 flags.go:64] FLAG: --reserved-cpus="" May 25 12:12:47.331287 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326447 2558 flags.go:64] FLAG: --reserved-memory="" May 25 12:12:47.331287 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326451 2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 25 12:12:47.331287 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326454 2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 25 12:12:47.331287 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326457 2558 flags.go:64] FLAG: --rotate-certificates="false" May 25 12:12:47.331287 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326460 2558 flags.go:64] FLAG: --rotate-server-certificates="false" May 25 12:12:47.331287 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326462 2558 flags.go:64] FLAG: --runonce="false" May 25 12:12:47.331287 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326465 2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 25 12:12:47.331287 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326468 2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 25 12:12:47.331287 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326471 2558 flags.go:64] FLAG: --seccomp-default="false" May 25 12:12:47.331287 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326473 2558 flags.go:64] FLAG: --serialize-image-pulls="true" May 25 12:12:47.331895 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326476 2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 25 12:12:47.331895 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326480 2558 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 25 12:12:47.331895 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326483 2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 25 12:12:47.331895 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326486 2558 flags.go:64] FLAG: --storage-driver-password="root" May 25 12:12:47.331895 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326488 2558 flags.go:64] FLAG: --storage-driver-secure="false" May 25 12:12:47.331895 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326491 2558 flags.go:64] FLAG: --storage-driver-table="stats" May 25 12:12:47.331895 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326494 2558 flags.go:64] FLAG: --storage-driver-user="root" May 25 12:12:47.331895 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326497 2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 25 12:12:47.331895 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326500 2558 flags.go:64] FLAG: --sync-frequency="1m0s" May 25 12:12:47.331895 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326502 2558 flags.go:64] FLAG: --system-cgroups="" May 25 12:12:47.331895 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326505 2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 25 12:12:47.331895 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326511 2558 flags.go:64] FLAG: --system-reserved-cgroup="" May 25 12:12:47.331895 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326513 2558 flags.go:64] FLAG: --tls-cert-file="" May 25 12:12:47.331895 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326516 2558 flags.go:64] FLAG: --tls-cipher-suites="[]" May 25 12:12:47.331895 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326520 2558 flags.go:64] FLAG: --tls-min-version="" May 25 12:12:47.331895 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326523 2558 flags.go:64] FLAG: --tls-private-key-file="" May 25 12:12:47.331895 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326526 2558 flags.go:64] FLAG: --topology-manager-policy="none" May 25 12:12:47.331895 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326529 2558 flags.go:64] FLAG: --topology-manager-policy-options="" May 25 12:12:47.331895 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326532 2558 flags.go:64] FLAG: --topology-manager-scope="container" May 25 12:12:47.331895 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326535 2558 flags.go:64] FLAG: --v="2" May 25 12:12:47.331895 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326539 2558 flags.go:64] FLAG: --version="false" May 25 12:12:47.331895 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326543 2558 flags.go:64] FLAG: --vmodule="" May 25 12:12:47.331895 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326548 2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 25 12:12:47.331895 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.326551 2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 25 12:12:47.331895 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326642 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 25 12:12:47.332505 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326646 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 25 12:12:47.332505 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326649 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 25 12:12:47.332505 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326652 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 25 12:12:47.332505 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326655 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 25 12:12:47.332505 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326658 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 25 12:12:47.332505 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326661 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 25 12:12:47.332505 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326664 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 25 12:12:47.332505 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326666 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 25 12:12:47.332505 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326669 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 25 12:12:47.332505 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326672 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 25 12:12:47.332505 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326676 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 25 12:12:47.332505 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326694 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 25 12:12:47.332505 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326698 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 25 12:12:47.332505 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326701 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 25 12:12:47.332505 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326704 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 25 12:12:47.332505 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326707 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 25 12:12:47.332505 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326710 2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 25 12:12:47.332505 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326716 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 25 12:12:47.332505 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326719 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 25 12:12:47.332962 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326722 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 25 12:12:47.332962 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326725 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 25 12:12:47.332962 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326728 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 25 12:12:47.332962 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326730 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 25 12:12:47.332962 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326733 2558 feature_gate.go:328] unrecognized feature gate: DualReplica May 25 12:12:47.332962 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326736 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 25 12:12:47.332962 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326739 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 25 12:12:47.332962 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326742 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 25 12:12:47.332962 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326745 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages May 25 12:12:47.332962 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326747 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 25 12:12:47.332962 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326750 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 25 12:12:47.332962 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326753 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 25 12:12:47.332962 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326755 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 25 12:12:47.332962 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326758 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 25 12:12:47.332962 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326761 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 25 12:12:47.332962 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326765 2558 feature_gate.go:328] unrecognized feature gate: NewOLM May 25 12:12:47.332962 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326767 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 25 12:12:47.332962 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326770 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 25 12:12:47.332962 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326772 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 25 12:12:47.332962 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326775 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 25 12:12:47.333546 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326777 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 25 12:12:47.333546 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326781 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 25 12:12:47.333546 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326784 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 25 12:12:47.333546 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326787 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 25 12:12:47.333546 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326789 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 25 12:12:47.333546 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326792 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 25 12:12:47.333546 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326794 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 25 12:12:47.333546 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326796 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 25 12:12:47.333546 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326799 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 25 12:12:47.333546 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326801 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 25 12:12:47.333546 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326805 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 25 12:12:47.333546 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326807 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 25 12:12:47.333546 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326809 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 25 12:12:47.333546 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326812 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 25 12:12:47.333546 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326814 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 25 12:12:47.333546 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326818 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 25 12:12:47.333546 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326821 2558 feature_gate.go:328] unrecognized feature gate: Example2 May 25 12:12:47.333546 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326825 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores May 25 12:12:47.333546 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326828 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 25 12:12:47.334004 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326830 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 25 12:12:47.334004 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326833 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 25 12:12:47.334004 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326836 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 25 12:12:47.334004 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326839 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 25 12:12:47.334004 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326841 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 25 12:12:47.334004 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326843 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 25 12:12:47.334004 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326846 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 25 12:12:47.334004 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326848 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 25 12:12:47.334004 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326851 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 25 12:12:47.334004 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326853 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 25 12:12:47.334004 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326856 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 25 12:12:47.334004 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326858 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 25 12:12:47.334004 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326861 2558 feature_gate.go:328] unrecognized feature gate: Example May 25 12:12:47.334004 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326863 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 25 12:12:47.334004 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326867 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 25 12:12:47.334004 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326869 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability May 25 12:12:47.334004 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326872 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 25 12:12:47.334004 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326875 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 25 12:12:47.334004 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326877 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 25 12:12:47.334004 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326880 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 25 12:12:47.334509 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326882 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 25 12:12:47.334509 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326885 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 25 12:12:47.334509 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326888 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 25 12:12:47.334509 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326892 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 25 12:12:47.334509 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326895 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 25 12:12:47.334509 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326897 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 25 12:12:47.334509 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.326900 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 25 12:12:47.334509 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.327641 2558 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 25 12:12:47.334509 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.334330 2558 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 25 12:12:47.334509 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.334347 2558 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 25 12:12:47.334509 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334394 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 25 12:12:47.334509 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334399 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 25 12:12:47.334509 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334402 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 25 12:12:47.334509 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334406 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 25 12:12:47.334509 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334409 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 25 12:12:47.334509 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334412 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 25 12:12:47.334910 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334414 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 25 12:12:47.334910 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334417 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 25 12:12:47.334910 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334420 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 25 12:12:47.334910 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334422 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 25 12:12:47.334910 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334425 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 25 12:12:47.334910 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334427 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 25 12:12:47.334910 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334430 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 25 12:12:47.334910 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334432 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 25 12:12:47.334910 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334435 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 25 12:12:47.334910 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334437 2558 feature_gate.go:328] unrecognized feature gate: Example2 May 25 12:12:47.334910 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334440 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 25 12:12:47.334910 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334442 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 25 12:12:47.334910 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334445 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 25 12:12:47.334910 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334448 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 25 12:12:47.334910 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334450 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 25 12:12:47.334910 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334453 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 25 12:12:47.334910 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334455 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 25 12:12:47.334910 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334457 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 25 12:12:47.334910 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334460 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 25 12:12:47.334910 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334463 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 25 12:12:47.335403 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334465 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 25 12:12:47.335403 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334468 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 25 12:12:47.335403 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334470 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 25 12:12:47.335403 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334473 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 25 12:12:47.335403 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334475 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 25 12:12:47.335403 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334479 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 25 12:12:47.335403 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334482 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 25 12:12:47.335403 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334484 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 25 12:12:47.335403 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334487 2558 feature_gate.go:328] unrecognized feature gate: NewOLM May 25 12:12:47.335403 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334489 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 25 12:12:47.335403 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334492 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 25 12:12:47.335403 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334494 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 25 12:12:47.335403 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334498 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 25 12:12:47.335403 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334501 2558 feature_gate.go:328] unrecognized feature gate: Example May 25 12:12:47.335403 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334504 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 25 12:12:47.335403 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334506 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 25 12:12:47.335403 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334508 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 25 12:12:47.335403 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334511 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores May 25 12:12:47.335403 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334514 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 25 12:12:47.335403 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334516 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 25 12:12:47.335898 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334520 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 25 12:12:47.335898 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334525 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 25 12:12:47.335898 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334527 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 25 12:12:47.335898 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334530 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 25 12:12:47.335898 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334533 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 25 12:12:47.335898 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334536 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 25 12:12:47.335898 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334538 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 25 12:12:47.335898 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334541 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages May 25 12:12:47.335898 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334543 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 25 12:12:47.335898 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334546 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 25 12:12:47.335898 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334548 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 25 12:12:47.335898 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334551 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 25 12:12:47.335898 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334553 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 25 12:12:47.335898 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334556 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 25 12:12:47.335898 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334558 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 25 12:12:47.335898 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334561 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 25 12:12:47.335898 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334563 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 25 12:12:47.335898 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334566 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 25 12:12:47.335898 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334569 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 25 12:12:47.335898 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334573 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 25 12:12:47.336439 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334575 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 25 12:12:47.336439 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334578 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 25 12:12:47.336439 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334580 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 25 12:12:47.336439 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334583 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability May 25 12:12:47.336439 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334585 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 25 12:12:47.336439 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334588 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 25 12:12:47.336439 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334591 2558 feature_gate.go:328] unrecognized feature gate: DualReplica May 25 12:12:47.336439 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334593 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 25 12:12:47.336439 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334596 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 25 12:12:47.336439 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334598 2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 25 12:12:47.336439 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334601 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 25 12:12:47.336439 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334603 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 25 12:12:47.336439 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334605 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 25 12:12:47.336439 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334608 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 25 12:12:47.336439 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334610 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 25 12:12:47.336439 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334613 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 25 12:12:47.336439 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334615 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 25 12:12:47.336439 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334618 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 25 12:12:47.336439 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334620 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 25 12:12:47.336439 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334622 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 25 12:12:47.336955 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.334627 2558 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 25 12:12:47.336955 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334724 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 25 12:12:47.336955 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334729 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 25 12:12:47.336955 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334732 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 25 12:12:47.336955 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334735 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 25 12:12:47.336955 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334738 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 25 12:12:47.336955 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334741 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 25 12:12:47.336955 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334744 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 25 12:12:47.336955 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334746 2558 feature_gate.go:328] unrecognized feature gate: NewOLM May 25 12:12:47.336955 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334749 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 25 12:12:47.336955 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334752 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 25 12:12:47.336955 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334755 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 25 12:12:47.336955 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334757 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 25 12:12:47.336955 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334760 2558 feature_gate.go:328] unrecognized feature gate: Example2 May 25 12:12:47.336955 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334762 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 25 12:12:47.336955 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334765 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 25 12:12:47.337367 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334768 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 25 12:12:47.337367 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334770 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 25 12:12:47.337367 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334772 2558 feature_gate.go:328] unrecognized feature gate: Example May 25 12:12:47.337367 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334775 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores May 25 12:12:47.337367 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334777 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 25 12:12:47.337367 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334780 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 25 12:12:47.337367 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334782 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 25 12:12:47.337367 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334785 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 25 12:12:47.337367 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334788 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 25 12:12:47.337367 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334792 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 25 12:12:47.337367 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334795 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 25 12:12:47.337367 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334798 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 25 12:12:47.337367 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334800 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 25 12:12:47.337367 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334803 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 25 12:12:47.337367 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334805 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 25 12:12:47.337367 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334807 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 25 12:12:47.337367 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334810 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 25 12:12:47.337367 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334812 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 25 12:12:47.337367 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334814 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 25 12:12:47.337827 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334817 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 25 12:12:47.337827 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334819 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 25 12:12:47.337827 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334822 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 25 12:12:47.337827 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334824 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 25 12:12:47.337827 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334826 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 25 12:12:47.337827 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334829 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 25 12:12:47.337827 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334832 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 25 12:12:47.337827 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334836 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 25 12:12:47.337827 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334838 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 25 12:12:47.337827 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334841 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 25 12:12:47.337827 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334844 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 25 12:12:47.337827 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334846 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 25 12:12:47.337827 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334849 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages May 25 12:12:47.337827 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334851 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 25 12:12:47.337827 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334853 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 25 12:12:47.337827 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334856 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 25 12:12:47.337827 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334858 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 25 12:12:47.337827 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334860 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 25 12:12:47.337827 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334863 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 25 12:12:47.338324 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334865 2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 25 12:12:47.338324 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334867 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 25 12:12:47.338324 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334870 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 25 12:12:47.338324 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334872 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 25 12:12:47.338324 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334875 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 25 12:12:47.338324 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334877 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 25 12:12:47.338324 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334879 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 25 12:12:47.338324 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334882 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 25 12:12:47.338324 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334884 2558 feature_gate.go:328] unrecognized feature gate: DualReplica May 25 12:12:47.338324 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334886 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 25 12:12:47.338324 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334889 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 25 12:12:47.338324 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334891 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 25 12:12:47.338324 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334893 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 25 12:12:47.338324 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334896 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 25 12:12:47.338324 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334898 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 25 12:12:47.338324 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334900 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 25 12:12:47.338324 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334903 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 25 12:12:47.338324 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334905 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 25 12:12:47.338324 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334907 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 25 12:12:47.338324 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334910 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 25 12:12:47.338799 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334913 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 25 12:12:47.338799 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334916 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 25 12:12:47.338799 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334918 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 25 12:12:47.338799 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334922 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 25 12:12:47.338799 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334924 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability May 25 12:12:47.338799 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334927 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 25 12:12:47.338799 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334929 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 25 12:12:47.338799 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334931 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 25 12:12:47.338799 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334934 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 25 12:12:47.338799 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334936 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 25 12:12:47.338799 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334939 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 25 12:12:47.338799 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334941 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 25 12:12:47.338799 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:47.334943 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 25 12:12:47.338799 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.334948 2558 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 25 12:12:47.338799 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.336057 2558 server.go:962] "Client rotation is on, will bootstrap in background" May 25 12:12:47.339271 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.338154 2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 25 12:12:47.339271 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.339259 2558 server.go:1019] "Starting client certificate rotation" May 25 12:12:47.339972 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.339957 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 25 12:12:47.340009 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.339990 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 25 12:12:47.365500 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.365475 2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 25 12:12:47.369008 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.368982 2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 25 12:12:47.389024 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.388998 2558 log.go:25] "Validated CRI v1 runtime API" May 25 12:12:47.394034 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.394020 2558 log.go:25] "Validated CRI v1 image API" May 25 12:12:47.395987 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.395968 2558 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 25 12:12:47.398728 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.398712 2558 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 25 12:12:47.399882 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.399862 2558 fs.go:135] Filesystem UUIDs: map[0c74a85e-19ac-42b2-96cb-ba93beaabe40:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 802738ab-0057-4c3b-b30e-d4ca602a01f7:/dev/nvme0n1p3] May 25 12:12:47.399949 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.399881 2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 25 12:12:47.403957 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.403860 2558 manager.go:217] Machine: {Timestamp:2026-05-25 12:12:47.40338189 +0000 UTC m=+0.404170130 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102922 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2167c888bb3a72d9e35f4a4929e9b7 SystemUUID:ec2167c8-88bb-3a72-d9e3-5f4a4929e9b7 BootID:eac31906-6d9f-4c30-800a-cf1cb6fc9862 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:dd:e5:2c:2a:e7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:dd:e5:2c:2a:e7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3e:eb:c3:0c:59:91 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 25 12:12:47.404791 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.404780 2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 25 12:12:47.404998 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.404889 2558 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 25 12:12:47.408192 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.408170 2558 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 25 12:12:47.408337 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.408194 2558 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-116.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 25 12:12:47.408379 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.408347 2558 topology_manager.go:138] "Creating topology manager with none policy" May 25 12:12:47.408379 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.408356 2558 container_manager_linux.go:306] "Creating device plugin manager" May 25 12:12:47.408379 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.408363 2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 25 12:12:47.409538 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.409526 2558 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 25 12:12:47.410425 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.410415 2558 state_mem.go:36] "Initialized new in-memory state store" May 25 12:12:47.410525 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.410516 2558 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 25 12:12:47.412918 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.412907 2558 kubelet.go:491] "Attempting to sync node with API server" May 25 12:12:47.412958 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.412920 2558 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 25 12:12:47.412958 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.412931 2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 25 12:12:47.412958 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.412943 2558 kubelet.go:397] "Adding apiserver pod source" May 25 12:12:47.412958 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.412957 2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 25 12:12:47.414059 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.414045 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 25 12:12:47.414059 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.414063 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 25 12:12:47.417561 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.417545 2558 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 25 12:12:47.419504 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.419491 2558 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 25 12:12:47.420906 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.420891 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 25 12:12:47.420948 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.420917 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 25 12:12:47.420948 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.420932 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 25 12:12:47.420948 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.420946 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 25 12:12:47.421025 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.420962 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 25 12:12:47.421025 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.420975 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 25 12:12:47.421025 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.420986 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 25 12:12:47.421025 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.420999 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 25 12:12:47.421156 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.421032 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 25 12:12:47.421156 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.421045 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 25 12:12:47.421156 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.421075 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 25 12:12:47.421156 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.421087 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 25 12:12:47.421800 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.421790 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 25 12:12:47.421832 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.421804 2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 25 12:12:47.424944 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.424932 2558 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 25 12:12:47.424977 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.424967 2558 server.go:1295] "Started kubelet" May 25 12:12:47.425115 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.425056 2558 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 25 12:12:47.425168 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.425124 2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 25 12:12:47.425168 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.425138 2558 server_v1.go:47] "podresources" method="list" useActivePods=true May 25 12:12:47.428445 ip-10-0-132-116 systemd[1]: Started Kubernetes Kubelet. May 25 12:12:47.430059 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.430003 2558 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 25 12:12:47.430230 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.430187 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lmcd5" May 25 12:12:47.431569 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.431551 2558 server.go:317] "Adding debug handlers to kubelet server" May 25 12:12:47.435495 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.435477 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 25 12:12:47.435995 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.435981 2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 25 12:12:47.436190 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.436175 2558 volume_manager.go:295] "The desired_state_of_world populator starts" May 25 12:12:47.436190 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.436190 2558 volume_manager.go:297] "Starting Kubelet Volume Manager" May 25 12:12:47.436343 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.436331 2558 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 25 12:12:47.436453 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.436434 2558 reconstruct.go:97] "Volume reconstruction finished" May 25 12:12:47.436503 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.436468 2558 reconciler.go:26] "Reconciler: start to sync state" May 25 12:12:47.436690 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:47.436663 2558 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-116.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 25 12:12:47.436690 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:47.436663 2558 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 25 12:12:47.436799 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.436766 2558 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-116.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 25 12:12:47.436880 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:47.436864 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-116.ec2.internal\" not found" May 25 12:12:47.437054 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.437039 2558 factory.go:153] Registering CRI-O factory May 25 12:12:47.437136 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.437058 2558 factory.go:223] Registration of the crio container factory successfully May 25 12:12:47.437136 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.437122 2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 25 12:12:47.437136 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.437132 2558 factory.go:55] Registering systemd factory May 25 12:12:47.437242 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.437139 2558 factory.go:223] Registration of the systemd container factory successfully May 25 12:12:47.437242 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.437152 2558 factory.go:103] Registering Raw factory May 25 12:12:47.437242 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.437161 2558 manager.go:1196] Started watching for new ooms in manager May 25 12:12:47.437242 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:47.437227 2558 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 25 12:12:47.437455 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.437443 2558 manager.go:319] Starting recovery of all containers May 25 12:12:47.437789 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:47.436679 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-116.ec2.internal.18b2cde0a128dcc1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-116.ec2.internal,UID:ip-10-0-132-116.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-116.ec2.internal,},FirstTimestamp:2026-05-25 12:12:47.424945345 +0000 UTC m=+0.425733584,LastTimestamp:2026-05-25 12:12:47.424945345 +0000 UTC m=+0.425733584,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-116.ec2.internal,}" May 25 12:12:47.442357 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:47.442081 2558 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 25 12:12:47.442357 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:47.442341 2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-116.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 25 12:12:47.447249 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.447214 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lmcd5" May 25 12:12:47.448203 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.448182 2558 manager.go:324] Recovery completed May 25 12:12:47.452146 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.452134 2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 25 12:12:47.453953 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.453937 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-116.ec2.internal" event="NodeHasSufficientMemory" May 25 12:12:47.453995 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.453967 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-116.ec2.internal" event="NodeHasNoDiskPressure" May 25 12:12:47.453995 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.453980 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-116.ec2.internal" event="NodeHasSufficientPID" May 25 12:12:47.454431 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.454418 2558 cpu_manager.go:222] "Starting CPU manager" policy="none" May 25 12:12:47.454431 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.454429 2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 25 12:12:47.454505 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.454443 2558 state_mem.go:36] "Initialized new in-memory state store" May 25 12:12:47.457118 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.457074 2558 policy_none.go:49] "None policy: Start" May 25 12:12:47.457201 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.457126 2558 memory_manager.go:186] "Starting memorymanager" policy="None" May 25 12:12:47.457201 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.457143 2558 state_mem.go:35] "Initializing new in-memory state store" May 25 12:12:47.457699 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:47.455834 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-116.ec2.internal.18b2cde0a2e37dee default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-116.ec2.internal,UID:ip-10-0-132-116.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-116.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-116.ec2.internal,},FirstTimestamp:2026-05-25 12:12:47.453953518 +0000 UTC m=+0.454741759,LastTimestamp:2026-05-25 12:12:47.453953518 +0000 UTC m=+0.454741759,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-116.ec2.internal,}" May 25 12:12:47.493638 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.493624 2558 manager.go:341] "Starting Device Plugin manager" May 25 12:12:47.506595 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:47.493659 2558 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 25 12:12:47.506595 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.493669 2558 server.go:85] "Starting device plugin registration server" May 25 12:12:47.506595 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.493867 2558 eviction_manager.go:189] "Eviction manager: starting control loop" May 25 12:12:47.506595 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.493878 2558 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 25 12:12:47.506595 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.493977 2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 25 12:12:47.506595 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.494085 2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 25 12:12:47.506595 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.494117 2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 25 12:12:47.506595 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:47.494697 2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 25 12:12:47.506595 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:47.494728 2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-116.ec2.internal\" not found" May 25 12:12:47.556992 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.556960 2558 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 25 12:12:47.558342 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.558325 2558 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 25 12:12:47.558419 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.558346 2558 status_manager.go:230] "Starting to sync pod status with apiserver" May 25 12:12:47.558419 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.558364 2558 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 25 12:12:47.558419 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.558372 2558 kubelet.go:2451] "Starting kubelet main sync loop" May 25 12:12:47.558419 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:47.558411 2558 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 25 12:12:47.562806 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.562782 2558 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 25 12:12:47.594940 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.594895 2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 25 12:12:47.595853 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.595838 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-116.ec2.internal" event="NodeHasSufficientMemory" May 25 12:12:47.595923 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.595867 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-116.ec2.internal" event="NodeHasNoDiskPressure" May 25 12:12:47.595923 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.595880 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-116.ec2.internal" event="NodeHasSufficientPID" May 25 12:12:47.595923 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.595900 2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-116.ec2.internal" May 25 12:12:47.604198 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.604184 2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-116.ec2.internal" May 25 12:12:47.604256 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:47.604204 2558 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-116.ec2.internal\": node \"ip-10-0-132-116.ec2.internal\" not found" May 25 12:12:47.618571 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:47.618548 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-116.ec2.internal\" not found" May 25 12:12:47.659246 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.659214 2558 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-116.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-116.ec2.internal"] May 25 12:12:47.659355 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.659292 2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 25 12:12:47.660193 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.660169 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-116.ec2.internal" event="NodeHasSufficientMemory" May 25 12:12:47.660290 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.660206 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-116.ec2.internal" event="NodeHasNoDiskPressure" May 25 12:12:47.660290 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.660217 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-116.ec2.internal" event="NodeHasSufficientPID" May 25 12:12:47.661469 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.661456 2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 25 12:12:47.661646 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.661631 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-116.ec2.internal" May 25 12:12:47.661692 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.661668 2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 25 12:12:47.662182 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.662168 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-116.ec2.internal" event="NodeHasSufficientMemory" May 25 12:12:47.662182 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.662181 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-116.ec2.internal" event="NodeHasSufficientMemory" May 25 12:12:47.662334 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.662200 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-116.ec2.internal" event="NodeHasNoDiskPressure" May 25 12:12:47.662334 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.662203 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-116.ec2.internal" event="NodeHasNoDiskPressure" May 25 12:12:47.662334 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.662214 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-116.ec2.internal" event="NodeHasSufficientPID" May 25 12:12:47.662334 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.662218 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-116.ec2.internal" event="NodeHasSufficientPID" May 25 12:12:47.663535 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.663518 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-116.ec2.internal" May 25 12:12:47.663623 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.663543 2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 25 12:12:47.664366 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.664348 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-116.ec2.internal" event="NodeHasSufficientMemory" May 25 12:12:47.664455 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.664380 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-116.ec2.internal" event="NodeHasNoDiskPressure" May 25 12:12:47.664455 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.664395 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-116.ec2.internal" event="NodeHasSufficientPID" May 25 12:12:47.680592 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:47.680570 2558 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-116.ec2.internal\" not found" node="ip-10-0-132-116.ec2.internal" May 25 12:12:47.684395 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:47.684381 2558 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-116.ec2.internal\" not found" node="ip-10-0-132-116.ec2.internal" May 25 12:12:47.719365 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:47.719348 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-116.ec2.internal\" not found" May 25 12:12:47.738060 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.738041 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/41194dcb30c71e287bcaa2f7065bdd2e-config\") pod \"kube-apiserver-proxy-ip-10-0-132-116.ec2.internal\" (UID: \"41194dcb30c71e287bcaa2f7065bdd2e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-116.ec2.internal" May 25 12:12:47.738139 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.738068 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f6451e2a0f2aca0b0442b8f91758a11a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-116.ec2.internal\" (UID: \"f6451e2a0f2aca0b0442b8f91758a11a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-116.ec2.internal" May 25 12:12:47.738139 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.738086 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6451e2a0f2aca0b0442b8f91758a11a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-116.ec2.internal\" (UID: \"f6451e2a0f2aca0b0442b8f91758a11a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-116.ec2.internal" May 25 12:12:47.819452 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:47.819429 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-116.ec2.internal\" not found" May 25 12:12:47.838584 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.838565 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f6451e2a0f2aca0b0442b8f91758a11a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-116.ec2.internal\" (UID: \"f6451e2a0f2aca0b0442b8f91758a11a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-116.ec2.internal" May 25 12:12:47.838638 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.838591 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6451e2a0f2aca0b0442b8f91758a11a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-116.ec2.internal\" (UID: \"f6451e2a0f2aca0b0442b8f91758a11a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-116.ec2.internal" May 25 12:12:47.838638 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.838610 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/41194dcb30c71e287bcaa2f7065bdd2e-config\") pod \"kube-apiserver-proxy-ip-10-0-132-116.ec2.internal\" (UID: \"41194dcb30c71e287bcaa2f7065bdd2e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-116.ec2.internal" May 25 12:12:47.838698 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.838640 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/41194dcb30c71e287bcaa2f7065bdd2e-config\") pod \"kube-apiserver-proxy-ip-10-0-132-116.ec2.internal\" (UID: \"41194dcb30c71e287bcaa2f7065bdd2e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-116.ec2.internal" May 25 12:12:47.838698 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.838659 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6451e2a0f2aca0b0442b8f91758a11a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-116.ec2.internal\" (UID: \"f6451e2a0f2aca0b0442b8f91758a11a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-116.ec2.internal" May 25 12:12:47.838698 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.838662 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f6451e2a0f2aca0b0442b8f91758a11a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-116.ec2.internal\" (UID: \"f6451e2a0f2aca0b0442b8f91758a11a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-116.ec2.internal" May 25 12:12:47.920038 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:47.919965 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-116.ec2.internal\" not found" May 25 12:12:47.983472 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.983439 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-116.ec2.internal" May 25 12:12:47.987114 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:47.987082 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-116.ec2.internal" May 25 12:12:48.020803 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:48.020779 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-116.ec2.internal\" not found" May 25 12:12:48.121264 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:48.121231 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-116.ec2.internal\" not found" May 25 12:12:48.221776 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:48.221698 2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-116.ec2.internal\" not found" May 25 12:12:48.269027 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.269009 2558 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 25 12:12:48.333836 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.333810 2558 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 25 12:12:48.336242 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.336225 2558 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-116.ec2.internal" May 25 12:12:48.339442 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.339421 2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 25 12:12:48.339551 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.339536 2558 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 25 12:12:48.339606 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.339572 2558 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 25 12:12:48.339606 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.339587 2558 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 25 12:12:48.340476 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:48.340450 2558 kubelet.go:3342] "Failed creating a mirror pod" err="Post \"https://a61faeadf567d4caca4c8abd58746ce7-d703e1bb5ed104cc.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-machine-config-operator/pods\": read tcp 10.0.132.116:41308->34.224.53.205:6443: use of closed network connection" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-116.ec2.internal" May 25 12:12:48.340549 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.340480 2558 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-116.ec2.internal" May 25 12:12:48.355969 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.355949 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 25 12:12:48.413528 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.413506 2558 apiserver.go:52] "Watching apiserver" May 25 12:12:48.422949 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.422911 2558 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 25 12:12:48.424366 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.424336 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-2sxb4","openshift-network-operator/iptables-alerter-86l52","openshift-cluster-node-tuning-operator/tuned-9wdlg","openshift-dns/node-resolver-wtj9s","openshift-image-registry/node-ca-wtscn","openshift-multus/multus-p9w9p","openshift-multus/network-metrics-daemon-g6zkc","openshift-network-diagnostics/network-check-target-26hst","openshift-ovn-kubernetes/ovnkube-node-c7fb8","kube-system/konnectivity-agent-7mgh4","kube-system/kube-apiserver-proxy-ip-10-0-132-116.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7msvf"] May 25 12:12:48.428797 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.428776 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2sxb4" May 25 12:12:48.430857 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.430840 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-86l52" May 25 12:12:48.431456 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.431436 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 25 12:12:48.431583 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.431481 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 25 12:12:48.431583 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.431554 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-k9g6m\"" May 25 12:12:48.431583 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.431555 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 25 12:12:48.431782 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.431664 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 25 12:12:48.431782 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.431760 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 25 12:12:48.432896 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.432877 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9wdlg" May 25 12:12:48.433192 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.433173 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 25 12:12:48.433404 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.433384 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 25 12:12:48.433465 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.433387 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 25 12:12:48.434178 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.434156 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-f97m4\"" May 25 12:12:48.435163 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.435149 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wtj9s" May 25 12:12:48.435442 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.435270 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wtscn" May 25 12:12:48.435442 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.435319 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 25 12:12:48.435553 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.435453 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jjgjh\"" May 25 12:12:48.435607 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.435553 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 25 12:12:48.435607 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.435563 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 25 12:12:48.437641 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.437513 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 25 12:12:48.437871 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.437851 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 25 12:12:48.437961 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.437892 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4n65r\"" May 25 12:12:48.438107 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.438017 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 25 12:12:48.438249 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.438230 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2wxcc\"" May 25 12:12:48.438300 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.438276 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 25 12:12:48.438352 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.438276 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 25 12:12:48.439620 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.439607 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-p9w9p" May 25 12:12:48.441187 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.441172 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/09c05b78-b511-4815-9c0f-18b3aee86125-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2sxb4\" (UID: \"09c05b78-b511-4815-9c0f-18b3aee86125\") " pod="openshift-multus/multus-additional-cni-plugins-2sxb4" May 25 12:12:48.441233 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.441197 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51472327-079d-4a4c-9fe8-78b993615360-etc-kubernetes\") pod \"tuned-9wdlg\" (UID: \"51472327-079d-4a4c-9fe8-78b993615360\") " pod="openshift-cluster-node-tuning-operator/tuned-9wdlg" May 25 12:12:48.441233 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.441212 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/51472327-079d-4a4c-9fe8-78b993615360-etc-systemd\") pod \"tuned-9wdlg\" (UID: \"51472327-079d-4a4c-9fe8-78b993615360\") " pod="openshift-cluster-node-tuning-operator/tuned-9wdlg" May 25 12:12:48.441233 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.441227 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/51472327-079d-4a4c-9fe8-78b993615360-host\") pod \"tuned-9wdlg\" (UID: \"51472327-079d-4a4c-9fe8-78b993615360\") " pod="openshift-cluster-node-tuning-operator/tuned-9wdlg" May 25 12:12:48.441390 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.441293 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lm9kz\" (UniqueName: \"kubernetes.io/projected/09c05b78-b511-4815-9c0f-18b3aee86125-kube-api-access-lm9kz\") pod \"multus-additional-cni-plugins-2sxb4\" (UID: \"09c05b78-b511-4815-9c0f-18b3aee86125\") " pod="openshift-multus/multus-additional-cni-plugins-2sxb4" May 25 12:12:48.441390 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.441344 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/51472327-079d-4a4c-9fe8-78b993615360-etc-sysctl-d\") pod \"tuned-9wdlg\" (UID: \"51472327-079d-4a4c-9fe8-78b993615360\") " pod="openshift-cluster-node-tuning-operator/tuned-9wdlg" May 25 12:12:48.441390 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.441370 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/51472327-079d-4a4c-9fe8-78b993615360-var-lib-kubelet\") pod \"tuned-9wdlg\" (UID: \"51472327-079d-4a4c-9fe8-78b993615360\") " pod="openshift-cluster-node-tuning-operator/tuned-9wdlg" May 25 12:12:48.441534 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.441400 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/51472327-079d-4a4c-9fe8-78b993615360-etc-tuned\") pod \"tuned-9wdlg\" (UID: \"51472327-079d-4a4c-9fe8-78b993615360\") " pod="openshift-cluster-node-tuning-operator/tuned-9wdlg" May 25 12:12:48.441534 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.441429 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/51472327-079d-4a4c-9fe8-78b993615360-tmp\") pod \"tuned-9wdlg\" (UID: \"51472327-079d-4a4c-9fe8-78b993615360\") " pod="openshift-cluster-node-tuning-operator/tuned-9wdlg" May 25 12:12:48.441534 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.441455 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9glb7\" (UniqueName: \"kubernetes.io/projected/51472327-079d-4a4c-9fe8-78b993615360-kube-api-access-9glb7\") pod \"tuned-9wdlg\" (UID: \"51472327-079d-4a4c-9fe8-78b993615360\") " pod="openshift-cluster-node-tuning-operator/tuned-9wdlg" May 25 12:12:48.441534 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.441481 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5c30b440-4b5e-43ca-a622-bb74465cb79b-hosts-file\") pod \"node-resolver-wtj9s\" (UID: \"5c30b440-4b5e-43ca-a622-bb74465cb79b\") " pod="openshift-dns/node-resolver-wtj9s" May 25 12:12:48.441534 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.441505 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/878b49ea-594a-4d14-8cd8-41f51008349d-host-var-lib-cni-bin\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.441534 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.441528 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/878b49ea-594a-4d14-8cd8-41f51008349d-host-var-lib-cni-multus\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.441763 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.441553 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/878b49ea-594a-4d14-8cd8-41f51008349d-host-run-multus-certs\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.441763 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.441577 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ldlv\" (UniqueName: \"kubernetes.io/projected/88e5c705-ce9b-41eb-8d8e-3092d38d11bc-kube-api-access-4ldlv\") pod \"node-ca-wtscn\" (UID: \"88e5c705-ce9b-41eb-8d8e-3092d38d11bc\") " pod="openshift-image-registry/node-ca-wtscn" May 25 12:12:48.441763 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.441636 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/878b49ea-594a-4d14-8cd8-41f51008349d-os-release\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.441763 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.441659 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/878b49ea-594a-4d14-8cd8-41f51008349d-host-run-k8s-cni-cncf-io\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.441763 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.441674 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/878b49ea-594a-4d14-8cd8-41f51008349d-hostroot\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.441763 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.441691 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/878b49ea-594a-4d14-8cd8-41f51008349d-multus-conf-dir\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.441763 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.441715 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5f2c06a2-06fe-41e4-9f01-6f43ede519cf-iptables-alerter-script\") pod \"iptables-alerter-86l52\" (UID: \"5f2c06a2-06fe-41e4-9f01-6f43ede519cf\") " pod="openshift-network-operator/iptables-alerter-86l52" May 25 12:12:48.441763 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.441732 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f2c06a2-06fe-41e4-9f01-6f43ede519cf-host-slash\") pod \"iptables-alerter-86l52\" (UID: \"5f2c06a2-06fe-41e4-9f01-6f43ede519cf\") " pod="openshift-network-operator/iptables-alerter-86l52" May 25 12:12:48.441763 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.441746 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/878b49ea-594a-4d14-8cd8-41f51008349d-system-cni-dir\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.441763 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.441761 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/878b49ea-594a-4d14-8cd8-41f51008349d-cnibin\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.442124 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.441802 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/878b49ea-594a-4d14-8cd8-41f51008349d-cni-binary-copy\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.442124 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.441828 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/878b49ea-594a-4d14-8cd8-41f51008349d-etc-kubernetes\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.442124 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.441847 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t769q\" (UniqueName: \"kubernetes.io/projected/878b49ea-594a-4d14-8cd8-41f51008349d-kube-api-access-t769q\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.442124 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.441864 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6zkc" May 25 12:12:48.442124 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.441883 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/09c05b78-b511-4815-9c0f-18b3aee86125-os-release\") pod \"multus-additional-cni-plugins-2sxb4\" (UID: \"09c05b78-b511-4815-9c0f-18b3aee86125\") " pod="openshift-multus/multus-additional-cni-plugins-2sxb4" May 25 12:12:48.442124 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.441903 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/51472327-079d-4a4c-9fe8-78b993615360-etc-modprobe-d\") pod \"tuned-9wdlg\" (UID: \"51472327-079d-4a4c-9fe8-78b993615360\") " pod="openshift-cluster-node-tuning-operator/tuned-9wdlg" May 25 12:12:48.442124 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.441920 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpjph\" (UniqueName: \"kubernetes.io/projected/5c30b440-4b5e-43ca-a622-bb74465cb79b-kube-api-access-tpjph\") pod \"node-resolver-wtj9s\" (UID: \"5c30b440-4b5e-43ca-a622-bb74465cb79b\") " pod="openshift-dns/node-resolver-wtj9s" May 25 12:12:48.442124 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:48.441928 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g6zkc" podUID="0d07b05a-e936-4270-a36e-f25820e43991" May 25 12:12:48.442124 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.441943 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/878b49ea-594a-4d14-8cd8-41f51008349d-host-var-lib-kubelet\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.442124 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.441969 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09c05b78-b511-4815-9c0f-18b3aee86125-system-cni-dir\") pod \"multus-additional-cni-plugins-2sxb4\" (UID: \"09c05b78-b511-4815-9c0f-18b3aee86125\") " pod="openshift-multus/multus-additional-cni-plugins-2sxb4" May 25 12:12:48.442124 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.441989 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s45fc\" (UniqueName: \"kubernetes.io/projected/5f2c06a2-06fe-41e4-9f01-6f43ede519cf-kube-api-access-s45fc\") pod \"iptables-alerter-86l52\" (UID: \"5f2c06a2-06fe-41e4-9f01-6f43ede519cf\") " pod="openshift-network-operator/iptables-alerter-86l52" May 25 12:12:48.442124 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.442006 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/51472327-079d-4a4c-9fe8-78b993615360-etc-sysctl-conf\") pod \"tuned-9wdlg\" (UID: \"51472327-079d-4a4c-9fe8-78b993615360\") " pod="openshift-cluster-node-tuning-operator/tuned-9wdlg" May 25 12:12:48.442124 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.442026 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/09c05b78-b511-4815-9c0f-18b3aee86125-cnibin\") pod \"multus-additional-cni-plugins-2sxb4\" (UID: \"09c05b78-b511-4815-9c0f-18b3aee86125\") " pod="openshift-multus/multus-additional-cni-plugins-2sxb4" May 25 12:12:48.442124 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.442042 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/09c05b78-b511-4815-9c0f-18b3aee86125-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2sxb4\" (UID: \"09c05b78-b511-4815-9c0f-18b3aee86125\") " pod="openshift-multus/multus-additional-cni-plugins-2sxb4" May 25 12:12:48.442124 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.442057 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/09c05b78-b511-4815-9c0f-18b3aee86125-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2sxb4\" (UID: \"09c05b78-b511-4815-9c0f-18b3aee86125\") " pod="openshift-multus/multus-additional-cni-plugins-2sxb4" May 25 12:12:48.442124 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.442073 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/51472327-079d-4a4c-9fe8-78b993615360-run\") pod \"tuned-9wdlg\" (UID: \"51472327-079d-4a4c-9fe8-78b993615360\") " pod="openshift-cluster-node-tuning-operator/tuned-9wdlg" May 25 12:12:48.442124 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.442126 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/51472327-079d-4a4c-9fe8-78b993615360-sys\") pod \"tuned-9wdlg\" (UID: \"51472327-079d-4a4c-9fe8-78b993615360\") " pod="openshift-cluster-node-tuning-operator/tuned-9wdlg" May 25 12:12:48.442859 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.442152 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c30b440-4b5e-43ca-a622-bb74465cb79b-tmp-dir\") pod \"node-resolver-wtj9s\" (UID: \"5c30b440-4b5e-43ca-a622-bb74465cb79b\") " pod="openshift-dns/node-resolver-wtj9s" May 25 12:12:48.442859 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.442187 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/09c05b78-b511-4815-9c0f-18b3aee86125-cni-binary-copy\") pod \"multus-additional-cni-plugins-2sxb4\" (UID: \"09c05b78-b511-4815-9c0f-18b3aee86125\") " pod="openshift-multus/multus-additional-cni-plugins-2sxb4" May 25 12:12:48.442859 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.442213 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/878b49ea-594a-4d14-8cd8-41f51008349d-multus-socket-dir-parent\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.442859 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.442236 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/878b49ea-594a-4d14-8cd8-41f51008349d-host-run-netns\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.442859 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.442271 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/878b49ea-594a-4d14-8cd8-41f51008349d-multus-daemon-config\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.442859 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.442298 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/51472327-079d-4a4c-9fe8-78b993615360-etc-sysconfig\") pod \"tuned-9wdlg\" (UID: \"51472327-079d-4a4c-9fe8-78b993615360\") " pod="openshift-cluster-node-tuning-operator/tuned-9wdlg" May 25 12:12:48.442859 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.442322 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/51472327-079d-4a4c-9fe8-78b993615360-lib-modules\") pod \"tuned-9wdlg\" (UID: \"51472327-079d-4a4c-9fe8-78b993615360\") " pod="openshift-cluster-node-tuning-operator/tuned-9wdlg" May 25 12:12:48.442859 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.442347 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/88e5c705-ce9b-41eb-8d8e-3092d38d11bc-host\") pod \"node-ca-wtscn\" (UID: \"88e5c705-ce9b-41eb-8d8e-3092d38d11bc\") " pod="openshift-image-registry/node-ca-wtscn" May 25 12:12:48.442859 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.442368 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/88e5c705-ce9b-41eb-8d8e-3092d38d11bc-serviceca\") pod \"node-ca-wtscn\" (UID: \"88e5c705-ce9b-41eb-8d8e-3092d38d11bc\") " pod="openshift-image-registry/node-ca-wtscn" May 25 12:12:48.442859 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.442390 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/878b49ea-594a-4d14-8cd8-41f51008349d-multus-cni-dir\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.442859 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.442513 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8bc9b\"" May 25 12:12:48.442859 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.442541 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 25 12:12:48.444113 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.444077 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26hst" May 25 12:12:48.444194 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:48.444172 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26hst" podUID="a8c1a67f-b7f8-425e-8836-ec0ff5ffca44" May 25 12:12:48.446626 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.446429 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.449869 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.449797 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7mgh4" May 25 12:12:48.450116 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.450079 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 25 12:12:48.450805 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.450785 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4rw66\"" May 25 12:12:48.452120 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.450898 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 25 12:12:48.452120 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.451188 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 25 12:12:48.452120 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.451199 2558 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 25 12:12:48.452373 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.452190 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-24 12:07:47 +0000 UTC" deadline="2027-12-02 04:36:28.94731484 +0000 UTC" May 25 12:12:48.452373 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.452214 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 25 12:12:48.452373 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.452223 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13336h23m40.495095355s" May 25 12:12:48.452373 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.452294 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 25 12:12:48.452373 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.452383 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 25 12:12:48.452373 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.452409 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 25 12:12:48.454059 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.453941 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 25 12:12:48.454059 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.453956 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5h6bn\"" May 25 12:12:48.454262 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.454246 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7msvf" May 25 12:12:48.456369 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.456352 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 25 12:12:48.456627 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.456609 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 25 12:12:48.456693 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.456612 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nkhm5\"" May 25 12:12:48.456778 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.456764 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 25 12:12:48.475924 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.475867 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5tsnq" May 25 12:12:48.483361 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.483333 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5tsnq" May 25 12:12:48.490425 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.490405 2558 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 25 12:12:48.537053 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.537036 2558 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 25 12:12:48.542549 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.542529 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d07b05a-e936-4270-a36e-f25820e43991-metrics-certs\") pod \"network-metrics-daemon-g6zkc\" (UID: \"0d07b05a-e936-4270-a36e-f25820e43991\") " pod="openshift-multus/network-metrics-daemon-g6zkc" May 25 12:12:48.542659 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.542566 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/88e5c705-ce9b-41eb-8d8e-3092d38d11bc-host\") pod \"node-ca-wtscn\" (UID: \"88e5c705-ce9b-41eb-8d8e-3092d38d11bc\") " pod="openshift-image-registry/node-ca-wtscn" May 25 12:12:48.542659 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.542592 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/88e5c705-ce9b-41eb-8d8e-3092d38d11bc-serviceca\") pod \"node-ca-wtscn\" (UID: \"88e5c705-ce9b-41eb-8d8e-3092d38d11bc\") " pod="openshift-image-registry/node-ca-wtscn" May 25 12:12:48.542659 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.542616 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/51472327-079d-4a4c-9fe8-78b993615360-host\") pod \"tuned-9wdlg\" (UID: \"51472327-079d-4a4c-9fe8-78b993615360\") " pod="openshift-cluster-node-tuning-operator/tuned-9wdlg" May 25 12:12:48.542659 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.542640 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/51472327-079d-4a4c-9fe8-78b993615360-tmp\") pod \"tuned-9wdlg\" (UID: \"51472327-079d-4a4c-9fe8-78b993615360\") " pod="openshift-cluster-node-tuning-operator/tuned-9wdlg" May 25 12:12:48.542659 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.542648 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/88e5c705-ce9b-41eb-8d8e-3092d38d11bc-host\") pod \"node-ca-wtscn\" (UID: \"88e5c705-ce9b-41eb-8d8e-3092d38d11bc\") " pod="openshift-image-registry/node-ca-wtscn" May 25 12:12:48.543008 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.542664 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9glb7\" (UniqueName: \"kubernetes.io/projected/51472327-079d-4a4c-9fe8-78b993615360-kube-api-access-9glb7\") pod \"tuned-9wdlg\" (UID: \"51472327-079d-4a4c-9fe8-78b993615360\") " pod="openshift-cluster-node-tuning-operator/tuned-9wdlg" May 25 12:12:48.543008 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.542690 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-node-log\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.543008 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.542716 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/51472327-079d-4a4c-9fe8-78b993615360-var-lib-kubelet\") pod \"tuned-9wdlg\" (UID: \"51472327-079d-4a4c-9fe8-78b993615360\") " pod="openshift-cluster-node-tuning-operator/tuned-9wdlg" May 25 12:12:48.543008 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.542740 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5c30b440-4b5e-43ca-a622-bb74465cb79b-hosts-file\") pod \"node-resolver-wtj9s\" (UID: \"5c30b440-4b5e-43ca-a622-bb74465cb79b\") " pod="openshift-dns/node-resolver-wtj9s" May 25 12:12:48.543008 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.542766 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-log-socket\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.543008 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.542796 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.543008 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.542823 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg82t\" (UniqueName: \"kubernetes.io/projected/0d07b05a-e936-4270-a36e-f25820e43991-kube-api-access-hg82t\") pod \"network-metrics-daemon-g6zkc\" (UID: \"0d07b05a-e936-4270-a36e-f25820e43991\") " pod="openshift-multus/network-metrics-daemon-g6zkc" May 25 12:12:48.543008 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.542854 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/878b49ea-594a-4d14-8cd8-41f51008349d-host-var-lib-cni-multus\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.543008 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.542897 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl8ws\" (UniqueName: \"kubernetes.io/projected/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-kube-api-access-dl8ws\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.543008 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.542942 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/be5af227-e08d-4635-976e-c0d3927ad946-device-dir\") pod \"aws-ebs-csi-driver-node-7msvf\" (UID: \"be5af227-e08d-4635-976e-c0d3927ad946\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7msvf" May 25 12:12:48.543008 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.542981 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhfqf\" (UniqueName: \"kubernetes.io/projected/be5af227-e08d-4635-976e-c0d3927ad946-kube-api-access-nhfqf\") pod \"aws-ebs-csi-driver-node-7msvf\" (UID: \"be5af227-e08d-4635-976e-c0d3927ad946\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7msvf" May 25 12:12:48.543008 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.543007 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/878b49ea-594a-4d14-8cd8-41f51008349d-host-run-multus-certs\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.543580 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.543049 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/878b49ea-594a-4d14-8cd8-41f51008349d-os-release\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.543580 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.543059 2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 25 12:12:48.543580 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.543116 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/878b49ea-594a-4d14-8cd8-41f51008349d-host-run-k8s-cni-cncf-io\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.543580 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.543146 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/878b49ea-594a-4d14-8cd8-41f51008349d-hostroot\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.543580 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.543173 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/878b49ea-594a-4d14-8cd8-41f51008349d-multus-conf-dir\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.543580 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.543190 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/878b49ea-594a-4d14-8cd8-41f51008349d-host-run-multus-certs\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.543580 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.543201 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5f2c06a2-06fe-41e4-9f01-6f43ede519cf-iptables-alerter-script\") pod \"iptables-alerter-86l52\" (UID: \"5f2c06a2-06fe-41e4-9f01-6f43ede519cf\") " pod="openshift-network-operator/iptables-alerter-86l52" May 25 12:12:48.543580 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.543203 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5c30b440-4b5e-43ca-a622-bb74465cb79b-hosts-file\") pod \"node-resolver-wtj9s\" (UID: \"5c30b440-4b5e-43ca-a622-bb74465cb79b\") " pod="openshift-dns/node-resolver-wtj9s" May 25 12:12:48.543580 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.543238 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f2c06a2-06fe-41e4-9f01-6f43ede519cf-host-slash\") pod \"iptables-alerter-86l52\" (UID: \"5f2c06a2-06fe-41e4-9f01-6f43ede519cf\") " pod="openshift-network-operator/iptables-alerter-86l52" May 25 12:12:48.543580 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.543051 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/88e5c705-ce9b-41eb-8d8e-3092d38d11bc-serviceca\") pod \"node-ca-wtscn\" (UID: \"88e5c705-ce9b-41eb-8d8e-3092d38d11bc\") " pod="openshift-image-registry/node-ca-wtscn" May 25 12:12:48.543580 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.543285 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f2c06a2-06fe-41e4-9f01-6f43ede519cf-host-slash\") pod \"iptables-alerter-86l52\" (UID: \"5f2c06a2-06fe-41e4-9f01-6f43ede519cf\") " pod="openshift-network-operator/iptables-alerter-86l52" May 25 12:12:48.543580 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.543323 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/878b49ea-594a-4d14-8cd8-41f51008349d-hostroot\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.543580 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.543330 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/51472327-079d-4a4c-9fe8-78b993615360-var-lib-kubelet\") pod \"tuned-9wdlg\" (UID: \"51472327-079d-4a4c-9fe8-78b993615360\") " pod="openshift-cluster-node-tuning-operator/tuned-9wdlg" May 25 12:12:48.543580 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.543372 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/878b49ea-594a-4d14-8cd8-41f51008349d-os-release\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.543580 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.543352 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/878b49ea-594a-4d14-8cd8-41f51008349d-host-run-k8s-cni-cncf-io\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.543580 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.543383 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6ssc\" (UniqueName: \"kubernetes.io/projected/a8c1a67f-b7f8-425e-8836-ec0ff5ffca44-kube-api-access-r6ssc\") pod \"network-check-target-26hst\" (UID: \"a8c1a67f-b7f8-425e-8836-ec0ff5ffca44\") " pod="openshift-network-diagnostics/network-check-target-26hst" May 25 12:12:48.543580 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.543416 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/878b49ea-594a-4d14-8cd8-41f51008349d-multus-conf-dir\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.543580 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.543446 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/878b49ea-594a-4d14-8cd8-41f51008349d-host-var-lib-cni-multus\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.544354 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.543494 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tpjph\" (UniqueName: \"kubernetes.io/projected/5c30b440-4b5e-43ca-a622-bb74465cb79b-kube-api-access-tpjph\") pod \"node-resolver-wtj9s\" (UID: \"5c30b440-4b5e-43ca-a622-bb74465cb79b\") " pod="openshift-dns/node-resolver-wtj9s" May 25 12:12:48.544354 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.543540 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/51472327-079d-4a4c-9fe8-78b993615360-host\") pod \"tuned-9wdlg\" (UID: \"51472327-079d-4a4c-9fe8-78b993615360\") " pod="openshift-cluster-node-tuning-operator/tuned-9wdlg" May 25 12:12:48.544354 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.543554 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09c05b78-b511-4815-9c0f-18b3aee86125-system-cni-dir\") pod \"multus-additional-cni-plugins-2sxb4\" (UID: \"09c05b78-b511-4815-9c0f-18b3aee86125\") " pod="openshift-multus/multus-additional-cni-plugins-2sxb4" May 25 12:12:48.544354 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.543662 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s45fc\" (UniqueName: \"kubernetes.io/projected/5f2c06a2-06fe-41e4-9f01-6f43ede519cf-kube-api-access-s45fc\") pod \"iptables-alerter-86l52\" (UID: \"5f2c06a2-06fe-41e4-9f01-6f43ede519cf\") " pod="openshift-network-operator/iptables-alerter-86l52" May 25 12:12:48.544354 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.543700 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09c05b78-b511-4815-9c0f-18b3aee86125-system-cni-dir\") pod \"multus-additional-cni-plugins-2sxb4\" (UID: \"09c05b78-b511-4815-9c0f-18b3aee86125\") " pod="openshift-multus/multus-additional-cni-plugins-2sxb4" May 25 12:12:48.544354 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.543710 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5f2c06a2-06fe-41e4-9f01-6f43ede519cf-iptables-alerter-script\") pod \"iptables-alerter-86l52\" (UID: \"5f2c06a2-06fe-41e4-9f01-6f43ede519cf\") " pod="openshift-network-operator/iptables-alerter-86l52" May 25 12:12:48.544354 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.543758 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/51472327-079d-4a4c-9fe8-78b993615360-etc-sysctl-conf\") pod \"tuned-9wdlg\" (UID: \"51472327-079d-4a4c-9fe8-78b993615360\") " pod="openshift-cluster-node-tuning-operator/tuned-9wdlg" May 25 12:12:48.544354 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.543839 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-systemd-units\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.544354 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.543883 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/51472327-079d-4a4c-9fe8-78b993615360-etc-sysctl-conf\") pod \"tuned-9wdlg\" (UID: \"51472327-079d-4a4c-9fe8-78b993615360\") " pod="openshift-cluster-node-tuning-operator/tuned-9wdlg" May 25 12:12:48.544354 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.543941 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/51472327-079d-4a4c-9fe8-78b993615360-run\") pod \"tuned-9wdlg\" (UID: \"51472327-079d-4a4c-9fe8-78b993615360\") " pod="openshift-cluster-node-tuning-operator/tuned-9wdlg" May 25 12:12:48.544354 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.543964 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/51472327-079d-4a4c-9fe8-78b993615360-run\") pod \"tuned-9wdlg\" (UID: \"51472327-079d-4a4c-9fe8-78b993615360\") " pod="openshift-cluster-node-tuning-operator/tuned-9wdlg" May 25 12:12:48.544354 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.543967 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/51472327-079d-4a4c-9fe8-78b993615360-sys\") pod \"tuned-9wdlg\" (UID: \"51472327-079d-4a4c-9fe8-78b993615360\") " pod="openshift-cluster-node-tuning-operator/tuned-9wdlg" May 25 12:12:48.544354 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.544008 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c30b440-4b5e-43ca-a622-bb74465cb79b-tmp-dir\") pod \"node-resolver-wtj9s\" (UID: \"5c30b440-4b5e-43ca-a622-bb74465cb79b\") " pod="openshift-dns/node-resolver-wtj9s" May 25 12:12:48.544354 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.544042 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/51472327-079d-4a4c-9fe8-78b993615360-etc-sysconfig\") pod \"tuned-9wdlg\" (UID: \"51472327-079d-4a4c-9fe8-78b993615360\") " pod="openshift-cluster-node-tuning-operator/tuned-9wdlg" May 25 12:12:48.544354 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.544084 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/51472327-079d-4a4c-9fe8-78b993615360-sys\") pod \"tuned-9wdlg\" (UID: \"51472327-079d-4a4c-9fe8-78b993615360\") " pod="openshift-cluster-node-tuning-operator/tuned-9wdlg" May 25 12:12:48.544354 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.544087 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-var-lib-openvswitch\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.544354 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.544140 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/51472327-079d-4a4c-9fe8-78b993615360-etc-sysconfig\") pod \"tuned-9wdlg\" (UID: \"51472327-079d-4a4c-9fe8-78b993615360\") " pod="openshift-cluster-node-tuning-operator/tuned-9wdlg" May 25 12:12:48.544989 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.544151 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-etc-openvswitch\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.544989 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.544194 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-run-ovn\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.544989 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.544231 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-ovnkube-config\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.544989 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.544268 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/be5af227-e08d-4635-976e-c0d3927ad946-registration-dir\") pod \"aws-ebs-csi-driver-node-7msvf\" (UID: \"be5af227-e08d-4635-976e-c0d3927ad946\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7msvf" May 25 12:12:48.544989 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.544278 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c30b440-4b5e-43ca-a622-bb74465cb79b-tmp-dir\") pod \"node-resolver-wtj9s\" (UID: \"5c30b440-4b5e-43ca-a622-bb74465cb79b\") " pod="openshift-dns/node-resolver-wtj9s" May 25 12:12:48.544989 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.544294 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bdb1015a-2223-4987-a813-6fea589e0dd0-agent-certs\") pod \"konnectivity-agent-7mgh4\" (UID: \"bdb1015a-2223-4987-a813-6fea589e0dd0\") " pod="kube-system/konnectivity-agent-7mgh4" May 25 12:12:48.544989 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.544320 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-host-kubelet\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.544989 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.544344 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-host-slash\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.544989 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.544373 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/878b49ea-594a-4d14-8cd8-41f51008349d-multus-cni-dir\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.544989 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.544398 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/09c05b78-b511-4815-9c0f-18b3aee86125-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2sxb4\" (UID: \"09c05b78-b511-4815-9c0f-18b3aee86125\") " pod="openshift-multus/multus-additional-cni-plugins-2sxb4" May 25 12:12:48.544989 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.544415 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51472327-079d-4a4c-9fe8-78b993615360-etc-kubernetes\") pod \"tuned-9wdlg\" (UID: \"51472327-079d-4a4c-9fe8-78b993615360\") " pod="openshift-cluster-node-tuning-operator/tuned-9wdlg" May 25 12:12:48.544989 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.544435 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/51472327-079d-4a4c-9fe8-78b993615360-etc-systemd\") pod \"tuned-9wdlg\" (UID: \"51472327-079d-4a4c-9fe8-78b993615360\") " pod="openshift-cluster-node-tuning-operator/tuned-9wdlg" May 25 12:12:48.544989 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.544451 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-run-systemd\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.544989 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.544466 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/878b49ea-594a-4d14-8cd8-41f51008349d-multus-cni-dir\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.544989 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.544472 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lm9kz\" (UniqueName: \"kubernetes.io/projected/09c05b78-b511-4815-9c0f-18b3aee86125-kube-api-access-lm9kz\") pod \"multus-additional-cni-plugins-2sxb4\" (UID: \"09c05b78-b511-4815-9c0f-18b3aee86125\") " pod="openshift-multus/multus-additional-cni-plugins-2sxb4" May 25 12:12:48.544989 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.544492 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51472327-079d-4a4c-9fe8-78b993615360-etc-kubernetes\") pod \"tuned-9wdlg\" (UID: \"51472327-079d-4a4c-9fe8-78b993615360\") " pod="openshift-cluster-node-tuning-operator/tuned-9wdlg" May 25 12:12:48.544989 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.544497 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/51472327-079d-4a4c-9fe8-78b993615360-etc-sysctl-d\") pod \"tuned-9wdlg\" (UID: \"51472327-079d-4a4c-9fe8-78b993615360\") " pod="openshift-cluster-node-tuning-operator/tuned-9wdlg" May 25 12:12:48.545765 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.544534 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/51472327-079d-4a4c-9fe8-78b993615360-etc-tuned\") pod \"tuned-9wdlg\" (UID: \"51472327-079d-4a4c-9fe8-78b993615360\") " pod="openshift-cluster-node-tuning-operator/tuned-9wdlg" May 25 12:12:48.545765 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.544537 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/51472327-079d-4a4c-9fe8-78b993615360-etc-systemd\") pod \"tuned-9wdlg\" (UID: \"51472327-079d-4a4c-9fe8-78b993615360\") " pod="openshift-cluster-node-tuning-operator/tuned-9wdlg" May 25 12:12:48.545765 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.544564 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-host-run-ovn-kubernetes\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.545765 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.544587 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/51472327-079d-4a4c-9fe8-78b993615360-etc-sysctl-d\") pod \"tuned-9wdlg\" (UID: \"51472327-079d-4a4c-9fe8-78b993615360\") " pod="openshift-cluster-node-tuning-operator/tuned-9wdlg" May 25 12:12:48.545765 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.544595 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-host-cni-netd\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.545765 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.544630 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/be5af227-e08d-4635-976e-c0d3927ad946-socket-dir\") pod \"aws-ebs-csi-driver-node-7msvf\" (UID: \"be5af227-e08d-4635-976e-c0d3927ad946\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7msvf" May 25 12:12:48.545765 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.544654 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/be5af227-e08d-4635-976e-c0d3927ad946-etc-selinux\") pod \"aws-ebs-csi-driver-node-7msvf\" (UID: \"be5af227-e08d-4635-976e-c0d3927ad946\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7msvf" May 25 12:12:48.545765 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.544681 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/878b49ea-594a-4d14-8cd8-41f51008349d-host-var-lib-cni-bin\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.545765 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.544704 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/51472327-079d-4a4c-9fe8-78b993615360-etc-modprobe-d\") pod \"tuned-9wdlg\" (UID: \"51472327-079d-4a4c-9fe8-78b993615360\") " pod="openshift-cluster-node-tuning-operator/tuned-9wdlg" May 25 12:12:48.545765 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.544729 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4ldlv\" (UniqueName: \"kubernetes.io/projected/88e5c705-ce9b-41eb-8d8e-3092d38d11bc-kube-api-access-4ldlv\") pod \"node-ca-wtscn\" (UID: \"88e5c705-ce9b-41eb-8d8e-3092d38d11bc\") " pod="openshift-image-registry/node-ca-wtscn" May 25 12:12:48.545765 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.544753 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bdb1015a-2223-4987-a813-6fea589e0dd0-konnectivity-ca\") pod \"konnectivity-agent-7mgh4\" (UID: \"bdb1015a-2223-4987-a813-6fea589e0dd0\") " pod="kube-system/konnectivity-agent-7mgh4" May 25 12:12:48.545765 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.544768 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/878b49ea-594a-4d14-8cd8-41f51008349d-host-var-lib-cni-bin\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.545765 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.544780 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/878b49ea-594a-4d14-8cd8-41f51008349d-system-cni-dir\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.545765 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.544808 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/878b49ea-594a-4d14-8cd8-41f51008349d-cnibin\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.545765 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.544848 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/51472327-079d-4a4c-9fe8-78b993615360-etc-modprobe-d\") pod \"tuned-9wdlg\" (UID: \"51472327-079d-4a4c-9fe8-78b993615360\") " pod="openshift-cluster-node-tuning-operator/tuned-9wdlg" May 25 12:12:48.545765 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.544867 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/878b49ea-594a-4d14-8cd8-41f51008349d-cnibin\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.545765 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.544902 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/878b49ea-594a-4d14-8cd8-41f51008349d-system-cni-dir\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.546740 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.544905 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/09c05b78-b511-4815-9c0f-18b3aee86125-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2sxb4\" (UID: \"09c05b78-b511-4815-9c0f-18b3aee86125\") " pod="openshift-multus/multus-additional-cni-plugins-2sxb4" May 25 12:12:48.546740 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.544927 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/878b49ea-594a-4d14-8cd8-41f51008349d-cni-binary-copy\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.546740 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.544961 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/878b49ea-594a-4d14-8cd8-41f51008349d-etc-kubernetes\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.546740 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.544989 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t769q\" (UniqueName: \"kubernetes.io/projected/878b49ea-594a-4d14-8cd8-41f51008349d-kube-api-access-t769q\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.546740 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.545011 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/878b49ea-594a-4d14-8cd8-41f51008349d-etc-kubernetes\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.546740 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.545013 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/09c05b78-b511-4815-9c0f-18b3aee86125-os-release\") pod \"multus-additional-cni-plugins-2sxb4\" (UID: \"09c05b78-b511-4815-9c0f-18b3aee86125\") " pod="openshift-multus/multus-additional-cni-plugins-2sxb4" May 25 12:12:48.546740 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.545054 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-host-run-netns\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.546740 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.545071 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/09c05b78-b511-4815-9c0f-18b3aee86125-os-release\") pod \"multus-additional-cni-plugins-2sxb4\" (UID: \"09c05b78-b511-4815-9c0f-18b3aee86125\") " pod="openshift-multus/multus-additional-cni-plugins-2sxb4" May 25 12:12:48.546740 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.545079 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-run-openvswitch\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.546740 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.545126 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/878b49ea-594a-4d14-8cd8-41f51008349d-host-var-lib-kubelet\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.546740 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.545150 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-host-cni-bin\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.546740 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.545173 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-ovn-node-metrics-cert\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.546740 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.545200 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/be5af227-e08d-4635-976e-c0d3927ad946-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7msvf\" (UID: \"be5af227-e08d-4635-976e-c0d3927ad946\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7msvf" May 25 12:12:48.546740 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.545224 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/be5af227-e08d-4635-976e-c0d3927ad946-sys-fs\") pod \"aws-ebs-csi-driver-node-7msvf\" (UID: \"be5af227-e08d-4635-976e-c0d3927ad946\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7msvf" May 25 12:12:48.546740 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.545223 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/878b49ea-594a-4d14-8cd8-41f51008349d-host-var-lib-kubelet\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.546740 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.545246 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/09c05b78-b511-4815-9c0f-18b3aee86125-cnibin\") pod \"multus-additional-cni-plugins-2sxb4\" (UID: \"09c05b78-b511-4815-9c0f-18b3aee86125\") " pod="openshift-multus/multus-additional-cni-plugins-2sxb4" May 25 12:12:48.546740 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.545264 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/09c05b78-b511-4815-9c0f-18b3aee86125-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2sxb4\" (UID: \"09c05b78-b511-4815-9c0f-18b3aee86125\") " pod="openshift-multus/multus-additional-cni-plugins-2sxb4" May 25 12:12:48.547566 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.545283 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/09c05b78-b511-4815-9c0f-18b3aee86125-cnibin\") pod \"multus-additional-cni-plugins-2sxb4\" (UID: \"09c05b78-b511-4815-9c0f-18b3aee86125\") " pod="openshift-multus/multus-additional-cni-plugins-2sxb4" May 25 12:12:48.547566 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.545291 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/09c05b78-b511-4815-9c0f-18b3aee86125-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2sxb4\" (UID: \"09c05b78-b511-4815-9c0f-18b3aee86125\") " pod="openshift-multus/multus-additional-cni-plugins-2sxb4" May 25 12:12:48.547566 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.545331 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-ovnkube-script-lib\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.547566 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.545363 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/09c05b78-b511-4815-9c0f-18b3aee86125-cni-binary-copy\") pod \"multus-additional-cni-plugins-2sxb4\" (UID: \"09c05b78-b511-4815-9c0f-18b3aee86125\") " pod="openshift-multus/multus-additional-cni-plugins-2sxb4" May 25 12:12:48.547566 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.545391 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/878b49ea-594a-4d14-8cd8-41f51008349d-multus-socket-dir-parent\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.547566 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.545412 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/09c05b78-b511-4815-9c0f-18b3aee86125-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2sxb4\" (UID: \"09c05b78-b511-4815-9c0f-18b3aee86125\") " pod="openshift-multus/multus-additional-cni-plugins-2sxb4" May 25 12:12:48.547566 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.545417 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/878b49ea-594a-4d14-8cd8-41f51008349d-host-run-netns\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.547566 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.545457 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/878b49ea-594a-4d14-8cd8-41f51008349d-multus-daemon-config\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.547566 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.545487 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/51472327-079d-4a4c-9fe8-78b993615360-lib-modules\") pod \"tuned-9wdlg\" (UID: \"51472327-079d-4a4c-9fe8-78b993615360\") " pod="openshift-cluster-node-tuning-operator/tuned-9wdlg" May 25 12:12:48.547566 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.545488 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/878b49ea-594a-4d14-8cd8-41f51008349d-multus-socket-dir-parent\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.547566 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.545524 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-env-overrides\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.547566 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.545572 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/878b49ea-594a-4d14-8cd8-41f51008349d-cni-binary-copy\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.547566 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.545704 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/51472327-079d-4a4c-9fe8-78b993615360-lib-modules\") pod \"tuned-9wdlg\" (UID: \"51472327-079d-4a4c-9fe8-78b993615360\") " pod="openshift-cluster-node-tuning-operator/tuned-9wdlg" May 25 12:12:48.547566 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.545733 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/878b49ea-594a-4d14-8cd8-41f51008349d-host-run-netns\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.547566 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.545758 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/09c05b78-b511-4815-9c0f-18b3aee86125-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2sxb4\" (UID: \"09c05b78-b511-4815-9c0f-18b3aee86125\") " pod="openshift-multus/multus-additional-cni-plugins-2sxb4" May 25 12:12:48.547566 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.545919 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/09c05b78-b511-4815-9c0f-18b3aee86125-cni-binary-copy\") pod \"multus-additional-cni-plugins-2sxb4\" (UID: \"09c05b78-b511-4815-9c0f-18b3aee86125\") " pod="openshift-multus/multus-additional-cni-plugins-2sxb4" May 25 12:12:48.547566 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.546270 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/51472327-079d-4a4c-9fe8-78b993615360-tmp\") pod \"tuned-9wdlg\" (UID: \"51472327-079d-4a4c-9fe8-78b993615360\") " pod="openshift-cluster-node-tuning-operator/tuned-9wdlg" May 25 12:12:48.548115 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.546509 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/878b49ea-594a-4d14-8cd8-41f51008349d-multus-daemon-config\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.548115 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.547830 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/51472327-079d-4a4c-9fe8-78b993615360-etc-tuned\") pod \"tuned-9wdlg\" (UID: \"51472327-079d-4a4c-9fe8-78b993615360\") " pod="openshift-cluster-node-tuning-operator/tuned-9wdlg" May 25 12:12:48.555322 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.555217 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpjph\" (UniqueName: \"kubernetes.io/projected/5c30b440-4b5e-43ca-a622-bb74465cb79b-kube-api-access-tpjph\") pod \"node-resolver-wtj9s\" (UID: \"5c30b440-4b5e-43ca-a622-bb74465cb79b\") " pod="openshift-dns/node-resolver-wtj9s" May 25 12:12:48.555596 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.555572 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9glb7\" (UniqueName: \"kubernetes.io/projected/51472327-079d-4a4c-9fe8-78b993615360-kube-api-access-9glb7\") pod \"tuned-9wdlg\" (UID: \"51472327-079d-4a4c-9fe8-78b993615360\") " pod="openshift-cluster-node-tuning-operator/tuned-9wdlg" May 25 12:12:48.556033 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.555994 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s45fc\" (UniqueName: \"kubernetes.io/projected/5f2c06a2-06fe-41e4-9f01-6f43ede519cf-kube-api-access-s45fc\") pod \"iptables-alerter-86l52\" (UID: \"5f2c06a2-06fe-41e4-9f01-6f43ede519cf\") " pod="openshift-network-operator/iptables-alerter-86l52" May 25 12:12:48.556373 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.556237 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ldlv\" (UniqueName: \"kubernetes.io/projected/88e5c705-ce9b-41eb-8d8e-3092d38d11bc-kube-api-access-4ldlv\") pod \"node-ca-wtscn\" (UID: \"88e5c705-ce9b-41eb-8d8e-3092d38d11bc\") " pod="openshift-image-registry/node-ca-wtscn" May 25 12:12:48.558433 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.558227 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t769q\" (UniqueName: \"kubernetes.io/projected/878b49ea-594a-4d14-8cd8-41f51008349d-kube-api-access-t769q\") pod \"multus-p9w9p\" (UID: \"878b49ea-594a-4d14-8cd8-41f51008349d\") " pod="openshift-multus/multus-p9w9p" May 25 12:12:48.558627 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.558267 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lm9kz\" (UniqueName: \"kubernetes.io/projected/09c05b78-b511-4815-9c0f-18b3aee86125-kube-api-access-lm9kz\") pod \"multus-additional-cni-plugins-2sxb4\" (UID: \"09c05b78-b511-4815-9c0f-18b3aee86125\") " pod="openshift-multus/multus-additional-cni-plugins-2sxb4" May 25 12:12:48.569164 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:48.569141 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41194dcb30c71e287bcaa2f7065bdd2e.slice/crio-5d44bd4e686f0e172abd921fce41bed6384221dc167e7efc4fe8961fb9431638 WatchSource:0}: Error finding container 5d44bd4e686f0e172abd921fce41bed6384221dc167e7efc4fe8961fb9431638: Status 404 returned error can't find the container with id 5d44bd4e686f0e172abd921fce41bed6384221dc167e7efc4fe8961fb9431638 May 25 12:12:48.569393 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:48.569371 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6451e2a0f2aca0b0442b8f91758a11a.slice/crio-bc7709c3310941ca3052634d8cef69168d420794671732d2138655b5cbf55b25 WatchSource:0}: Error finding container bc7709c3310941ca3052634d8cef69168d420794671732d2138655b5cbf55b25: Status 404 returned error can't find the container with id bc7709c3310941ca3052634d8cef69168d420794671732d2138655b5cbf55b25 May 25 12:12:48.573238 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.573222 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 25 12:12:48.646719 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.646692 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-var-lib-openvswitch\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.646839 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.646731 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-etc-openvswitch\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.646839 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.646753 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-run-ovn\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.646839 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.646768 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-ovnkube-config\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.646839 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.646790 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/be5af227-e08d-4635-976e-c0d3927ad946-registration-dir\") pod \"aws-ebs-csi-driver-node-7msvf\" (UID: \"be5af227-e08d-4635-976e-c0d3927ad946\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7msvf" May 25 12:12:48.646839 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.646808 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-var-lib-openvswitch\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.646839 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.646814 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bdb1015a-2223-4987-a813-6fea589e0dd0-agent-certs\") pod \"konnectivity-agent-7mgh4\" (UID: \"bdb1015a-2223-4987-a813-6fea589e0dd0\") " pod="kube-system/konnectivity-agent-7mgh4" May 25 12:12:48.646839 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.646821 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-run-ovn\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.647230 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.646854 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-host-kubelet\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.647230 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.646866 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/be5af227-e08d-4635-976e-c0d3927ad946-registration-dir\") pod \"aws-ebs-csi-driver-node-7msvf\" (UID: \"be5af227-e08d-4635-976e-c0d3927ad946\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7msvf" May 25 12:12:48.647230 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.646880 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-host-slash\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.647230 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.646915 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-host-slash\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.647230 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.646930 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-etc-openvswitch\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.647230 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.646989 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-host-kubelet\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.647230 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.647033 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-run-systemd\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.647230 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.647067 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-run-systemd\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.647230 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.647076 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-host-run-ovn-kubernetes\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.647230 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.647127 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-host-cni-netd\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.647230 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.647138 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-host-run-ovn-kubernetes\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.647230 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.647153 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/be5af227-e08d-4635-976e-c0d3927ad946-socket-dir\") pod \"aws-ebs-csi-driver-node-7msvf\" (UID: \"be5af227-e08d-4635-976e-c0d3927ad946\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7msvf" May 25 12:12:48.647230 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.647168 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-host-cni-netd\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.647230 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.647178 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/be5af227-e08d-4635-976e-c0d3927ad946-etc-selinux\") pod \"aws-ebs-csi-driver-node-7msvf\" (UID: \"be5af227-e08d-4635-976e-c0d3927ad946\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7msvf" May 25 12:12:48.647230 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.647210 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bdb1015a-2223-4987-a813-6fea589e0dd0-konnectivity-ca\") pod \"konnectivity-agent-7mgh4\" (UID: \"bdb1015a-2223-4987-a813-6fea589e0dd0\") " pod="kube-system/konnectivity-agent-7mgh4" May 25 12:12:48.648550 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.647262 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/be5af227-e08d-4635-976e-c0d3927ad946-etc-selinux\") pod \"aws-ebs-csi-driver-node-7msvf\" (UID: \"be5af227-e08d-4635-976e-c0d3927ad946\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7msvf" May 25 12:12:48.648550 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.647266 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-host-run-netns\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.648550 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.647308 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-run-openvswitch\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.648550 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.647332 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-host-cni-bin\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.648550 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.647357 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-ovn-node-metrics-cert\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.648550 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.647381 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/be5af227-e08d-4635-976e-c0d3927ad946-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7msvf\" (UID: \"be5af227-e08d-4635-976e-c0d3927ad946\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7msvf" May 25 12:12:48.648550 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.647405 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/be5af227-e08d-4635-976e-c0d3927ad946-sys-fs\") pod \"aws-ebs-csi-driver-node-7msvf\" (UID: \"be5af227-e08d-4635-976e-c0d3927ad946\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7msvf" May 25 12:12:48.648550 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.647402 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-ovnkube-config\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.648550 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.647463 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-ovnkube-script-lib\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.648550 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.647477 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/be5af227-e08d-4635-976e-c0d3927ad946-sys-fs\") pod \"aws-ebs-csi-driver-node-7msvf\" (UID: \"be5af227-e08d-4635-976e-c0d3927ad946\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7msvf" May 25 12:12:48.648550 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.647514 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-env-overrides\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.648550 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.647540 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d07b05a-e936-4270-a36e-f25820e43991-metrics-certs\") pod \"network-metrics-daemon-g6zkc\" (UID: \"0d07b05a-e936-4270-a36e-f25820e43991\") " pod="openshift-multus/network-metrics-daemon-g6zkc" May 25 12:12:48.648550 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.647268 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/be5af227-e08d-4635-976e-c0d3927ad946-socket-dir\") pod \"aws-ebs-csi-driver-node-7msvf\" (UID: \"be5af227-e08d-4635-976e-c0d3927ad946\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7msvf" May 25 12:12:48.648550 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.647612 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-node-log\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.648550 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:48.647616 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 12:12:48.648550 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:48.647729 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d07b05a-e936-4270-a36e-f25820e43991-metrics-certs podName:0d07b05a-e936-4270-a36e-f25820e43991 nodeName:}" failed. No retries permitted until 2026-05-25 12:12:49.147659157 +0000 UTC m=+2.148447401 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d07b05a-e936-4270-a36e-f25820e43991-metrics-certs") pod "network-metrics-daemon-g6zkc" (UID: "0d07b05a-e936-4270-a36e-f25820e43991") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 12:12:48.648550 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.647731 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bdb1015a-2223-4987-a813-6fea589e0dd0-konnectivity-ca\") pod \"konnectivity-agent-7mgh4\" (UID: \"bdb1015a-2223-4987-a813-6fea589e0dd0\") " pod="kube-system/konnectivity-agent-7mgh4" May 25 12:12:48.649183 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.647514 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-host-cni-bin\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.649183 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.647580 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-node-log\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.649183 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.647990 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-host-run-netns\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.649183 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.648009 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-run-openvswitch\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.649183 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.648047 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-log-socket\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.649183 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.648052 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-ovnkube-script-lib\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.649183 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.648054 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/be5af227-e08d-4635-976e-c0d3927ad946-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7msvf\" (UID: \"be5af227-e08d-4635-976e-c0d3927ad946\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7msvf" May 25 12:12:48.649183 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.648073 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-env-overrides\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.649183 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.648087 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.649183 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.648119 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-log-socket\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.649183 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.648139 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hg82t\" (UniqueName: \"kubernetes.io/projected/0d07b05a-e936-4270-a36e-f25820e43991-kube-api-access-hg82t\") pod \"network-metrics-daemon-g6zkc\" (UID: \"0d07b05a-e936-4270-a36e-f25820e43991\") " pod="openshift-multus/network-metrics-daemon-g6zkc" May 25 12:12:48.649183 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.648140 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.649183 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.648164 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dl8ws\" (UniqueName: \"kubernetes.io/projected/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-kube-api-access-dl8ws\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.649183 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.648188 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/be5af227-e08d-4635-976e-c0d3927ad946-device-dir\") pod \"aws-ebs-csi-driver-node-7msvf\" (UID: \"be5af227-e08d-4635-976e-c0d3927ad946\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7msvf" May 25 12:12:48.649183 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.648216 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nhfqf\" (UniqueName: \"kubernetes.io/projected/be5af227-e08d-4635-976e-c0d3927ad946-kube-api-access-nhfqf\") pod \"aws-ebs-csi-driver-node-7msvf\" (UID: \"be5af227-e08d-4635-976e-c0d3927ad946\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7msvf" May 25 12:12:48.649183 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.648248 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/be5af227-e08d-4635-976e-c0d3927ad946-device-dir\") pod \"aws-ebs-csi-driver-node-7msvf\" (UID: \"be5af227-e08d-4635-976e-c0d3927ad946\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7msvf" May 25 12:12:48.649183 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.648248 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r6ssc\" (UniqueName: \"kubernetes.io/projected/a8c1a67f-b7f8-425e-8836-ec0ff5ffca44-kube-api-access-r6ssc\") pod \"network-check-target-26hst\" (UID: \"a8c1a67f-b7f8-425e-8836-ec0ff5ffca44\") " pod="openshift-network-diagnostics/network-check-target-26hst" May 25 12:12:48.649743 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.648291 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-systemd-units\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.649743 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.648343 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-systemd-units\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.649743 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.649385 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bdb1015a-2223-4987-a813-6fea589e0dd0-agent-certs\") pod \"konnectivity-agent-7mgh4\" (UID: \"bdb1015a-2223-4987-a813-6fea589e0dd0\") " pod="kube-system/konnectivity-agent-7mgh4" May 25 12:12:48.649989 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.649972 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-ovn-node-metrics-cert\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.655698 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:48.655682 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 12:12:48.655698 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:48.655699 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 12:12:48.655836 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:48.655711 2558 projected.go:194] Error preparing data for projected volume kube-api-access-r6ssc for pod openshift-network-diagnostics/network-check-target-26hst: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 12:12:48.655836 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:48.655753 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8c1a67f-b7f8-425e-8836-ec0ff5ffca44-kube-api-access-r6ssc podName:a8c1a67f-b7f8-425e-8836-ec0ff5ffca44 nodeName:}" failed. No retries permitted until 2026-05-25 12:12:49.15574208 +0000 UTC m=+2.156530320 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-r6ssc" (UniqueName: "kubernetes.io/projected/a8c1a67f-b7f8-425e-8836-ec0ff5ffca44-kube-api-access-r6ssc") pod "network-check-target-26hst" (UID: "a8c1a67f-b7f8-425e-8836-ec0ff5ffca44") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 12:12:48.657245 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.657223 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhfqf\" (UniqueName: \"kubernetes.io/projected/be5af227-e08d-4635-976e-c0d3927ad946-kube-api-access-nhfqf\") pod \"aws-ebs-csi-driver-node-7msvf\" (UID: \"be5af227-e08d-4635-976e-c0d3927ad946\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7msvf" May 25 12:12:48.657882 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.657863 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl8ws\" (UniqueName: \"kubernetes.io/projected/fea7fe46-bebe-4e32-adbe-2d3a6bbae354-kube-api-access-dl8ws\") pod \"ovnkube-node-c7fb8\" (UID: \"fea7fe46-bebe-4e32-adbe-2d3a6bbae354\") " pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.657972 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.657957 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg82t\" (UniqueName: \"kubernetes.io/projected/0d07b05a-e936-4270-a36e-f25820e43991-kube-api-access-hg82t\") pod \"network-metrics-daemon-g6zkc\" (UID: \"0d07b05a-e936-4270-a36e-f25820e43991\") " pod="openshift-multus/network-metrics-daemon-g6zkc" May 25 12:12:48.756522 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.756463 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2sxb4" May 25 12:12:48.763986 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:48.763966 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09c05b78_b511_4815_9c0f_18b3aee86125.slice/crio-938db03f18cf41aa2c26de0b280d3ef9e7d110dc30797d6851783f50a64d2622 WatchSource:0}: Error finding container 938db03f18cf41aa2c26de0b280d3ef9e7d110dc30797d6851783f50a64d2622: Status 404 returned error can't find the container with id 938db03f18cf41aa2c26de0b280d3ef9e7d110dc30797d6851783f50a64d2622 May 25 12:12:48.776829 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.776803 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-86l52" May 25 12:12:48.782261 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:48.782244 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f2c06a2_06fe_41e4_9f01_6f43ede519cf.slice/crio-7ddfcf4e3ec0bf31abe7a2637da5b00e1e3c6072fd0b6c1846e7b5f28ddc72c7 WatchSource:0}: Error finding container 7ddfcf4e3ec0bf31abe7a2637da5b00e1e3c6072fd0b6c1846e7b5f28ddc72c7: Status 404 returned error can't find the container with id 7ddfcf4e3ec0bf31abe7a2637da5b00e1e3c6072fd0b6c1846e7b5f28ddc72c7 May 25 12:12:48.792281 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.792263 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9wdlg" May 25 12:12:48.797571 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:48.797552 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51472327_079d_4a4c_9fe8_78b993615360.slice/crio-5d69865281933d828755838dfc7530f24b54f7d6d1a2d23395bb93ae4c503dcd WatchSource:0}: Error finding container 5d69865281933d828755838dfc7530f24b54f7d6d1a2d23395bb93ae4c503dcd: Status 404 returned error can't find the container with id 5d69865281933d828755838dfc7530f24b54f7d6d1a2d23395bb93ae4c503dcd May 25 12:12:48.805332 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.805315 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wtj9s" May 25 12:12:48.810905 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:48.810883 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c30b440_4b5e_43ca_a622_bb74465cb79b.slice/crio-36ab4079282cc0a4bfd16988a28bace96cb31cbbf9ae35c7a21d02936165d5b6 WatchSource:0}: Error finding container 36ab4079282cc0a4bfd16988a28bace96cb31cbbf9ae35c7a21d02936165d5b6: Status 404 returned error can't find the container with id 36ab4079282cc0a4bfd16988a28bace96cb31cbbf9ae35c7a21d02936165d5b6 May 25 12:12:48.820878 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.820862 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wtscn" May 25 12:12:48.826626 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:48.826605 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88e5c705_ce9b_41eb_8d8e_3092d38d11bc.slice/crio-501666f5099ed74afcbaedac45bbd03ae90b226596d9c9cb81ade20edc02785e WatchSource:0}: Error finding container 501666f5099ed74afcbaedac45bbd03ae90b226596d9c9cb81ade20edc02785e: Status 404 returned error can't find the container with id 501666f5099ed74afcbaedac45bbd03ae90b226596d9c9cb81ade20edc02785e May 25 12:12:48.840230 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.840211 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-p9w9p" May 25 12:12:48.845681 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:48.845657 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod878b49ea_594a_4d14_8cd8_41f51008349d.slice/crio-e9bbe7644d96c8d819223f2f3507081d0e0629f48d9c255ebc233eeaa0328b55 WatchSource:0}: Error finding container e9bbe7644d96c8d819223f2f3507081d0e0629f48d9c255ebc233eeaa0328b55: Status 404 returned error can't find the container with id e9bbe7644d96c8d819223f2f3507081d0e0629f48d9c255ebc233eeaa0328b55 May 25 12:12:48.874140 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.874110 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:12:48.879716 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.879690 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7mgh4" May 25 12:12:48.879973 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:48.879949 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfea7fe46_bebe_4e32_adbe_2d3a6bbae354.slice/crio-18cfcbdcd1f312524c22bb53bf801efc780d95fcad7771b3267cdcd08e3e20d7 WatchSource:0}: Error finding container 18cfcbdcd1f312524c22bb53bf801efc780d95fcad7771b3267cdcd08e3e20d7: Status 404 returned error can't find the container with id 18cfcbdcd1f312524c22bb53bf801efc780d95fcad7771b3267cdcd08e3e20d7 May 25 12:12:48.885373 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:48.885350 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7msvf" May 25 12:12:48.885574 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:48.885551 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdb1015a_2223_4987_a813_6fea589e0dd0.slice/crio-18d78259e7bb17d401a41d96aa80a0a3f888e1377d5bfbc5bbe3d3d2d78d06ca WatchSource:0}: Error finding container 18d78259e7bb17d401a41d96aa80a0a3f888e1377d5bfbc5bbe3d3d2d78d06ca: Status 404 returned error can't find the container with id 18d78259e7bb17d401a41d96aa80a0a3f888e1377d5bfbc5bbe3d3d2d78d06ca May 25 12:12:48.891671 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:12:48.891653 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe5af227_e08d_4635_976e_c0d3927ad946.slice/crio-2d878aa73608f4587c1962a11babadb757f7a38f7c16c629f4810b978bb9f7ad WatchSource:0}: Error finding container 2d878aa73608f4587c1962a11babadb757f7a38f7c16c629f4810b978bb9f7ad: Status 404 returned error can't find the container with id 2d878aa73608f4587c1962a11babadb757f7a38f7c16c629f4810b978bb9f7ad May 25 12:12:49.152400 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:49.152315 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d07b05a-e936-4270-a36e-f25820e43991-metrics-certs\") pod \"network-metrics-daemon-g6zkc\" (UID: \"0d07b05a-e936-4270-a36e-f25820e43991\") " pod="openshift-multus/network-metrics-daemon-g6zkc" May 25 12:12:49.152546 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:49.152521 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 12:12:49.152601 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:49.152585 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d07b05a-e936-4270-a36e-f25820e43991-metrics-certs podName:0d07b05a-e936-4270-a36e-f25820e43991 nodeName:}" failed. No retries permitted until 2026-05-25 12:12:50.152565771 +0000 UTC m=+3.153354003 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d07b05a-e936-4270-a36e-f25820e43991-metrics-certs") pod "network-metrics-daemon-g6zkc" (UID: "0d07b05a-e936-4270-a36e-f25820e43991") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 12:12:49.253213 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:49.253175 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r6ssc\" (UniqueName: \"kubernetes.io/projected/a8c1a67f-b7f8-425e-8836-ec0ff5ffca44-kube-api-access-r6ssc\") pod \"network-check-target-26hst\" (UID: \"a8c1a67f-b7f8-425e-8836-ec0ff5ffca44\") " pod="openshift-network-diagnostics/network-check-target-26hst" May 25 12:12:49.253406 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:49.253364 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 12:12:49.253406 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:49.253384 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 12:12:49.253406 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:49.253396 2558 projected.go:194] Error preparing data for projected volume kube-api-access-r6ssc for pod openshift-network-diagnostics/network-check-target-26hst: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 12:12:49.253563 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:49.253453 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8c1a67f-b7f8-425e-8836-ec0ff5ffca44-kube-api-access-r6ssc podName:a8c1a67f-b7f8-425e-8836-ec0ff5ffca44 nodeName:}" failed. No retries permitted until 2026-05-25 12:12:50.253435168 +0000 UTC m=+3.254223408 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-r6ssc" (UniqueName: "kubernetes.io/projected/a8c1a67f-b7f8-425e-8836-ec0ff5ffca44-kube-api-access-r6ssc") pod "network-check-target-26hst" (UID: "a8c1a67f-b7f8-425e-8836-ec0ff5ffca44") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 12:12:49.480616 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:49.480287 2558 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 25 12:12:49.484916 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:49.484837 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-24 12:07:48 +0000 UTC" deadline="2028-01-30 00:12:47.460178754 +0000 UTC" May 25 12:12:49.484916 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:49.484866 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14747h59m57.975316173s" May 25 12:12:49.588916 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:49.588857 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-p9w9p" event={"ID":"878b49ea-594a-4d14-8cd8-41f51008349d","Type":"ContainerStarted","Data":"e9bbe7644d96c8d819223f2f3507081d0e0629f48d9c255ebc233eeaa0328b55"} May 25 12:12:49.603010 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:49.602974 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wtscn" event={"ID":"88e5c705-ce9b-41eb-8d8e-3092d38d11bc","Type":"ContainerStarted","Data":"501666f5099ed74afcbaedac45bbd03ae90b226596d9c9cb81ade20edc02785e"} May 25 12:12:49.612973 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:49.612923 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9wdlg" event={"ID":"51472327-079d-4a4c-9fe8-78b993615360","Type":"ContainerStarted","Data":"5d69865281933d828755838dfc7530f24b54f7d6d1a2d23395bb93ae4c503dcd"} May 25 12:12:49.619495 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:49.619469 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-116.ec2.internal" event={"ID":"41194dcb30c71e287bcaa2f7065bdd2e","Type":"ContainerStarted","Data":"5d44bd4e686f0e172abd921fce41bed6384221dc167e7efc4fe8961fb9431638"} May 25 12:12:49.624072 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:49.624048 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7mgh4" event={"ID":"bdb1015a-2223-4987-a813-6fea589e0dd0","Type":"ContainerStarted","Data":"18d78259e7bb17d401a41d96aa80a0a3f888e1377d5bfbc5bbe3d3d2d78d06ca"} May 25 12:12:49.649481 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:49.649448 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wtj9s" event={"ID":"5c30b440-4b5e-43ca-a622-bb74465cb79b","Type":"ContainerStarted","Data":"36ab4079282cc0a4bfd16988a28bace96cb31cbbf9ae35c7a21d02936165d5b6"} May 25 12:12:49.656053 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:49.656027 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-86l52" event={"ID":"5f2c06a2-06fe-41e4-9f01-6f43ede519cf","Type":"ContainerStarted","Data":"7ddfcf4e3ec0bf31abe7a2637da5b00e1e3c6072fd0b6c1846e7b5f28ddc72c7"} May 25 12:12:49.658946 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:49.658918 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2sxb4" event={"ID":"09c05b78-b511-4815-9c0f-18b3aee86125","Type":"ContainerStarted","Data":"938db03f18cf41aa2c26de0b280d3ef9e7d110dc30797d6851783f50a64d2622"} May 25 12:12:49.694079 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:49.694047 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-116.ec2.internal" event={"ID":"f6451e2a0f2aca0b0442b8f91758a11a","Type":"ContainerStarted","Data":"bc7709c3310941ca3052634d8cef69168d420794671732d2138655b5cbf55b25"} May 25 12:12:49.720313 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:49.720281 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7msvf" event={"ID":"be5af227-e08d-4635-976e-c0d3927ad946","Type":"ContainerStarted","Data":"2d878aa73608f4587c1962a11babadb757f7a38f7c16c629f4810b978bb9f7ad"} May 25 12:12:49.735670 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:49.735536 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" event={"ID":"fea7fe46-bebe-4e32-adbe-2d3a6bbae354","Type":"ContainerStarted","Data":"18cfcbdcd1f312524c22bb53bf801efc780d95fcad7771b3267cdcd08e3e20d7"} May 25 12:12:50.161781 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:50.161656 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d07b05a-e936-4270-a36e-f25820e43991-metrics-certs\") pod \"network-metrics-daemon-g6zkc\" (UID: \"0d07b05a-e936-4270-a36e-f25820e43991\") " pod="openshift-multus/network-metrics-daemon-g6zkc" May 25 12:12:50.161984 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:50.161854 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 12:12:50.161984 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:50.161919 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d07b05a-e936-4270-a36e-f25820e43991-metrics-certs podName:0d07b05a-e936-4270-a36e-f25820e43991 nodeName:}" failed. No retries permitted until 2026-05-25 12:12:52.161900303 +0000 UTC m=+5.162688541 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d07b05a-e936-4270-a36e-f25820e43991-metrics-certs") pod "network-metrics-daemon-g6zkc" (UID: "0d07b05a-e936-4270-a36e-f25820e43991") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 12:12:50.263108 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:50.263039 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r6ssc\" (UniqueName: \"kubernetes.io/projected/a8c1a67f-b7f8-425e-8836-ec0ff5ffca44-kube-api-access-r6ssc\") pod \"network-check-target-26hst\" (UID: \"a8c1a67f-b7f8-425e-8836-ec0ff5ffca44\") " pod="openshift-network-diagnostics/network-check-target-26hst" May 25 12:12:50.263280 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:50.263255 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 12:12:50.263366 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:50.263282 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 12:12:50.263366 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:50.263296 2558 projected.go:194] Error preparing data for projected volume kube-api-access-r6ssc for pod openshift-network-diagnostics/network-check-target-26hst: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 12:12:50.263366 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:50.263357 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8c1a67f-b7f8-425e-8836-ec0ff5ffca44-kube-api-access-r6ssc podName:a8c1a67f-b7f8-425e-8836-ec0ff5ffca44 nodeName:}" failed. No retries permitted until 2026-05-25 12:12:52.263338728 +0000 UTC m=+5.264126980 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-r6ssc" (UniqueName: "kubernetes.io/projected/a8c1a67f-b7f8-425e-8836-ec0ff5ffca44-kube-api-access-r6ssc") pod "network-check-target-26hst" (UID: "a8c1a67f-b7f8-425e-8836-ec0ff5ffca44") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 12:12:50.372786 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:50.372420 2558 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 25 12:12:50.485816 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:50.485725 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-24 12:07:48 +0000 UTC" deadline="2028-02-03 18:42:05.300969244 +0000 UTC" May 25 12:12:50.485816 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:50.485758 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14862h29m14.815215343s" May 25 12:12:50.559269 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:50.559237 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6zkc" May 25 12:12:50.559455 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:50.559375 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g6zkc" podUID="0d07b05a-e936-4270-a36e-f25820e43991" May 25 12:12:50.559817 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:50.559791 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26hst" May 25 12:12:50.559914 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:50.559882 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26hst" podUID="a8c1a67f-b7f8-425e-8836-ec0ff5ffca44" May 25 12:12:50.886005 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:50.885926 2558 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 25 12:12:52.179545 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:52.179513 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d07b05a-e936-4270-a36e-f25820e43991-metrics-certs\") pod \"network-metrics-daemon-g6zkc\" (UID: \"0d07b05a-e936-4270-a36e-f25820e43991\") " pod="openshift-multus/network-metrics-daemon-g6zkc" May 25 12:12:52.180001 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:52.179672 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 12:12:52.180001 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:52.179741 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d07b05a-e936-4270-a36e-f25820e43991-metrics-certs podName:0d07b05a-e936-4270-a36e-f25820e43991 nodeName:}" failed. No retries permitted until 2026-05-25 12:12:56.179725637 +0000 UTC m=+9.180513866 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d07b05a-e936-4270-a36e-f25820e43991-metrics-certs") pod "network-metrics-daemon-g6zkc" (UID: "0d07b05a-e936-4270-a36e-f25820e43991") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 12:12:52.280187 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:52.280148 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r6ssc\" (UniqueName: \"kubernetes.io/projected/a8c1a67f-b7f8-425e-8836-ec0ff5ffca44-kube-api-access-r6ssc\") pod \"network-check-target-26hst\" (UID: \"a8c1a67f-b7f8-425e-8836-ec0ff5ffca44\") " pod="openshift-network-diagnostics/network-check-target-26hst" May 25 12:12:52.280351 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:52.280299 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 12:12:52.280351 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:52.280314 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 12:12:52.280351 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:52.280324 2558 projected.go:194] Error preparing data for projected volume kube-api-access-r6ssc for pod openshift-network-diagnostics/network-check-target-26hst: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 12:12:52.280520 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:52.280370 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8c1a67f-b7f8-425e-8836-ec0ff5ffca44-kube-api-access-r6ssc podName:a8c1a67f-b7f8-425e-8836-ec0ff5ffca44 nodeName:}" failed. No retries permitted until 2026-05-25 12:12:56.28035752 +0000 UTC m=+9.281145748 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-r6ssc" (UniqueName: "kubernetes.io/projected/a8c1a67f-b7f8-425e-8836-ec0ff5ffca44-kube-api-access-r6ssc") pod "network-check-target-26hst" (UID: "a8c1a67f-b7f8-425e-8836-ec0ff5ffca44") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 12:12:52.559656 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:52.559566 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26hst" May 25 12:12:52.559815 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:52.559697 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26hst" podUID="a8c1a67f-b7f8-425e-8836-ec0ff5ffca44" May 25 12:12:52.559988 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:52.559969 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6zkc" May 25 12:12:52.560113 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:52.560071 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g6zkc" podUID="0d07b05a-e936-4270-a36e-f25820e43991" May 25 12:12:54.560007 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:54.559505 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26hst" May 25 12:12:54.560007 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:54.559633 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26hst" podUID="a8c1a67f-b7f8-425e-8836-ec0ff5ffca44" May 25 12:12:54.560007 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:54.559697 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6zkc" May 25 12:12:54.560007 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:54.559827 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g6zkc" podUID="0d07b05a-e936-4270-a36e-f25820e43991" May 25 12:12:56.210144 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:56.210111 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d07b05a-e936-4270-a36e-f25820e43991-metrics-certs\") pod \"network-metrics-daemon-g6zkc\" (UID: \"0d07b05a-e936-4270-a36e-f25820e43991\") " pod="openshift-multus/network-metrics-daemon-g6zkc" May 25 12:12:56.210558 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:56.210249 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 12:12:56.210558 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:56.210299 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d07b05a-e936-4270-a36e-f25820e43991-metrics-certs podName:0d07b05a-e936-4270-a36e-f25820e43991 nodeName:}" failed. No retries permitted until 2026-05-25 12:13:04.210285293 +0000 UTC m=+17.211073529 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d07b05a-e936-4270-a36e-f25820e43991-metrics-certs") pod "network-metrics-daemon-g6zkc" (UID: "0d07b05a-e936-4270-a36e-f25820e43991") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 12:12:56.310974 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:56.310935 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r6ssc\" (UniqueName: \"kubernetes.io/projected/a8c1a67f-b7f8-425e-8836-ec0ff5ffca44-kube-api-access-r6ssc\") pod \"network-check-target-26hst\" (UID: \"a8c1a67f-b7f8-425e-8836-ec0ff5ffca44\") " pod="openshift-network-diagnostics/network-check-target-26hst" May 25 12:12:56.311211 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:56.311116 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 12:12:56.311211 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:56.311202 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 12:12:56.311329 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:56.311219 2558 projected.go:194] Error preparing data for projected volume kube-api-access-r6ssc for pod openshift-network-diagnostics/network-check-target-26hst: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 12:12:56.311329 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:56.311279 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8c1a67f-b7f8-425e-8836-ec0ff5ffca44-kube-api-access-r6ssc podName:a8c1a67f-b7f8-425e-8836-ec0ff5ffca44 nodeName:}" failed. No retries permitted until 2026-05-25 12:13:04.31125989 +0000 UTC m=+17.312048124 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-r6ssc" (UniqueName: "kubernetes.io/projected/a8c1a67f-b7f8-425e-8836-ec0ff5ffca44-kube-api-access-r6ssc") pod "network-check-target-26hst" (UID: "a8c1a67f-b7f8-425e-8836-ec0ff5ffca44") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 12:12:56.559638 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:56.559553 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26hst" May 25 12:12:56.559803 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:56.559662 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26hst" podUID="a8c1a67f-b7f8-425e-8836-ec0ff5ffca44" May 25 12:12:56.560024 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:56.559973 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6zkc" May 25 12:12:56.560149 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:56.560047 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g6zkc" podUID="0d07b05a-e936-4270-a36e-f25820e43991" May 25 12:12:58.558694 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:58.558658 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26hst" May 25 12:12:58.559155 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:12:58.558665 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6zkc" May 25 12:12:58.559155 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:58.558777 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26hst" podUID="a8c1a67f-b7f8-425e-8836-ec0ff5ffca44" May 25 12:12:58.559155 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:12:58.558888 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g6zkc" podUID="0d07b05a-e936-4270-a36e-f25820e43991" May 25 12:13:00.558705 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:00.558673 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26hst" May 25 12:13:00.559145 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:00.558685 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6zkc" May 25 12:13:00.559145 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:00.558770 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26hst" podUID="a8c1a67f-b7f8-425e-8836-ec0ff5ffca44" May 25 12:13:00.559145 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:00.558892 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g6zkc" podUID="0d07b05a-e936-4270-a36e-f25820e43991" May 25 12:13:02.559154 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:02.559124 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26hst" May 25 12:13:02.559612 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:02.559130 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6zkc" May 25 12:13:02.559612 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:02.559251 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26hst" podUID="a8c1a67f-b7f8-425e-8836-ec0ff5ffca44" May 25 12:13:02.559612 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:02.559363 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g6zkc" podUID="0d07b05a-e936-4270-a36e-f25820e43991" May 25 12:13:04.274136 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:04.274078 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d07b05a-e936-4270-a36e-f25820e43991-metrics-certs\") pod \"network-metrics-daemon-g6zkc\" (UID: \"0d07b05a-e936-4270-a36e-f25820e43991\") " pod="openshift-multus/network-metrics-daemon-g6zkc" May 25 12:13:04.274667 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:04.274233 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 12:13:04.274667 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:04.274296 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d07b05a-e936-4270-a36e-f25820e43991-metrics-certs podName:0d07b05a-e936-4270-a36e-f25820e43991 nodeName:}" failed. No retries permitted until 2026-05-25 12:13:20.274277104 +0000 UTC m=+33.275065339 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d07b05a-e936-4270-a36e-f25820e43991-metrics-certs") pod "network-metrics-daemon-g6zkc" (UID: "0d07b05a-e936-4270-a36e-f25820e43991") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 12:13:04.375173 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:04.375140 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r6ssc\" (UniqueName: \"kubernetes.io/projected/a8c1a67f-b7f8-425e-8836-ec0ff5ffca44-kube-api-access-r6ssc\") pod \"network-check-target-26hst\" (UID: \"a8c1a67f-b7f8-425e-8836-ec0ff5ffca44\") " pod="openshift-network-diagnostics/network-check-target-26hst" May 25 12:13:04.375342 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:04.375268 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 12:13:04.375342 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:04.375282 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 12:13:04.375342 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:04.375291 2558 projected.go:194] Error preparing data for projected volume kube-api-access-r6ssc for pod openshift-network-diagnostics/network-check-target-26hst: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 12:13:04.375342 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:04.375341 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8c1a67f-b7f8-425e-8836-ec0ff5ffca44-kube-api-access-r6ssc podName:a8c1a67f-b7f8-425e-8836-ec0ff5ffca44 nodeName:}" failed. No retries permitted until 2026-05-25 12:13:20.375327602 +0000 UTC m=+33.376115833 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-r6ssc" (UniqueName: "kubernetes.io/projected/a8c1a67f-b7f8-425e-8836-ec0ff5ffca44-kube-api-access-r6ssc") pod "network-check-target-26hst" (UID: "a8c1a67f-b7f8-425e-8836-ec0ff5ffca44") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 12:13:04.558862 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:04.558782 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26hst" May 25 12:13:04.558862 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:04.558803 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6zkc" May 25 12:13:04.559069 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:04.558909 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26hst" podUID="a8c1a67f-b7f8-425e-8836-ec0ff5ffca44" May 25 12:13:04.559069 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:04.558996 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g6zkc" podUID="0d07b05a-e936-4270-a36e-f25820e43991" May 25 12:13:06.559012 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:06.558982 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26hst" May 25 12:13:06.559463 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:06.558982 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6zkc" May 25 12:13:06.559463 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:06.559110 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26hst" podUID="a8c1a67f-b7f8-425e-8836-ec0ff5ffca44" May 25 12:13:06.559463 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:06.559222 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g6zkc" podUID="0d07b05a-e936-4270-a36e-f25820e43991" May 25 12:13:07.783787 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:07.783760 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-vhv79"] May 25 12:13:07.802431 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:07.802409 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhv79" May 25 12:13:07.802552 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:07.802479 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhv79" podUID="79806095-6157-40ab-b31e-353a019ef116" May 25 12:13:07.898704 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:07.898675 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/79806095-6157-40ab-b31e-353a019ef116-dbus\") pod \"global-pull-secret-syncer-vhv79\" (UID: \"79806095-6157-40ab-b31e-353a019ef116\") " pod="kube-system/global-pull-secret-syncer-vhv79" May 25 12:13:07.898840 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:07.898710 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79806095-6157-40ab-b31e-353a019ef116-original-pull-secret\") pod \"global-pull-secret-syncer-vhv79\" (UID: \"79806095-6157-40ab-b31e-353a019ef116\") " pod="kube-system/global-pull-secret-syncer-vhv79" May 25 12:13:07.898840 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:07.898766 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/79806095-6157-40ab-b31e-353a019ef116-kubelet-config\") pod \"global-pull-secret-syncer-vhv79\" (UID: \"79806095-6157-40ab-b31e-353a019ef116\") " pod="kube-system/global-pull-secret-syncer-vhv79" May 25 12:13:07.999367 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:07.999340 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/79806095-6157-40ab-b31e-353a019ef116-dbus\") pod \"global-pull-secret-syncer-vhv79\" (UID: \"79806095-6157-40ab-b31e-353a019ef116\") " pod="kube-system/global-pull-secret-syncer-vhv79" May 25 12:13:07.999367 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:07.999371 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79806095-6157-40ab-b31e-353a019ef116-original-pull-secret\") pod \"global-pull-secret-syncer-vhv79\" (UID: \"79806095-6157-40ab-b31e-353a019ef116\") " pod="kube-system/global-pull-secret-syncer-vhv79" May 25 12:13:07.999523 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:07.999415 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/79806095-6157-40ab-b31e-353a019ef116-kubelet-config\") pod \"global-pull-secret-syncer-vhv79\" (UID: \"79806095-6157-40ab-b31e-353a019ef116\") " pod="kube-system/global-pull-secret-syncer-vhv79" May 25 12:13:07.999562 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:07.999517 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 25 12:13:07.999562 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:07.999549 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/79806095-6157-40ab-b31e-353a019ef116-dbus\") pod \"global-pull-secret-syncer-vhv79\" (UID: \"79806095-6157-40ab-b31e-353a019ef116\") " pod="kube-system/global-pull-secret-syncer-vhv79" May 25 12:13:07.999622 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:07.999589 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79806095-6157-40ab-b31e-353a019ef116-original-pull-secret podName:79806095-6157-40ab-b31e-353a019ef116 nodeName:}" failed. No retries permitted until 2026-05-25 12:13:08.499568243 +0000 UTC m=+21.500356498 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/79806095-6157-40ab-b31e-353a019ef116-original-pull-secret") pod "global-pull-secret-syncer-vhv79" (UID: "79806095-6157-40ab-b31e-353a019ef116") : object "kube-system"/"original-pull-secret" not registered May 25 12:13:08.008607 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:08.008578 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/79806095-6157-40ab-b31e-353a019ef116-kubelet-config\") pod \"global-pull-secret-syncer-vhv79\" (UID: \"79806095-6157-40ab-b31e-353a019ef116\") " pod="kube-system/global-pull-secret-syncer-vhv79" May 25 12:13:08.504290 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:08.504130 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79806095-6157-40ab-b31e-353a019ef116-original-pull-secret\") pod \"global-pull-secret-syncer-vhv79\" (UID: \"79806095-6157-40ab-b31e-353a019ef116\") " pod="kube-system/global-pull-secret-syncer-vhv79" May 25 12:13:08.504395 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:08.504293 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 25 12:13:08.504395 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:08.504371 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79806095-6157-40ab-b31e-353a019ef116-original-pull-secret podName:79806095-6157-40ab-b31e-353a019ef116 nodeName:}" failed. No retries permitted until 2026-05-25 12:13:09.504350266 +0000 UTC m=+22.505138494 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/79806095-6157-40ab-b31e-353a019ef116-original-pull-secret") pod "global-pull-secret-syncer-vhv79" (UID: "79806095-6157-40ab-b31e-353a019ef116") : object "kube-system"/"original-pull-secret" not registered May 25 12:13:08.559328 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:08.559305 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6zkc" May 25 12:13:08.559443 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:08.559305 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26hst" May 25 12:13:08.559498 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:08.559449 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g6zkc" podUID="0d07b05a-e936-4270-a36e-f25820e43991" May 25 12:13:08.559552 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:08.559507 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26hst" podUID="a8c1a67f-b7f8-425e-8836-ec0ff5ffca44" May 25 12:13:08.769981 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:08.769935 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9wdlg" event={"ID":"51472327-079d-4a4c-9fe8-78b993615360","Type":"ContainerStarted","Data":"83422a1f0221dc828955a9ae6d1f5eb413aa928d41762c28354e5d5929367d57"} May 25 12:13:08.772520 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:08.772501 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-116.ec2.internal" event={"ID":"41194dcb30c71e287bcaa2f7065bdd2e","Type":"ContainerStarted","Data":"f2cba90ed701477acdb9d9fabc1f74a864f21c64c101eeeb4cd6cb0d1a991845"} May 25 12:13:08.775438 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:08.775413 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" event={"ID":"fea7fe46-bebe-4e32-adbe-2d3a6bbae354","Type":"ContainerStarted","Data":"e33125c25ae25040790d6f175e655525e4b240044ca2171de93b7e2c4a48002d"} May 25 12:13:08.775504 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:08.775447 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" event={"ID":"fea7fe46-bebe-4e32-adbe-2d3a6bbae354","Type":"ContainerStarted","Data":"1dc820472388e9a02a80005226f22252141884c6ec20efde34597b59812868a8"} May 25 12:13:08.775504 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:08.775461 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" event={"ID":"fea7fe46-bebe-4e32-adbe-2d3a6bbae354","Type":"ContainerStarted","Data":"57b7c51a459165ccb88b67f797284d7f52582e7daf9517d0da83025d16e3f930"} May 25 12:13:08.775504 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:08.775475 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" event={"ID":"fea7fe46-bebe-4e32-adbe-2d3a6bbae354","Type":"ContainerStarted","Data":"8fd4f2b842c2b53566e76934d8fd2dec871e89805e5874933286a75638ad517c"} May 25 12:13:08.775504 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:08.775487 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" event={"ID":"fea7fe46-bebe-4e32-adbe-2d3a6bbae354","Type":"ContainerStarted","Data":"2d710ae5e511b2942b1051b96868c1a94810621b70110795a3280b9e46067bad"} May 25 12:13:08.778839 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:08.778818 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-p9w9p" event={"ID":"878b49ea-594a-4d14-8cd8-41f51008349d","Type":"ContainerStarted","Data":"d43329085ff5dadf552a846d4a163a7845c8e89d0d67ccec3757624e20cc2995"} May 25 12:13:08.790725 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:08.790278 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9wdlg" podStartSLOduration=2.478486955 podStartE2EDuration="21.790267924s" podCreationTimestamp="2026-05-25 12:12:47 +0000 UTC" firstStartedPulling="2026-05-25 12:12:48.798857878 +0000 UTC m=+1.799646105" lastFinishedPulling="2026-05-25 12:13:08.110638844 +0000 UTC m=+21.111427074" observedRunningTime="2026-05-25 12:13:08.789534711 +0000 UTC m=+21.790322960" watchObservedRunningTime="2026-05-25 12:13:08.790267924 +0000 UTC m=+21.791056173" May 25 12:13:08.804922 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:08.804886 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-p9w9p" podStartSLOduration=2.506620078 podStartE2EDuration="21.804878316s" podCreationTimestamp="2026-05-25 12:12:47 +0000 UTC" firstStartedPulling="2026-05-25 12:12:48.847236745 +0000 UTC m=+1.848024975" lastFinishedPulling="2026-05-25 12:13:08.145494983 +0000 UTC m=+21.146283213" observedRunningTime="2026-05-25 12:13:08.804674273 +0000 UTC m=+21.805462525" watchObservedRunningTime="2026-05-25 12:13:08.804878316 +0000 UTC m=+21.805666565" May 25 12:13:08.821412 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:08.821375 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-116.ec2.internal" podStartSLOduration=20.821362165 podStartE2EDuration="20.821362165s" podCreationTimestamp="2026-05-25 12:12:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 12:13:08.820916266 +0000 UTC m=+21.821704515" watchObservedRunningTime="2026-05-25 12:13:08.821362165 +0000 UTC m=+21.822150414" May 25 12:13:09.511394 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:09.511318 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79806095-6157-40ab-b31e-353a019ef116-original-pull-secret\") pod \"global-pull-secret-syncer-vhv79\" (UID: \"79806095-6157-40ab-b31e-353a019ef116\") " pod="kube-system/global-pull-secret-syncer-vhv79" May 25 12:13:09.511543 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:09.511508 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 25 12:13:09.511592 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:09.511581 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79806095-6157-40ab-b31e-353a019ef116-original-pull-secret podName:79806095-6157-40ab-b31e-353a019ef116 nodeName:}" failed. No retries permitted until 2026-05-25 12:13:11.511561048 +0000 UTC m=+24.512349278 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/79806095-6157-40ab-b31e-353a019ef116-original-pull-secret") pod "global-pull-secret-syncer-vhv79" (UID: "79806095-6157-40ab-b31e-353a019ef116") : object "kube-system"/"original-pull-secret" not registered May 25 12:13:09.561127 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:09.559515 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhv79" May 25 12:13:09.561127 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:09.559642 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhv79" podUID="79806095-6157-40ab-b31e-353a019ef116" May 25 12:13:09.781625 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:09.781548 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7msvf" event={"ID":"be5af227-e08d-4635-976e-c0d3927ad946","Type":"ContainerStarted","Data":"09f667fc71d94b84aa500ae551b6607b79b5a8ad33a40ee2138ac9238cd37a29"} May 25 12:13:09.783620 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:09.783597 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" event={"ID":"fea7fe46-bebe-4e32-adbe-2d3a6bbae354","Type":"ContainerStarted","Data":"76ba334848ee473e509d6ed1ccc7250ab0b61a972ac05741e07a11a4b9f2b97c"} May 25 12:13:09.784642 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:09.784617 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wtscn" event={"ID":"88e5c705-ce9b-41eb-8d8e-3092d38d11bc","Type":"ContainerStarted","Data":"e84d167a0928ebea27fb19f4a52f8861343290e894ecd414a213210cd567d2c6"} May 25 12:13:09.785758 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:09.785738 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7mgh4" event={"ID":"bdb1015a-2223-4987-a813-6fea589e0dd0","Type":"ContainerStarted","Data":"f45e302613341a0a54ac1160d25b9edf13da21b88a217e2d128d9f5f9077f9e7"} May 25 12:13:09.786883 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:09.786862 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wtj9s" event={"ID":"5c30b440-4b5e-43ca-a622-bb74465cb79b","Type":"ContainerStarted","Data":"f04fc6968e26c39259f15732e382c597fc69d5929f59e0b2046b4c17b000e1f8"} May 25 12:13:09.787971 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:09.787951 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-86l52" event={"ID":"5f2c06a2-06fe-41e4-9f01-6f43ede519cf","Type":"ContainerStarted","Data":"24c5495a859384d4a0f22c4415304e1714ac56714eaa0d63828d3ee1b6fa41d0"} May 25 12:13:09.789041 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:09.789014 2558 generic.go:358] "Generic (PLEG): container finished" podID="09c05b78-b511-4815-9c0f-18b3aee86125" containerID="0aca89d722061a42fd5acb2ea8ccc6febea30f4ac403f5afc27dd04b8dd19680" exitCode=0 May 25 12:13:09.789151 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:09.789106 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2sxb4" event={"ID":"09c05b78-b511-4815-9c0f-18b3aee86125","Type":"ContainerDied","Data":"0aca89d722061a42fd5acb2ea8ccc6febea30f4ac403f5afc27dd04b8dd19680"} May 25 12:13:09.790262 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:09.790244 2558 generic.go:358] "Generic (PLEG): container finished" podID="f6451e2a0f2aca0b0442b8f91758a11a" containerID="7b91d3e5678fd27302df690c51093ae4edeb8af72ce211a9443a5b1002fc1a99" exitCode=0 May 25 12:13:09.790343 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:09.790302 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-116.ec2.internal" event={"ID":"f6451e2a0f2aca0b0442b8f91758a11a","Type":"ContainerDied","Data":"7b91d3e5678fd27302df690c51093ae4edeb8af72ce211a9443a5b1002fc1a99"} May 25 12:13:09.790402 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:09.790392 2558 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-116.ec2.internal" May 25 12:13:09.801397 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:09.801362 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wtscn" podStartSLOduration=3.5186807030000002 podStartE2EDuration="22.801352914s" podCreationTimestamp="2026-05-25 12:12:47 +0000 UTC" firstStartedPulling="2026-05-25 12:12:48.827905154 +0000 UTC m=+1.828693381" lastFinishedPulling="2026-05-25 12:13:08.110577349 +0000 UTC m=+21.111365592" observedRunningTime="2026-05-25 12:13:09.800936639 +0000 UTC m=+22.801724889" watchObservedRunningTime="2026-05-25 12:13:09.801352914 +0000 UTC m=+22.802141162" May 25 12:13:09.803962 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:09.803944 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 25 12:13:09.804488 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:09.804432 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-116.ec2.internal"] May 25 12:13:09.838986 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:09.838953 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7mgh4" podStartSLOduration=3.594641624 podStartE2EDuration="22.838943017s" podCreationTimestamp="2026-05-25 12:12:47 +0000 UTC" firstStartedPulling="2026-05-25 12:12:48.887985333 +0000 UTC m=+1.888773574" lastFinishedPulling="2026-05-25 12:13:08.132286728 +0000 UTC m=+21.133074967" observedRunningTime="2026-05-25 12:13:09.819009814 +0000 UTC m=+22.819798063" watchObservedRunningTime="2026-05-25 12:13:09.838943017 +0000 UTC m=+22.839731266" May 25 12:13:09.851881 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:09.851847 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-wtj9s" podStartSLOduration=3.53150193 podStartE2EDuration="22.851836931s" podCreationTimestamp="2026-05-25 12:12:47 +0000 UTC" firstStartedPulling="2026-05-25 12:12:48.812311828 +0000 UTC m=+1.813100058" lastFinishedPulling="2026-05-25 12:13:08.132646818 +0000 UTC m=+21.133435059" observedRunningTime="2026-05-25 12:13:09.851605293 +0000 UTC m=+22.852393543" watchObservedRunningTime="2026-05-25 12:13:09.851836931 +0000 UTC m=+22.852625180" May 25 12:13:09.865049 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:09.865014 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-86l52" podStartSLOduration=3.51406442 podStartE2EDuration="22.865003708s" podCreationTimestamp="2026-05-25 12:12:47 +0000 UTC" firstStartedPulling="2026-05-25 12:12:48.783550139 +0000 UTC m=+1.784338366" lastFinishedPulling="2026-05-25 12:13:08.134489414 +0000 UTC m=+21.135277654" observedRunningTime="2026-05-25 12:13:09.864946773 +0000 UTC m=+22.865735022" watchObservedRunningTime="2026-05-25 12:13:09.865003708 +0000 UTC m=+22.865791956" May 25 12:13:10.056548 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:10.056319 2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 25 12:13:10.508215 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:10.508049 2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-25T12:13:10.056545616Z","UUID":"0798403b-97be-4c04-8ab2-6e62bf2a3c78","Handler":null,"Name":"","Endpoint":""} May 25 12:13:10.509902 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:10.509837 2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 25 12:13:10.510024 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:10.509914 2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 25 12:13:10.559527 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:10.559497 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26hst" May 25 12:13:10.559676 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:10.559631 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26hst" podUID="a8c1a67f-b7f8-425e-8836-ec0ff5ffca44" May 25 12:13:10.559676 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:10.559671 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6zkc" May 25 12:13:10.559778 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:10.559756 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g6zkc" podUID="0d07b05a-e936-4270-a36e-f25820e43991" May 25 12:13:10.794644 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:10.794561 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7msvf" event={"ID":"be5af227-e08d-4635-976e-c0d3927ad946","Type":"ContainerStarted","Data":"394eae44bb8b7cbc57dc4903068b9627a44c622f1ea2d9c9629a0128530930e1"} May 25 12:13:10.797511 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:10.797483 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-116.ec2.internal" event={"ID":"f6451e2a0f2aca0b0442b8f91758a11a","Type":"ContainerStarted","Data":"3844f761f3b04e7cc39e38c3f3c1ef30d501e9be8ba2234cb5fc58974ce2a1ec"} May 25 12:13:11.526108 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:11.526010 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79806095-6157-40ab-b31e-353a019ef116-original-pull-secret\") pod \"global-pull-secret-syncer-vhv79\" (UID: \"79806095-6157-40ab-b31e-353a019ef116\") " pod="kube-system/global-pull-secret-syncer-vhv79" May 25 12:13:11.526574 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:11.526149 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 25 12:13:11.526574 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:11.526210 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79806095-6157-40ab-b31e-353a019ef116-original-pull-secret podName:79806095-6157-40ab-b31e-353a019ef116 nodeName:}" failed. No retries permitted until 2026-05-25 12:13:15.526197168 +0000 UTC m=+28.526985398 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/79806095-6157-40ab-b31e-353a019ef116-original-pull-secret") pod "global-pull-secret-syncer-vhv79" (UID: "79806095-6157-40ab-b31e-353a019ef116") : object "kube-system"/"original-pull-secret" not registered May 25 12:13:11.558983 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:11.558952 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhv79" May 25 12:13:11.559245 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:11.559073 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhv79" podUID="79806095-6157-40ab-b31e-353a019ef116" May 25 12:13:11.801793 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:11.801069 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7msvf" event={"ID":"be5af227-e08d-4635-976e-c0d3927ad946","Type":"ContainerStarted","Data":"50bb080f069c9038ac6ebc7e9137b5e5c70acc288713e77442554908a384221a"} May 25 12:13:11.804407 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:11.804369 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" event={"ID":"fea7fe46-bebe-4e32-adbe-2d3a6bbae354","Type":"ContainerStarted","Data":"4b4457ad43743f8a3028a640b5b94f68952b519472f01c77423f2e9cfeeed156"} May 25 12:13:11.818862 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:11.818806 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7msvf" podStartSLOduration=2.4851155719999998 podStartE2EDuration="24.818789379s" podCreationTimestamp="2026-05-25 12:12:47 +0000 UTC" firstStartedPulling="2026-05-25 12:12:48.892980282 +0000 UTC m=+1.893768509" lastFinishedPulling="2026-05-25 12:13:11.226654075 +0000 UTC m=+24.227442316" observedRunningTime="2026-05-25 12:13:11.81843034 +0000 UTC m=+24.819218579" watchObservedRunningTime="2026-05-25 12:13:11.818789379 +0000 UTC m=+24.819577629" May 25 12:13:11.819074 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:11.819053 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-116.ec2.internal" podStartSLOduration=2.819047146 podStartE2EDuration="2.819047146s" podCreationTimestamp="2026-05-25 12:13:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 12:13:10.812581936 +0000 UTC m=+23.813370184" watchObservedRunningTime="2026-05-25 12:13:11.819047146 +0000 UTC m=+24.819835408" May 25 12:13:12.559371 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:12.559329 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6zkc" May 25 12:13:12.560018 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:12.559332 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26hst" May 25 12:13:12.560018 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:12.559473 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g6zkc" podUID="0d07b05a-e936-4270-a36e-f25820e43991" May 25 12:13:12.560018 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:12.559617 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26hst" podUID="a8c1a67f-b7f8-425e-8836-ec0ff5ffca44" May 25 12:13:12.904435 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:12.904347 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7mgh4" May 25 12:13:12.905007 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:12.904989 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7mgh4" May 25 12:13:13.558622 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:13.558587 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhv79" May 25 12:13:13.558788 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:13.558718 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhv79" podUID="79806095-6157-40ab-b31e-353a019ef116" May 25 12:13:13.808906 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:13.808832 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7mgh4" May 25 12:13:13.809411 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:13.809391 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7mgh4" May 25 12:13:14.558935 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:14.558775 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26hst" May 25 12:13:14.559064 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:14.558778 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6zkc" May 25 12:13:14.559064 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:14.559006 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26hst" podUID="a8c1a67f-b7f8-425e-8836-ec0ff5ffca44" May 25 12:13:14.559151 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:14.559127 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g6zkc" podUID="0d07b05a-e936-4270-a36e-f25820e43991" May 25 12:13:14.812845 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:14.812806 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2sxb4" event={"ID":"09c05b78-b511-4815-9c0f-18b3aee86125","Type":"ContainerStarted","Data":"05cd7da90f2ff3f4d6aee3baba524bfcdb90307f1c7579a45efc59b008dc0641"} May 25 12:13:14.816108 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:14.816054 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" event={"ID":"fea7fe46-bebe-4e32-adbe-2d3a6bbae354","Type":"ContainerStarted","Data":"ac85a981555b8497ce09908419780c89343a2c59fd1ad2c0ba5fcb3402ed6510"} May 25 12:13:14.816454 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:14.816438 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:13:14.816513 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:14.816459 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:13:14.832430 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:14.832408 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:13:14.858168 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:14.858132 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" podStartSLOduration=8.506948795 podStartE2EDuration="27.858119631s" podCreationTimestamp="2026-05-25 12:12:47 +0000 UTC" firstStartedPulling="2026-05-25 12:12:48.882311757 +0000 UTC m=+1.883099984" lastFinishedPulling="2026-05-25 12:13:08.233482591 +0000 UTC m=+21.234270820" observedRunningTime="2026-05-25 12:13:14.857208247 +0000 UTC m=+27.857996496" watchObservedRunningTime="2026-05-25 12:13:14.858119631 +0000 UTC m=+27.858907874" May 25 12:13:15.559005 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:15.558965 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhv79" May 25 12:13:15.559202 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:15.559078 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhv79" podUID="79806095-6157-40ab-b31e-353a019ef116" May 25 12:13:15.562332 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:15.562308 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79806095-6157-40ab-b31e-353a019ef116-original-pull-secret\") pod \"global-pull-secret-syncer-vhv79\" (UID: \"79806095-6157-40ab-b31e-353a019ef116\") " pod="kube-system/global-pull-secret-syncer-vhv79" May 25 12:13:15.562448 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:15.562405 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 25 12:13:15.562486 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:15.562464 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79806095-6157-40ab-b31e-353a019ef116-original-pull-secret podName:79806095-6157-40ab-b31e-353a019ef116 nodeName:}" failed. No retries permitted until 2026-05-25 12:13:23.562451451 +0000 UTC m=+36.563239681 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/79806095-6157-40ab-b31e-353a019ef116-original-pull-secret") pod "global-pull-secret-syncer-vhv79" (UID: "79806095-6157-40ab-b31e-353a019ef116") : object "kube-system"/"original-pull-secret" not registered May 25 12:13:15.820007 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:15.819930 2558 generic.go:358] "Generic (PLEG): container finished" podID="09c05b78-b511-4815-9c0f-18b3aee86125" containerID="05cd7da90f2ff3f4d6aee3baba524bfcdb90307f1c7579a45efc59b008dc0641" exitCode=0 May 25 12:13:15.820388 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:15.820018 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2sxb4" event={"ID":"09c05b78-b511-4815-9c0f-18b3aee86125","Type":"ContainerDied","Data":"05cd7da90f2ff3f4d6aee3baba524bfcdb90307f1c7579a45efc59b008dc0641"} May 25 12:13:15.821605 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:15.820781 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:13:15.836507 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:15.836484 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:13:16.347830 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:16.347794 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-26hst"] May 25 12:13:16.348002 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:16.347941 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26hst" May 25 12:13:16.348056 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:16.348027 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26hst" podUID="a8c1a67f-b7f8-425e-8836-ec0ff5ffca44" May 25 12:13:16.350671 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:16.350638 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g6zkc"] May 25 12:13:16.350788 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:16.350761 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6zkc" May 25 12:13:16.350904 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:16.350886 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g6zkc" podUID="0d07b05a-e936-4270-a36e-f25820e43991" May 25 12:13:16.362701 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:16.362674 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vhv79"] May 25 12:13:16.362885 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:16.362776 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhv79" May 25 12:13:16.362885 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:16.362857 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhv79" podUID="79806095-6157-40ab-b31e-353a019ef116" May 25 12:13:17.559429 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:17.559401 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26hst" May 25 12:13:17.559895 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:17.559489 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26hst" podUID="a8c1a67f-b7f8-425e-8836-ec0ff5ffca44" May 25 12:13:17.559895 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:17.559540 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhv79" May 25 12:13:17.559895 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:17.559626 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhv79" podUID="79806095-6157-40ab-b31e-353a019ef116" May 25 12:13:17.824493 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:17.824408 2558 generic.go:358] "Generic (PLEG): container finished" podID="09c05b78-b511-4815-9c0f-18b3aee86125" containerID="0e9cacf459c655d7d62f716861b787580183c5c1a4ddbda85f94d058124cb57b" exitCode=0 May 25 12:13:17.824493 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:17.824445 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2sxb4" event={"ID":"09c05b78-b511-4815-9c0f-18b3aee86125","Type":"ContainerDied","Data":"0e9cacf459c655d7d62f716861b787580183c5c1a4ddbda85f94d058124cb57b"} May 25 12:13:18.558851 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:18.558825 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6zkc" May 25 12:13:18.558977 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:18.558957 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g6zkc" podUID="0d07b05a-e936-4270-a36e-f25820e43991" May 25 12:13:18.828563 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:18.828525 2558 generic.go:358] "Generic (PLEG): container finished" podID="09c05b78-b511-4815-9c0f-18b3aee86125" containerID="0766b47c4beab438301ce20e35925439bb21853347119e7ca656764721cb5046" exitCode=0 May 25 12:13:18.829233 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:18.828609 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2sxb4" event={"ID":"09c05b78-b511-4815-9c0f-18b3aee86125","Type":"ContainerDied","Data":"0766b47c4beab438301ce20e35925439bb21853347119e7ca656764721cb5046"} May 25 12:13:19.559595 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:19.559562 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26hst" May 25 12:13:19.559767 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:19.559601 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhv79" May 25 12:13:19.559767 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:19.559686 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26hst" podUID="a8c1a67f-b7f8-425e-8836-ec0ff5ffca44" May 25 12:13:19.559871 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:19.559831 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vhv79" podUID="79806095-6157-40ab-b31e-353a019ef116" May 25 12:13:20.300060 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:20.300019 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d07b05a-e936-4270-a36e-f25820e43991-metrics-certs\") pod \"network-metrics-daemon-g6zkc\" (UID: \"0d07b05a-e936-4270-a36e-f25820e43991\") " pod="openshift-multus/network-metrics-daemon-g6zkc" May 25 12:13:20.300512 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:20.300196 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 12:13:20.300512 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:20.300265 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d07b05a-e936-4270-a36e-f25820e43991-metrics-certs podName:0d07b05a-e936-4270-a36e-f25820e43991 nodeName:}" failed. No retries permitted until 2026-05-25 12:13:52.300249817 +0000 UTC m=+65.301038050 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d07b05a-e936-4270-a36e-f25820e43991-metrics-certs") pod "network-metrics-daemon-g6zkc" (UID: "0d07b05a-e936-4270-a36e-f25820e43991") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 12:13:20.400921 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:20.400891 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r6ssc\" (UniqueName: \"kubernetes.io/projected/a8c1a67f-b7f8-425e-8836-ec0ff5ffca44-kube-api-access-r6ssc\") pod \"network-check-target-26hst\" (UID: \"a8c1a67f-b7f8-425e-8836-ec0ff5ffca44\") " pod="openshift-network-diagnostics/network-check-target-26hst" May 25 12:13:20.401199 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:20.401056 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 12:13:20.401199 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:20.401076 2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 12:13:20.401199 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:20.401088 2558 projected.go:194] Error preparing data for projected volume kube-api-access-r6ssc for pod openshift-network-diagnostics/network-check-target-26hst: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 12:13:20.401199 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:20.401170 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8c1a67f-b7f8-425e-8836-ec0ff5ffca44-kube-api-access-r6ssc podName:a8c1a67f-b7f8-425e-8836-ec0ff5ffca44 nodeName:}" failed. No retries permitted until 2026-05-25 12:13:52.401151691 +0000 UTC m=+65.401939921 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-r6ssc" (UniqueName: "kubernetes.io/projected/a8c1a67f-b7f8-425e-8836-ec0ff5ffca44-kube-api-access-r6ssc") pod "network-check-target-26hst" (UID: "a8c1a67f-b7f8-425e-8836-ec0ff5ffca44") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 12:13:20.558778 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:20.558679 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6zkc" May 25 12:13:20.558925 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:20.558798 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g6zkc" podUID="0d07b05a-e936-4270-a36e-f25820e43991" May 25 12:13:20.767029 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:20.766998 2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-116.ec2.internal" event="NodeReady" May 25 12:13:20.767219 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:20.767156 2558 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 25 12:13:20.806861 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:20.806831 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-l6n7f"] May 25 12:13:20.811299 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:20.811219 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jd9hk"] May 25 12:13:20.811454 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:20.811346 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l6n7f" May 25 12:13:20.814264 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:20.814199 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 25 12:13:20.814724 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:20.814523 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 25 12:13:20.814724 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:20.814559 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fp9z9\"" May 25 12:13:20.815141 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:20.815125 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jd9hk" May 25 12:13:20.818162 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:20.818141 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 25 12:13:20.818267 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:20.818201 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 25 12:13:20.818642 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:20.818479 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 25 12:13:20.818777 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:20.818646 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zkb72\"" May 25 12:13:20.819403 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:20.819346 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l6n7f"] May 25 12:13:20.822744 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:20.822725 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jd9hk"] May 25 12:13:20.903556 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:20.903523 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bd3923cb-c163-4844-b189-de774a7e7407-config-volume\") pod \"dns-default-l6n7f\" (UID: \"bd3923cb-c163-4844-b189-de774a7e7407\") " pod="openshift-dns/dns-default-l6n7f" May 25 12:13:20.903556 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:20.903558 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd3923cb-c163-4844-b189-de774a7e7407-tmp-dir\") pod \"dns-default-l6n7f\" (UID: \"bd3923cb-c163-4844-b189-de774a7e7407\") " pod="openshift-dns/dns-default-l6n7f" May 25 12:13:20.903789 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:20.903581 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd3923cb-c163-4844-b189-de774a7e7407-metrics-tls\") pod \"dns-default-l6n7f\" (UID: \"bd3923cb-c163-4844-b189-de774a7e7407\") " pod="openshift-dns/dns-default-l6n7f" May 25 12:13:20.903789 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:20.903641 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcxtk\" (UniqueName: \"kubernetes.io/projected/49c5d043-eb23-43a4-afb0-0f5ebeba2e8d-kube-api-access-pcxtk\") pod \"ingress-canary-jd9hk\" (UID: \"49c5d043-eb23-43a4-afb0-0f5ebeba2e8d\") " pod="openshift-ingress-canary/ingress-canary-jd9hk" May 25 12:13:20.903789 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:20.903706 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7qgb\" (UniqueName: \"kubernetes.io/projected/bd3923cb-c163-4844-b189-de774a7e7407-kube-api-access-b7qgb\") pod \"dns-default-l6n7f\" (UID: \"bd3923cb-c163-4844-b189-de774a7e7407\") " pod="openshift-dns/dns-default-l6n7f" May 25 12:13:20.903789 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:20.903757 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49c5d043-eb23-43a4-afb0-0f5ebeba2e8d-cert\") pod \"ingress-canary-jd9hk\" (UID: \"49c5d043-eb23-43a4-afb0-0f5ebeba2e8d\") " pod="openshift-ingress-canary/ingress-canary-jd9hk" May 25 12:13:21.005062 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:21.005021 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd3923cb-c163-4844-b189-de774a7e7407-metrics-tls\") pod \"dns-default-l6n7f\" (UID: \"bd3923cb-c163-4844-b189-de774a7e7407\") " pod="openshift-dns/dns-default-l6n7f" May 25 12:13:21.005256 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:21.005070 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pcxtk\" (UniqueName: \"kubernetes.io/projected/49c5d043-eb23-43a4-afb0-0f5ebeba2e8d-kube-api-access-pcxtk\") pod \"ingress-canary-jd9hk\" (UID: \"49c5d043-eb23-43a4-afb0-0f5ebeba2e8d\") " pod="openshift-ingress-canary/ingress-canary-jd9hk" May 25 12:13:21.005256 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:21.005132 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b7qgb\" (UniqueName: \"kubernetes.io/projected/bd3923cb-c163-4844-b189-de774a7e7407-kube-api-access-b7qgb\") pod \"dns-default-l6n7f\" (UID: \"bd3923cb-c163-4844-b189-de774a7e7407\") " pod="openshift-dns/dns-default-l6n7f" May 25 12:13:21.005256 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:21.005194 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 12:13:21.005256 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:21.005197 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49c5d043-eb23-43a4-afb0-0f5ebeba2e8d-cert\") pod \"ingress-canary-jd9hk\" (UID: \"49c5d043-eb23-43a4-afb0-0f5ebeba2e8d\") " pod="openshift-ingress-canary/ingress-canary-jd9hk" May 25 12:13:21.005256 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:21.005259 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd3923cb-c163-4844-b189-de774a7e7407-metrics-tls podName:bd3923cb-c163-4844-b189-de774a7e7407 nodeName:}" failed. No retries permitted until 2026-05-25 12:13:21.505239998 +0000 UTC m=+34.506028227 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd3923cb-c163-4844-b189-de774a7e7407-metrics-tls") pod "dns-default-l6n7f" (UID: "bd3923cb-c163-4844-b189-de774a7e7407") : secret "dns-default-metrics-tls" not found May 25 12:13:21.005509 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:21.005274 2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 12:13:21.005509 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:21.005307 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49c5d043-eb23-43a4-afb0-0f5ebeba2e8d-cert podName:49c5d043-eb23-43a4-afb0-0f5ebeba2e8d nodeName:}" failed. No retries permitted until 2026-05-25 12:13:21.505295968 +0000 UTC m=+34.506084195 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/49c5d043-eb23-43a4-afb0-0f5ebeba2e8d-cert") pod "ingress-canary-jd9hk" (UID: "49c5d043-eb23-43a4-afb0-0f5ebeba2e8d") : secret "canary-serving-cert" not found May 25 12:13:21.005509 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:21.005322 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bd3923cb-c163-4844-b189-de774a7e7407-config-volume\") pod \"dns-default-l6n7f\" (UID: \"bd3923cb-c163-4844-b189-de774a7e7407\") " pod="openshift-dns/dns-default-l6n7f" May 25 12:13:21.005509 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:21.005342 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd3923cb-c163-4844-b189-de774a7e7407-tmp-dir\") pod \"dns-default-l6n7f\" (UID: \"bd3923cb-c163-4844-b189-de774a7e7407\") " pod="openshift-dns/dns-default-l6n7f" May 25 12:13:21.005701 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:21.005660 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd3923cb-c163-4844-b189-de774a7e7407-tmp-dir\") pod \"dns-default-l6n7f\" (UID: \"bd3923cb-c163-4844-b189-de774a7e7407\") " pod="openshift-dns/dns-default-l6n7f" May 25 12:13:21.006060 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:21.006039 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bd3923cb-c163-4844-b189-de774a7e7407-config-volume\") pod \"dns-default-l6n7f\" (UID: \"bd3923cb-c163-4844-b189-de774a7e7407\") " pod="openshift-dns/dns-default-l6n7f" May 25 12:13:21.015722 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:21.015689 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7qgb\" (UniqueName: \"kubernetes.io/projected/bd3923cb-c163-4844-b189-de774a7e7407-kube-api-access-b7qgb\") pod \"dns-default-l6n7f\" (UID: \"bd3923cb-c163-4844-b189-de774a7e7407\") " pod="openshift-dns/dns-default-l6n7f" May 25 12:13:21.015850 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:21.015829 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcxtk\" (UniqueName: \"kubernetes.io/projected/49c5d043-eb23-43a4-afb0-0f5ebeba2e8d-kube-api-access-pcxtk\") pod \"ingress-canary-jd9hk\" (UID: \"49c5d043-eb23-43a4-afb0-0f5ebeba2e8d\") " pod="openshift-ingress-canary/ingress-canary-jd9hk" May 25 12:13:21.509426 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:21.509212 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd3923cb-c163-4844-b189-de774a7e7407-metrics-tls\") pod \"dns-default-l6n7f\" (UID: \"bd3923cb-c163-4844-b189-de774a7e7407\") " pod="openshift-dns/dns-default-l6n7f" May 25 12:13:21.509855 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:21.509365 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 12:13:21.509855 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:21.509502 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49c5d043-eb23-43a4-afb0-0f5ebeba2e8d-cert\") pod \"ingress-canary-jd9hk\" (UID: \"49c5d043-eb23-43a4-afb0-0f5ebeba2e8d\") " pod="openshift-ingress-canary/ingress-canary-jd9hk" May 25 12:13:21.509855 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:21.509562 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd3923cb-c163-4844-b189-de774a7e7407-metrics-tls podName:bd3923cb-c163-4844-b189-de774a7e7407 nodeName:}" failed. No retries permitted until 2026-05-25 12:13:22.509543846 +0000 UTC m=+35.510332086 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd3923cb-c163-4844-b189-de774a7e7407-metrics-tls") pod "dns-default-l6n7f" (UID: "bd3923cb-c163-4844-b189-de774a7e7407") : secret "dns-default-metrics-tls" not found May 25 12:13:21.509855 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:21.509636 2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 12:13:21.509855 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:21.509695 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49c5d043-eb23-43a4-afb0-0f5ebeba2e8d-cert podName:49c5d043-eb23-43a4-afb0-0f5ebeba2e8d nodeName:}" failed. No retries permitted until 2026-05-25 12:13:22.509679209 +0000 UTC m=+35.510467458 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/49c5d043-eb23-43a4-afb0-0f5ebeba2e8d-cert") pod "ingress-canary-jd9hk" (UID: "49c5d043-eb23-43a4-afb0-0f5ebeba2e8d") : secret "canary-serving-cert" not found May 25 12:13:21.559604 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:21.559574 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhv79" May 25 12:13:21.559789 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:21.559617 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26hst" May 25 12:13:21.562484 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:21.562459 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 25 12:13:21.563642 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:21.563617 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 25 12:13:21.563744 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:21.563641 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wxdt4\"" May 25 12:13:21.563744 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:21.563714 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 25 12:13:22.517393 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:22.517354 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49c5d043-eb23-43a4-afb0-0f5ebeba2e8d-cert\") pod \"ingress-canary-jd9hk\" (UID: \"49c5d043-eb23-43a4-afb0-0f5ebeba2e8d\") " pod="openshift-ingress-canary/ingress-canary-jd9hk" May 25 12:13:22.517792 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:22.517425 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd3923cb-c163-4844-b189-de774a7e7407-metrics-tls\") pod \"dns-default-l6n7f\" (UID: \"bd3923cb-c163-4844-b189-de774a7e7407\") " pod="openshift-dns/dns-default-l6n7f" May 25 12:13:22.517792 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:22.517518 2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 12:13:22.517792 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:22.517551 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 12:13:22.517792 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:22.517610 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd3923cb-c163-4844-b189-de774a7e7407-metrics-tls podName:bd3923cb-c163-4844-b189-de774a7e7407 nodeName:}" failed. No retries permitted until 2026-05-25 12:13:24.517591087 +0000 UTC m=+37.518379314 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd3923cb-c163-4844-b189-de774a7e7407-metrics-tls") pod "dns-default-l6n7f" (UID: "bd3923cb-c163-4844-b189-de774a7e7407") : secret "dns-default-metrics-tls" not found May 25 12:13:22.517792 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:22.517626 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49c5d043-eb23-43a4-afb0-0f5ebeba2e8d-cert podName:49c5d043-eb23-43a4-afb0-0f5ebeba2e8d nodeName:}" failed. No retries permitted until 2026-05-25 12:13:24.517618761 +0000 UTC m=+37.518406987 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/49c5d043-eb23-43a4-afb0-0f5ebeba2e8d-cert") pod "ingress-canary-jd9hk" (UID: "49c5d043-eb23-43a4-afb0-0f5ebeba2e8d") : secret "canary-serving-cert" not found May 25 12:13:22.558964 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:22.558931 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6zkc" May 25 12:13:22.561721 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:22.561699 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 25 12:13:22.561834 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:22.561803 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nlm6z\"" May 25 12:13:23.626792 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:23.626745 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79806095-6157-40ab-b31e-353a019ef116-original-pull-secret\") pod \"global-pull-secret-syncer-vhv79\" (UID: \"79806095-6157-40ab-b31e-353a019ef116\") " pod="kube-system/global-pull-secret-syncer-vhv79" May 25 12:13:23.630288 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:23.630260 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79806095-6157-40ab-b31e-353a019ef116-original-pull-secret\") pod \"global-pull-secret-syncer-vhv79\" (UID: \"79806095-6157-40ab-b31e-353a019ef116\") " pod="kube-system/global-pull-secret-syncer-vhv79" May 25 12:13:23.671340 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:23.671294 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vhv79" May 25 12:13:24.326287 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:24.326258 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vhv79"] May 25 12:13:24.351313 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:13:24.351245 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79806095_6157_40ab_b31e_353a019ef116.slice/crio-cb4f20f03d7e056310cd1baac6db109f5267ff3feff053ba2f0794d7234129b9 WatchSource:0}: Error finding container cb4f20f03d7e056310cd1baac6db109f5267ff3feff053ba2f0794d7234129b9: Status 404 returned error can't find the container with id cb4f20f03d7e056310cd1baac6db109f5267ff3feff053ba2f0794d7234129b9 May 25 12:13:24.534193 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:24.533999 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49c5d043-eb23-43a4-afb0-0f5ebeba2e8d-cert\") pod \"ingress-canary-jd9hk\" (UID: \"49c5d043-eb23-43a4-afb0-0f5ebeba2e8d\") " pod="openshift-ingress-canary/ingress-canary-jd9hk" May 25 12:13:24.534340 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:24.534200 2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 12:13:24.534340 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:24.534232 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd3923cb-c163-4844-b189-de774a7e7407-metrics-tls\") pod \"dns-default-l6n7f\" (UID: \"bd3923cb-c163-4844-b189-de774a7e7407\") " pod="openshift-dns/dns-default-l6n7f" May 25 12:13:24.534340 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:24.534287 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49c5d043-eb23-43a4-afb0-0f5ebeba2e8d-cert podName:49c5d043-eb23-43a4-afb0-0f5ebeba2e8d nodeName:}" failed. No retries permitted until 2026-05-25 12:13:28.534264632 +0000 UTC m=+41.535052874 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/49c5d043-eb23-43a4-afb0-0f5ebeba2e8d-cert") pod "ingress-canary-jd9hk" (UID: "49c5d043-eb23-43a4-afb0-0f5ebeba2e8d") : secret "canary-serving-cert" not found May 25 12:13:24.534488 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:24.534355 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 12:13:24.534488 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:24.534411 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd3923cb-c163-4844-b189-de774a7e7407-metrics-tls podName:bd3923cb-c163-4844-b189-de774a7e7407 nodeName:}" failed. No retries permitted until 2026-05-25 12:13:28.534396019 +0000 UTC m=+41.535184252 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd3923cb-c163-4844-b189-de774a7e7407-metrics-tls") pod "dns-default-l6n7f" (UID: "bd3923cb-c163-4844-b189-de774a7e7407") : secret "dns-default-metrics-tls" not found May 25 12:13:24.842847 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:24.842766 2558 generic.go:358] "Generic (PLEG): container finished" podID="09c05b78-b511-4815-9c0f-18b3aee86125" containerID="96d77e0d378d6643795bca42a713b3ecb383cc31e5e24b3955e20e2eb565bd24" exitCode=0 May 25 12:13:24.843307 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:24.842851 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2sxb4" event={"ID":"09c05b78-b511-4815-9c0f-18b3aee86125","Type":"ContainerDied","Data":"96d77e0d378d6643795bca42a713b3ecb383cc31e5e24b3955e20e2eb565bd24"} May 25 12:13:24.844364 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:24.843949 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vhv79" event={"ID":"79806095-6157-40ab-b31e-353a019ef116","Type":"ContainerStarted","Data":"cb4f20f03d7e056310cd1baac6db109f5267ff3feff053ba2f0794d7234129b9"} May 25 12:13:25.852698 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:25.852660 2558 generic.go:358] "Generic (PLEG): container finished" podID="09c05b78-b511-4815-9c0f-18b3aee86125" containerID="f66849d413e2a79c7f1456f6b895f47f8b43e266c27e984bfafd94fedbe2ac60" exitCode=0 May 25 12:13:25.853185 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:25.852712 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2sxb4" event={"ID":"09c05b78-b511-4815-9c0f-18b3aee86125","Type":"ContainerDied","Data":"f66849d413e2a79c7f1456f6b895f47f8b43e266c27e984bfafd94fedbe2ac60"} May 25 12:13:26.857991 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:26.857949 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2sxb4" event={"ID":"09c05b78-b511-4815-9c0f-18b3aee86125","Type":"ContainerStarted","Data":"19149fa37fde05a27b723689e7c989b390b60f9ae818bc76ceb70432c7f2d9b5"} May 25 12:13:26.881592 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:26.881537 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2sxb4" podStartSLOduration=4.265645263 podStartE2EDuration="39.881515717s" podCreationTimestamp="2026-05-25 12:12:47 +0000 UTC" firstStartedPulling="2026-05-25 12:12:48.765403741 +0000 UTC m=+1.766191968" lastFinishedPulling="2026-05-25 12:13:24.381274193 +0000 UTC m=+37.382062422" observedRunningTime="2026-05-25 12:13:26.879629247 +0000 UTC m=+39.880417496" watchObservedRunningTime="2026-05-25 12:13:26.881515717 +0000 UTC m=+39.882303967" May 25 12:13:28.570364 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:28.570334 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd3923cb-c163-4844-b189-de774a7e7407-metrics-tls\") pod \"dns-default-l6n7f\" (UID: \"bd3923cb-c163-4844-b189-de774a7e7407\") " pod="openshift-dns/dns-default-l6n7f" May 25 12:13:28.570692 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:28.570413 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49c5d043-eb23-43a4-afb0-0f5ebeba2e8d-cert\") pod \"ingress-canary-jd9hk\" (UID: \"49c5d043-eb23-43a4-afb0-0f5ebeba2e8d\") " pod="openshift-ingress-canary/ingress-canary-jd9hk" May 25 12:13:28.570692 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:28.570450 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 12:13:28.570692 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:28.570510 2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 12:13:28.570692 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:28.570520 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd3923cb-c163-4844-b189-de774a7e7407-metrics-tls podName:bd3923cb-c163-4844-b189-de774a7e7407 nodeName:}" failed. No retries permitted until 2026-05-25 12:13:36.570502187 +0000 UTC m=+49.571290416 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd3923cb-c163-4844-b189-de774a7e7407-metrics-tls") pod "dns-default-l6n7f" (UID: "bd3923cb-c163-4844-b189-de774a7e7407") : secret "dns-default-metrics-tls" not found May 25 12:13:28.570692 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:28.570555 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49c5d043-eb23-43a4-afb0-0f5ebeba2e8d-cert podName:49c5d043-eb23-43a4-afb0-0f5ebeba2e8d nodeName:}" failed. No retries permitted until 2026-05-25 12:13:36.57054027 +0000 UTC m=+49.571328519 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/49c5d043-eb23-43a4-afb0-0f5ebeba2e8d-cert") pod "ingress-canary-jd9hk" (UID: "49c5d043-eb23-43a4-afb0-0f5ebeba2e8d") : secret "canary-serving-cert" not found May 25 12:13:28.862826 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:28.862792 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vhv79" event={"ID":"79806095-6157-40ab-b31e-353a019ef116","Type":"ContainerStarted","Data":"dca9ae0284af5e6482fc2039d437270651160ab11479248f019ca93572abb2e6"} May 25 12:13:28.878192 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:28.878147 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vhv79" podStartSLOduration=17.711736719 podStartE2EDuration="21.878132638s" podCreationTimestamp="2026-05-25 12:13:07 +0000 UTC" firstStartedPulling="2026-05-25 12:13:24.3575929 +0000 UTC m=+37.358381138" lastFinishedPulling="2026-05-25 12:13:28.523988828 +0000 UTC m=+41.524777057" observedRunningTime="2026-05-25 12:13:28.87758408 +0000 UTC m=+41.878372334" watchObservedRunningTime="2026-05-25 12:13:28.878132638 +0000 UTC m=+41.878920886" May 25 12:13:36.622447 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:36.622403 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49c5d043-eb23-43a4-afb0-0f5ebeba2e8d-cert\") pod \"ingress-canary-jd9hk\" (UID: \"49c5d043-eb23-43a4-afb0-0f5ebeba2e8d\") " pod="openshift-ingress-canary/ingress-canary-jd9hk" May 25 12:13:36.622839 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:36.622474 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd3923cb-c163-4844-b189-de774a7e7407-metrics-tls\") pod \"dns-default-l6n7f\" (UID: \"bd3923cb-c163-4844-b189-de774a7e7407\") " pod="openshift-dns/dns-default-l6n7f" May 25 12:13:36.622839 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:36.622560 2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 12:13:36.622839 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:36.622570 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 12:13:36.622839 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:36.622643 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd3923cb-c163-4844-b189-de774a7e7407-metrics-tls podName:bd3923cb-c163-4844-b189-de774a7e7407 nodeName:}" failed. No retries permitted until 2026-05-25 12:13:52.622624581 +0000 UTC m=+65.623412823 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd3923cb-c163-4844-b189-de774a7e7407-metrics-tls") pod "dns-default-l6n7f" (UID: "bd3923cb-c163-4844-b189-de774a7e7407") : secret "dns-default-metrics-tls" not found May 25 12:13:36.622839 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:36.622659 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49c5d043-eb23-43a4-afb0-0f5ebeba2e8d-cert podName:49c5d043-eb23-43a4-afb0-0f5ebeba2e8d nodeName:}" failed. No retries permitted until 2026-05-25 12:13:52.622651695 +0000 UTC m=+65.623439933 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/49c5d043-eb23-43a4-afb0-0f5ebeba2e8d-cert") pod "ingress-canary-jd9hk" (UID: "49c5d043-eb23-43a4-afb0-0f5ebeba2e8d") : secret "canary-serving-cert" not found May 25 12:13:47.835172 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:47.835131 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c7fb8" May 25 12:13:52.342867 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:52.342821 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d07b05a-e936-4270-a36e-f25820e43991-metrics-certs\") pod \"network-metrics-daemon-g6zkc\" (UID: \"0d07b05a-e936-4270-a36e-f25820e43991\") " pod="openshift-multus/network-metrics-daemon-g6zkc" May 25 12:13:52.345814 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:52.345794 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 25 12:13:52.353175 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:52.353154 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 25 12:13:52.353277 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:52.353212 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d07b05a-e936-4270-a36e-f25820e43991-metrics-certs podName:0d07b05a-e936-4270-a36e-f25820e43991 nodeName:}" failed. No retries permitted until 2026-05-25 12:14:56.35319667 +0000 UTC m=+129.353984898 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d07b05a-e936-4270-a36e-f25820e43991-metrics-certs") pod "network-metrics-daemon-g6zkc" (UID: "0d07b05a-e936-4270-a36e-f25820e43991") : secret "metrics-daemon-secret" not found May 25 12:13:52.443356 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:52.443316 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r6ssc\" (UniqueName: \"kubernetes.io/projected/a8c1a67f-b7f8-425e-8836-ec0ff5ffca44-kube-api-access-r6ssc\") pod \"network-check-target-26hst\" (UID: \"a8c1a67f-b7f8-425e-8836-ec0ff5ffca44\") " pod="openshift-network-diagnostics/network-check-target-26hst" May 25 12:13:52.446850 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:52.446828 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 25 12:13:52.456557 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:52.456523 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 25 12:13:52.468491 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:52.468460 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6ssc\" (UniqueName: \"kubernetes.io/projected/a8c1a67f-b7f8-425e-8836-ec0ff5ffca44-kube-api-access-r6ssc\") pod \"network-check-target-26hst\" (UID: \"a8c1a67f-b7f8-425e-8836-ec0ff5ffca44\") " pod="openshift-network-diagnostics/network-check-target-26hst" May 25 12:13:52.479180 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:52.479153 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wxdt4\"" May 25 12:13:52.487309 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:52.487289 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26hst" May 25 12:13:52.624204 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:52.624151 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-26hst"] May 25 12:13:52.627136 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:13:52.627109 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8c1a67f_b7f8_425e_8836_ec0ff5ffca44.slice/crio-45dafd6a2ce8b9a4437b49ba2f4667529f094796b08c2b35d2c4f82a67621043 WatchSource:0}: Error finding container 45dafd6a2ce8b9a4437b49ba2f4667529f094796b08c2b35d2c4f82a67621043: Status 404 returned error can't find the container with id 45dafd6a2ce8b9a4437b49ba2f4667529f094796b08c2b35d2c4f82a67621043 May 25 12:13:52.646854 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:52.646822 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49c5d043-eb23-43a4-afb0-0f5ebeba2e8d-cert\") pod \"ingress-canary-jd9hk\" (UID: \"49c5d043-eb23-43a4-afb0-0f5ebeba2e8d\") " pod="openshift-ingress-canary/ingress-canary-jd9hk" May 25 12:13:52.647025 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:52.646882 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd3923cb-c163-4844-b189-de774a7e7407-metrics-tls\") pod \"dns-default-l6n7f\" (UID: \"bd3923cb-c163-4844-b189-de774a7e7407\") " pod="openshift-dns/dns-default-l6n7f" May 25 12:13:52.647025 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:52.646982 2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 12:13:52.647025 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:52.646993 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 12:13:52.647224 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:52.647058 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd3923cb-c163-4844-b189-de774a7e7407-metrics-tls podName:bd3923cb-c163-4844-b189-de774a7e7407 nodeName:}" failed. No retries permitted until 2026-05-25 12:14:24.647038539 +0000 UTC m=+97.647826766 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd3923cb-c163-4844-b189-de774a7e7407-metrics-tls") pod "dns-default-l6n7f" (UID: "bd3923cb-c163-4844-b189-de774a7e7407") : secret "dns-default-metrics-tls" not found May 25 12:13:52.647224 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:13:52.647077 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49c5d043-eb23-43a4-afb0-0f5ebeba2e8d-cert podName:49c5d043-eb23-43a4-afb0-0f5ebeba2e8d nodeName:}" failed. No retries permitted until 2026-05-25 12:14:24.647067799 +0000 UTC m=+97.647856029 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/49c5d043-eb23-43a4-afb0-0f5ebeba2e8d-cert") pod "ingress-canary-jd9hk" (UID: "49c5d043-eb23-43a4-afb0-0f5ebeba2e8d") : secret "canary-serving-cert" not found May 25 12:13:52.910133 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:52.910027 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-26hst" event={"ID":"a8c1a67f-b7f8-425e-8836-ec0ff5ffca44","Type":"ContainerStarted","Data":"45dafd6a2ce8b9a4437b49ba2f4667529f094796b08c2b35d2c4f82a67621043"} May 25 12:13:56.919239 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:56.919206 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-26hst" event={"ID":"a8c1a67f-b7f8-425e-8836-ec0ff5ffca44","Type":"ContainerStarted","Data":"bfd1290cedecbc88ef290a00575f09791bc06c28ea84c5ff8363b908079371b0"} May 25 12:13:56.919704 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:56.919436 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-26hst" May 25 12:13:56.938278 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:13:56.938227 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-26hst" podStartSLOduration=66.151456751 podStartE2EDuration="1m9.938212542s" podCreationTimestamp="2026-05-25 12:12:47 +0000 UTC" firstStartedPulling="2026-05-25 12:13:52.628917808 +0000 UTC m=+65.629706035" lastFinishedPulling="2026-05-25 12:13:56.415673584 +0000 UTC m=+69.416461826" observedRunningTime="2026-05-25 12:13:56.937982339 +0000 UTC m=+69.938770588" watchObservedRunningTime="2026-05-25 12:13:56.938212542 +0000 UTC m=+69.939000791" May 25 12:14:24.670201 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:14:24.670160 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd3923cb-c163-4844-b189-de774a7e7407-metrics-tls\") pod \"dns-default-l6n7f\" (UID: \"bd3923cb-c163-4844-b189-de774a7e7407\") " pod="openshift-dns/dns-default-l6n7f" May 25 12:14:24.670593 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:14:24.670235 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49c5d043-eb23-43a4-afb0-0f5ebeba2e8d-cert\") pod \"ingress-canary-jd9hk\" (UID: \"49c5d043-eb23-43a4-afb0-0f5ebeba2e8d\") " pod="openshift-ingress-canary/ingress-canary-jd9hk" May 25 12:14:24.670593 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:14:24.670328 2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 12:14:24.670593 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:14:24.670328 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 12:14:24.670593 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:14:24.670399 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49c5d043-eb23-43a4-afb0-0f5ebeba2e8d-cert podName:49c5d043-eb23-43a4-afb0-0f5ebeba2e8d nodeName:}" failed. No retries permitted until 2026-05-25 12:15:28.670380039 +0000 UTC m=+161.671168271 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/49c5d043-eb23-43a4-afb0-0f5ebeba2e8d-cert") pod "ingress-canary-jd9hk" (UID: "49c5d043-eb23-43a4-afb0-0f5ebeba2e8d") : secret "canary-serving-cert" not found May 25 12:14:24.670593 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:14:24.670413 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd3923cb-c163-4844-b189-de774a7e7407-metrics-tls podName:bd3923cb-c163-4844-b189-de774a7e7407 nodeName:}" failed. No retries permitted until 2026-05-25 12:15:28.67040695 +0000 UTC m=+161.671195177 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd3923cb-c163-4844-b189-de774a7e7407-metrics-tls") pod "dns-default-l6n7f" (UID: "bd3923cb-c163-4844-b189-de774a7e7407") : secret "dns-default-metrics-tls" not found May 25 12:14:27.923730 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:14:27.923700 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-26hst" May 25 12:14:56.381430 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:14:56.381393 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d07b05a-e936-4270-a36e-f25820e43991-metrics-certs\") pod \"network-metrics-daemon-g6zkc\" (UID: \"0d07b05a-e936-4270-a36e-f25820e43991\") " pod="openshift-multus/network-metrics-daemon-g6zkc" May 25 12:14:56.381867 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:14:56.381510 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 25 12:14:56.381867 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:14:56.381576 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d07b05a-e936-4270-a36e-f25820e43991-metrics-certs podName:0d07b05a-e936-4270-a36e-f25820e43991 nodeName:}" failed. No retries permitted until 2026-05-25 12:16:58.381560699 +0000 UTC m=+251.382348930 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d07b05a-e936-4270-a36e-f25820e43991-metrics-certs") pod "network-metrics-daemon-g6zkc" (UID: "0d07b05a-e936-4270-a36e-f25820e43991") : secret "metrics-daemon-secret" not found May 25 12:15:08.757920 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:08.757865 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-gjgb8"] May 25 12:15:08.760373 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:08.760354 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-574b9ddcd4-5kbh6"] May 25 12:15:08.760521 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:08.760502 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-gjgb8" May 25 12:15:08.765753 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:08.765728 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-574b9ddcd4-5kbh6" May 25 12:15:08.765904 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:08.765811 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" May 25 12:15:08.767399 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:08.767375 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 25 12:15:08.767532 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:08.767439 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-nsb7d\"" May 25 12:15:08.767532 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:08.767379 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 25 12:15:08.767650 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:08.767607 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" May 25 12:15:08.769318 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:08.769302 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" May 25 12:15:08.769983 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:08.769964 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 25 12:15:08.770139 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:08.770124 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" May 25 12:15:08.770220 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:08.770204 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 25 12:15:08.770264 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:08.770247 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" May 25 12:15:08.770881 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:08.770867 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-2jzmm\"" May 25 12:15:08.770881 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:08.770874 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" May 25 12:15:08.777200 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:08.777177 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-gjgb8"] May 25 12:15:08.778086 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:08.778067 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-574b9ddcd4-5kbh6"] May 25 12:15:08.857680 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:08.857648 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/658c5966-fad8-4301-bed7-474492cdc44f-service-ca-bundle\") pod \"router-default-574b9ddcd4-5kbh6\" (UID: \"658c5966-fad8-4301-bed7-474492cdc44f\") " pod="openshift-ingress/router-default-574b9ddcd4-5kbh6" May 25 12:15:08.857680 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:08.857678 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/658c5966-fad8-4301-bed7-474492cdc44f-metrics-certs\") pod \"router-default-574b9ddcd4-5kbh6\" (UID: \"658c5966-fad8-4301-bed7-474492cdc44f\") " pod="openshift-ingress/router-default-574b9ddcd4-5kbh6" May 25 12:15:08.857886 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:08.857696 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pn2d8\" (UniqueName: \"kubernetes.io/projected/658c5966-fad8-4301-bed7-474492cdc44f-kube-api-access-pn2d8\") pod \"router-default-574b9ddcd4-5kbh6\" (UID: \"658c5966-fad8-4301-bed7-474492cdc44f\") " pod="openshift-ingress/router-default-574b9ddcd4-5kbh6" May 25 12:15:08.857886 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:08.857711 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a9b80b14-cbf7-45ac-89af-2f0ca563299d-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-gjgb8\" (UID: \"a9b80b14-cbf7-45ac-89af-2f0ca563299d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-gjgb8" May 25 12:15:08.857886 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:08.857795 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/658c5966-fad8-4301-bed7-474492cdc44f-default-certificate\") pod \"router-default-574b9ddcd4-5kbh6\" (UID: \"658c5966-fad8-4301-bed7-474492cdc44f\") " pod="openshift-ingress/router-default-574b9ddcd4-5kbh6" May 25 12:15:08.857886 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:08.857827 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/658c5966-fad8-4301-bed7-474492cdc44f-stats-auth\") pod \"router-default-574b9ddcd4-5kbh6\" (UID: \"658c5966-fad8-4301-bed7-474492cdc44f\") " pod="openshift-ingress/router-default-574b9ddcd4-5kbh6" May 25 12:15:08.857886 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:08.857844 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a9b80b14-cbf7-45ac-89af-2f0ca563299d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-gjgb8\" (UID: \"a9b80b14-cbf7-45ac-89af-2f0ca563299d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-gjgb8" May 25 12:15:08.857886 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:08.857862 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfwrn\" (UniqueName: \"kubernetes.io/projected/a9b80b14-cbf7-45ac-89af-2f0ca563299d-kube-api-access-bfwrn\") pod \"cluster-monitoring-operator-6c75959455-gjgb8\" (UID: \"a9b80b14-cbf7-45ac-89af-2f0ca563299d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-gjgb8" May 25 12:15:08.958156 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:08.958119 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/658c5966-fad8-4301-bed7-474492cdc44f-service-ca-bundle\") pod \"router-default-574b9ddcd4-5kbh6\" (UID: \"658c5966-fad8-4301-bed7-474492cdc44f\") " pod="openshift-ingress/router-default-574b9ddcd4-5kbh6" May 25 12:15:08.958156 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:08.958153 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/658c5966-fad8-4301-bed7-474492cdc44f-metrics-certs\") pod \"router-default-574b9ddcd4-5kbh6\" (UID: \"658c5966-fad8-4301-bed7-474492cdc44f\") " pod="openshift-ingress/router-default-574b9ddcd4-5kbh6" May 25 12:15:08.958388 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:08.958173 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pn2d8\" (UniqueName: \"kubernetes.io/projected/658c5966-fad8-4301-bed7-474492cdc44f-kube-api-access-pn2d8\") pod \"router-default-574b9ddcd4-5kbh6\" (UID: \"658c5966-fad8-4301-bed7-474492cdc44f\") " pod="openshift-ingress/router-default-574b9ddcd4-5kbh6" May 25 12:15:08.958388 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:15:08.958257 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 25 12:15:08.958388 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:08.958291 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a9b80b14-cbf7-45ac-89af-2f0ca563299d-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-gjgb8\" (UID: \"a9b80b14-cbf7-45ac-89af-2f0ca563299d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-gjgb8" May 25 12:15:08.958388 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:15:08.958294 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/658c5966-fad8-4301-bed7-474492cdc44f-service-ca-bundle podName:658c5966-fad8-4301-bed7-474492cdc44f nodeName:}" failed. No retries permitted until 2026-05-25 12:15:09.458276679 +0000 UTC m=+142.459064909 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/658c5966-fad8-4301-bed7-474492cdc44f-service-ca-bundle") pod "router-default-574b9ddcd4-5kbh6" (UID: "658c5966-fad8-4301-bed7-474492cdc44f") : configmap references non-existent config key: service-ca.crt May 25 12:15:08.958388 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:15:08.958334 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/658c5966-fad8-4301-bed7-474492cdc44f-metrics-certs podName:658c5966-fad8-4301-bed7-474492cdc44f nodeName:}" failed. No retries permitted until 2026-05-25 12:15:09.458318566 +0000 UTC m=+142.459106793 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/658c5966-fad8-4301-bed7-474492cdc44f-metrics-certs") pod "router-default-574b9ddcd4-5kbh6" (UID: "658c5966-fad8-4301-bed7-474492cdc44f") : secret "router-metrics-certs-default" not found May 25 12:15:08.958715 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:08.958401 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/658c5966-fad8-4301-bed7-474492cdc44f-default-certificate\") pod \"router-default-574b9ddcd4-5kbh6\" (UID: \"658c5966-fad8-4301-bed7-474492cdc44f\") " pod="openshift-ingress/router-default-574b9ddcd4-5kbh6" May 25 12:15:08.958715 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:08.958435 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/658c5966-fad8-4301-bed7-474492cdc44f-stats-auth\") pod \"router-default-574b9ddcd4-5kbh6\" (UID: \"658c5966-fad8-4301-bed7-474492cdc44f\") " pod="openshift-ingress/router-default-574b9ddcd4-5kbh6" May 25 12:15:08.958715 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:08.958455 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a9b80b14-cbf7-45ac-89af-2f0ca563299d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-gjgb8\" (UID: \"a9b80b14-cbf7-45ac-89af-2f0ca563299d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-gjgb8" May 25 12:15:08.958715 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:08.958477 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bfwrn\" (UniqueName: \"kubernetes.io/projected/a9b80b14-cbf7-45ac-89af-2f0ca563299d-kube-api-access-bfwrn\") pod \"cluster-monitoring-operator-6c75959455-gjgb8\" (UID: \"a9b80b14-cbf7-45ac-89af-2f0ca563299d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-gjgb8" May 25 12:15:08.958715 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:15:08.958578 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 25 12:15:08.958715 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:15:08.958642 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9b80b14-cbf7-45ac-89af-2f0ca563299d-cluster-monitoring-operator-tls podName:a9b80b14-cbf7-45ac-89af-2f0ca563299d nodeName:}" failed. No retries permitted until 2026-05-25 12:15:09.45862737 +0000 UTC m=+142.459415600 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a9b80b14-cbf7-45ac-89af-2f0ca563299d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-gjgb8" (UID: "a9b80b14-cbf7-45ac-89af-2f0ca563299d") : secret "cluster-monitoring-operator-tls" not found May 25 12:15:08.958988 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:08.958972 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a9b80b14-cbf7-45ac-89af-2f0ca563299d-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-gjgb8\" (UID: \"a9b80b14-cbf7-45ac-89af-2f0ca563299d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-gjgb8" May 25 12:15:08.960973 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:08.960951 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/658c5966-fad8-4301-bed7-474492cdc44f-default-certificate\") pod \"router-default-574b9ddcd4-5kbh6\" (UID: \"658c5966-fad8-4301-bed7-474492cdc44f\") " pod="openshift-ingress/router-default-574b9ddcd4-5kbh6" May 25 12:15:08.961619 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:08.961600 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/658c5966-fad8-4301-bed7-474492cdc44f-stats-auth\") pod \"router-default-574b9ddcd4-5kbh6\" (UID: \"658c5966-fad8-4301-bed7-474492cdc44f\") " pod="openshift-ingress/router-default-574b9ddcd4-5kbh6" May 25 12:15:08.968590 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:08.968560 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfwrn\" (UniqueName: \"kubernetes.io/projected/a9b80b14-cbf7-45ac-89af-2f0ca563299d-kube-api-access-bfwrn\") pod \"cluster-monitoring-operator-6c75959455-gjgb8\" (UID: \"a9b80b14-cbf7-45ac-89af-2f0ca563299d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-gjgb8" May 25 12:15:08.969260 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:08.969242 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pn2d8\" (UniqueName: \"kubernetes.io/projected/658c5966-fad8-4301-bed7-474492cdc44f-kube-api-access-pn2d8\") pod \"router-default-574b9ddcd4-5kbh6\" (UID: \"658c5966-fad8-4301-bed7-474492cdc44f\") " pod="openshift-ingress/router-default-574b9ddcd4-5kbh6" May 25 12:15:09.463542 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:09.463487 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a9b80b14-cbf7-45ac-89af-2f0ca563299d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-gjgb8\" (UID: \"a9b80b14-cbf7-45ac-89af-2f0ca563299d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-gjgb8" May 25 12:15:09.463542 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:09.463552 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/658c5966-fad8-4301-bed7-474492cdc44f-service-ca-bundle\") pod \"router-default-574b9ddcd4-5kbh6\" (UID: \"658c5966-fad8-4301-bed7-474492cdc44f\") " pod="openshift-ingress/router-default-574b9ddcd4-5kbh6" May 25 12:15:09.463769 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:09.463571 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/658c5966-fad8-4301-bed7-474492cdc44f-metrics-certs\") pod \"router-default-574b9ddcd4-5kbh6\" (UID: \"658c5966-fad8-4301-bed7-474492cdc44f\") " pod="openshift-ingress/router-default-574b9ddcd4-5kbh6" May 25 12:15:09.463769 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:15:09.463633 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 25 12:15:09.463769 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:15:09.463671 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 25 12:15:09.463769 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:15:09.463690 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/658c5966-fad8-4301-bed7-474492cdc44f-service-ca-bundle podName:658c5966-fad8-4301-bed7-474492cdc44f nodeName:}" failed. No retries permitted until 2026-05-25 12:15:10.463671104 +0000 UTC m=+143.464459342 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/658c5966-fad8-4301-bed7-474492cdc44f-service-ca-bundle") pod "router-default-574b9ddcd4-5kbh6" (UID: "658c5966-fad8-4301-bed7-474492cdc44f") : configmap references non-existent config key: service-ca.crt May 25 12:15:09.463769 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:15:09.463713 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/658c5966-fad8-4301-bed7-474492cdc44f-metrics-certs podName:658c5966-fad8-4301-bed7-474492cdc44f nodeName:}" failed. No retries permitted until 2026-05-25 12:15:10.463701451 +0000 UTC m=+143.464489701 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/658c5966-fad8-4301-bed7-474492cdc44f-metrics-certs") pod "router-default-574b9ddcd4-5kbh6" (UID: "658c5966-fad8-4301-bed7-474492cdc44f") : secret "router-metrics-certs-default" not found May 25 12:15:09.463769 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:15:09.463725 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9b80b14-cbf7-45ac-89af-2f0ca563299d-cluster-monitoring-operator-tls podName:a9b80b14-cbf7-45ac-89af-2f0ca563299d nodeName:}" failed. No retries permitted until 2026-05-25 12:15:10.463718878 +0000 UTC m=+143.464507108 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a9b80b14-cbf7-45ac-89af-2f0ca563299d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-gjgb8" (UID: "a9b80b14-cbf7-45ac-89af-2f0ca563299d") : secret "cluster-monitoring-operator-tls" not found May 25 12:15:10.470778 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:10.470732 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a9b80b14-cbf7-45ac-89af-2f0ca563299d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-gjgb8\" (UID: \"a9b80b14-cbf7-45ac-89af-2f0ca563299d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-gjgb8" May 25 12:15:10.470778 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:10.470792 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/658c5966-fad8-4301-bed7-474492cdc44f-service-ca-bundle\") pod \"router-default-574b9ddcd4-5kbh6\" (UID: \"658c5966-fad8-4301-bed7-474492cdc44f\") " pod="openshift-ingress/router-default-574b9ddcd4-5kbh6" May 25 12:15:10.471251 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:10.470812 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/658c5966-fad8-4301-bed7-474492cdc44f-metrics-certs\") pod \"router-default-574b9ddcd4-5kbh6\" (UID: \"658c5966-fad8-4301-bed7-474492cdc44f\") " pod="openshift-ingress/router-default-574b9ddcd4-5kbh6" May 25 12:15:10.471251 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:15:10.470894 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 25 12:15:10.471251 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:15:10.470926 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/658c5966-fad8-4301-bed7-474492cdc44f-service-ca-bundle podName:658c5966-fad8-4301-bed7-474492cdc44f nodeName:}" failed. No retries permitted until 2026-05-25 12:15:12.470908768 +0000 UTC m=+145.471696998 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/658c5966-fad8-4301-bed7-474492cdc44f-service-ca-bundle") pod "router-default-574b9ddcd4-5kbh6" (UID: "658c5966-fad8-4301-bed7-474492cdc44f") : configmap references non-existent config key: service-ca.crt May 25 12:15:10.471251 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:15:10.470899 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 25 12:15:10.471251 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:15:10.470946 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9b80b14-cbf7-45ac-89af-2f0ca563299d-cluster-monitoring-operator-tls podName:a9b80b14-cbf7-45ac-89af-2f0ca563299d nodeName:}" failed. No retries permitted until 2026-05-25 12:15:12.47093951 +0000 UTC m=+145.471727736 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a9b80b14-cbf7-45ac-89af-2f0ca563299d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-gjgb8" (UID: "a9b80b14-cbf7-45ac-89af-2f0ca563299d") : secret "cluster-monitoring-operator-tls" not found May 25 12:15:10.471251 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:15:10.470963 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/658c5966-fad8-4301-bed7-474492cdc44f-metrics-certs podName:658c5966-fad8-4301-bed7-474492cdc44f nodeName:}" failed. No retries permitted until 2026-05-25 12:15:12.47095155 +0000 UTC m=+145.471739777 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/658c5966-fad8-4301-bed7-474492cdc44f-metrics-certs") pod "router-default-574b9ddcd4-5kbh6" (UID: "658c5966-fad8-4301-bed7-474492cdc44f") : secret "router-metrics-certs-default" not found May 25 12:15:12.485619 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:12.485564 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/658c5966-fad8-4301-bed7-474492cdc44f-service-ca-bundle\") pod \"router-default-574b9ddcd4-5kbh6\" (UID: \"658c5966-fad8-4301-bed7-474492cdc44f\") " pod="openshift-ingress/router-default-574b9ddcd4-5kbh6" May 25 12:15:12.485619 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:12.485618 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/658c5966-fad8-4301-bed7-474492cdc44f-metrics-certs\") pod \"router-default-574b9ddcd4-5kbh6\" (UID: \"658c5966-fad8-4301-bed7-474492cdc44f\") " pod="openshift-ingress/router-default-574b9ddcd4-5kbh6" May 25 12:15:12.486234 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:15:12.485708 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 25 12:15:12.486234 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:15:12.485754 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/658c5966-fad8-4301-bed7-474492cdc44f-metrics-certs podName:658c5966-fad8-4301-bed7-474492cdc44f nodeName:}" failed. No retries permitted until 2026-05-25 12:15:16.485741171 +0000 UTC m=+149.486529421 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/658c5966-fad8-4301-bed7-474492cdc44f-metrics-certs") pod "router-default-574b9ddcd4-5kbh6" (UID: "658c5966-fad8-4301-bed7-474492cdc44f") : secret "router-metrics-certs-default" not found May 25 12:15:12.486234 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:15:12.485766 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/658c5966-fad8-4301-bed7-474492cdc44f-service-ca-bundle podName:658c5966-fad8-4301-bed7-474492cdc44f nodeName:}" failed. No retries permitted until 2026-05-25 12:15:16.485760376 +0000 UTC m=+149.486548603 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/658c5966-fad8-4301-bed7-474492cdc44f-service-ca-bundle") pod "router-default-574b9ddcd4-5kbh6" (UID: "658c5966-fad8-4301-bed7-474492cdc44f") : configmap references non-existent config key: service-ca.crt May 25 12:15:12.486234 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:12.485814 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a9b80b14-cbf7-45ac-89af-2f0ca563299d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-gjgb8\" (UID: \"a9b80b14-cbf7-45ac-89af-2f0ca563299d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-gjgb8" May 25 12:15:12.486234 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:15:12.485875 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 25 12:15:12.486234 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:15:12.485900 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9b80b14-cbf7-45ac-89af-2f0ca563299d-cluster-monitoring-operator-tls podName:a9b80b14-cbf7-45ac-89af-2f0ca563299d nodeName:}" failed. No retries permitted until 2026-05-25 12:15:16.485893856 +0000 UTC m=+149.486682083 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a9b80b14-cbf7-45ac-89af-2f0ca563299d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-gjgb8" (UID: "a9b80b14-cbf7-45ac-89af-2f0ca563299d") : secret "cluster-monitoring-operator-tls" not found May 25 12:15:14.681109 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:14.681067 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-wgnbb"] May 25 12:15:14.683944 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:14.683925 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-wgnbb" May 25 12:15:14.687796 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:14.687773 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" May 25 12:15:14.687796 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:14.687784 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-7vq48\"" May 25 12:15:14.687988 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:14.687784 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" May 25 12:15:14.693193 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:14.693173 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-wgnbb"] May 25 12:15:14.703644 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:14.703622 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chb6j\" (UniqueName: \"kubernetes.io/projected/3f950645-7082-4d5e-aec5-745bb3385c58-kube-api-access-chb6j\") pod \"migrator-b985f5d89-wgnbb\" (UID: \"3f950645-7082-4d5e-aec5-745bb3385c58\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-wgnbb" May 25 12:15:14.805080 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:14.805033 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-chb6j\" (UniqueName: \"kubernetes.io/projected/3f950645-7082-4d5e-aec5-745bb3385c58-kube-api-access-chb6j\") pod \"migrator-b985f5d89-wgnbb\" (UID: \"3f950645-7082-4d5e-aec5-745bb3385c58\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-wgnbb" May 25 12:15:14.813318 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:14.813287 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chb6j\" (UniqueName: \"kubernetes.io/projected/3f950645-7082-4d5e-aec5-745bb3385c58-kube-api-access-chb6j\") pod \"migrator-b985f5d89-wgnbb\" (UID: \"3f950645-7082-4d5e-aec5-745bb3385c58\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-wgnbb" May 25 12:15:14.992846 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:14.992749 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-wgnbb" May 25 12:15:15.113170 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:15.113139 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-wgnbb"] May 25 12:15:15.116234 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:15:15.116206 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f950645_7082_4d5e_aec5_745bb3385c58.slice/crio-e5ac7263ba31cf3d3d5ac51270a568686454a9b40ed99d02f5624bd62fd6b3ad WatchSource:0}: Error finding container e5ac7263ba31cf3d3d5ac51270a568686454a9b40ed99d02f5624bd62fd6b3ad: Status 404 returned error can't find the container with id e5ac7263ba31cf3d3d5ac51270a568686454a9b40ed99d02f5624bd62fd6b3ad May 25 12:15:16.069071 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:16.069035 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-wgnbb" event={"ID":"3f950645-7082-4d5e-aec5-745bb3385c58","Type":"ContainerStarted","Data":"e5ac7263ba31cf3d3d5ac51270a568686454a9b40ed99d02f5624bd62fd6b3ad"} May 25 12:15:16.122394 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:16.122371 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-zvx2b"] May 25 12:15:16.124916 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:16.124900 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-zvx2b" May 25 12:15:16.127548 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:16.127528 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-kl7sn\"" May 25 12:15:16.127636 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:16.127548 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" May 25 12:15:16.128876 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:16.128845 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" May 25 12:15:16.128951 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:16.128885 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" May 25 12:15:16.128951 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:16.128896 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" May 25 12:15:16.133814 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:16.133792 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-zvx2b"] May 25 12:15:16.215600 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:16.215574 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/85dec7b2-454d-4abc-af71-2bcaa0db9fef-signing-key\") pod \"service-ca-67d667c7d-zvx2b\" (UID: \"85dec7b2-454d-4abc-af71-2bcaa0db9fef\") " pod="openshift-service-ca/service-ca-67d667c7d-zvx2b" May 25 12:15:16.215707 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:16.215605 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/85dec7b2-454d-4abc-af71-2bcaa0db9fef-signing-cabundle\") pod \"service-ca-67d667c7d-zvx2b\" (UID: \"85dec7b2-454d-4abc-af71-2bcaa0db9fef\") " pod="openshift-service-ca/service-ca-67d667c7d-zvx2b" May 25 12:15:16.215749 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:16.215738 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j58p2\" (UniqueName: \"kubernetes.io/projected/85dec7b2-454d-4abc-af71-2bcaa0db9fef-kube-api-access-j58p2\") pod \"service-ca-67d667c7d-zvx2b\" (UID: \"85dec7b2-454d-4abc-af71-2bcaa0db9fef\") " pod="openshift-service-ca/service-ca-67d667c7d-zvx2b" May 25 12:15:16.316446 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:16.316400 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j58p2\" (UniqueName: \"kubernetes.io/projected/85dec7b2-454d-4abc-af71-2bcaa0db9fef-kube-api-access-j58p2\") pod \"service-ca-67d667c7d-zvx2b\" (UID: \"85dec7b2-454d-4abc-af71-2bcaa0db9fef\") " pod="openshift-service-ca/service-ca-67d667c7d-zvx2b" May 25 12:15:16.316617 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:16.316482 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/85dec7b2-454d-4abc-af71-2bcaa0db9fef-signing-key\") pod \"service-ca-67d667c7d-zvx2b\" (UID: \"85dec7b2-454d-4abc-af71-2bcaa0db9fef\") " pod="openshift-service-ca/service-ca-67d667c7d-zvx2b" May 25 12:15:16.316617 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:16.316501 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/85dec7b2-454d-4abc-af71-2bcaa0db9fef-signing-cabundle\") pod \"service-ca-67d667c7d-zvx2b\" (UID: \"85dec7b2-454d-4abc-af71-2bcaa0db9fef\") " pod="openshift-service-ca/service-ca-67d667c7d-zvx2b" May 25 12:15:16.317293 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:16.317269 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/85dec7b2-454d-4abc-af71-2bcaa0db9fef-signing-cabundle\") pod \"service-ca-67d667c7d-zvx2b\" (UID: \"85dec7b2-454d-4abc-af71-2bcaa0db9fef\") " pod="openshift-service-ca/service-ca-67d667c7d-zvx2b" May 25 12:15:16.319029 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:16.319009 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/85dec7b2-454d-4abc-af71-2bcaa0db9fef-signing-key\") pod \"service-ca-67d667c7d-zvx2b\" (UID: \"85dec7b2-454d-4abc-af71-2bcaa0db9fef\") " pod="openshift-service-ca/service-ca-67d667c7d-zvx2b" May 25 12:15:16.324246 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:16.324188 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j58p2\" (UniqueName: \"kubernetes.io/projected/85dec7b2-454d-4abc-af71-2bcaa0db9fef-kube-api-access-j58p2\") pod \"service-ca-67d667c7d-zvx2b\" (UID: \"85dec7b2-454d-4abc-af71-2bcaa0db9fef\") " pod="openshift-service-ca/service-ca-67d667c7d-zvx2b" May 25 12:15:16.440663 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:16.440612 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-zvx2b" May 25 12:15:16.518575 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:16.518547 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a9b80b14-cbf7-45ac-89af-2f0ca563299d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-gjgb8\" (UID: \"a9b80b14-cbf7-45ac-89af-2f0ca563299d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-gjgb8" May 25 12:15:16.518682 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:16.518595 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/658c5966-fad8-4301-bed7-474492cdc44f-service-ca-bundle\") pod \"router-default-574b9ddcd4-5kbh6\" (UID: \"658c5966-fad8-4301-bed7-474492cdc44f\") " pod="openshift-ingress/router-default-574b9ddcd4-5kbh6" May 25 12:15:16.518682 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:16.518615 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/658c5966-fad8-4301-bed7-474492cdc44f-metrics-certs\") pod \"router-default-574b9ddcd4-5kbh6\" (UID: \"658c5966-fad8-4301-bed7-474492cdc44f\") " pod="openshift-ingress/router-default-574b9ddcd4-5kbh6" May 25 12:15:16.518759 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:15:16.518706 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 25 12:15:16.518759 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:15:16.518716 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 25 12:15:16.518759 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:15:16.518754 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/658c5966-fad8-4301-bed7-474492cdc44f-metrics-certs podName:658c5966-fad8-4301-bed7-474492cdc44f nodeName:}" failed. No retries permitted until 2026-05-25 12:15:24.518738995 +0000 UTC m=+157.519527234 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/658c5966-fad8-4301-bed7-474492cdc44f-metrics-certs") pod "router-default-574b9ddcd4-5kbh6" (UID: "658c5966-fad8-4301-bed7-474492cdc44f") : secret "router-metrics-certs-default" not found May 25 12:15:16.518869 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:15:16.518778 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9b80b14-cbf7-45ac-89af-2f0ca563299d-cluster-monitoring-operator-tls podName:a9b80b14-cbf7-45ac-89af-2f0ca563299d nodeName:}" failed. No retries permitted until 2026-05-25 12:15:24.518760559 +0000 UTC m=+157.519548802 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a9b80b14-cbf7-45ac-89af-2f0ca563299d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-gjgb8" (UID: "a9b80b14-cbf7-45ac-89af-2f0ca563299d") : secret "cluster-monitoring-operator-tls" not found May 25 12:15:16.518869 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:15:16.518798 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/658c5966-fad8-4301-bed7-474492cdc44f-service-ca-bundle podName:658c5966-fad8-4301-bed7-474492cdc44f nodeName:}" failed. No retries permitted until 2026-05-25 12:15:24.518786897 +0000 UTC m=+157.519575130 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/658c5966-fad8-4301-bed7-474492cdc44f-service-ca-bundle") pod "router-default-574b9ddcd4-5kbh6" (UID: "658c5966-fad8-4301-bed7-474492cdc44f") : configmap references non-existent config key: service-ca.crt May 25 12:15:16.558506 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:16.558476 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-zvx2b"] May 25 12:15:16.561819 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:15:16.561790 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85dec7b2_454d_4abc_af71_2bcaa0db9fef.slice/crio-d929d7e3c797c7bc25ddcc86e5419f9f2bfb5aa8a1670a0779058d4e97a1d792 WatchSource:0}: Error finding container d929d7e3c797c7bc25ddcc86e5419f9f2bfb5aa8a1670a0779058d4e97a1d792: Status 404 returned error can't find the container with id d929d7e3c797c7bc25ddcc86e5419f9f2bfb5aa8a1670a0779058d4e97a1d792 May 25 12:15:17.071363 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:17.071322 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-zvx2b" event={"ID":"85dec7b2-454d-4abc-af71-2bcaa0db9fef","Type":"ContainerStarted","Data":"d929d7e3c797c7bc25ddcc86e5419f9f2bfb5aa8a1670a0779058d4e97a1d792"} May 25 12:15:17.072966 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:17.072938 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-wgnbb" event={"ID":"3f950645-7082-4d5e-aec5-745bb3385c58","Type":"ContainerStarted","Data":"9b3009892ce691cfb8dfc29121b227841345bb804e45faa5f265c79f93cdca82"} May 25 12:15:17.073076 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:17.072975 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-wgnbb" event={"ID":"3f950645-7082-4d5e-aec5-745bb3385c58","Type":"ContainerStarted","Data":"0b4574764ba93c2e125d2a4841138961783960a7ceb750dfe4bac6cce641b144"} May 25 12:15:17.088913 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:17.088862 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-wgnbb" podStartSLOduration=2.087058063 podStartE2EDuration="3.088844435s" podCreationTimestamp="2026-05-25 12:15:14 +0000 UTC" firstStartedPulling="2026-05-25 12:15:15.117784609 +0000 UTC m=+148.118572840" lastFinishedPulling="2026-05-25 12:15:16.119570982 +0000 UTC m=+149.120359212" observedRunningTime="2026-05-25 12:15:17.087995255 +0000 UTC m=+150.088783505" watchObservedRunningTime="2026-05-25 12:15:17.088844435 +0000 UTC m=+150.089632684" May 25 12:15:17.801251 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:17.801227 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wtj9s_5c30b440-4b5e-43ca-a622-bb74465cb79b/dns-node-resolver/0.log" May 25 12:15:18.601306 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:18.601188 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wtscn_88e5c705-ce9b-41eb-8d8e-3092d38d11bc/node-ca/0.log" May 25 12:15:19.078230 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:19.078195 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-zvx2b" event={"ID":"85dec7b2-454d-4abc-af71-2bcaa0db9fef","Type":"ContainerStarted","Data":"15e76953f5c6a1a89e63f3648472e0902592e9ee21f341df6e40d270708def6b"} May 25 12:15:19.092824 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:19.092682 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-zvx2b" podStartSLOduration=0.939053272 podStartE2EDuration="3.092663167s" podCreationTimestamp="2026-05-25 12:15:16 +0000 UTC" firstStartedPulling="2026-05-25 12:15:16.563608035 +0000 UTC m=+149.564396263" lastFinishedPulling="2026-05-25 12:15:18.717217918 +0000 UTC m=+151.718006158" observedRunningTime="2026-05-25 12:15:19.092234655 +0000 UTC m=+152.093022908" watchObservedRunningTime="2026-05-25 12:15:19.092663167 +0000 UTC m=+152.093451417" May 25 12:15:19.602002 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:19.601971 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-wgnbb_3f950645-7082-4d5e-aec5-745bb3385c58/migrator/0.log" May 25 12:15:19.800977 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:19.800944 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-wgnbb_3f950645-7082-4d5e-aec5-745bb3385c58/graceful-termination/0.log" May 25 12:15:23.823945 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:15:23.823893 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-l6n7f" podUID="bd3923cb-c163-4844-b189-de774a7e7407" May 25 12:15:23.832003 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:15:23.831976 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-jd9hk" podUID="49c5d043-eb23-43a4-afb0-0f5ebeba2e8d" May 25 12:15:24.087298 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:24.087226 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jd9hk" May 25 12:15:24.087298 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:24.087287 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l6n7f" May 25 12:15:24.589144 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:24.589106 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a9b80b14-cbf7-45ac-89af-2f0ca563299d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-gjgb8\" (UID: \"a9b80b14-cbf7-45ac-89af-2f0ca563299d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-gjgb8" May 25 12:15:24.589358 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:24.589159 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/658c5966-fad8-4301-bed7-474492cdc44f-service-ca-bundle\") pod \"router-default-574b9ddcd4-5kbh6\" (UID: \"658c5966-fad8-4301-bed7-474492cdc44f\") " pod="openshift-ingress/router-default-574b9ddcd4-5kbh6" May 25 12:15:24.589358 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:24.589188 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/658c5966-fad8-4301-bed7-474492cdc44f-metrics-certs\") pod \"router-default-574b9ddcd4-5kbh6\" (UID: \"658c5966-fad8-4301-bed7-474492cdc44f\") " pod="openshift-ingress/router-default-574b9ddcd4-5kbh6" May 25 12:15:24.589358 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:15:24.589262 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 25 12:15:24.589358 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:15:24.589288 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 25 12:15:24.589358 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:15:24.589347 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9b80b14-cbf7-45ac-89af-2f0ca563299d-cluster-monitoring-operator-tls podName:a9b80b14-cbf7-45ac-89af-2f0ca563299d nodeName:}" failed. No retries permitted until 2026-05-25 12:15:40.589325779 +0000 UTC m=+173.590114013 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a9b80b14-cbf7-45ac-89af-2f0ca563299d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-gjgb8" (UID: "a9b80b14-cbf7-45ac-89af-2f0ca563299d") : secret "cluster-monitoring-operator-tls" not found May 25 12:15:24.589612 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:15:24.589366 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/658c5966-fad8-4301-bed7-474492cdc44f-metrics-certs podName:658c5966-fad8-4301-bed7-474492cdc44f nodeName:}" failed. No retries permitted until 2026-05-25 12:15:40.589356687 +0000 UTC m=+173.590144922 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/658c5966-fad8-4301-bed7-474492cdc44f-metrics-certs") pod "router-default-574b9ddcd4-5kbh6" (UID: "658c5966-fad8-4301-bed7-474492cdc44f") : secret "router-metrics-certs-default" not found May 25 12:15:24.589612 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:15:24.589382 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/658c5966-fad8-4301-bed7-474492cdc44f-service-ca-bundle podName:658c5966-fad8-4301-bed7-474492cdc44f nodeName:}" failed. No retries permitted until 2026-05-25 12:15:40.589372512 +0000 UTC m=+173.590160744 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/658c5966-fad8-4301-bed7-474492cdc44f-service-ca-bundle") pod "router-default-574b9ddcd4-5kbh6" (UID: "658c5966-fad8-4301-bed7-474492cdc44f") : configmap references non-existent config key: service-ca.crt May 25 12:15:25.568506 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:15:25.568471 2558 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-g6zkc" podUID="0d07b05a-e936-4270-a36e-f25820e43991" May 25 12:15:28.721967 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:28.721927 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49c5d043-eb23-43a4-afb0-0f5ebeba2e8d-cert\") pod \"ingress-canary-jd9hk\" (UID: \"49c5d043-eb23-43a4-afb0-0f5ebeba2e8d\") " pod="openshift-ingress-canary/ingress-canary-jd9hk" May 25 12:15:28.722401 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:28.722015 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd3923cb-c163-4844-b189-de774a7e7407-metrics-tls\") pod \"dns-default-l6n7f\" (UID: \"bd3923cb-c163-4844-b189-de774a7e7407\") " pod="openshift-dns/dns-default-l6n7f" May 25 12:15:28.724435 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:28.724414 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd3923cb-c163-4844-b189-de774a7e7407-metrics-tls\") pod \"dns-default-l6n7f\" (UID: \"bd3923cb-c163-4844-b189-de774a7e7407\") " pod="openshift-dns/dns-default-l6n7f" May 25 12:15:28.724573 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:28.724555 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49c5d043-eb23-43a4-afb0-0f5ebeba2e8d-cert\") pod \"ingress-canary-jd9hk\" (UID: \"49c5d043-eb23-43a4-afb0-0f5ebeba2e8d\") " pod="openshift-ingress-canary/ingress-canary-jd9hk" May 25 12:15:28.891894 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:28.891863 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zkb72\"" May 25 12:15:28.891894 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:28.891863 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fp9z9\"" May 25 12:15:28.898505 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:28.898484 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l6n7f" May 25 12:15:28.898620 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:28.898553 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jd9hk" May 25 12:15:29.031195 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:29.031125 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l6n7f"] May 25 12:15:29.033729 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:15:29.033695 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd3923cb_c163_4844_b189_de774a7e7407.slice/crio-f3179eb6cc9586d155198100d53261ffeda07cfd33941fabb9de25b6584ced17 WatchSource:0}: Error finding container f3179eb6cc9586d155198100d53261ffeda07cfd33941fabb9de25b6584ced17: Status 404 returned error can't find the container with id f3179eb6cc9586d155198100d53261ffeda07cfd33941fabb9de25b6584ced17 May 25 12:15:29.046550 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:29.046526 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jd9hk"] May 25 12:15:29.049320 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:15:29.049291 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49c5d043_eb23_43a4_afb0_0f5ebeba2e8d.slice/crio-7d3a282a9193256c0d61986d385396d0d8a6bc690c3a7412a7988d8c0c3969be WatchSource:0}: Error finding container 7d3a282a9193256c0d61986d385396d0d8a6bc690c3a7412a7988d8c0c3969be: Status 404 returned error can't find the container with id 7d3a282a9193256c0d61986d385396d0d8a6bc690c3a7412a7988d8c0c3969be May 25 12:15:29.097376 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:29.097336 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l6n7f" event={"ID":"bd3923cb-c163-4844-b189-de774a7e7407","Type":"ContainerStarted","Data":"f3179eb6cc9586d155198100d53261ffeda07cfd33941fabb9de25b6584ced17"} May 25 12:15:29.098316 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:29.098292 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jd9hk" event={"ID":"49c5d043-eb23-43a4-afb0-0f5ebeba2e8d","Type":"ContainerStarted","Data":"7d3a282a9193256c0d61986d385396d0d8a6bc690c3a7412a7988d8c0c3969be"} May 25 12:15:31.107978 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:31.107909 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jd9hk" event={"ID":"49c5d043-eb23-43a4-afb0-0f5ebeba2e8d","Type":"ContainerStarted","Data":"3b88c19189ea24d1ad999a8e950752231c9807e4494fbbc8b9b8da4e467b7911"} May 25 12:15:31.123121 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:31.123051 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jd9hk" podStartSLOduration=129.156526316 podStartE2EDuration="2m11.123031933s" podCreationTimestamp="2026-05-25 12:13:20 +0000 UTC" firstStartedPulling="2026-05-25 12:15:29.051063793 +0000 UTC m=+162.051852022" lastFinishedPulling="2026-05-25 12:15:31.01756941 +0000 UTC m=+164.018357639" observedRunningTime="2026-05-25 12:15:31.122898317 +0000 UTC m=+164.123686567" watchObservedRunningTime="2026-05-25 12:15:31.123031933 +0000 UTC m=+164.123820184" May 25 12:15:32.117559 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:32.117472 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l6n7f" event={"ID":"bd3923cb-c163-4844-b189-de774a7e7407","Type":"ContainerStarted","Data":"d92c50a98c0d7a695cf69352e01dca35f64d3d5e813a9590487445d71ee197c4"} May 25 12:15:32.117559 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:32.117511 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l6n7f" event={"ID":"bd3923cb-c163-4844-b189-de774a7e7407","Type":"ContainerStarted","Data":"3620402fd51fe4a2176d339fbc5476f8153c323403a8bb4904b4bce939a64e59"} May 25 12:15:32.136579 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:32.136530 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-l6n7f" podStartSLOduration=130.153154753 podStartE2EDuration="2m12.136517126s" podCreationTimestamp="2026-05-25 12:13:20 +0000 UTC" firstStartedPulling="2026-05-25 12:15:29.035505998 +0000 UTC m=+162.036294228" lastFinishedPulling="2026-05-25 12:15:31.018868374 +0000 UTC m=+164.019656601" observedRunningTime="2026-05-25 12:15:32.134720872 +0000 UTC m=+165.135509120" watchObservedRunningTime="2026-05-25 12:15:32.136517126 +0000 UTC m=+165.137305369" May 25 12:15:33.119872 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:33.119831 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-l6n7f" May 25 12:15:36.760268 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:36.760231 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6bldh"] May 25 12:15:36.763360 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:36.763343 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6bldh" May 25 12:15:36.766591 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:36.766570 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 25 12:15:36.767924 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:36.767906 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 25 12:15:36.768032 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:36.767910 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 25 12:15:36.768032 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:36.767967 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-m27gk\"" May 25 12:15:36.768183 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:36.767910 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 25 12:15:36.784452 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:36.784424 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6bldh"] May 25 12:15:36.885011 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:36.884979 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/21bb0d2f-dfe2-4087-82a3-ed81f8782053-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6bldh\" (UID: \"21bb0d2f-dfe2-4087-82a3-ed81f8782053\") " pod="openshift-insights/insights-runtime-extractor-6bldh" May 25 12:15:36.885168 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:36.885017 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/21bb0d2f-dfe2-4087-82a3-ed81f8782053-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6bldh\" (UID: \"21bb0d2f-dfe2-4087-82a3-ed81f8782053\") " pod="openshift-insights/insights-runtime-extractor-6bldh" May 25 12:15:36.885168 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:36.885042 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/21bb0d2f-dfe2-4087-82a3-ed81f8782053-crio-socket\") pod \"insights-runtime-extractor-6bldh\" (UID: \"21bb0d2f-dfe2-4087-82a3-ed81f8782053\") " pod="openshift-insights/insights-runtime-extractor-6bldh" May 25 12:15:36.885168 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:36.885119 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/21bb0d2f-dfe2-4087-82a3-ed81f8782053-data-volume\") pod \"insights-runtime-extractor-6bldh\" (UID: \"21bb0d2f-dfe2-4087-82a3-ed81f8782053\") " pod="openshift-insights/insights-runtime-extractor-6bldh" May 25 12:15:36.885168 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:36.885145 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlwgc\" (UniqueName: \"kubernetes.io/projected/21bb0d2f-dfe2-4087-82a3-ed81f8782053-kube-api-access-tlwgc\") pod \"insights-runtime-extractor-6bldh\" (UID: \"21bb0d2f-dfe2-4087-82a3-ed81f8782053\") " pod="openshift-insights/insights-runtime-extractor-6bldh" May 25 12:15:36.986381 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:36.986343 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/21bb0d2f-dfe2-4087-82a3-ed81f8782053-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6bldh\" (UID: \"21bb0d2f-dfe2-4087-82a3-ed81f8782053\") " pod="openshift-insights/insights-runtime-extractor-6bldh" May 25 12:15:36.986381 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:36.986378 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/21bb0d2f-dfe2-4087-82a3-ed81f8782053-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6bldh\" (UID: \"21bb0d2f-dfe2-4087-82a3-ed81f8782053\") " pod="openshift-insights/insights-runtime-extractor-6bldh" May 25 12:15:36.986589 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:36.986400 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/21bb0d2f-dfe2-4087-82a3-ed81f8782053-crio-socket\") pod \"insights-runtime-extractor-6bldh\" (UID: \"21bb0d2f-dfe2-4087-82a3-ed81f8782053\") " pod="openshift-insights/insights-runtime-extractor-6bldh" May 25 12:15:36.986589 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:36.986428 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/21bb0d2f-dfe2-4087-82a3-ed81f8782053-data-volume\") pod \"insights-runtime-extractor-6bldh\" (UID: \"21bb0d2f-dfe2-4087-82a3-ed81f8782053\") " pod="openshift-insights/insights-runtime-extractor-6bldh" May 25 12:15:36.986589 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:36.986452 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tlwgc\" (UniqueName: \"kubernetes.io/projected/21bb0d2f-dfe2-4087-82a3-ed81f8782053-kube-api-access-tlwgc\") pod \"insights-runtime-extractor-6bldh\" (UID: \"21bb0d2f-dfe2-4087-82a3-ed81f8782053\") " pod="openshift-insights/insights-runtime-extractor-6bldh" May 25 12:15:36.986589 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:36.986513 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/21bb0d2f-dfe2-4087-82a3-ed81f8782053-crio-socket\") pod \"insights-runtime-extractor-6bldh\" (UID: \"21bb0d2f-dfe2-4087-82a3-ed81f8782053\") " pod="openshift-insights/insights-runtime-extractor-6bldh" May 25 12:15:36.986828 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:36.986808 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/21bb0d2f-dfe2-4087-82a3-ed81f8782053-data-volume\") pod \"insights-runtime-extractor-6bldh\" (UID: \"21bb0d2f-dfe2-4087-82a3-ed81f8782053\") " pod="openshift-insights/insights-runtime-extractor-6bldh" May 25 12:15:36.987007 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:36.986989 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/21bb0d2f-dfe2-4087-82a3-ed81f8782053-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6bldh\" (UID: \"21bb0d2f-dfe2-4087-82a3-ed81f8782053\") " pod="openshift-insights/insights-runtime-extractor-6bldh" May 25 12:15:36.989038 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:36.989017 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/21bb0d2f-dfe2-4087-82a3-ed81f8782053-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6bldh\" (UID: \"21bb0d2f-dfe2-4087-82a3-ed81f8782053\") " pod="openshift-insights/insights-runtime-extractor-6bldh" May 25 12:15:36.997046 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:36.997020 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlwgc\" (UniqueName: \"kubernetes.io/projected/21bb0d2f-dfe2-4087-82a3-ed81f8782053-kube-api-access-tlwgc\") pod \"insights-runtime-extractor-6bldh\" (UID: \"21bb0d2f-dfe2-4087-82a3-ed81f8782053\") " pod="openshift-insights/insights-runtime-extractor-6bldh" May 25 12:15:37.072123 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:37.072005 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6bldh" May 25 12:15:37.193932 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:37.193900 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6bldh"] May 25 12:15:37.197557 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:15:37.197528 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21bb0d2f_dfe2_4087_82a3_ed81f8782053.slice/crio-ca490938d5f112b09f268574d09a2412fe020ac3c6c61c7ec7db6d71fb915d69 WatchSource:0}: Error finding container ca490938d5f112b09f268574d09a2412fe020ac3c6c61c7ec7db6d71fb915d69: Status 404 returned error can't find the container with id ca490938d5f112b09f268574d09a2412fe020ac3c6c61c7ec7db6d71fb915d69 May 25 12:15:38.134559 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:38.134522 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6bldh" event={"ID":"21bb0d2f-dfe2-4087-82a3-ed81f8782053","Type":"ContainerStarted","Data":"3b4451e634069e37af1b7dfd621a708e76e16255a3e6cde8a713ac0d8795a55b"} May 25 12:15:38.134559 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:38.134563 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6bldh" event={"ID":"21bb0d2f-dfe2-4087-82a3-ed81f8782053","Type":"ContainerStarted","Data":"887c4d95a1d182142baf59156c9eda084fd980a451b7c50065493e3529d99b40"} May 25 12:15:38.134945 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:38.134575 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6bldh" event={"ID":"21bb0d2f-dfe2-4087-82a3-ed81f8782053","Type":"ContainerStarted","Data":"ca490938d5f112b09f268574d09a2412fe020ac3c6c61c7ec7db6d71fb915d69"} May 25 12:15:39.559073 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:39.559029 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6zkc" May 25 12:15:40.141592 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:40.141554 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6bldh" event={"ID":"21bb0d2f-dfe2-4087-82a3-ed81f8782053","Type":"ContainerStarted","Data":"f20366f1c2396581e587d653fc25a570ae666013e2807ed4d61775ffc61191eb"} May 25 12:15:40.159521 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:40.159464 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6bldh" podStartSLOduration=1.981340086 podStartE2EDuration="4.159449523s" podCreationTimestamp="2026-05-25 12:15:36 +0000 UTC" firstStartedPulling="2026-05-25 12:15:37.252713082 +0000 UTC m=+170.253501309" lastFinishedPulling="2026-05-25 12:15:39.430822517 +0000 UTC m=+172.431610746" observedRunningTime="2026-05-25 12:15:40.157434914 +0000 UTC m=+173.158223163" watchObservedRunningTime="2026-05-25 12:15:40.159449523 +0000 UTC m=+173.160237771" May 25 12:15:40.620899 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:40.620861 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/658c5966-fad8-4301-bed7-474492cdc44f-service-ca-bundle\") pod \"router-default-574b9ddcd4-5kbh6\" (UID: \"658c5966-fad8-4301-bed7-474492cdc44f\") " pod="openshift-ingress/router-default-574b9ddcd4-5kbh6" May 25 12:15:40.620899 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:40.620903 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/658c5966-fad8-4301-bed7-474492cdc44f-metrics-certs\") pod \"router-default-574b9ddcd4-5kbh6\" (UID: \"658c5966-fad8-4301-bed7-474492cdc44f\") " pod="openshift-ingress/router-default-574b9ddcd4-5kbh6" May 25 12:15:40.621344 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:40.620982 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a9b80b14-cbf7-45ac-89af-2f0ca563299d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-gjgb8\" (UID: \"a9b80b14-cbf7-45ac-89af-2f0ca563299d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-gjgb8" May 25 12:15:40.621600 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:40.621579 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/658c5966-fad8-4301-bed7-474492cdc44f-service-ca-bundle\") pod \"router-default-574b9ddcd4-5kbh6\" (UID: \"658c5966-fad8-4301-bed7-474492cdc44f\") " pod="openshift-ingress/router-default-574b9ddcd4-5kbh6" May 25 12:15:40.623404 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:40.623381 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/658c5966-fad8-4301-bed7-474492cdc44f-metrics-certs\") pod \"router-default-574b9ddcd4-5kbh6\" (UID: \"658c5966-fad8-4301-bed7-474492cdc44f\") " pod="openshift-ingress/router-default-574b9ddcd4-5kbh6" May 25 12:15:40.623801 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:40.623780 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a9b80b14-cbf7-45ac-89af-2f0ca563299d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-gjgb8\" (UID: \"a9b80b14-cbf7-45ac-89af-2f0ca563299d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-gjgb8" May 25 12:15:40.872675 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:40.872573 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-gjgb8" May 25 12:15:40.878309 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:40.878284 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-574b9ddcd4-5kbh6" May 25 12:15:41.002605 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:41.002568 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-gjgb8"] May 25 12:15:41.006210 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:15:41.006178 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9b80b14_cbf7_45ac_89af_2f0ca563299d.slice/crio-f9fbbc08a1d13bd9e3f3415efd91d798d8cff911f80fa06d16af46bad016cde9 WatchSource:0}: Error finding container f9fbbc08a1d13bd9e3f3415efd91d798d8cff911f80fa06d16af46bad016cde9: Status 404 returned error can't find the container with id f9fbbc08a1d13bd9e3f3415efd91d798d8cff911f80fa06d16af46bad016cde9 May 25 12:15:41.022865 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:41.022839 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-574b9ddcd4-5kbh6"] May 25 12:15:41.026783 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:15:41.026758 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod658c5966_fad8_4301_bed7_474492cdc44f.slice/crio-63fa62f6e5723f473f298f05db3278f4e9c1ba9faa8bf7c404bf20857150f35c WatchSource:0}: Error finding container 63fa62f6e5723f473f298f05db3278f4e9c1ba9faa8bf7c404bf20857150f35c: Status 404 returned error can't find the container with id 63fa62f6e5723f473f298f05db3278f4e9c1ba9faa8bf7c404bf20857150f35c May 25 12:15:41.145031 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:41.144953 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-574b9ddcd4-5kbh6" event={"ID":"658c5966-fad8-4301-bed7-474492cdc44f","Type":"ContainerStarted","Data":"71bb99b5c8052001a6dc3473eae062e755224f851ee88f620028e5b558503c04"} May 25 12:15:41.145031 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:41.144990 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-574b9ddcd4-5kbh6" event={"ID":"658c5966-fad8-4301-bed7-474492cdc44f","Type":"ContainerStarted","Data":"63fa62f6e5723f473f298f05db3278f4e9c1ba9faa8bf7c404bf20857150f35c"} May 25 12:15:41.146034 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:41.146012 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-gjgb8" event={"ID":"a9b80b14-cbf7-45ac-89af-2f0ca563299d","Type":"ContainerStarted","Data":"f9fbbc08a1d13bd9e3f3415efd91d798d8cff911f80fa06d16af46bad016cde9"} May 25 12:15:41.162231 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:41.162190 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-574b9ddcd4-5kbh6" podStartSLOduration=33.162176885 podStartE2EDuration="33.162176885s" podCreationTimestamp="2026-05-25 12:15:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 12:15:41.161637463 +0000 UTC m=+174.162425712" watchObservedRunningTime="2026-05-25 12:15:41.162176885 +0000 UTC m=+174.162965133" May 25 12:15:41.879166 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:41.879127 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-574b9ddcd4-5kbh6" May 25 12:15:41.881874 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:41.881846 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-574b9ddcd4-5kbh6" May 25 12:15:42.148490 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:42.148395 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-574b9ddcd4-5kbh6" May 25 12:15:42.149721 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:42.149697 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-574b9ddcd4-5kbh6" May 25 12:15:43.124384 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:43.124352 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-l6n7f" May 25 12:15:43.154698 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:43.153859 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-gjgb8" event={"ID":"a9b80b14-cbf7-45ac-89af-2f0ca563299d","Type":"ContainerStarted","Data":"fafd983c55f742b08149230067ef7b79518ac496cc630a72cc34c83fc171aafc"} May 25 12:15:43.170627 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:43.170565 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-gjgb8" podStartSLOduration=33.4464489 podStartE2EDuration="35.170548744s" podCreationTimestamp="2026-05-25 12:15:08 +0000 UTC" firstStartedPulling="2026-05-25 12:15:41.007952338 +0000 UTC m=+174.008740571" lastFinishedPulling="2026-05-25 12:15:42.732052189 +0000 UTC m=+175.732840415" observedRunningTime="2026-05-25 12:15:43.169685549 +0000 UTC m=+176.170473798" watchObservedRunningTime="2026-05-25 12:15:43.170548744 +0000 UTC m=+176.171336995" May 25 12:15:43.199300 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:43.199256 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-drlhp"] May 25 12:15:43.202520 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:43.202501 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-drlhp" May 25 12:15:43.205256 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:43.205233 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-jpzdj\"" May 25 12:15:43.205384 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:43.205232 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" May 25 12:15:43.208819 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:43.208797 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-drlhp"] May 25 12:15:43.342626 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:43.342582 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8b6f94b0-fafc-4bbd-a971-fe9f978645da-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-drlhp\" (UID: \"8b6f94b0-fafc-4bbd-a971-fe9f978645da\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-drlhp" May 25 12:15:43.443715 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:43.443627 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8b6f94b0-fafc-4bbd-a971-fe9f978645da-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-drlhp\" (UID: \"8b6f94b0-fafc-4bbd-a971-fe9f978645da\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-drlhp" May 25 12:15:43.446183 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:43.446149 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8b6f94b0-fafc-4bbd-a971-fe9f978645da-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-drlhp\" (UID: \"8b6f94b0-fafc-4bbd-a971-fe9f978645da\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-drlhp" May 25 12:15:43.513237 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:43.513200 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-drlhp" May 25 12:15:43.636924 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:43.636891 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-drlhp"] May 25 12:15:43.639936 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:15:43.639903 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b6f94b0_fafc_4bbd_a971_fe9f978645da.slice/crio-1e8d6c2a0179407c2739cd3f5598affcf70cded7c208eba6588bfe1169c9a2ed WatchSource:0}: Error finding container 1e8d6c2a0179407c2739cd3f5598affcf70cded7c208eba6588bfe1169c9a2ed: Status 404 returned error can't find the container with id 1e8d6c2a0179407c2739cd3f5598affcf70cded7c208eba6588bfe1169c9a2ed May 25 12:15:44.156653 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:44.156614 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-drlhp" event={"ID":"8b6f94b0-fafc-4bbd-a971-fe9f978645da","Type":"ContainerStarted","Data":"1e8d6c2a0179407c2739cd3f5598affcf70cded7c208eba6588bfe1169c9a2ed"} May 25 12:15:45.160646 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:45.160610 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-drlhp" event={"ID":"8b6f94b0-fafc-4bbd-a971-fe9f978645da","Type":"ContainerStarted","Data":"00fc0242338492f1bc6889e36d353fc2bd29f4d15e75f073de9485488cae1ec3"} May 25 12:15:45.161122 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:45.160811 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-drlhp" May 25 12:15:45.165960 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:45.165937 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-drlhp" May 25 12:15:45.180219 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:45.180175 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-drlhp" podStartSLOduration=1.113298933 podStartE2EDuration="2.18015888s" podCreationTimestamp="2026-05-25 12:15:43 +0000 UTC" firstStartedPulling="2026-05-25 12:15:43.64183104 +0000 UTC m=+176.642619267" lastFinishedPulling="2026-05-25 12:15:44.708690982 +0000 UTC m=+177.709479214" observedRunningTime="2026-05-25 12:15:45.179215501 +0000 UTC m=+178.180003752" watchObservedRunningTime="2026-05-25 12:15:45.18015888 +0000 UTC m=+178.180947135" May 25 12:15:58.621219 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.621182 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-q6j77"] May 25 12:15:58.627007 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.626989 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-q6j77" May 25 12:15:58.629781 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.629749 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" May 25 12:15:58.629914 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.629751 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" May 25 12:15:58.629914 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.629857 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-7mzlh\"" May 25 12:15:58.631058 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.631035 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 25 12:15:58.637841 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.637819 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-q6j77"] May 25 12:15:58.639436 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.639415 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dgf44"] May 25 12:15:58.643540 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.643518 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dgf44" May 25 12:15:58.646968 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.646950 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 25 12:15:58.647123 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.647081 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 25 12:15:58.647205 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.646977 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 25 12:15:58.647205 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.646988 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qb5mz\"" May 25 12:15:58.653719 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.653699 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-d6h5p"] May 25 12:15:58.657552 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.657535 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-d6h5p" May 25 12:15:58.659981 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.659960 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" May 25 12:15:58.660341 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.660276 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" May 25 12:15:58.660341 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.660309 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-qmhg9\"" May 25 12:15:58.660341 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.660318 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" May 25 12:15:58.667300 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.667281 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-d6h5p"] May 25 12:15:58.755025 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.754986 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/38a38a1a-53f0-498a-8e09-c274b365c58d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-q6j77\" (UID: \"38a38a1a-53f0-498a-8e09-c274b365c58d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-q6j77" May 25 12:15:58.755219 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.755028 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38a38a1a-53f0-498a-8e09-c274b365c58d-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-q6j77\" (UID: \"38a38a1a-53f0-498a-8e09-c274b365c58d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-q6j77" May 25 12:15:58.755219 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.755058 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0adb1f7c-393b-4690-b70b-8ffbb670d95e-node-exporter-tls\") pod \"node-exporter-dgf44\" (UID: \"0adb1f7c-393b-4690-b70b-8ffbb670d95e\") " pod="openshift-monitoring/node-exporter-dgf44" May 25 12:15:58.755219 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.755168 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/62b68527-00bb-4ed3-9b6c-ffa10beb044e-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-d6h5p\" (UID: \"62b68527-00bb-4ed3-9b6c-ffa10beb044e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-d6h5p" May 25 12:15:58.755219 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.755213 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/38a38a1a-53f0-498a-8e09-c274b365c58d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-q6j77\" (UID: \"38a38a1a-53f0-498a-8e09-c274b365c58d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-q6j77" May 25 12:15:58.755373 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.755253 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0adb1f7c-393b-4690-b70b-8ffbb670d95e-node-exporter-accelerators-collector-config\") pod \"node-exporter-dgf44\" (UID: \"0adb1f7c-393b-4690-b70b-8ffbb670d95e\") " pod="openshift-monitoring/node-exporter-dgf44" May 25 12:15:58.755373 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.755283 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rs7m\" (UniqueName: \"kubernetes.io/projected/0adb1f7c-393b-4690-b70b-8ffbb670d95e-kube-api-access-9rs7m\") pod \"node-exporter-dgf44\" (UID: \"0adb1f7c-393b-4690-b70b-8ffbb670d95e\") " pod="openshift-monitoring/node-exporter-dgf44" May 25 12:15:58.755373 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.755325 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0adb1f7c-393b-4690-b70b-8ffbb670d95e-sys\") pod \"node-exporter-dgf44\" (UID: \"0adb1f7c-393b-4690-b70b-8ffbb670d95e\") " pod="openshift-monitoring/node-exporter-dgf44" May 25 12:15:58.755373 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.755351 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0adb1f7c-393b-4690-b70b-8ffbb670d95e-metrics-client-ca\") pod \"node-exporter-dgf44\" (UID: \"0adb1f7c-393b-4690-b70b-8ffbb670d95e\") " pod="openshift-monitoring/node-exporter-dgf44" May 25 12:15:58.755514 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.755374 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftl6f\" (UniqueName: \"kubernetes.io/projected/38a38a1a-53f0-498a-8e09-c274b365c58d-kube-api-access-ftl6f\") pod \"openshift-state-metrics-9c959559f-q6j77\" (UID: \"38a38a1a-53f0-498a-8e09-c274b365c58d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-q6j77" May 25 12:15:58.755514 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.755415 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0adb1f7c-393b-4690-b70b-8ffbb670d95e-node-exporter-wtmp\") pod \"node-exporter-dgf44\" (UID: \"0adb1f7c-393b-4690-b70b-8ffbb670d95e\") " pod="openshift-monitoring/node-exporter-dgf44" May 25 12:15:58.755514 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.755441 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/62b68527-00bb-4ed3-9b6c-ffa10beb044e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-d6h5p\" (UID: \"62b68527-00bb-4ed3-9b6c-ffa10beb044e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-d6h5p" May 25 12:15:58.755514 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.755475 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/62b68527-00bb-4ed3-9b6c-ffa10beb044e-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-d6h5p\" (UID: \"62b68527-00bb-4ed3-9b6c-ffa10beb044e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-d6h5p" May 25 12:15:58.755514 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.755508 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0adb1f7c-393b-4690-b70b-8ffbb670d95e-node-exporter-textfile\") pod \"node-exporter-dgf44\" (UID: \"0adb1f7c-393b-4690-b70b-8ffbb670d95e\") " pod="openshift-monitoring/node-exporter-dgf44" May 25 12:15:58.755760 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.755573 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0adb1f7c-393b-4690-b70b-8ffbb670d95e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dgf44\" (UID: \"0adb1f7c-393b-4690-b70b-8ffbb670d95e\") " pod="openshift-monitoring/node-exporter-dgf44" May 25 12:15:58.755760 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.755608 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxdkk\" (UniqueName: \"kubernetes.io/projected/62b68527-00bb-4ed3-9b6c-ffa10beb044e-kube-api-access-mxdkk\") pod \"kube-state-metrics-54fd6bc5c4-d6h5p\" (UID: \"62b68527-00bb-4ed3-9b6c-ffa10beb044e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-d6h5p" May 25 12:15:58.755760 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.755639 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0adb1f7c-393b-4690-b70b-8ffbb670d95e-root\") pod \"node-exporter-dgf44\" (UID: \"0adb1f7c-393b-4690-b70b-8ffbb670d95e\") " pod="openshift-monitoring/node-exporter-dgf44" May 25 12:15:58.755760 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.755666 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62b68527-00bb-4ed3-9b6c-ffa10beb044e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-d6h5p\" (UID: \"62b68527-00bb-4ed3-9b6c-ffa10beb044e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-d6h5p" May 25 12:15:58.755760 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.755704 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62b68527-00bb-4ed3-9b6c-ffa10beb044e-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-d6h5p\" (UID: \"62b68527-00bb-4ed3-9b6c-ffa10beb044e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-d6h5p" May 25 12:15:58.856139 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.856107 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0adb1f7c-393b-4690-b70b-8ffbb670d95e-node-exporter-wtmp\") pod \"node-exporter-dgf44\" (UID: \"0adb1f7c-393b-4690-b70b-8ffbb670d95e\") " pod="openshift-monitoring/node-exporter-dgf44" May 25 12:15:58.856302 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.856152 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/62b68527-00bb-4ed3-9b6c-ffa10beb044e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-d6h5p\" (UID: \"62b68527-00bb-4ed3-9b6c-ffa10beb044e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-d6h5p" May 25 12:15:58.856302 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.856188 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/62b68527-00bb-4ed3-9b6c-ffa10beb044e-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-d6h5p\" (UID: \"62b68527-00bb-4ed3-9b6c-ffa10beb044e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-d6h5p" May 25 12:15:58.856302 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.856216 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0adb1f7c-393b-4690-b70b-8ffbb670d95e-node-exporter-textfile\") pod \"node-exporter-dgf44\" (UID: \"0adb1f7c-393b-4690-b70b-8ffbb670d95e\") " pod="openshift-monitoring/node-exporter-dgf44" May 25 12:15:58.856302 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.856245 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0adb1f7c-393b-4690-b70b-8ffbb670d95e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dgf44\" (UID: \"0adb1f7c-393b-4690-b70b-8ffbb670d95e\") " pod="openshift-monitoring/node-exporter-dgf44" May 25 12:15:58.856302 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.856251 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0adb1f7c-393b-4690-b70b-8ffbb670d95e-node-exporter-wtmp\") pod \"node-exporter-dgf44\" (UID: \"0adb1f7c-393b-4690-b70b-8ffbb670d95e\") " pod="openshift-monitoring/node-exporter-dgf44" May 25 12:15:58.856302 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.856271 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mxdkk\" (UniqueName: \"kubernetes.io/projected/62b68527-00bb-4ed3-9b6c-ffa10beb044e-kube-api-access-mxdkk\") pod \"kube-state-metrics-54fd6bc5c4-d6h5p\" (UID: \"62b68527-00bb-4ed3-9b6c-ffa10beb044e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-d6h5p" May 25 12:15:58.856302 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.856297 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0adb1f7c-393b-4690-b70b-8ffbb670d95e-root\") pod \"node-exporter-dgf44\" (UID: \"0adb1f7c-393b-4690-b70b-8ffbb670d95e\") " pod="openshift-monitoring/node-exporter-dgf44" May 25 12:15:58.856651 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.856324 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62b68527-00bb-4ed3-9b6c-ffa10beb044e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-d6h5p\" (UID: \"62b68527-00bb-4ed3-9b6c-ffa10beb044e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-d6h5p" May 25 12:15:58.856651 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.856361 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62b68527-00bb-4ed3-9b6c-ffa10beb044e-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-d6h5p\" (UID: \"62b68527-00bb-4ed3-9b6c-ffa10beb044e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-d6h5p" May 25 12:15:58.856651 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.856384 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0adb1f7c-393b-4690-b70b-8ffbb670d95e-root\") pod \"node-exporter-dgf44\" (UID: \"0adb1f7c-393b-4690-b70b-8ffbb670d95e\") " pod="openshift-monitoring/node-exporter-dgf44" May 25 12:15:58.856651 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.856389 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/38a38a1a-53f0-498a-8e09-c274b365c58d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-q6j77\" (UID: \"38a38a1a-53f0-498a-8e09-c274b365c58d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-q6j77" May 25 12:15:58.856651 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.856441 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38a38a1a-53f0-498a-8e09-c274b365c58d-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-q6j77\" (UID: \"38a38a1a-53f0-498a-8e09-c274b365c58d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-q6j77" May 25 12:15:58.856651 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.856470 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0adb1f7c-393b-4690-b70b-8ffbb670d95e-node-exporter-tls\") pod \"node-exporter-dgf44\" (UID: \"0adb1f7c-393b-4690-b70b-8ffbb670d95e\") " pod="openshift-monitoring/node-exporter-dgf44" May 25 12:15:58.856651 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:15:58.856483 2558 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found May 25 12:15:58.856651 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.856502 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/62b68527-00bb-4ed3-9b6c-ffa10beb044e-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-d6h5p\" (UID: \"62b68527-00bb-4ed3-9b6c-ffa10beb044e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-d6h5p" May 25 12:15:58.856651 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:15:58.856547 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38a38a1a-53f0-498a-8e09-c274b365c58d-openshift-state-metrics-tls podName:38a38a1a-53f0-498a-8e09-c274b365c58d nodeName:}" failed. No retries permitted until 2026-05-25 12:15:59.356526325 +0000 UTC m=+192.357314566 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/38a38a1a-53f0-498a-8e09-c274b365c58d-openshift-state-metrics-tls") pod "openshift-state-metrics-9c959559f-q6j77" (UID: "38a38a1a-53f0-498a-8e09-c274b365c58d") : secret "openshift-state-metrics-tls" not found May 25 12:15:58.856651 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.856566 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/38a38a1a-53f0-498a-8e09-c274b365c58d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-q6j77\" (UID: \"38a38a1a-53f0-498a-8e09-c274b365c58d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-q6j77" May 25 12:15:58.856651 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.856607 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0adb1f7c-393b-4690-b70b-8ffbb670d95e-node-exporter-accelerators-collector-config\") pod \"node-exporter-dgf44\" (UID: \"0adb1f7c-393b-4690-b70b-8ffbb670d95e\") " pod="openshift-monitoring/node-exporter-dgf44" May 25 12:15:58.856651 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.856619 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0adb1f7c-393b-4690-b70b-8ffbb670d95e-node-exporter-textfile\") pod \"node-exporter-dgf44\" (UID: \"0adb1f7c-393b-4690-b70b-8ffbb670d95e\") " pod="openshift-monitoring/node-exporter-dgf44" May 25 12:15:58.856651 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.856635 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9rs7m\" (UniqueName: \"kubernetes.io/projected/0adb1f7c-393b-4690-b70b-8ffbb670d95e-kube-api-access-9rs7m\") pod \"node-exporter-dgf44\" (UID: \"0adb1f7c-393b-4690-b70b-8ffbb670d95e\") " pod="openshift-monitoring/node-exporter-dgf44" May 25 12:15:58.857380 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.856674 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0adb1f7c-393b-4690-b70b-8ffbb670d95e-sys\") pod \"node-exporter-dgf44\" (UID: \"0adb1f7c-393b-4690-b70b-8ffbb670d95e\") " pod="openshift-monitoring/node-exporter-dgf44" May 25 12:15:58.857380 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.856700 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0adb1f7c-393b-4690-b70b-8ffbb670d95e-metrics-client-ca\") pod \"node-exporter-dgf44\" (UID: \"0adb1f7c-393b-4690-b70b-8ffbb670d95e\") " pod="openshift-monitoring/node-exporter-dgf44" May 25 12:15:58.857380 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.856728 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ftl6f\" (UniqueName: \"kubernetes.io/projected/38a38a1a-53f0-498a-8e09-c274b365c58d-kube-api-access-ftl6f\") pod \"openshift-state-metrics-9c959559f-q6j77\" (UID: \"38a38a1a-53f0-498a-8e09-c274b365c58d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-q6j77" May 25 12:15:58.857380 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.856934 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/62b68527-00bb-4ed3-9b6c-ffa10beb044e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-d6h5p\" (UID: \"62b68527-00bb-4ed3-9b6c-ffa10beb044e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-d6h5p" May 25 12:15:58.857380 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.857031 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0adb1f7c-393b-4690-b70b-8ffbb670d95e-sys\") pod \"node-exporter-dgf44\" (UID: \"0adb1f7c-393b-4690-b70b-8ffbb670d95e\") " pod="openshift-monitoring/node-exporter-dgf44" May 25 12:15:58.857380 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.857347 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38a38a1a-53f0-498a-8e09-c274b365c58d-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-q6j77\" (UID: \"38a38a1a-53f0-498a-8e09-c274b365c58d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-q6j77" May 25 12:15:58.857652 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.857477 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62b68527-00bb-4ed3-9b6c-ffa10beb044e-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-d6h5p\" (UID: \"62b68527-00bb-4ed3-9b6c-ffa10beb044e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-d6h5p" May 25 12:15:58.857652 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.857529 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0adb1f7c-393b-4690-b70b-8ffbb670d95e-metrics-client-ca\") pod \"node-exporter-dgf44\" (UID: \"0adb1f7c-393b-4690-b70b-8ffbb670d95e\") " pod="openshift-monitoring/node-exporter-dgf44" May 25 12:15:58.857652 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:15:58.857619 2558 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found May 25 12:15:58.857804 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:15:58.857666 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0adb1f7c-393b-4690-b70b-8ffbb670d95e-node-exporter-tls podName:0adb1f7c-393b-4690-b70b-8ffbb670d95e nodeName:}" failed. No retries permitted until 2026-05-25 12:15:59.357650181 +0000 UTC m=+192.358438422 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0adb1f7c-393b-4690-b70b-8ffbb670d95e-node-exporter-tls") pod "node-exporter-dgf44" (UID: "0adb1f7c-393b-4690-b70b-8ffbb670d95e") : secret "node-exporter-tls" not found May 25 12:15:58.858122 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.858079 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0adb1f7c-393b-4690-b70b-8ffbb670d95e-node-exporter-accelerators-collector-config\") pod \"node-exporter-dgf44\" (UID: \"0adb1f7c-393b-4690-b70b-8ffbb670d95e\") " pod="openshift-monitoring/node-exporter-dgf44" May 25 12:15:58.858263 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.858199 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/62b68527-00bb-4ed3-9b6c-ffa10beb044e-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-d6h5p\" (UID: \"62b68527-00bb-4ed3-9b6c-ffa10beb044e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-d6h5p" May 25 12:15:58.859417 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.859397 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/62b68527-00bb-4ed3-9b6c-ffa10beb044e-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-d6h5p\" (UID: \"62b68527-00bb-4ed3-9b6c-ffa10beb044e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-d6h5p" May 25 12:15:58.859829 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.859802 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/38a38a1a-53f0-498a-8e09-c274b365c58d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-q6j77\" (UID: \"38a38a1a-53f0-498a-8e09-c274b365c58d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-q6j77" May 25 12:15:58.860240 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.860218 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62b68527-00bb-4ed3-9b6c-ffa10beb044e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-d6h5p\" (UID: \"62b68527-00bb-4ed3-9b6c-ffa10beb044e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-d6h5p" May 25 12:15:58.860661 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.860644 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0adb1f7c-393b-4690-b70b-8ffbb670d95e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dgf44\" (UID: \"0adb1f7c-393b-4690-b70b-8ffbb670d95e\") " pod="openshift-monitoring/node-exporter-dgf44" May 25 12:15:58.864701 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.864681 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxdkk\" (UniqueName: \"kubernetes.io/projected/62b68527-00bb-4ed3-9b6c-ffa10beb044e-kube-api-access-mxdkk\") pod \"kube-state-metrics-54fd6bc5c4-d6h5p\" (UID: \"62b68527-00bb-4ed3-9b6c-ffa10beb044e\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-d6h5p" May 25 12:15:58.868796 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.868732 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rs7m\" (UniqueName: \"kubernetes.io/projected/0adb1f7c-393b-4690-b70b-8ffbb670d95e-kube-api-access-9rs7m\") pod \"node-exporter-dgf44\" (UID: \"0adb1f7c-393b-4690-b70b-8ffbb670d95e\") " pod="openshift-monitoring/node-exporter-dgf44" May 25 12:15:58.868908 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.868857 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftl6f\" (UniqueName: \"kubernetes.io/projected/38a38a1a-53f0-498a-8e09-c274b365c58d-kube-api-access-ftl6f\") pod \"openshift-state-metrics-9c959559f-q6j77\" (UID: \"38a38a1a-53f0-498a-8e09-c274b365c58d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-q6j77" May 25 12:15:58.967393 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:58.967306 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-d6h5p" May 25 12:15:59.101575 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.101543 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-d6h5p"] May 25 12:15:59.104780 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:15:59.104749 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62b68527_00bb_4ed3_9b6c_ffa10beb044e.slice/crio-fa6655b808b7b94a48d289558ae76d1e33389d91b01f59c32968c5b1847d96dd WatchSource:0}: Error finding container fa6655b808b7b94a48d289558ae76d1e33389d91b01f59c32968c5b1847d96dd: Status 404 returned error can't find the container with id fa6655b808b7b94a48d289558ae76d1e33389d91b01f59c32968c5b1847d96dd May 25 12:15:59.197388 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.197344 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-d6h5p" event={"ID":"62b68527-00bb-4ed3-9b6c-ffa10beb044e","Type":"ContainerStarted","Data":"fa6655b808b7b94a48d289558ae76d1e33389d91b01f59c32968c5b1847d96dd"} May 25 12:15:59.360409 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.360375 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/38a38a1a-53f0-498a-8e09-c274b365c58d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-q6j77\" (UID: \"38a38a1a-53f0-498a-8e09-c274b365c58d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-q6j77" May 25 12:15:59.360572 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.360413 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0adb1f7c-393b-4690-b70b-8ffbb670d95e-node-exporter-tls\") pod \"node-exporter-dgf44\" (UID: \"0adb1f7c-393b-4690-b70b-8ffbb670d95e\") " pod="openshift-monitoring/node-exporter-dgf44" May 25 12:15:59.360572 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:15:59.360513 2558 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found May 25 12:15:59.360655 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:15:59.360576 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38a38a1a-53f0-498a-8e09-c274b365c58d-openshift-state-metrics-tls podName:38a38a1a-53f0-498a-8e09-c274b365c58d nodeName:}" failed. No retries permitted until 2026-05-25 12:16:00.360560767 +0000 UTC m=+193.361348993 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/38a38a1a-53f0-498a-8e09-c274b365c58d-openshift-state-metrics-tls") pod "openshift-state-metrics-9c959559f-q6j77" (UID: "38a38a1a-53f0-498a-8e09-c274b365c58d") : secret "openshift-state-metrics-tls" not found May 25 12:15:59.362740 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.362720 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0adb1f7c-393b-4690-b70b-8ffbb670d95e-node-exporter-tls\") pod \"node-exporter-dgf44\" (UID: \"0adb1f7c-393b-4690-b70b-8ffbb670d95e\") " pod="openshift-monitoring/node-exporter-dgf44" May 25 12:15:59.553492 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.553462 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dgf44" May 25 12:15:59.561727 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:15:59.561701 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0adb1f7c_393b_4690_b70b_8ffbb670d95e.slice/crio-0209bb3bbebc568c5f75043f09a3c85ea52b25b26f3ad6c55f8eaf2dda29bd48 WatchSource:0}: Error finding container 0209bb3bbebc568c5f75043f09a3c85ea52b25b26f3ad6c55f8eaf2dda29bd48: Status 404 returned error can't find the container with id 0209bb3bbebc568c5f75043f09a3c85ea52b25b26f3ad6c55f8eaf2dda29bd48 May 25 12:15:59.712964 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.712877 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 25 12:15:59.717057 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.717031 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:59.719713 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.719692 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 25 12:15:59.719894 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.719875 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bxjng\"" May 25 12:15:59.720115 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.720082 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 25 12:15:59.720525 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.720400 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 25 12:15:59.720525 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.720464 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 25 12:15:59.720678 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.720643 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 25 12:15:59.720933 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.720914 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 25 12:15:59.721040 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.720936 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 25 12:15:59.721122 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.721035 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 25 12:15:59.721202 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.721183 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 25 12:15:59.731277 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.731255 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 25 12:15:59.865398 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.865368 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/916ba74a-0221-4c54-811a-358055461518-tls-assets\") pod \"alertmanager-main-0\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:59.865571 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.865428 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/916ba74a-0221-4c54-811a-358055461518-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:59.865571 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.865495 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/916ba74a-0221-4c54-811a-358055461518-config-volume\") pod \"alertmanager-main-0\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:59.865571 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.865537 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4llvz\" (UniqueName: \"kubernetes.io/projected/916ba74a-0221-4c54-811a-358055461518-kube-api-access-4llvz\") pod \"alertmanager-main-0\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:59.865725 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.865579 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/916ba74a-0221-4c54-811a-358055461518-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:59.865725 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.865612 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/916ba74a-0221-4c54-811a-358055461518-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:59.865725 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.865640 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/916ba74a-0221-4c54-811a-358055461518-web-config\") pod \"alertmanager-main-0\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:59.865725 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.865679 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/916ba74a-0221-4c54-811a-358055461518-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:59.865725 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.865706 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/916ba74a-0221-4c54-811a-358055461518-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:59.865968 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.865754 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/916ba74a-0221-4c54-811a-358055461518-config-out\") pod \"alertmanager-main-0\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:59.865968 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.865787 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/916ba74a-0221-4c54-811a-358055461518-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:59.865968 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.865833 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/916ba74a-0221-4c54-811a-358055461518-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:59.865968 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.865914 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/916ba74a-0221-4c54-811a-358055461518-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:59.967189 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.967081 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/916ba74a-0221-4c54-811a-358055461518-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:59.967189 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.967144 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/916ba74a-0221-4c54-811a-358055461518-config-out\") pod \"alertmanager-main-0\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:59.967189 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.967166 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/916ba74a-0221-4c54-811a-358055461518-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:59.967446 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.967200 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/916ba74a-0221-4c54-811a-358055461518-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:59.967446 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.967223 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/916ba74a-0221-4c54-811a-358055461518-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:59.967446 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.967243 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/916ba74a-0221-4c54-811a-358055461518-tls-assets\") pod \"alertmanager-main-0\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:59.967446 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.967378 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/916ba74a-0221-4c54-811a-358055461518-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:59.967446 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.967425 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/916ba74a-0221-4c54-811a-358055461518-config-volume\") pod \"alertmanager-main-0\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:59.967689 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.967452 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4llvz\" (UniqueName: \"kubernetes.io/projected/916ba74a-0221-4c54-811a-358055461518-kube-api-access-4llvz\") pod \"alertmanager-main-0\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:59.967689 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.967483 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/916ba74a-0221-4c54-811a-358055461518-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:59.967689 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.967528 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/916ba74a-0221-4c54-811a-358055461518-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:59.967689 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.967556 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/916ba74a-0221-4c54-811a-358055461518-web-config\") pod \"alertmanager-main-0\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:59.967689 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.967628 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/916ba74a-0221-4c54-811a-358055461518-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:59.967961 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.967857 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/916ba74a-0221-4c54-811a-358055461518-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:59.968737 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.968709 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/916ba74a-0221-4c54-811a-358055461518-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:59.969118 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.969078 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/916ba74a-0221-4c54-811a-358055461518-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:59.970566 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.970543 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/916ba74a-0221-4c54-811a-358055461518-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:59.970653 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.970564 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/916ba74a-0221-4c54-811a-358055461518-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:59.971197 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.971156 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/916ba74a-0221-4c54-811a-358055461518-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:59.971365 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.971341 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/916ba74a-0221-4c54-811a-358055461518-tls-assets\") pod \"alertmanager-main-0\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:59.971639 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.971616 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/916ba74a-0221-4c54-811a-358055461518-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:59.971756 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.971738 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/916ba74a-0221-4c54-811a-358055461518-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:59.972062 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.972046 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/916ba74a-0221-4c54-811a-358055461518-config-out\") pod \"alertmanager-main-0\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:59.972480 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.972463 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/916ba74a-0221-4c54-811a-358055461518-web-config\") pod \"alertmanager-main-0\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:59.972784 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.972765 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/916ba74a-0221-4c54-811a-358055461518-config-volume\") pod \"alertmanager-main-0\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:59.978442 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:15:59.978423 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4llvz\" (UniqueName: \"kubernetes.io/projected/916ba74a-0221-4c54-811a-358055461518-kube-api-access-4llvz\") pod \"alertmanager-main-0\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:16:00.030141 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:00.030037 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 25 12:16:00.206310 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:00.206270 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dgf44" event={"ID":"0adb1f7c-393b-4690-b70b-8ffbb670d95e","Type":"ContainerStarted","Data":"0209bb3bbebc568c5f75043f09a3c85ea52b25b26f3ad6c55f8eaf2dda29bd48"} May 25 12:16:00.370424 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:00.370384 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/38a38a1a-53f0-498a-8e09-c274b365c58d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-q6j77\" (UID: \"38a38a1a-53f0-498a-8e09-c274b365c58d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-q6j77" May 25 12:16:00.372786 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:00.372758 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/38a38a1a-53f0-498a-8e09-c274b365c58d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-q6j77\" (UID: \"38a38a1a-53f0-498a-8e09-c274b365c58d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-q6j77" May 25 12:16:00.438766 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:00.438731 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-q6j77" May 25 12:16:00.609359 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:00.609330 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-58bb874567-k497g"] May 25 12:16:00.612885 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:00.612864 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-58bb874567-k497g" May 25 12:16:00.616055 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:00.615881 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" May 25 12:16:00.616055 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:00.615895 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" May 25 12:16:00.616055 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:00.615905 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" May 25 12:16:00.616055 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:00.615951 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-w2vqt\"" May 25 12:16:00.616055 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:00.616000 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-7av2m3dmuqu6\"" May 25 12:16:00.616385 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:00.616327 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" May 25 12:16:00.617040 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:00.617012 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" May 25 12:16:00.622402 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:00.622165 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-58bb874567-k497g"] May 25 12:16:00.759652 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:00.759342 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-q6j77"] May 25 12:16:00.761597 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:16:00.761490 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38a38a1a_53f0_498a_8e09_c274b365c58d.slice/crio-ccb192858fd5b81b679631224823bf8cb9702c5ebf7eb01e475414a21578f1f5 WatchSource:0}: Error finding container ccb192858fd5b81b679631224823bf8cb9702c5ebf7eb01e475414a21578f1f5: Status 404 returned error can't find the container with id ccb192858fd5b81b679631224823bf8cb9702c5ebf7eb01e475414a21578f1f5 May 25 12:16:00.775991 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:00.775921 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e90631d3-7f49-4fa3-b842-28b86aa7e335-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-58bb874567-k497g\" (UID: \"e90631d3-7f49-4fa3-b842-28b86aa7e335\") " pod="openshift-monitoring/thanos-querier-58bb874567-k497g" May 25 12:16:00.775991 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:00.775971 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j82fr\" (UniqueName: \"kubernetes.io/projected/e90631d3-7f49-4fa3-b842-28b86aa7e335-kube-api-access-j82fr\") pod \"thanos-querier-58bb874567-k497g\" (UID: \"e90631d3-7f49-4fa3-b842-28b86aa7e335\") " pod="openshift-monitoring/thanos-querier-58bb874567-k497g" May 25 12:16:00.776203 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:00.776008 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e90631d3-7f49-4fa3-b842-28b86aa7e335-metrics-client-ca\") pod \"thanos-querier-58bb874567-k497g\" (UID: \"e90631d3-7f49-4fa3-b842-28b86aa7e335\") " pod="openshift-monitoring/thanos-querier-58bb874567-k497g" May 25 12:16:00.776203 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:00.776034 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e90631d3-7f49-4fa3-b842-28b86aa7e335-secret-thanos-querier-tls\") pod \"thanos-querier-58bb874567-k497g\" (UID: \"e90631d3-7f49-4fa3-b842-28b86aa7e335\") " pod="openshift-monitoring/thanos-querier-58bb874567-k497g" May 25 12:16:00.776203 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:00.776061 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e90631d3-7f49-4fa3-b842-28b86aa7e335-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-58bb874567-k497g\" (UID: \"e90631d3-7f49-4fa3-b842-28b86aa7e335\") " pod="openshift-monitoring/thanos-querier-58bb874567-k497g" May 25 12:16:00.776203 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:00.776086 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e90631d3-7f49-4fa3-b842-28b86aa7e335-secret-grpc-tls\") pod \"thanos-querier-58bb874567-k497g\" (UID: \"e90631d3-7f49-4fa3-b842-28b86aa7e335\") " pod="openshift-monitoring/thanos-querier-58bb874567-k497g" May 25 12:16:00.776428 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:00.776231 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e90631d3-7f49-4fa3-b842-28b86aa7e335-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-58bb874567-k497g\" (UID: \"e90631d3-7f49-4fa3-b842-28b86aa7e335\") " pod="openshift-monitoring/thanos-querier-58bb874567-k497g" May 25 12:16:00.776428 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:00.776265 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e90631d3-7f49-4fa3-b842-28b86aa7e335-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-58bb874567-k497g\" (UID: \"e90631d3-7f49-4fa3-b842-28b86aa7e335\") " pod="openshift-monitoring/thanos-querier-58bb874567-k497g" May 25 12:16:00.795713 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:00.795521 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 25 12:16:00.804565 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:16:00.804514 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod916ba74a_0221_4c54_811a_358055461518.slice/crio-8f8371830a0154733ee10bd4593ff7c82fd4620b78fc7cffaf7b0e7fcc756704 WatchSource:0}: Error finding container 8f8371830a0154733ee10bd4593ff7c82fd4620b78fc7cffaf7b0e7fcc756704: Status 404 returned error can't find the container with id 8f8371830a0154733ee10bd4593ff7c82fd4620b78fc7cffaf7b0e7fcc756704 May 25 12:16:00.877216 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:00.877149 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e90631d3-7f49-4fa3-b842-28b86aa7e335-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-58bb874567-k497g\" (UID: \"e90631d3-7f49-4fa3-b842-28b86aa7e335\") " pod="openshift-monitoring/thanos-querier-58bb874567-k497g" May 25 12:16:00.877216 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:00.877184 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e90631d3-7f49-4fa3-b842-28b86aa7e335-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-58bb874567-k497g\" (UID: \"e90631d3-7f49-4fa3-b842-28b86aa7e335\") " pod="openshift-monitoring/thanos-querier-58bb874567-k497g" May 25 12:16:00.877410 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:00.877235 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e90631d3-7f49-4fa3-b842-28b86aa7e335-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-58bb874567-k497g\" (UID: \"e90631d3-7f49-4fa3-b842-28b86aa7e335\") " pod="openshift-monitoring/thanos-querier-58bb874567-k497g" May 25 12:16:00.877410 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:00.877264 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j82fr\" (UniqueName: \"kubernetes.io/projected/e90631d3-7f49-4fa3-b842-28b86aa7e335-kube-api-access-j82fr\") pod \"thanos-querier-58bb874567-k497g\" (UID: \"e90631d3-7f49-4fa3-b842-28b86aa7e335\") " pod="openshift-monitoring/thanos-querier-58bb874567-k497g" May 25 12:16:00.877410 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:00.877290 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e90631d3-7f49-4fa3-b842-28b86aa7e335-metrics-client-ca\") pod \"thanos-querier-58bb874567-k497g\" (UID: \"e90631d3-7f49-4fa3-b842-28b86aa7e335\") " pod="openshift-monitoring/thanos-querier-58bb874567-k497g" May 25 12:16:00.877539 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:00.877471 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e90631d3-7f49-4fa3-b842-28b86aa7e335-secret-thanos-querier-tls\") pod \"thanos-querier-58bb874567-k497g\" (UID: \"e90631d3-7f49-4fa3-b842-28b86aa7e335\") " pod="openshift-monitoring/thanos-querier-58bb874567-k497g" May 25 12:16:00.877539 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:00.877516 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e90631d3-7f49-4fa3-b842-28b86aa7e335-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-58bb874567-k497g\" (UID: \"e90631d3-7f49-4fa3-b842-28b86aa7e335\") " pod="openshift-monitoring/thanos-querier-58bb874567-k497g" May 25 12:16:00.877630 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:00.877550 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e90631d3-7f49-4fa3-b842-28b86aa7e335-secret-grpc-tls\") pod \"thanos-querier-58bb874567-k497g\" (UID: \"e90631d3-7f49-4fa3-b842-28b86aa7e335\") " pod="openshift-monitoring/thanos-querier-58bb874567-k497g" May 25 12:16:00.877981 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:00.877939 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e90631d3-7f49-4fa3-b842-28b86aa7e335-metrics-client-ca\") pod \"thanos-querier-58bb874567-k497g\" (UID: \"e90631d3-7f49-4fa3-b842-28b86aa7e335\") " pod="openshift-monitoring/thanos-querier-58bb874567-k497g" May 25 12:16:00.880559 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:00.880515 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e90631d3-7f49-4fa3-b842-28b86aa7e335-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-58bb874567-k497g\" (UID: \"e90631d3-7f49-4fa3-b842-28b86aa7e335\") " pod="openshift-monitoring/thanos-querier-58bb874567-k497g" May 25 12:16:00.881186 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:00.881164 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e90631d3-7f49-4fa3-b842-28b86aa7e335-secret-thanos-querier-tls\") pod \"thanos-querier-58bb874567-k497g\" (UID: \"e90631d3-7f49-4fa3-b842-28b86aa7e335\") " pod="openshift-monitoring/thanos-querier-58bb874567-k497g" May 25 12:16:00.881349 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:00.881316 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e90631d3-7f49-4fa3-b842-28b86aa7e335-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-58bb874567-k497g\" (UID: \"e90631d3-7f49-4fa3-b842-28b86aa7e335\") " pod="openshift-monitoring/thanos-querier-58bb874567-k497g" May 25 12:16:00.881474 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:00.881393 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e90631d3-7f49-4fa3-b842-28b86aa7e335-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-58bb874567-k497g\" (UID: \"e90631d3-7f49-4fa3-b842-28b86aa7e335\") " pod="openshift-monitoring/thanos-querier-58bb874567-k497g" May 25 12:16:00.883671 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:00.883643 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e90631d3-7f49-4fa3-b842-28b86aa7e335-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-58bb874567-k497g\" (UID: \"e90631d3-7f49-4fa3-b842-28b86aa7e335\") " pod="openshift-monitoring/thanos-querier-58bb874567-k497g" May 25 12:16:00.883879 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:00.883855 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e90631d3-7f49-4fa3-b842-28b86aa7e335-secret-grpc-tls\") pod \"thanos-querier-58bb874567-k497g\" (UID: \"e90631d3-7f49-4fa3-b842-28b86aa7e335\") " pod="openshift-monitoring/thanos-querier-58bb874567-k497g" May 25 12:16:00.885777 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:00.885761 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j82fr\" (UniqueName: \"kubernetes.io/projected/e90631d3-7f49-4fa3-b842-28b86aa7e335-kube-api-access-j82fr\") pod \"thanos-querier-58bb874567-k497g\" (UID: \"e90631d3-7f49-4fa3-b842-28b86aa7e335\") " pod="openshift-monitoring/thanos-querier-58bb874567-k497g" May 25 12:16:00.925776 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:00.925737 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-58bb874567-k497g" May 25 12:16:01.069001 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:01.068951 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-58bb874567-k497g"] May 25 12:16:01.074788 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:16:01.074758 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode90631d3_7f49_4fa3_b842_28b86aa7e335.slice/crio-95cbf0c80557a9bbf4b7b8e4b2d7b15cc04c5588e378b6bcc11cbe73bf8424e8 WatchSource:0}: Error finding container 95cbf0c80557a9bbf4b7b8e4b2d7b15cc04c5588e378b6bcc11cbe73bf8424e8: Status 404 returned error can't find the container with id 95cbf0c80557a9bbf4b7b8e4b2d7b15cc04c5588e378b6bcc11cbe73bf8424e8 May 25 12:16:01.211965 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:01.211880 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-d6h5p" event={"ID":"62b68527-00bb-4ed3-9b6c-ffa10beb044e","Type":"ContainerStarted","Data":"aa35667bb7e83b38e681405ce46214c548c1b953bf2165779bd67159fb03e7f3"} May 25 12:16:01.211965 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:01.211920 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-d6h5p" event={"ID":"62b68527-00bb-4ed3-9b6c-ffa10beb044e","Type":"ContainerStarted","Data":"5f55b5bd0d4bef257206c8d1db82bf0a99a28282690ae5d290b1c6115208908c"} May 25 12:16:01.211965 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:01.211935 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-d6h5p" event={"ID":"62b68527-00bb-4ed3-9b6c-ffa10beb044e","Type":"ContainerStarted","Data":"a6c206b3888e5c5b2bbe10cc1bc1b130fe02302383ddb397a2b197929e52602c"} May 25 12:16:01.213534 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:01.213507 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-q6j77" event={"ID":"38a38a1a-53f0-498a-8e09-c274b365c58d","Type":"ContainerStarted","Data":"3c75a88f26969f4192d1ae9cc546a8e4dfffca9a0b62b7252d963e589c201995"} May 25 12:16:01.213648 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:01.213538 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-q6j77" event={"ID":"38a38a1a-53f0-498a-8e09-c274b365c58d","Type":"ContainerStarted","Data":"03ae7995e428aaf29e328c6ea07c108b0cc55440cf4b607248ecb9ff5876b5ff"} May 25 12:16:01.213648 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:01.213551 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-q6j77" event={"ID":"38a38a1a-53f0-498a-8e09-c274b365c58d","Type":"ContainerStarted","Data":"ccb192858fd5b81b679631224823bf8cb9702c5ebf7eb01e475414a21578f1f5"} May 25 12:16:01.214807 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:01.214785 2558 generic.go:358] "Generic (PLEG): container finished" podID="0adb1f7c-393b-4690-b70b-8ffbb670d95e" containerID="3530a60ba4a3b5f1788c289ed8583fee88acae954cf242094971bd43a40f7218" exitCode=0 May 25 12:16:01.214886 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:01.214856 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dgf44" event={"ID":"0adb1f7c-393b-4690-b70b-8ffbb670d95e","Type":"ContainerDied","Data":"3530a60ba4a3b5f1788c289ed8583fee88acae954cf242094971bd43a40f7218"} May 25 12:16:01.215963 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:01.215945 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58bb874567-k497g" event={"ID":"e90631d3-7f49-4fa3-b842-28b86aa7e335","Type":"ContainerStarted","Data":"95cbf0c80557a9bbf4b7b8e4b2d7b15cc04c5588e378b6bcc11cbe73bf8424e8"} May 25 12:16:01.216883 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:01.216864 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"916ba74a-0221-4c54-811a-358055461518","Type":"ContainerStarted","Data":"8f8371830a0154733ee10bd4593ff7c82fd4620b78fc7cffaf7b0e7fcc756704"} May 25 12:16:01.236059 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:01.236020 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-d6h5p" podStartSLOduration=1.73234974 podStartE2EDuration="3.236006682s" podCreationTimestamp="2026-05-25 12:15:58 +0000 UTC" firstStartedPulling="2026-05-25 12:15:59.106764774 +0000 UTC m=+192.107553006" lastFinishedPulling="2026-05-25 12:16:00.610421712 +0000 UTC m=+193.611209948" observedRunningTime="2026-05-25 12:16:01.234732462 +0000 UTC m=+194.235520711" watchObservedRunningTime="2026-05-25 12:16:01.236006682 +0000 UTC m=+194.236794933" May 25 12:16:02.221869 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:02.221828 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dgf44" event={"ID":"0adb1f7c-393b-4690-b70b-8ffbb670d95e","Type":"ContainerStarted","Data":"d4dc96d06564928f1f10c46eac8d9dd5c92e577b3321390e52569f29715e9bad"} May 25 12:16:02.222327 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:02.221880 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dgf44" event={"ID":"0adb1f7c-393b-4690-b70b-8ffbb670d95e","Type":"ContainerStarted","Data":"ceac6b74ccaf5baad31c01242b38fdb91eba737f01d1da85419638d3a4a10acd"} May 25 12:16:02.242486 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:02.242432 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dgf44" podStartSLOduration=3.193982945 podStartE2EDuration="4.242419024s" podCreationTimestamp="2026-05-25 12:15:58 +0000 UTC" firstStartedPulling="2026-05-25 12:15:59.563231431 +0000 UTC m=+192.564019658" lastFinishedPulling="2026-05-25 12:16:00.6116675 +0000 UTC m=+193.612455737" observedRunningTime="2026-05-25 12:16:02.240401266 +0000 UTC m=+195.241189538" watchObservedRunningTime="2026-05-25 12:16:02.242419024 +0000 UTC m=+195.243207267" May 25 12:16:03.067155 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.067128 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-76749bc9c-k667z"] May 25 12:16:03.071385 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.071366 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-76749bc9c-k667z" May 25 12:16:03.074005 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.073981 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" May 25 12:16:03.075145 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.075125 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-83o65ek6gnpvn\"" May 25 12:16:03.075247 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.075146 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-kq49x\"" May 25 12:16:03.075305 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.075258 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 25 12:16:03.075305 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.075270 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" May 25 12:16:03.075404 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.075329 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" May 25 12:16:03.077595 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.077572 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-76749bc9c-k667z"] May 25 12:16:03.099821 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.099798 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/dd66a003-aa5d-4cc2-92b6-a5f69fee74df-secret-metrics-server-tls\") pod \"metrics-server-76749bc9c-k667z\" (UID: \"dd66a003-aa5d-4cc2-92b6-a5f69fee74df\") " pod="openshift-monitoring/metrics-server-76749bc9c-k667z" May 25 12:16:03.099943 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.099829 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/dd66a003-aa5d-4cc2-92b6-a5f69fee74df-secret-metrics-server-client-certs\") pod \"metrics-server-76749bc9c-k667z\" (UID: \"dd66a003-aa5d-4cc2-92b6-a5f69fee74df\") " pod="openshift-monitoring/metrics-server-76749bc9c-k667z" May 25 12:16:03.099943 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.099850 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n66hj\" (UniqueName: \"kubernetes.io/projected/dd66a003-aa5d-4cc2-92b6-a5f69fee74df-kube-api-access-n66hj\") pod \"metrics-server-76749bc9c-k667z\" (UID: \"dd66a003-aa5d-4cc2-92b6-a5f69fee74df\") " pod="openshift-monitoring/metrics-server-76749bc9c-k667z" May 25 12:16:03.099943 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.099928 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dd66a003-aa5d-4cc2-92b6-a5f69fee74df-client-ca-bundle\") pod \"metrics-server-76749bc9c-k667z\" (UID: \"dd66a003-aa5d-4cc2-92b6-a5f69fee74df\") " pod="openshift-monitoring/metrics-server-76749bc9c-k667z" May 25 12:16:03.100036 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.099983 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/dd66a003-aa5d-4cc2-92b6-a5f69fee74df-audit-log\") pod \"metrics-server-76749bc9c-k667z\" (UID: \"dd66a003-aa5d-4cc2-92b6-a5f69fee74df\") " pod="openshift-monitoring/metrics-server-76749bc9c-k667z" May 25 12:16:03.100036 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.100017 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/dd66a003-aa5d-4cc2-92b6-a5f69fee74df-metrics-server-audit-profiles\") pod \"metrics-server-76749bc9c-k667z\" (UID: \"dd66a003-aa5d-4cc2-92b6-a5f69fee74df\") " pod="openshift-monitoring/metrics-server-76749bc9c-k667z" May 25 12:16:03.100120 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.100036 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd66a003-aa5d-4cc2-92b6-a5f69fee74df-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-76749bc9c-k667z\" (UID: \"dd66a003-aa5d-4cc2-92b6-a5f69fee74df\") " pod="openshift-monitoring/metrics-server-76749bc9c-k667z" May 25 12:16:03.200746 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.200719 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/dd66a003-aa5d-4cc2-92b6-a5f69fee74df-secret-metrics-server-client-certs\") pod \"metrics-server-76749bc9c-k667z\" (UID: \"dd66a003-aa5d-4cc2-92b6-a5f69fee74df\") " pod="openshift-monitoring/metrics-server-76749bc9c-k667z" May 25 12:16:03.200849 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.200762 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n66hj\" (UniqueName: \"kubernetes.io/projected/dd66a003-aa5d-4cc2-92b6-a5f69fee74df-kube-api-access-n66hj\") pod \"metrics-server-76749bc9c-k667z\" (UID: \"dd66a003-aa5d-4cc2-92b6-a5f69fee74df\") " pod="openshift-monitoring/metrics-server-76749bc9c-k667z" May 25 12:16:03.200849 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.200832 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dd66a003-aa5d-4cc2-92b6-a5f69fee74df-client-ca-bundle\") pod \"metrics-server-76749bc9c-k667z\" (UID: \"dd66a003-aa5d-4cc2-92b6-a5f69fee74df\") " pod="openshift-monitoring/metrics-server-76749bc9c-k667z" May 25 12:16:03.201188 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.201021 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/dd66a003-aa5d-4cc2-92b6-a5f69fee74df-audit-log\") pod \"metrics-server-76749bc9c-k667z\" (UID: \"dd66a003-aa5d-4cc2-92b6-a5f69fee74df\") " pod="openshift-monitoring/metrics-server-76749bc9c-k667z" May 25 12:16:03.201188 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.201058 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/dd66a003-aa5d-4cc2-92b6-a5f69fee74df-metrics-server-audit-profiles\") pod \"metrics-server-76749bc9c-k667z\" (UID: \"dd66a003-aa5d-4cc2-92b6-a5f69fee74df\") " pod="openshift-monitoring/metrics-server-76749bc9c-k667z" May 25 12:16:03.201188 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.201113 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd66a003-aa5d-4cc2-92b6-a5f69fee74df-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-76749bc9c-k667z\" (UID: \"dd66a003-aa5d-4cc2-92b6-a5f69fee74df\") " pod="openshift-monitoring/metrics-server-76749bc9c-k667z" May 25 12:16:03.201188 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.201167 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/dd66a003-aa5d-4cc2-92b6-a5f69fee74df-secret-metrics-server-tls\") pod \"metrics-server-76749bc9c-k667z\" (UID: \"dd66a003-aa5d-4cc2-92b6-a5f69fee74df\") " pod="openshift-monitoring/metrics-server-76749bc9c-k667z" May 25 12:16:03.201597 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.201573 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/dd66a003-aa5d-4cc2-92b6-a5f69fee74df-audit-log\") pod \"metrics-server-76749bc9c-k667z\" (UID: \"dd66a003-aa5d-4cc2-92b6-a5f69fee74df\") " pod="openshift-monitoring/metrics-server-76749bc9c-k667z" May 25 12:16:03.202133 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.201915 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd66a003-aa5d-4cc2-92b6-a5f69fee74df-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-76749bc9c-k667z\" (UID: \"dd66a003-aa5d-4cc2-92b6-a5f69fee74df\") " pod="openshift-monitoring/metrics-server-76749bc9c-k667z" May 25 12:16:03.202593 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.202574 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/dd66a003-aa5d-4cc2-92b6-a5f69fee74df-metrics-server-audit-profiles\") pod \"metrics-server-76749bc9c-k667z\" (UID: \"dd66a003-aa5d-4cc2-92b6-a5f69fee74df\") " pod="openshift-monitoring/metrics-server-76749bc9c-k667z" May 25 12:16:03.203716 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.203690 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dd66a003-aa5d-4cc2-92b6-a5f69fee74df-client-ca-bundle\") pod \"metrics-server-76749bc9c-k667z\" (UID: \"dd66a003-aa5d-4cc2-92b6-a5f69fee74df\") " pod="openshift-monitoring/metrics-server-76749bc9c-k667z" May 25 12:16:03.203957 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.203939 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/dd66a003-aa5d-4cc2-92b6-a5f69fee74df-secret-metrics-server-client-certs\") pod \"metrics-server-76749bc9c-k667z\" (UID: \"dd66a003-aa5d-4cc2-92b6-a5f69fee74df\") " pod="openshift-monitoring/metrics-server-76749bc9c-k667z" May 25 12:16:03.204229 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.204212 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/dd66a003-aa5d-4cc2-92b6-a5f69fee74df-secret-metrics-server-tls\") pod \"metrics-server-76749bc9c-k667z\" (UID: \"dd66a003-aa5d-4cc2-92b6-a5f69fee74df\") " pod="openshift-monitoring/metrics-server-76749bc9c-k667z" May 25 12:16:03.209071 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.209049 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n66hj\" (UniqueName: \"kubernetes.io/projected/dd66a003-aa5d-4cc2-92b6-a5f69fee74df-kube-api-access-n66hj\") pod \"metrics-server-76749bc9c-k667z\" (UID: \"dd66a003-aa5d-4cc2-92b6-a5f69fee74df\") " pod="openshift-monitoring/metrics-server-76749bc9c-k667z" May 25 12:16:03.226790 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.226747 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58bb874567-k497g" event={"ID":"e90631d3-7f49-4fa3-b842-28b86aa7e335","Type":"ContainerStarted","Data":"1071776fe68c4dc910ee1331b13208338606eecb8b5213cabb3b9c4fd36d1096"} May 25 12:16:03.227139 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.226805 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58bb874567-k497g" event={"ID":"e90631d3-7f49-4fa3-b842-28b86aa7e335","Type":"ContainerStarted","Data":"ff0e62ba7b6e3b51329503df173b775b8486fc814fedb6bbc41b714bf5b99935"} May 25 12:16:03.228198 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.228172 2558 generic.go:358] "Generic (PLEG): container finished" podID="916ba74a-0221-4c54-811a-358055461518" containerID="ec0dba068f19bc3efb2fb7f1b3f8c3412342c3fd277f5c4ade155321bd29e1df" exitCode=0 May 25 12:16:03.228335 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.228247 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"916ba74a-0221-4c54-811a-358055461518","Type":"ContainerDied","Data":"ec0dba068f19bc3efb2fb7f1b3f8c3412342c3fd277f5c4ade155321bd29e1df"} May 25 12:16:03.230158 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.230129 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-q6j77" event={"ID":"38a38a1a-53f0-498a-8e09-c274b365c58d","Type":"ContainerStarted","Data":"fef5e7ef59a44e5e1c783fed4cfc681ded5175f476da0d2c9c672841353131bf"} May 25 12:16:03.269120 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.269037 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-q6j77" podStartSLOduration=4.009565377 podStartE2EDuration="5.269019101s" podCreationTimestamp="2026-05-25 12:15:58 +0000 UTC" firstStartedPulling="2026-05-25 12:16:01.00003626 +0000 UTC m=+194.000824514" lastFinishedPulling="2026-05-25 12:16:02.259490006 +0000 UTC m=+195.260278238" observedRunningTime="2026-05-25 12:16:03.26889191 +0000 UTC m=+196.269680160" watchObservedRunningTime="2026-05-25 12:16:03.269019101 +0000 UTC m=+196.269807350" May 25 12:16:03.404696 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.404665 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-76749bc9c-k667z" May 25 12:16:03.432681 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.432617 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7797964479-f7rc9"] May 25 12:16:03.436499 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.436477 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7797964479-f7rc9" May 25 12:16:03.439307 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.439252 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wc5r9\"" May 25 12:16:03.439546 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.439523 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 25 12:16:03.439632 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.439562 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 25 12:16:03.439632 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.439384 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 25 12:16:03.439632 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.439593 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 25 12:16:03.439632 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.439565 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 25 12:16:03.439935 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.439357 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 25 12:16:03.439935 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.439387 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 25 12:16:03.446968 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.446785 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7797964479-f7rc9"] May 25 12:16:03.446968 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.446789 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" May 25 12:16:03.451641 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.451620 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-mldx5"] May 25 12:16:03.454144 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.454125 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-mldx5" May 25 12:16:03.457504 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.457466 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" May 25 12:16:03.458147 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.458128 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-g2vcs\"" May 25 12:16:03.465719 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.465696 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-mldx5"] May 25 12:16:03.503904 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.503876 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/35e99c47-a6c6-4ae1-b18b-41e885794adb-oauth-serving-cert\") pod \"console-7797964479-f7rc9\" (UID: \"35e99c47-a6c6-4ae1-b18b-41e885794adb\") " pod="openshift-console/console-7797964479-f7rc9" May 25 12:16:03.504033 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.503917 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/75db06a3-439a-4d9e-a11e-02232ed870fd-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-mldx5\" (UID: \"75db06a3-439a-4d9e-a11e-02232ed870fd\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-mldx5" May 25 12:16:03.504033 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.503938 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/35e99c47-a6c6-4ae1-b18b-41e885794adb-service-ca\") pod \"console-7797964479-f7rc9\" (UID: \"35e99c47-a6c6-4ae1-b18b-41e885794adb\") " pod="openshift-console/console-7797964479-f7rc9" May 25 12:16:03.504033 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.503971 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35e99c47-a6c6-4ae1-b18b-41e885794adb-trusted-ca-bundle\") pod \"console-7797964479-f7rc9\" (UID: \"35e99c47-a6c6-4ae1-b18b-41e885794adb\") " pod="openshift-console/console-7797964479-f7rc9" May 25 12:16:03.504033 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.503998 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65kdg\" (UniqueName: \"kubernetes.io/projected/35e99c47-a6c6-4ae1-b18b-41e885794adb-kube-api-access-65kdg\") pod \"console-7797964479-f7rc9\" (UID: \"35e99c47-a6c6-4ae1-b18b-41e885794adb\") " pod="openshift-console/console-7797964479-f7rc9" May 25 12:16:03.504033 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.504028 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/35e99c47-a6c6-4ae1-b18b-41e885794adb-console-config\") pod \"console-7797964479-f7rc9\" (UID: \"35e99c47-a6c6-4ae1-b18b-41e885794adb\") " pod="openshift-console/console-7797964479-f7rc9" May 25 12:16:03.504266 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.504130 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/35e99c47-a6c6-4ae1-b18b-41e885794adb-console-oauth-config\") pod \"console-7797964479-f7rc9\" (UID: \"35e99c47-a6c6-4ae1-b18b-41e885794adb\") " pod="openshift-console/console-7797964479-f7rc9" May 25 12:16:03.504305 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.504271 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/35e99c47-a6c6-4ae1-b18b-41e885794adb-console-serving-cert\") pod \"console-7797964479-f7rc9\" (UID: \"35e99c47-a6c6-4ae1-b18b-41e885794adb\") " pod="openshift-console/console-7797964479-f7rc9" May 25 12:16:03.544280 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.544026 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-76749bc9c-k667z"] May 25 12:16:03.548292 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:16:03.548237 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd66a003_aa5d_4cc2_92b6_a5f69fee74df.slice/crio-738a59ec34f10a6f7f4094e29f7c7eb0a4e9794b1d3fbabcbdd7f9960b9cdd24 WatchSource:0}: Error finding container 738a59ec34f10a6f7f4094e29f7c7eb0a4e9794b1d3fbabcbdd7f9960b9cdd24: Status 404 returned error can't find the container with id 738a59ec34f10a6f7f4094e29f7c7eb0a4e9794b1d3fbabcbdd7f9960b9cdd24 May 25 12:16:03.605231 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.605201 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/35e99c47-a6c6-4ae1-b18b-41e885794adb-console-config\") pod \"console-7797964479-f7rc9\" (UID: \"35e99c47-a6c6-4ae1-b18b-41e885794adb\") " pod="openshift-console/console-7797964479-f7rc9" May 25 12:16:03.605406 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.605240 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/35e99c47-a6c6-4ae1-b18b-41e885794adb-console-oauth-config\") pod \"console-7797964479-f7rc9\" (UID: \"35e99c47-a6c6-4ae1-b18b-41e885794adb\") " pod="openshift-console/console-7797964479-f7rc9" May 25 12:16:03.605406 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.605296 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/35e99c47-a6c6-4ae1-b18b-41e885794adb-console-serving-cert\") pod \"console-7797964479-f7rc9\" (UID: \"35e99c47-a6c6-4ae1-b18b-41e885794adb\") " pod="openshift-console/console-7797964479-f7rc9" May 25 12:16:03.605406 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.605353 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/35e99c47-a6c6-4ae1-b18b-41e885794adb-oauth-serving-cert\") pod \"console-7797964479-f7rc9\" (UID: \"35e99c47-a6c6-4ae1-b18b-41e885794adb\") " pod="openshift-console/console-7797964479-f7rc9" May 25 12:16:03.605406 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.605387 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/75db06a3-439a-4d9e-a11e-02232ed870fd-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-mldx5\" (UID: \"75db06a3-439a-4d9e-a11e-02232ed870fd\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-mldx5" May 25 12:16:03.605616 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.605412 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/35e99c47-a6c6-4ae1-b18b-41e885794adb-service-ca\") pod \"console-7797964479-f7rc9\" (UID: \"35e99c47-a6c6-4ae1-b18b-41e885794adb\") " pod="openshift-console/console-7797964479-f7rc9" May 25 12:16:03.605616 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.605436 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35e99c47-a6c6-4ae1-b18b-41e885794adb-trusted-ca-bundle\") pod \"console-7797964479-f7rc9\" (UID: \"35e99c47-a6c6-4ae1-b18b-41e885794adb\") " pod="openshift-console/console-7797964479-f7rc9" May 25 12:16:03.605616 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.605466 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-65kdg\" (UniqueName: \"kubernetes.io/projected/35e99c47-a6c6-4ae1-b18b-41e885794adb-kube-api-access-65kdg\") pod \"console-7797964479-f7rc9\" (UID: \"35e99c47-a6c6-4ae1-b18b-41e885794adb\") " pod="openshift-console/console-7797964479-f7rc9" May 25 12:16:03.606050 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.606025 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/35e99c47-a6c6-4ae1-b18b-41e885794adb-console-config\") pod \"console-7797964479-f7rc9\" (UID: \"35e99c47-a6c6-4ae1-b18b-41e885794adb\") " pod="openshift-console/console-7797964479-f7rc9" May 25 12:16:03.606427 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.606356 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/35e99c47-a6c6-4ae1-b18b-41e885794adb-service-ca\") pod \"console-7797964479-f7rc9\" (UID: \"35e99c47-a6c6-4ae1-b18b-41e885794adb\") " pod="openshift-console/console-7797964479-f7rc9" May 25 12:16:03.606427 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.606130 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/35e99c47-a6c6-4ae1-b18b-41e885794adb-oauth-serving-cert\") pod \"console-7797964479-f7rc9\" (UID: \"35e99c47-a6c6-4ae1-b18b-41e885794adb\") " pod="openshift-console/console-7797964479-f7rc9" May 25 12:16:03.606765 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.606744 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35e99c47-a6c6-4ae1-b18b-41e885794adb-trusted-ca-bundle\") pod \"console-7797964479-f7rc9\" (UID: \"35e99c47-a6c6-4ae1-b18b-41e885794adb\") " pod="openshift-console/console-7797964479-f7rc9" May 25 12:16:03.607980 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.607960 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/35e99c47-a6c6-4ae1-b18b-41e885794adb-console-serving-cert\") pod \"console-7797964479-f7rc9\" (UID: \"35e99c47-a6c6-4ae1-b18b-41e885794adb\") " pod="openshift-console/console-7797964479-f7rc9" May 25 12:16:03.608179 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.608158 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/75db06a3-439a-4d9e-a11e-02232ed870fd-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-mldx5\" (UID: \"75db06a3-439a-4d9e-a11e-02232ed870fd\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-mldx5" May 25 12:16:03.608221 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.608085 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/35e99c47-a6c6-4ae1-b18b-41e885794adb-console-oauth-config\") pod \"console-7797964479-f7rc9\" (UID: \"35e99c47-a6c6-4ae1-b18b-41e885794adb\") " pod="openshift-console/console-7797964479-f7rc9" May 25 12:16:03.619923 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.619901 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65kdg\" (UniqueName: \"kubernetes.io/projected/35e99c47-a6c6-4ae1-b18b-41e885794adb-kube-api-access-65kdg\") pod \"console-7797964479-f7rc9\" (UID: \"35e99c47-a6c6-4ae1-b18b-41e885794adb\") " pod="openshift-console/console-7797964479-f7rc9" May 25 12:16:03.747808 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.747721 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7797964479-f7rc9" May 25 12:16:03.770862 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.770412 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-mldx5" May 25 12:16:03.925838 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.925812 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7797964479-f7rc9"] May 25 12:16:03.953624 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:03.953604 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-mldx5"] May 25 12:16:04.041779 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:16:04.041696 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35e99c47_a6c6_4ae1_b18b_41e885794adb.slice/crio-bfabcff73c883ed5223dfd962aa37f0aaf0226bda583c75ceebba86fc1d430bc WatchSource:0}: Error finding container bfabcff73c883ed5223dfd962aa37f0aaf0226bda583c75ceebba86fc1d430bc: Status 404 returned error can't find the container with id bfabcff73c883ed5223dfd962aa37f0aaf0226bda583c75ceebba86fc1d430bc May 25 12:16:04.042990 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:16:04.042817 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75db06a3_439a_4d9e_a11e_02232ed870fd.slice/crio-6ff0188e24168840b16d88204cb77083152d33b3f76c2d2a25a7ac571973d1f4 WatchSource:0}: Error finding container 6ff0188e24168840b16d88204cb77083152d33b3f76c2d2a25a7ac571973d1f4: Status 404 returned error can't find the container with id 6ff0188e24168840b16d88204cb77083152d33b3f76c2d2a25a7ac571973d1f4 May 25 12:16:04.234698 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.234673 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-mldx5" event={"ID":"75db06a3-439a-4d9e-a11e-02232ed870fd","Type":"ContainerStarted","Data":"6ff0188e24168840b16d88204cb77083152d33b3f76c2d2a25a7ac571973d1f4"} May 25 12:16:04.237510 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.237450 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58bb874567-k497g" event={"ID":"e90631d3-7f49-4fa3-b842-28b86aa7e335","Type":"ContainerStarted","Data":"b5fd860a98901c0d254054aad43e0f12cc5514a81ea61469d9df81af352be53c"} May 25 12:16:04.237611 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.237536 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58bb874567-k497g" event={"ID":"e90631d3-7f49-4fa3-b842-28b86aa7e335","Type":"ContainerStarted","Data":"997b9aaf84a41199b469ad5fb9c014b69cb87b699c5fb75a0dcd6ce750ffddb9"} May 25 12:16:04.239684 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.239619 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-76749bc9c-k667z" event={"ID":"dd66a003-aa5d-4cc2-92b6-a5f69fee74df","Type":"ContainerStarted","Data":"738a59ec34f10a6f7f4094e29f7c7eb0a4e9794b1d3fbabcbdd7f9960b9cdd24"} May 25 12:16:04.241057 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.241020 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7797964479-f7rc9" event={"ID":"35e99c47-a6c6-4ae1-b18b-41e885794adb","Type":"ContainerStarted","Data":"bfabcff73c883ed5223dfd962aa37f0aaf0226bda583c75ceebba86fc1d430bc"} May 25 12:16:04.809278 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.809231 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 12:16:04.812881 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.812859 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.816887 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.815669 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 25 12:16:04.816887 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.816146 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 25 12:16:04.816887 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.816374 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 25 12:16:04.816887 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.816559 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-dc1ccq2rr5csk\"" May 25 12:16:04.816887 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.816580 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 25 12:16:04.816887 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.816718 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 25 12:16:04.816887 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.816735 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 25 12:16:04.816887 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.816758 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 25 12:16:04.817557 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.817537 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 25 12:16:04.817778 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.817760 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 25 12:16:04.817858 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.817780 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 25 12:16:04.818135 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.818110 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vndj4\"" May 25 12:16:04.818211 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.818162 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 25 12:16:04.821329 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.821304 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.821456 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.821409 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.821517 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.821479 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61b5c371-5637-4913-abd0-5790c95d17e1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.821681 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.821625 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-config\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.822040 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.821768 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/61b5c371-5637-4913-abd0-5790c95d17e1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.822040 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.821814 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-web-config\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.822040 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.821859 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.822040 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.821896 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.822040 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.821934 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/61b5c371-5637-4913-abd0-5790c95d17e1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.822040 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.821968 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/61b5c371-5637-4913-abd0-5790c95d17e1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.822360 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.822046 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/61b5c371-5637-4913-abd0-5790c95d17e1-config-out\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.822360 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.822074 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61b5c371-5637-4913-abd0-5790c95d17e1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.822360 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.822115 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.822360 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.822140 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-492kt\" (UniqueName: \"kubernetes.io/projected/61b5c371-5637-4913-abd0-5790c95d17e1-kube-api-access-492kt\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.822360 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.822189 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61b5c371-5637-4913-abd0-5790c95d17e1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.822360 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.822223 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.822360 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.822256 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.822360 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.822285 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61b5c371-5637-4913-abd0-5790c95d17e1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.824264 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.824069 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 25 12:16:04.828758 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.828720 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 12:16:04.923453 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.923375 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/61b5c371-5637-4913-abd0-5790c95d17e1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.923611 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.923459 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/61b5c371-5637-4913-abd0-5790c95d17e1-config-out\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.923611 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.923477 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61b5c371-5637-4913-abd0-5790c95d17e1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.923611 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.923509 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.923611 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.923536 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-492kt\" (UniqueName: \"kubernetes.io/projected/61b5c371-5637-4913-abd0-5790c95d17e1-kube-api-access-492kt\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.923611 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.923570 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61b5c371-5637-4913-abd0-5790c95d17e1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.923611 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.923603 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.923882 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.923637 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.923882 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.923663 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61b5c371-5637-4913-abd0-5790c95d17e1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.923882 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.923690 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.923882 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.923726 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.923882 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.923752 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61b5c371-5637-4913-abd0-5790c95d17e1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.923882 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.923779 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-config\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.923882 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.923811 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/61b5c371-5637-4913-abd0-5790c95d17e1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.923882 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.923844 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-web-config\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.925560 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.925532 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61b5c371-5637-4913-abd0-5790c95d17e1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.925663 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.925584 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61b5c371-5637-4913-abd0-5790c95d17e1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.926129 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.925845 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/61b5c371-5637-4913-abd0-5790c95d17e1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.926129 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.925941 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.926129 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.926001 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.926129 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.926037 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/61b5c371-5637-4913-abd0-5790c95d17e1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.926717 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.926691 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61b5c371-5637-4913-abd0-5790c95d17e1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.929338 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.929280 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61b5c371-5637-4913-abd0-5790c95d17e1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.929520 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.929494 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/61b5c371-5637-4913-abd0-5790c95d17e1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.930880 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.930835 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.933197 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.933143 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-web-config\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.934199 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.934129 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-492kt\" (UniqueName: \"kubernetes.io/projected/61b5c371-5637-4913-abd0-5790c95d17e1-kube-api-access-492kt\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.935338 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.935312 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.935838 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.935799 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.937167 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.937127 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/61b5c371-5637-4913-abd0-5790c95d17e1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.940500 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.940299 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.940500 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.940463 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.940644 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.940597 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/61b5c371-5637-4913-abd0-5790c95d17e1-config-out\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.941534 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.941506 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.943676 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.943636 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-config\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:04.945314 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:04.945289 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:05.129614 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:05.129575 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:05.260006 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:05.259772 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58bb874567-k497g" event={"ID":"e90631d3-7f49-4fa3-b842-28b86aa7e335","Type":"ContainerStarted","Data":"0337ab77ad45c8c3099e5351b28f153cde96d9c035a1847f7c5e61ca173925b9"} May 25 12:16:05.260006 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:05.259814 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58bb874567-k497g" event={"ID":"e90631d3-7f49-4fa3-b842-28b86aa7e335","Type":"ContainerStarted","Data":"0b5b29e6080f3ab93a71d4164498f7a61a6eb6903742acbf32c4d499e794fa50"} May 25 12:16:05.368305 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:05.368235 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-58bb874567-k497g" podStartSLOduration=2.3702649239999998 podStartE2EDuration="5.368214509s" podCreationTimestamp="2026-05-25 12:16:00 +0000 UTC" firstStartedPulling="2026-05-25 12:16:01.076764716 +0000 UTC m=+194.077552946" lastFinishedPulling="2026-05-25 12:16:04.074714286 +0000 UTC m=+197.075502531" observedRunningTime="2026-05-25 12:16:05.294438331 +0000 UTC m=+198.295226585" watchObservedRunningTime="2026-05-25 12:16:05.368214509 +0000 UTC m=+198.369002760" May 25 12:16:05.369772 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:05.369751 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 12:16:06.264985 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:06.264888 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-mldx5" event={"ID":"75db06a3-439a-4d9e-a11e-02232ed870fd","Type":"ContainerStarted","Data":"1944baa3a4ff8c22018f8dd7ebbfb27c523035de754137d5dcc4fc74f37ce42c"} May 25 12:16:06.265452 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:06.265326 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-mldx5" May 25 12:16:06.268577 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:06.268549 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"916ba74a-0221-4c54-811a-358055461518","Type":"ContainerStarted","Data":"17db1f6185b5d83b98f211aac869ff254a60a907a404d0bbee3932faf4a5aa7c"} May 25 12:16:06.268577 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:06.268579 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"916ba74a-0221-4c54-811a-358055461518","Type":"ContainerStarted","Data":"89b39196adbb0c2c475a0d586220cba8dd138d1efc10e4d1772c9ab9c41194c1"} May 25 12:16:06.268772 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:06.268594 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"916ba74a-0221-4c54-811a-358055461518","Type":"ContainerStarted","Data":"2d78d7120cf8d9ed9fbe77114ec13d28b88de48ac33939b4e0306c16a5a70161"} May 25 12:16:06.268772 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:06.268602 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"916ba74a-0221-4c54-811a-358055461518","Type":"ContainerStarted","Data":"c4392423d30db6402883ac0422dafbc6359cb06e640928aeb256538e283a81c0"} May 25 12:16:06.268772 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:06.268610 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"916ba74a-0221-4c54-811a-358055461518","Type":"ContainerStarted","Data":"37f5b0411ee8e1e8b9533ccb9a7a6350f1e96cc2de9db3f1fd864bb345cf7ba9"} May 25 12:16:06.268772 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:06.268618 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"916ba74a-0221-4c54-811a-358055461518","Type":"ContainerStarted","Data":"7cbf0471e3a44d7d0ee0c1c87ae3a91149c3acbc46d5a215ba35f6b8aaf82362"} May 25 12:16:06.270412 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:06.270382 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-76749bc9c-k667z" event={"ID":"dd66a003-aa5d-4cc2-92b6-a5f69fee74df","Type":"ContainerStarted","Data":"79bab9efdc70c82380c3c7bce96a2ece05db8330393a254ff26a402c71c951ea"} May 25 12:16:06.271814 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:06.271782 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-mldx5" May 25 12:16:06.272251 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:06.272232 2558 generic.go:358] "Generic (PLEG): container finished" podID="61b5c371-5637-4913-abd0-5790c95d17e1" containerID="19f150cae9885e8fad63cdf50e47b4b6fe3dec9397f3c0ddf331cf7b5ecfe55f" exitCode=0 May 25 12:16:06.272353 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:06.272315 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"61b5c371-5637-4913-abd0-5790c95d17e1","Type":"ContainerDied","Data":"19f150cae9885e8fad63cdf50e47b4b6fe3dec9397f3c0ddf331cf7b5ecfe55f"} May 25 12:16:06.272353 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:06.272345 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"61b5c371-5637-4913-abd0-5790c95d17e1","Type":"ContainerStarted","Data":"e759d422bc34a252d493c6203afaa991c03b014660b424467c5b56247bf4a2c0"} May 25 12:16:06.272826 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:06.272806 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-58bb874567-k497g" May 25 12:16:06.280443 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:06.280395 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-mldx5" podStartSLOduration=1.56049321 podStartE2EDuration="3.280381596s" podCreationTimestamp="2026-05-25 12:16:03 +0000 UTC" firstStartedPulling="2026-05-25 12:16:04.044661124 +0000 UTC m=+197.045449351" lastFinishedPulling="2026-05-25 12:16:05.764549496 +0000 UTC m=+198.765337737" observedRunningTime="2026-05-25 12:16:06.279736821 +0000 UTC m=+199.280525072" watchObservedRunningTime="2026-05-25 12:16:06.280381596 +0000 UTC m=+199.281169847" May 25 12:16:06.314154 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:06.314114 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-76749bc9c-k667z" podStartSLOduration=1.649863008 podStartE2EDuration="3.314083823s" podCreationTimestamp="2026-05-25 12:16:03 +0000 UTC" firstStartedPulling="2026-05-25 12:16:03.550074733 +0000 UTC m=+196.550862960" lastFinishedPulling="2026-05-25 12:16:05.214295535 +0000 UTC m=+198.215083775" observedRunningTime="2026-05-25 12:16:06.313358863 +0000 UTC m=+199.314147113" watchObservedRunningTime="2026-05-25 12:16:06.314083823 +0000 UTC m=+199.314872071" May 25 12:16:06.364571 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:06.364518 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.985812312 podStartE2EDuration="7.364500582s" podCreationTimestamp="2026-05-25 12:15:59 +0000 UTC" firstStartedPulling="2026-05-25 12:16:00.808012425 +0000 UTC m=+193.808800656" lastFinishedPulling="2026-05-25 12:16:05.186700683 +0000 UTC m=+198.187488926" observedRunningTime="2026-05-25 12:16:06.363736829 +0000 UTC m=+199.364525080" watchObservedRunningTime="2026-05-25 12:16:06.364500582 +0000 UTC m=+199.365288828" May 25 12:16:08.280341 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:08.280295 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7797964479-f7rc9" event={"ID":"35e99c47-a6c6-4ae1-b18b-41e885794adb","Type":"ContainerStarted","Data":"c28ad3673bd0d18fbeb95017df25d5bceb38b889df1060a3cf00eeaa7d79e17a"} May 25 12:16:08.300432 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:08.300373 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7797964479-f7rc9" podStartSLOduration=2.076295972 podStartE2EDuration="5.300357312s" podCreationTimestamp="2026-05-25 12:16:03 +0000 UTC" firstStartedPulling="2026-05-25 12:16:04.044227517 +0000 UTC m=+197.045015744" lastFinishedPulling="2026-05-25 12:16:07.268288855 +0000 UTC m=+200.269077084" observedRunningTime="2026-05-25 12:16:08.297385373 +0000 UTC m=+201.298173623" watchObservedRunningTime="2026-05-25 12:16:08.300357312 +0000 UTC m=+201.301145561" May 25 12:16:10.289161 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:10.289122 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"61b5c371-5637-4913-abd0-5790c95d17e1","Type":"ContainerStarted","Data":"5c90cc330eeadd446f1cda94224973f41acc4e8c4a17d4a4d32269ccfc968a26"} May 25 12:16:10.289161 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:10.289163 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"61b5c371-5637-4913-abd0-5790c95d17e1","Type":"ContainerStarted","Data":"265f6844c8bc5c4eea0873fb339e5710cd86e157781c97edeff163f328396670"} May 25 12:16:10.289630 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:10.289173 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"61b5c371-5637-4913-abd0-5790c95d17e1","Type":"ContainerStarted","Data":"d5f48dbc78b6df9735d23644f27891ab48303e0878be8bc8ff8907bff6bd6c10"} May 25 12:16:10.289630 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:10.289181 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"61b5c371-5637-4913-abd0-5790c95d17e1","Type":"ContainerStarted","Data":"b78b135fc0e6202c22272ab5fde81061e9c8a6697c95177dea6558f738b826fa"} May 25 12:16:10.289630 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:10.289189 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"61b5c371-5637-4913-abd0-5790c95d17e1","Type":"ContainerStarted","Data":"a6154b08340b58564a759f2db6be0909783914f47d0ed730757af403d91c1118"} May 25 12:16:10.289630 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:10.289197 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"61b5c371-5637-4913-abd0-5790c95d17e1","Type":"ContainerStarted","Data":"cfa034bdca39ba1edb28a5ba98b471bf8977bf2539816bd7e429666db3eadfbf"} May 25 12:16:10.321113 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:10.321044 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.151689503 podStartE2EDuration="6.32103008s" podCreationTimestamp="2026-05-25 12:16:04 +0000 UTC" firstStartedPulling="2026-05-25 12:16:06.273535178 +0000 UTC m=+199.274323424" lastFinishedPulling="2026-05-25 12:16:09.442875767 +0000 UTC m=+202.443664001" observedRunningTime="2026-05-25 12:16:10.318957534 +0000 UTC m=+203.319745785" watchObservedRunningTime="2026-05-25 12:16:10.32103008 +0000 UTC m=+203.321818329" May 25 12:16:12.284339 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:12.284309 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-58bb874567-k497g" May 25 12:16:13.748240 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:13.748204 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7797964479-f7rc9" May 25 12:16:13.748616 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:13.748251 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7797964479-f7rc9" May 25 12:16:13.752575 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:13.752554 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7797964479-f7rc9" May 25 12:16:14.309979 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:14.309951 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7797964479-f7rc9" May 25 12:16:15.129749 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:15.129713 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:19.793940 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:19.793912 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-574b9ddcd4-5kbh6_658c5966-fad8-4301-bed7-474492cdc44f/router/0.log" May 25 12:16:19.816218 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:19.816195 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jd9hk_49c5d043-eb23-43a4-afb0-0f5ebeba2e8d/serve-healthcheck-canary/0.log" May 25 12:16:23.405636 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:23.405591 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-76749bc9c-k667z" May 25 12:16:23.405636 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:23.405649 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-76749bc9c-k667z" May 25 12:16:43.410142 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:43.410113 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-76749bc9c-k667z" May 25 12:16:43.414079 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:43.414052 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-76749bc9c-k667z" May 25 12:16:58.417246 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:58.417206 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d07b05a-e936-4270-a36e-f25820e43991-metrics-certs\") pod \"network-metrics-daemon-g6zkc\" (UID: \"0d07b05a-e936-4270-a36e-f25820e43991\") " pod="openshift-multus/network-metrics-daemon-g6zkc" May 25 12:16:58.419646 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:58.419622 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d07b05a-e936-4270-a36e-f25820e43991-metrics-certs\") pod \"network-metrics-daemon-g6zkc\" (UID: \"0d07b05a-e936-4270-a36e-f25820e43991\") " pod="openshift-multus/network-metrics-daemon-g6zkc" May 25 12:16:58.462700 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:58.462670 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nlm6z\"" May 25 12:16:58.471020 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:58.470996 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6zkc" May 25 12:16:58.598828 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:58.598732 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g6zkc"] May 25 12:16:58.606427 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:16:58.606321 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d07b05a_e936_4270_a36e_f25820e43991.slice/crio-5107a65f733160177ded55e914e6eb08ea88851cc75ce15521a28c317e6d09d0 WatchSource:0}: Error finding container 5107a65f733160177ded55e914e6eb08ea88851cc75ce15521a28c317e6d09d0: Status 404 returned error can't find the container with id 5107a65f733160177ded55e914e6eb08ea88851cc75ce15521a28c317e6d09d0 May 25 12:16:59.451110 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:16:59.451052 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g6zkc" event={"ID":"0d07b05a-e936-4270-a36e-f25820e43991","Type":"ContainerStarted","Data":"5107a65f733160177ded55e914e6eb08ea88851cc75ce15521a28c317e6d09d0"} May 25 12:17:00.455984 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:00.455949 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g6zkc" event={"ID":"0d07b05a-e936-4270-a36e-f25820e43991","Type":"ContainerStarted","Data":"44bdd7d4c04f0d6a3806331e395be6b3e210b1a56e5576a4d18f5f67199d1f10"} May 25 12:17:00.455984 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:00.455984 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g6zkc" event={"ID":"0d07b05a-e936-4270-a36e-f25820e43991","Type":"ContainerStarted","Data":"95b9f3a224cb485b9079d4a4a6f5a2c01bf6b59036c15e79322795af0badeb25"} May 25 12:17:00.473111 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:00.473043 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-g6zkc" podStartSLOduration=252.289249526 podStartE2EDuration="4m13.473029388s" podCreationTimestamp="2026-05-25 12:12:47 +0000 UTC" firstStartedPulling="2026-05-25 12:16:58.608487476 +0000 UTC m=+251.609275703" lastFinishedPulling="2026-05-25 12:16:59.792267337 +0000 UTC m=+252.793055565" observedRunningTime="2026-05-25 12:17:00.471606953 +0000 UTC m=+253.472395202" watchObservedRunningTime="2026-05-25 12:17:00.473029388 +0000 UTC m=+253.473817637" May 25 12:17:05.129804 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:05.129716 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:05.146300 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:05.146263 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:05.486778 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:05.486704 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:18.872064 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:18.872030 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 25 12:17:18.872553 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:18.872467 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="916ba74a-0221-4c54-811a-358055461518" containerName="alertmanager" containerID="cri-o://7cbf0471e3a44d7d0ee0c1c87ae3a91149c3acbc46d5a215ba35f6b8aaf82362" gracePeriod=120 May 25 12:17:18.872617 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:18.872548 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="916ba74a-0221-4c54-811a-358055461518" containerName="kube-rbac-proxy-metric" containerID="cri-o://89b39196adbb0c2c475a0d586220cba8dd138d1efc10e4d1772c9ab9c41194c1" gracePeriod=120 May 25 12:17:18.872617 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:18.872587 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="916ba74a-0221-4c54-811a-358055461518" containerName="kube-rbac-proxy-web" containerID="cri-o://c4392423d30db6402883ac0422dafbc6359cb06e640928aeb256538e283a81c0" gracePeriod=120 May 25 12:17:18.872720 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:18.872619 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="916ba74a-0221-4c54-811a-358055461518" containerName="kube-rbac-proxy" containerID="cri-o://2d78d7120cf8d9ed9fbe77114ec13d28b88de48ac33939b4e0306c16a5a70161" gracePeriod=120 May 25 12:17:18.872720 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:18.872639 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="916ba74a-0221-4c54-811a-358055461518" containerName="config-reloader" containerID="cri-o://37f5b0411ee8e1e8b9533ccb9a7a6350f1e96cc2de9db3f1fd864bb345cf7ba9" gracePeriod=120 May 25 12:17:18.872720 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:18.872566 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="916ba74a-0221-4c54-811a-358055461518" containerName="prom-label-proxy" containerID="cri-o://17db1f6185b5d83b98f211aac869ff254a60a907a404d0bbee3932faf4a5aa7c" gracePeriod=120 May 25 12:17:19.510016 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:19.509980 2558 generic.go:358] "Generic (PLEG): container finished" podID="916ba74a-0221-4c54-811a-358055461518" containerID="17db1f6185b5d83b98f211aac869ff254a60a907a404d0bbee3932faf4a5aa7c" exitCode=0 May 25 12:17:19.510016 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:19.510008 2558 generic.go:358] "Generic (PLEG): container finished" podID="916ba74a-0221-4c54-811a-358055461518" containerID="2d78d7120cf8d9ed9fbe77114ec13d28b88de48ac33939b4e0306c16a5a70161" exitCode=0 May 25 12:17:19.510016 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:19.510018 2558 generic.go:358] "Generic (PLEG): container finished" podID="916ba74a-0221-4c54-811a-358055461518" containerID="37f5b0411ee8e1e8b9533ccb9a7a6350f1e96cc2de9db3f1fd864bb345cf7ba9" exitCode=0 May 25 12:17:19.510016 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:19.510025 2558 generic.go:358] "Generic (PLEG): container finished" podID="916ba74a-0221-4c54-811a-358055461518" containerID="7cbf0471e3a44d7d0ee0c1c87ae3a91149c3acbc46d5a215ba35f6b8aaf82362" exitCode=0 May 25 12:17:19.510313 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:19.510050 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"916ba74a-0221-4c54-811a-358055461518","Type":"ContainerDied","Data":"17db1f6185b5d83b98f211aac869ff254a60a907a404d0bbee3932faf4a5aa7c"} May 25 12:17:19.510313 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:19.510082 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"916ba74a-0221-4c54-811a-358055461518","Type":"ContainerDied","Data":"2d78d7120cf8d9ed9fbe77114ec13d28b88de48ac33939b4e0306c16a5a70161"} May 25 12:17:19.510313 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:19.510113 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"916ba74a-0221-4c54-811a-358055461518","Type":"ContainerDied","Data":"37f5b0411ee8e1e8b9533ccb9a7a6350f1e96cc2de9db3f1fd864bb345cf7ba9"} May 25 12:17:19.510313 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:19.510128 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"916ba74a-0221-4c54-811a-358055461518","Type":"ContainerDied","Data":"7cbf0471e3a44d7d0ee0c1c87ae3a91149c3acbc46d5a215ba35f6b8aaf82362"} May 25 12:17:20.120411 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.120382 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 25 12:17:20.207442 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.207350 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/916ba74a-0221-4c54-811a-358055461518-cluster-tls-config\") pod \"916ba74a-0221-4c54-811a-358055461518\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " May 25 12:17:20.207442 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.207421 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/916ba74a-0221-4c54-811a-358055461518-web-config\") pod \"916ba74a-0221-4c54-811a-358055461518\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " May 25 12:17:20.207685 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.207448 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/916ba74a-0221-4c54-811a-358055461518-secret-alertmanager-kube-rbac-proxy-metric\") pod \"916ba74a-0221-4c54-811a-358055461518\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " May 25 12:17:20.207685 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.207475 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/916ba74a-0221-4c54-811a-358055461518-config-out\") pod \"916ba74a-0221-4c54-811a-358055461518\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " May 25 12:17:20.207685 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.207498 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/916ba74a-0221-4c54-811a-358055461518-secret-alertmanager-main-tls\") pod \"916ba74a-0221-4c54-811a-358055461518\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " May 25 12:17:20.207685 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.207546 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/916ba74a-0221-4c54-811a-358055461518-tls-assets\") pod \"916ba74a-0221-4c54-811a-358055461518\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " May 25 12:17:20.207685 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.207576 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/916ba74a-0221-4c54-811a-358055461518-secret-alertmanager-kube-rbac-proxy\") pod \"916ba74a-0221-4c54-811a-358055461518\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " May 25 12:17:20.207685 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.207629 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/916ba74a-0221-4c54-811a-358055461518-secret-alertmanager-kube-rbac-proxy-web\") pod \"916ba74a-0221-4c54-811a-358055461518\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " May 25 12:17:20.207685 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.207660 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/916ba74a-0221-4c54-811a-358055461518-alertmanager-trusted-ca-bundle\") pod \"916ba74a-0221-4c54-811a-358055461518\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " May 25 12:17:20.208047 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.207689 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4llvz\" (UniqueName: \"kubernetes.io/projected/916ba74a-0221-4c54-811a-358055461518-kube-api-access-4llvz\") pod \"916ba74a-0221-4c54-811a-358055461518\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " May 25 12:17:20.208047 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.207723 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/916ba74a-0221-4c54-811a-358055461518-config-volume\") pod \"916ba74a-0221-4c54-811a-358055461518\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " May 25 12:17:20.208047 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.207752 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/916ba74a-0221-4c54-811a-358055461518-alertmanager-main-db\") pod \"916ba74a-0221-4c54-811a-358055461518\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " May 25 12:17:20.208047 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.207818 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/916ba74a-0221-4c54-811a-358055461518-metrics-client-ca\") pod \"916ba74a-0221-4c54-811a-358055461518\" (UID: \"916ba74a-0221-4c54-811a-358055461518\") " May 25 12:17:20.209123 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.209035 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/916ba74a-0221-4c54-811a-358055461518-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "916ba74a-0221-4c54-811a-358055461518" (UID: "916ba74a-0221-4c54-811a-358055461518"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 12:17:20.209123 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.209112 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/916ba74a-0221-4c54-811a-358055461518-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "916ba74a-0221-4c54-811a-358055461518" (UID: "916ba74a-0221-4c54-811a-358055461518"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 25 12:17:20.209494 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.209458 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/916ba74a-0221-4c54-811a-358055461518-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "916ba74a-0221-4c54-811a-358055461518" (UID: "916ba74a-0221-4c54-811a-358055461518"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 12:17:20.211581 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.211513 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/916ba74a-0221-4c54-811a-358055461518-config-out" (OuterVolumeSpecName: "config-out") pod "916ba74a-0221-4c54-811a-358055461518" (UID: "916ba74a-0221-4c54-811a-358055461518"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 25 12:17:20.211581 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.211513 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/916ba74a-0221-4c54-811a-358055461518-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "916ba74a-0221-4c54-811a-358055461518" (UID: "916ba74a-0221-4c54-811a-358055461518"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 12:17:20.211734 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.211571 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/916ba74a-0221-4c54-811a-358055461518-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "916ba74a-0221-4c54-811a-358055461518" (UID: "916ba74a-0221-4c54-811a-358055461518"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 12:17:20.211809 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.211791 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/916ba74a-0221-4c54-811a-358055461518-config-volume" (OuterVolumeSpecName: "config-volume") pod "916ba74a-0221-4c54-811a-358055461518" (UID: "916ba74a-0221-4c54-811a-358055461518"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 12:17:20.212139 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.212115 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/916ba74a-0221-4c54-811a-358055461518-kube-api-access-4llvz" (OuterVolumeSpecName: "kube-api-access-4llvz") pod "916ba74a-0221-4c54-811a-358055461518" (UID: "916ba74a-0221-4c54-811a-358055461518"). InnerVolumeSpecName "kube-api-access-4llvz". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 12:17:20.213248 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.213212 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/916ba74a-0221-4c54-811a-358055461518-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "916ba74a-0221-4c54-811a-358055461518" (UID: "916ba74a-0221-4c54-811a-358055461518"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 12:17:20.213248 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.213212 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/916ba74a-0221-4c54-811a-358055461518-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "916ba74a-0221-4c54-811a-358055461518" (UID: "916ba74a-0221-4c54-811a-358055461518"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 12:17:20.213366 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.213340 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/916ba74a-0221-4c54-811a-358055461518-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "916ba74a-0221-4c54-811a-358055461518" (UID: "916ba74a-0221-4c54-811a-358055461518"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 12:17:20.216647 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.216622 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/916ba74a-0221-4c54-811a-358055461518-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "916ba74a-0221-4c54-811a-358055461518" (UID: "916ba74a-0221-4c54-811a-358055461518"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 12:17:20.223943 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.223907 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/916ba74a-0221-4c54-811a-358055461518-web-config" (OuterVolumeSpecName: "web-config") pod "916ba74a-0221-4c54-811a-358055461518" (UID: "916ba74a-0221-4c54-811a-358055461518"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 12:17:20.309198 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.309166 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4llvz\" (UniqueName: \"kubernetes.io/projected/916ba74a-0221-4c54-811a-358055461518-kube-api-access-4llvz\") on node \"ip-10-0-132-116.ec2.internal\" DevicePath \"\"" May 25 12:17:20.309198 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.309196 2558 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/916ba74a-0221-4c54-811a-358055461518-config-volume\") on node \"ip-10-0-132-116.ec2.internal\" DevicePath \"\"" May 25 12:17:20.309198 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.309206 2558 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/916ba74a-0221-4c54-811a-358055461518-alertmanager-main-db\") on node \"ip-10-0-132-116.ec2.internal\" DevicePath \"\"" May 25 12:17:20.309410 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.309215 2558 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/916ba74a-0221-4c54-811a-358055461518-metrics-client-ca\") on node \"ip-10-0-132-116.ec2.internal\" DevicePath \"\"" May 25 12:17:20.309410 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.309223 2558 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/916ba74a-0221-4c54-811a-358055461518-cluster-tls-config\") on node \"ip-10-0-132-116.ec2.internal\" DevicePath \"\"" May 25 12:17:20.309410 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.309233 2558 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/916ba74a-0221-4c54-811a-358055461518-web-config\") on node \"ip-10-0-132-116.ec2.internal\" DevicePath \"\"" May 25 12:17:20.309410 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.309242 2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/916ba74a-0221-4c54-811a-358055461518-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-132-116.ec2.internal\" DevicePath \"\"" May 25 12:17:20.309410 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.309251 2558 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/916ba74a-0221-4c54-811a-358055461518-config-out\") on node \"ip-10-0-132-116.ec2.internal\" DevicePath \"\"" May 25 12:17:20.309410 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.309261 2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/916ba74a-0221-4c54-811a-358055461518-secret-alertmanager-main-tls\") on node \"ip-10-0-132-116.ec2.internal\" DevicePath \"\"" May 25 12:17:20.309410 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.309270 2558 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/916ba74a-0221-4c54-811a-358055461518-tls-assets\") on node \"ip-10-0-132-116.ec2.internal\" DevicePath \"\"" May 25 12:17:20.309410 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.309278 2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/916ba74a-0221-4c54-811a-358055461518-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-132-116.ec2.internal\" DevicePath \"\"" May 25 12:17:20.309410 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.309287 2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/916ba74a-0221-4c54-811a-358055461518-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-132-116.ec2.internal\" DevicePath \"\"" May 25 12:17:20.309410 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.309296 2558 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/916ba74a-0221-4c54-811a-358055461518-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-132-116.ec2.internal\" DevicePath \"\"" May 25 12:17:20.515474 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.515384 2558 generic.go:358] "Generic (PLEG): container finished" podID="916ba74a-0221-4c54-811a-358055461518" containerID="89b39196adbb0c2c475a0d586220cba8dd138d1efc10e4d1772c9ab9c41194c1" exitCode=0 May 25 12:17:20.515474 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.515412 2558 generic.go:358] "Generic (PLEG): container finished" podID="916ba74a-0221-4c54-811a-358055461518" containerID="c4392423d30db6402883ac0422dafbc6359cb06e640928aeb256538e283a81c0" exitCode=0 May 25 12:17:20.515474 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.515457 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"916ba74a-0221-4c54-811a-358055461518","Type":"ContainerDied","Data":"89b39196adbb0c2c475a0d586220cba8dd138d1efc10e4d1772c9ab9c41194c1"} May 25 12:17:20.515731 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.515485 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 25 12:17:20.515731 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.515493 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"916ba74a-0221-4c54-811a-358055461518","Type":"ContainerDied","Data":"c4392423d30db6402883ac0422dafbc6359cb06e640928aeb256538e283a81c0"} May 25 12:17:20.515731 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.515508 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"916ba74a-0221-4c54-811a-358055461518","Type":"ContainerDied","Data":"8f8371830a0154733ee10bd4593ff7c82fd4620b78fc7cffaf7b0e7fcc756704"} May 25 12:17:20.515731 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.515532 2558 scope.go:117] "RemoveContainer" containerID="17db1f6185b5d83b98f211aac869ff254a60a907a404d0bbee3932faf4a5aa7c" May 25 12:17:20.524952 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.524930 2558 scope.go:117] "RemoveContainer" containerID="89b39196adbb0c2c475a0d586220cba8dd138d1efc10e4d1772c9ab9c41194c1" May 25 12:17:20.531954 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.531937 2558 scope.go:117] "RemoveContainer" containerID="2d78d7120cf8d9ed9fbe77114ec13d28b88de48ac33939b4e0306c16a5a70161" May 25 12:17:20.540395 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.540374 2558 scope.go:117] "RemoveContainer" containerID="c4392423d30db6402883ac0422dafbc6359cb06e640928aeb256538e283a81c0" May 25 12:17:20.541171 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.540741 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 25 12:17:20.544595 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.544571 2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 25 12:17:20.548552 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.548528 2558 scope.go:117] "RemoveContainer" containerID="37f5b0411ee8e1e8b9533ccb9a7a6350f1e96cc2de9db3f1fd864bb345cf7ba9" May 25 12:17:20.557613 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.557588 2558 scope.go:117] "RemoveContainer" containerID="7cbf0471e3a44d7d0ee0c1c87ae3a91149c3acbc46d5a215ba35f6b8aaf82362" May 25 12:17:20.565074 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.565051 2558 scope.go:117] "RemoveContainer" containerID="ec0dba068f19bc3efb2fb7f1b3f8c3412342c3fd277f5c4ade155321bd29e1df" May 25 12:17:20.572529 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.572510 2558 scope.go:117] "RemoveContainer" containerID="17db1f6185b5d83b98f211aac869ff254a60a907a404d0bbee3932faf4a5aa7c" May 25 12:17:20.572826 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:17:20.572800 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17db1f6185b5d83b98f211aac869ff254a60a907a404d0bbee3932faf4a5aa7c\": container with ID starting with 17db1f6185b5d83b98f211aac869ff254a60a907a404d0bbee3932faf4a5aa7c not found: ID does not exist" containerID="17db1f6185b5d83b98f211aac869ff254a60a907a404d0bbee3932faf4a5aa7c" May 25 12:17:20.572870 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.572837 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17db1f6185b5d83b98f211aac869ff254a60a907a404d0bbee3932faf4a5aa7c"} err="failed to get container status \"17db1f6185b5d83b98f211aac869ff254a60a907a404d0bbee3932faf4a5aa7c\": rpc error: code = NotFound desc = could not find container \"17db1f6185b5d83b98f211aac869ff254a60a907a404d0bbee3932faf4a5aa7c\": container with ID starting with 17db1f6185b5d83b98f211aac869ff254a60a907a404d0bbee3932faf4a5aa7c not found: ID does not exist" May 25 12:17:20.572914 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.572875 2558 scope.go:117] "RemoveContainer" containerID="89b39196adbb0c2c475a0d586220cba8dd138d1efc10e4d1772c9ab9c41194c1" May 25 12:17:20.573152 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:17:20.573133 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89b39196adbb0c2c475a0d586220cba8dd138d1efc10e4d1772c9ab9c41194c1\": container with ID starting with 89b39196adbb0c2c475a0d586220cba8dd138d1efc10e4d1772c9ab9c41194c1 not found: ID does not exist" containerID="89b39196adbb0c2c475a0d586220cba8dd138d1efc10e4d1772c9ab9c41194c1" May 25 12:17:20.573214 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.573158 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89b39196adbb0c2c475a0d586220cba8dd138d1efc10e4d1772c9ab9c41194c1"} err="failed to get container status \"89b39196adbb0c2c475a0d586220cba8dd138d1efc10e4d1772c9ab9c41194c1\": rpc error: code = NotFound desc = could not find container \"89b39196adbb0c2c475a0d586220cba8dd138d1efc10e4d1772c9ab9c41194c1\": container with ID starting with 89b39196adbb0c2c475a0d586220cba8dd138d1efc10e4d1772c9ab9c41194c1 not found: ID does not exist" May 25 12:17:20.573214 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.573175 2558 scope.go:117] "RemoveContainer" containerID="2d78d7120cf8d9ed9fbe77114ec13d28b88de48ac33939b4e0306c16a5a70161" May 25 12:17:20.573423 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:17:20.573406 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d78d7120cf8d9ed9fbe77114ec13d28b88de48ac33939b4e0306c16a5a70161\": container with ID starting with 2d78d7120cf8d9ed9fbe77114ec13d28b88de48ac33939b4e0306c16a5a70161 not found: ID does not exist" containerID="2d78d7120cf8d9ed9fbe77114ec13d28b88de48ac33939b4e0306c16a5a70161" May 25 12:17:20.573463 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.573428 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d78d7120cf8d9ed9fbe77114ec13d28b88de48ac33939b4e0306c16a5a70161"} err="failed to get container status \"2d78d7120cf8d9ed9fbe77114ec13d28b88de48ac33939b4e0306c16a5a70161\": rpc error: code = NotFound desc = could not find container \"2d78d7120cf8d9ed9fbe77114ec13d28b88de48ac33939b4e0306c16a5a70161\": container with ID starting with 2d78d7120cf8d9ed9fbe77114ec13d28b88de48ac33939b4e0306c16a5a70161 not found: ID does not exist" May 25 12:17:20.573463 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.573452 2558 scope.go:117] "RemoveContainer" containerID="c4392423d30db6402883ac0422dafbc6359cb06e640928aeb256538e283a81c0" May 25 12:17:20.573659 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:17:20.573643 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4392423d30db6402883ac0422dafbc6359cb06e640928aeb256538e283a81c0\": container with ID starting with c4392423d30db6402883ac0422dafbc6359cb06e640928aeb256538e283a81c0 not found: ID does not exist" containerID="c4392423d30db6402883ac0422dafbc6359cb06e640928aeb256538e283a81c0" May 25 12:17:20.573705 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.573662 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4392423d30db6402883ac0422dafbc6359cb06e640928aeb256538e283a81c0"} err="failed to get container status \"c4392423d30db6402883ac0422dafbc6359cb06e640928aeb256538e283a81c0\": rpc error: code = NotFound desc = could not find container \"c4392423d30db6402883ac0422dafbc6359cb06e640928aeb256538e283a81c0\": container with ID starting with c4392423d30db6402883ac0422dafbc6359cb06e640928aeb256538e283a81c0 not found: ID does not exist" May 25 12:17:20.573705 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.573677 2558 scope.go:117] "RemoveContainer" containerID="37f5b0411ee8e1e8b9533ccb9a7a6350f1e96cc2de9db3f1fd864bb345cf7ba9" May 25 12:17:20.573901 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:17:20.573885 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37f5b0411ee8e1e8b9533ccb9a7a6350f1e96cc2de9db3f1fd864bb345cf7ba9\": container with ID starting with 37f5b0411ee8e1e8b9533ccb9a7a6350f1e96cc2de9db3f1fd864bb345cf7ba9 not found: ID does not exist" containerID="37f5b0411ee8e1e8b9533ccb9a7a6350f1e96cc2de9db3f1fd864bb345cf7ba9" May 25 12:17:20.573938 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.573905 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37f5b0411ee8e1e8b9533ccb9a7a6350f1e96cc2de9db3f1fd864bb345cf7ba9"} err="failed to get container status \"37f5b0411ee8e1e8b9533ccb9a7a6350f1e96cc2de9db3f1fd864bb345cf7ba9\": rpc error: code = NotFound desc = could not find container \"37f5b0411ee8e1e8b9533ccb9a7a6350f1e96cc2de9db3f1fd864bb345cf7ba9\": container with ID starting with 37f5b0411ee8e1e8b9533ccb9a7a6350f1e96cc2de9db3f1fd864bb345cf7ba9 not found: ID does not exist" May 25 12:17:20.573938 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.573919 2558 scope.go:117] "RemoveContainer" containerID="7cbf0471e3a44d7d0ee0c1c87ae3a91149c3acbc46d5a215ba35f6b8aaf82362" May 25 12:17:20.574162 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:17:20.574144 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cbf0471e3a44d7d0ee0c1c87ae3a91149c3acbc46d5a215ba35f6b8aaf82362\": container with ID starting with 7cbf0471e3a44d7d0ee0c1c87ae3a91149c3acbc46d5a215ba35f6b8aaf82362 not found: ID does not exist" containerID="7cbf0471e3a44d7d0ee0c1c87ae3a91149c3acbc46d5a215ba35f6b8aaf82362" May 25 12:17:20.574240 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.574163 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cbf0471e3a44d7d0ee0c1c87ae3a91149c3acbc46d5a215ba35f6b8aaf82362"} err="failed to get container status \"7cbf0471e3a44d7d0ee0c1c87ae3a91149c3acbc46d5a215ba35f6b8aaf82362\": rpc error: code = NotFound desc = could not find container \"7cbf0471e3a44d7d0ee0c1c87ae3a91149c3acbc46d5a215ba35f6b8aaf82362\": container with ID starting with 7cbf0471e3a44d7d0ee0c1c87ae3a91149c3acbc46d5a215ba35f6b8aaf82362 not found: ID does not exist" May 25 12:17:20.574240 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.574176 2558 scope.go:117] "RemoveContainer" containerID="ec0dba068f19bc3efb2fb7f1b3f8c3412342c3fd277f5c4ade155321bd29e1df" May 25 12:17:20.574414 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:17:20.574398 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec0dba068f19bc3efb2fb7f1b3f8c3412342c3fd277f5c4ade155321bd29e1df\": container with ID starting with ec0dba068f19bc3efb2fb7f1b3f8c3412342c3fd277f5c4ade155321bd29e1df not found: ID does not exist" containerID="ec0dba068f19bc3efb2fb7f1b3f8c3412342c3fd277f5c4ade155321bd29e1df" May 25 12:17:20.574450 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.574419 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec0dba068f19bc3efb2fb7f1b3f8c3412342c3fd277f5c4ade155321bd29e1df"} err="failed to get container status \"ec0dba068f19bc3efb2fb7f1b3f8c3412342c3fd277f5c4ade155321bd29e1df\": rpc error: code = NotFound desc = could not find container \"ec0dba068f19bc3efb2fb7f1b3f8c3412342c3fd277f5c4ade155321bd29e1df\": container with ID starting with ec0dba068f19bc3efb2fb7f1b3f8c3412342c3fd277f5c4ade155321bd29e1df not found: ID does not exist" May 25 12:17:20.574450 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.574432 2558 scope.go:117] "RemoveContainer" containerID="17db1f6185b5d83b98f211aac869ff254a60a907a404d0bbee3932faf4a5aa7c" May 25 12:17:20.574650 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.574631 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17db1f6185b5d83b98f211aac869ff254a60a907a404d0bbee3932faf4a5aa7c"} err="failed to get container status \"17db1f6185b5d83b98f211aac869ff254a60a907a404d0bbee3932faf4a5aa7c\": rpc error: code = NotFound desc = could not find container \"17db1f6185b5d83b98f211aac869ff254a60a907a404d0bbee3932faf4a5aa7c\": container with ID starting with 17db1f6185b5d83b98f211aac869ff254a60a907a404d0bbee3932faf4a5aa7c not found: ID does not exist" May 25 12:17:20.574694 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.574652 2558 scope.go:117] "RemoveContainer" containerID="89b39196adbb0c2c475a0d586220cba8dd138d1efc10e4d1772c9ab9c41194c1" May 25 12:17:20.574841 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.574828 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89b39196adbb0c2c475a0d586220cba8dd138d1efc10e4d1772c9ab9c41194c1"} err="failed to get container status \"89b39196adbb0c2c475a0d586220cba8dd138d1efc10e4d1772c9ab9c41194c1\": rpc error: code = NotFound desc = could not find container \"89b39196adbb0c2c475a0d586220cba8dd138d1efc10e4d1772c9ab9c41194c1\": container with ID starting with 89b39196adbb0c2c475a0d586220cba8dd138d1efc10e4d1772c9ab9c41194c1 not found: ID does not exist" May 25 12:17:20.574890 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.574842 2558 scope.go:117] "RemoveContainer" containerID="2d78d7120cf8d9ed9fbe77114ec13d28b88de48ac33939b4e0306c16a5a70161" May 25 12:17:20.575047 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.575030 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d78d7120cf8d9ed9fbe77114ec13d28b88de48ac33939b4e0306c16a5a70161"} err="failed to get container status \"2d78d7120cf8d9ed9fbe77114ec13d28b88de48ac33939b4e0306c16a5a70161\": rpc error: code = NotFound desc = could not find container \"2d78d7120cf8d9ed9fbe77114ec13d28b88de48ac33939b4e0306c16a5a70161\": container with ID starting with 2d78d7120cf8d9ed9fbe77114ec13d28b88de48ac33939b4e0306c16a5a70161 not found: ID does not exist" May 25 12:17:20.575114 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.575050 2558 scope.go:117] "RemoveContainer" containerID="c4392423d30db6402883ac0422dafbc6359cb06e640928aeb256538e283a81c0" May 25 12:17:20.575289 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.575265 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4392423d30db6402883ac0422dafbc6359cb06e640928aeb256538e283a81c0"} err="failed to get container status \"c4392423d30db6402883ac0422dafbc6359cb06e640928aeb256538e283a81c0\": rpc error: code = NotFound desc = could not find container \"c4392423d30db6402883ac0422dafbc6359cb06e640928aeb256538e283a81c0\": container with ID starting with c4392423d30db6402883ac0422dafbc6359cb06e640928aeb256538e283a81c0 not found: ID does not exist" May 25 12:17:20.575289 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.575287 2558 scope.go:117] "RemoveContainer" containerID="37f5b0411ee8e1e8b9533ccb9a7a6350f1e96cc2de9db3f1fd864bb345cf7ba9" May 25 12:17:20.575497 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.575481 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37f5b0411ee8e1e8b9533ccb9a7a6350f1e96cc2de9db3f1fd864bb345cf7ba9"} err="failed to get container status \"37f5b0411ee8e1e8b9533ccb9a7a6350f1e96cc2de9db3f1fd864bb345cf7ba9\": rpc error: code = NotFound desc = could not find container \"37f5b0411ee8e1e8b9533ccb9a7a6350f1e96cc2de9db3f1fd864bb345cf7ba9\": container with ID starting with 37f5b0411ee8e1e8b9533ccb9a7a6350f1e96cc2de9db3f1fd864bb345cf7ba9 not found: ID does not exist" May 25 12:17:20.575555 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.575497 2558 scope.go:117] "RemoveContainer" containerID="7cbf0471e3a44d7d0ee0c1c87ae3a91149c3acbc46d5a215ba35f6b8aaf82362" May 25 12:17:20.575702 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.575683 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cbf0471e3a44d7d0ee0c1c87ae3a91149c3acbc46d5a215ba35f6b8aaf82362"} err="failed to get container status \"7cbf0471e3a44d7d0ee0c1c87ae3a91149c3acbc46d5a215ba35f6b8aaf82362\": rpc error: code = NotFound desc = could not find container \"7cbf0471e3a44d7d0ee0c1c87ae3a91149c3acbc46d5a215ba35f6b8aaf82362\": container with ID starting with 7cbf0471e3a44d7d0ee0c1c87ae3a91149c3acbc46d5a215ba35f6b8aaf82362 not found: ID does not exist" May 25 12:17:20.575764 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.575705 2558 scope.go:117] "RemoveContainer" containerID="ec0dba068f19bc3efb2fb7f1b3f8c3412342c3fd277f5c4ade155321bd29e1df" May 25 12:17:20.575905 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.575890 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec0dba068f19bc3efb2fb7f1b3f8c3412342c3fd277f5c4ade155321bd29e1df"} err="failed to get container status \"ec0dba068f19bc3efb2fb7f1b3f8c3412342c3fd277f5c4ade155321bd29e1df\": rpc error: code = NotFound desc = could not find container \"ec0dba068f19bc3efb2fb7f1b3f8c3412342c3fd277f5c4ade155321bd29e1df\": container with ID starting with ec0dba068f19bc3efb2fb7f1b3f8c3412342c3fd277f5c4ade155321bd29e1df not found: ID does not exist" May 25 12:17:20.581484 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.581462 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 25 12:17:20.581826 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.581803 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="916ba74a-0221-4c54-811a-358055461518" containerName="prom-label-proxy" May 25 12:17:20.581826 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.581818 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="916ba74a-0221-4c54-811a-358055461518" containerName="prom-label-proxy" May 25 12:17:20.581916 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.581831 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="916ba74a-0221-4c54-811a-358055461518" containerName="alertmanager" May 25 12:17:20.581916 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.581837 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="916ba74a-0221-4c54-811a-358055461518" containerName="alertmanager" May 25 12:17:20.581916 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.581846 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="916ba74a-0221-4c54-811a-358055461518" containerName="config-reloader" May 25 12:17:20.581916 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.581852 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="916ba74a-0221-4c54-811a-358055461518" containerName="config-reloader" May 25 12:17:20.581916 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.581859 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="916ba74a-0221-4c54-811a-358055461518" containerName="init-config-reloader" May 25 12:17:20.581916 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.581864 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="916ba74a-0221-4c54-811a-358055461518" containerName="init-config-reloader" May 25 12:17:20.581916 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.581875 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="916ba74a-0221-4c54-811a-358055461518" containerName="kube-rbac-proxy" May 25 12:17:20.581916 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.581880 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="916ba74a-0221-4c54-811a-358055461518" containerName="kube-rbac-proxy" May 25 12:17:20.581916 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.581885 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="916ba74a-0221-4c54-811a-358055461518" containerName="kube-rbac-proxy-metric" May 25 12:17:20.581916 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.581890 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="916ba74a-0221-4c54-811a-358055461518" containerName="kube-rbac-proxy-metric" May 25 12:17:20.581916 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.581896 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="916ba74a-0221-4c54-811a-358055461518" containerName="kube-rbac-proxy-web" May 25 12:17:20.581916 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.581901 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="916ba74a-0221-4c54-811a-358055461518" containerName="kube-rbac-proxy-web" May 25 12:17:20.582300 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.581962 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="916ba74a-0221-4c54-811a-358055461518" containerName="config-reloader" May 25 12:17:20.582300 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.581971 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="916ba74a-0221-4c54-811a-358055461518" containerName="prom-label-proxy" May 25 12:17:20.582300 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.581977 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="916ba74a-0221-4c54-811a-358055461518" containerName="kube-rbac-proxy" May 25 12:17:20.582300 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.581983 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="916ba74a-0221-4c54-811a-358055461518" containerName="kube-rbac-proxy-metric" May 25 12:17:20.582300 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.581990 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="916ba74a-0221-4c54-811a-358055461518" containerName="alertmanager" May 25 12:17:20.582300 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.581997 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="916ba74a-0221-4c54-811a-358055461518" containerName="kube-rbac-proxy-web" May 25 12:17:20.585602 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.585583 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 25 12:17:20.588368 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.588350 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bxjng\"" May 25 12:17:20.588486 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.588365 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 25 12:17:20.588486 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.588397 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 25 12:17:20.588486 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.588354 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 25 12:17:20.588486 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.588351 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 25 12:17:20.588714 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.588691 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 25 12:17:20.588714 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.588709 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 25 12:17:20.588821 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.588708 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 25 12:17:20.588821 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.588691 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 25 12:17:20.593339 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.593322 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 25 12:17:20.597216 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.597194 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 25 12:17:20.712878 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.712821 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8fvs\" (UniqueName: \"kubernetes.io/projected/f55615a8-9290-4b68-831e-abde9a0d317d-kube-api-access-h8fvs\") pod \"alertmanager-main-0\" (UID: \"f55615a8-9290-4b68-831e-abde9a0d317d\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:17:20.712878 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.712888 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f55615a8-9290-4b68-831e-abde9a0d317d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f55615a8-9290-4b68-831e-abde9a0d317d\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:17:20.713132 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.712916 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f55615a8-9290-4b68-831e-abde9a0d317d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f55615a8-9290-4b68-831e-abde9a0d317d\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:17:20.713132 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.713009 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f55615a8-9290-4b68-831e-abde9a0d317d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f55615a8-9290-4b68-831e-abde9a0d317d\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:17:20.713132 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.713043 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f55615a8-9290-4b68-831e-abde9a0d317d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f55615a8-9290-4b68-831e-abde9a0d317d\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:17:20.713132 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.713074 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f55615a8-9290-4b68-831e-abde9a0d317d-config-out\") pod \"alertmanager-main-0\" (UID: \"f55615a8-9290-4b68-831e-abde9a0d317d\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:17:20.713132 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.713128 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f55615a8-9290-4b68-831e-abde9a0d317d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f55615a8-9290-4b68-831e-abde9a0d317d\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:17:20.713295 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.713154 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f55615a8-9290-4b68-831e-abde9a0d317d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f55615a8-9290-4b68-831e-abde9a0d317d\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:17:20.713295 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.713172 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f55615a8-9290-4b68-831e-abde9a0d317d-web-config\") pod \"alertmanager-main-0\" (UID: \"f55615a8-9290-4b68-831e-abde9a0d317d\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:17:20.713295 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.713202 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f55615a8-9290-4b68-831e-abde9a0d317d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f55615a8-9290-4b68-831e-abde9a0d317d\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:17:20.713295 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.713237 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f55615a8-9290-4b68-831e-abde9a0d317d-config-volume\") pod \"alertmanager-main-0\" (UID: \"f55615a8-9290-4b68-831e-abde9a0d317d\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:17:20.713295 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.713252 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f55615a8-9290-4b68-831e-abde9a0d317d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f55615a8-9290-4b68-831e-abde9a0d317d\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:17:20.713438 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.713313 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f55615a8-9290-4b68-831e-abde9a0d317d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f55615a8-9290-4b68-831e-abde9a0d317d\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:17:20.814601 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.814509 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f55615a8-9290-4b68-831e-abde9a0d317d-config-volume\") pod \"alertmanager-main-0\" (UID: \"f55615a8-9290-4b68-831e-abde9a0d317d\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:17:20.814601 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.814547 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f55615a8-9290-4b68-831e-abde9a0d317d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f55615a8-9290-4b68-831e-abde9a0d317d\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:17:20.814601 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.814574 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f55615a8-9290-4b68-831e-abde9a0d317d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f55615a8-9290-4b68-831e-abde9a0d317d\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:17:20.814842 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.814694 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h8fvs\" (UniqueName: \"kubernetes.io/projected/f55615a8-9290-4b68-831e-abde9a0d317d-kube-api-access-h8fvs\") pod \"alertmanager-main-0\" (UID: \"f55615a8-9290-4b68-831e-abde9a0d317d\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:17:20.814842 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.814736 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f55615a8-9290-4b68-831e-abde9a0d317d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f55615a8-9290-4b68-831e-abde9a0d317d\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:17:20.814842 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.814762 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f55615a8-9290-4b68-831e-abde9a0d317d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f55615a8-9290-4b68-831e-abde9a0d317d\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:17:20.814842 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.814813 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f55615a8-9290-4b68-831e-abde9a0d317d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f55615a8-9290-4b68-831e-abde9a0d317d\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:17:20.815009 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.814841 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f55615a8-9290-4b68-831e-abde9a0d317d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f55615a8-9290-4b68-831e-abde9a0d317d\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:17:20.815009 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.814871 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f55615a8-9290-4b68-831e-abde9a0d317d-config-out\") pod \"alertmanager-main-0\" (UID: \"f55615a8-9290-4b68-831e-abde9a0d317d\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:17:20.815009 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.814899 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f55615a8-9290-4b68-831e-abde9a0d317d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f55615a8-9290-4b68-831e-abde9a0d317d\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:17:20.815009 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.814928 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f55615a8-9290-4b68-831e-abde9a0d317d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f55615a8-9290-4b68-831e-abde9a0d317d\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:17:20.815009 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.814957 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f55615a8-9290-4b68-831e-abde9a0d317d-web-config\") pod \"alertmanager-main-0\" (UID: \"f55615a8-9290-4b68-831e-abde9a0d317d\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:17:20.815009 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.814972 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f55615a8-9290-4b68-831e-abde9a0d317d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f55615a8-9290-4b68-831e-abde9a0d317d\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:17:20.815344 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.815030 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f55615a8-9290-4b68-831e-abde9a0d317d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f55615a8-9290-4b68-831e-abde9a0d317d\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:17:20.815928 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.815902 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f55615a8-9290-4b68-831e-abde9a0d317d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f55615a8-9290-4b68-831e-abde9a0d317d\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:17:20.816040 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.815955 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f55615a8-9290-4b68-831e-abde9a0d317d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f55615a8-9290-4b68-831e-abde9a0d317d\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:17:20.818106 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.818021 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f55615a8-9290-4b68-831e-abde9a0d317d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f55615a8-9290-4b68-831e-abde9a0d317d\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:17:20.818259 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.818211 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f55615a8-9290-4b68-831e-abde9a0d317d-config-out\") pod \"alertmanager-main-0\" (UID: \"f55615a8-9290-4b68-831e-abde9a0d317d\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:17:20.818259 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.818242 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f55615a8-9290-4b68-831e-abde9a0d317d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f55615a8-9290-4b68-831e-abde9a0d317d\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:17:20.818376 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.818253 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f55615a8-9290-4b68-831e-abde9a0d317d-config-volume\") pod \"alertmanager-main-0\" (UID: \"f55615a8-9290-4b68-831e-abde9a0d317d\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:17:20.818495 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.818476 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f55615a8-9290-4b68-831e-abde9a0d317d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f55615a8-9290-4b68-831e-abde9a0d317d\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:17:20.818860 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.818845 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f55615a8-9290-4b68-831e-abde9a0d317d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f55615a8-9290-4b68-831e-abde9a0d317d\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:17:20.819136 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.819115 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f55615a8-9290-4b68-831e-abde9a0d317d-web-config\") pod \"alertmanager-main-0\" (UID: \"f55615a8-9290-4b68-831e-abde9a0d317d\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:17:20.819565 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.819548 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f55615a8-9290-4b68-831e-abde9a0d317d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f55615a8-9290-4b68-831e-abde9a0d317d\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:17:20.820194 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.820177 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f55615a8-9290-4b68-831e-abde9a0d317d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f55615a8-9290-4b68-831e-abde9a0d317d\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:17:20.822375 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.822355 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8fvs\" (UniqueName: \"kubernetes.io/projected/f55615a8-9290-4b68-831e-abde9a0d317d-kube-api-access-h8fvs\") pod \"alertmanager-main-0\" (UID: \"f55615a8-9290-4b68-831e-abde9a0d317d\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:17:20.895988 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:20.895951 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 25 12:17:21.041835 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:21.041809 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 25 12:17:21.043862 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:17:21.043833 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf55615a8_9290_4b68_831e_abde9a0d317d.slice/crio-45dd18c015231d7db9024c95dba6f70edacdd176b70b3698dd1764c1211ea687 WatchSource:0}: Error finding container 45dd18c015231d7db9024c95dba6f70edacdd176b70b3698dd1764c1211ea687: Status 404 returned error can't find the container with id 45dd18c015231d7db9024c95dba6f70edacdd176b70b3698dd1764c1211ea687 May 25 12:17:21.519771 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:21.519736 2558 generic.go:358] "Generic (PLEG): container finished" podID="f55615a8-9290-4b68-831e-abde9a0d317d" containerID="7bcee70952f91e0299e2d22cd6077e384d0e26776438d991541d7f366ca3fdf6" exitCode=0 May 25 12:17:21.520242 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:21.519833 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f55615a8-9290-4b68-831e-abde9a0d317d","Type":"ContainerDied","Data":"7bcee70952f91e0299e2d22cd6077e384d0e26776438d991541d7f366ca3fdf6"} May 25 12:17:21.520242 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:21.519875 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f55615a8-9290-4b68-831e-abde9a0d317d","Type":"ContainerStarted","Data":"45dd18c015231d7db9024c95dba6f70edacdd176b70b3698dd1764c1211ea687"} May 25 12:17:21.563855 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:21.563823 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="916ba74a-0221-4c54-811a-358055461518" path="/var/lib/kubelet/pods/916ba74a-0221-4c54-811a-358055461518/volumes" May 25 12:17:22.527566 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:22.527527 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f55615a8-9290-4b68-831e-abde9a0d317d","Type":"ContainerStarted","Data":"c000faf64f0e1a76650ebe919f6c9f285a31dbbc38994af57f42cdff98ab6bad"} May 25 12:17:22.527566 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:22.527568 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f55615a8-9290-4b68-831e-abde9a0d317d","Type":"ContainerStarted","Data":"ddf76e1a376037d06bcf91340d6f3490bfb5c559011ef837970b5124b2602a37"} May 25 12:17:22.528005 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:22.527577 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f55615a8-9290-4b68-831e-abde9a0d317d","Type":"ContainerStarted","Data":"774926f46f10aadf210945cdda52725f2f68cf8610f8424c836ec274c9647626"} May 25 12:17:22.528005 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:22.527587 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f55615a8-9290-4b68-831e-abde9a0d317d","Type":"ContainerStarted","Data":"cfc6f57d779a68ed751879b80f4bdfea7c2b01fc36a37422e58b634830e27608"} May 25 12:17:22.528005 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:22.527595 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f55615a8-9290-4b68-831e-abde9a0d317d","Type":"ContainerStarted","Data":"ce6b633322c740487bc4819e63409f5a43f25b54404b8c3dc9a03440c15b0f84"} May 25 12:17:22.528005 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:22.527604 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f55615a8-9290-4b68-831e-abde9a0d317d","Type":"ContainerStarted","Data":"11791ba513f70ebbaaf013f904cf7215b3c6a2faf9b81eb34cbd47fe32ef3757"} May 25 12:17:22.555041 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:22.554980 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.554961741 podStartE2EDuration="2.554961741s" podCreationTimestamp="2026-05-25 12:17:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 12:17:22.552618757 +0000 UTC m=+275.553407006" watchObservedRunningTime="2026-05-25 12:17:22.554961741 +0000 UTC m=+275.555749992" May 25 12:17:23.178263 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.178228 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 12:17:23.178749 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.178632 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="61b5c371-5637-4913-abd0-5790c95d17e1" containerName="prometheus" containerID="cri-o://cfa034bdca39ba1edb28a5ba98b471bf8977bf2539816bd7e429666db3eadfbf" gracePeriod=600 May 25 12:17:23.178749 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.178689 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="61b5c371-5637-4913-abd0-5790c95d17e1" containerName="thanos-sidecar" containerID="cri-o://b78b135fc0e6202c22272ab5fde81061e9c8a6697c95177dea6558f738b826fa" gracePeriod=600 May 25 12:17:23.178749 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.178712 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="61b5c371-5637-4913-abd0-5790c95d17e1" containerName="kube-rbac-proxy-thanos" containerID="cri-o://5c90cc330eeadd446f1cda94224973f41acc4e8c4a17d4a4d32269ccfc968a26" gracePeriod=600 May 25 12:17:23.178749 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.178662 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="61b5c371-5637-4913-abd0-5790c95d17e1" containerName="kube-rbac-proxy" containerID="cri-o://265f6844c8bc5c4eea0873fb339e5710cd86e157781c97edeff163f328396670" gracePeriod=600 May 25 12:17:23.179049 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.178699 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="61b5c371-5637-4913-abd0-5790c95d17e1" containerName="config-reloader" containerID="cri-o://a6154b08340b58564a759f2db6be0909783914f47d0ed730757af403d91c1118" gracePeriod=600 May 25 12:17:23.179049 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.178676 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="61b5c371-5637-4913-abd0-5790c95d17e1" containerName="kube-rbac-proxy-web" containerID="cri-o://d5f48dbc78b6df9735d23644f27891ab48303e0878be8bc8ff8907bff6bd6c10" gracePeriod=600 May 25 12:17:23.417682 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.417653 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:23.533682 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.533577 2558 generic.go:358] "Generic (PLEG): container finished" podID="61b5c371-5637-4913-abd0-5790c95d17e1" containerID="5c90cc330eeadd446f1cda94224973f41acc4e8c4a17d4a4d32269ccfc968a26" exitCode=0 May 25 12:17:23.533682 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.533609 2558 generic.go:358] "Generic (PLEG): container finished" podID="61b5c371-5637-4913-abd0-5790c95d17e1" containerID="265f6844c8bc5c4eea0873fb339e5710cd86e157781c97edeff163f328396670" exitCode=0 May 25 12:17:23.533682 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.533619 2558 generic.go:358] "Generic (PLEG): container finished" podID="61b5c371-5637-4913-abd0-5790c95d17e1" containerID="d5f48dbc78b6df9735d23644f27891ab48303e0878be8bc8ff8907bff6bd6c10" exitCode=0 May 25 12:17:23.533682 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.533627 2558 generic.go:358] "Generic (PLEG): container finished" podID="61b5c371-5637-4913-abd0-5790c95d17e1" containerID="b78b135fc0e6202c22272ab5fde81061e9c8a6697c95177dea6558f738b826fa" exitCode=0 May 25 12:17:23.533682 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.533635 2558 generic.go:358] "Generic (PLEG): container finished" podID="61b5c371-5637-4913-abd0-5790c95d17e1" containerID="a6154b08340b58564a759f2db6be0909783914f47d0ed730757af403d91c1118" exitCode=0 May 25 12:17:23.533682 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.533641 2558 generic.go:358] "Generic (PLEG): container finished" podID="61b5c371-5637-4913-abd0-5790c95d17e1" containerID="cfa034bdca39ba1edb28a5ba98b471bf8977bf2539816bd7e429666db3eadfbf" exitCode=0 May 25 12:17:23.533682 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.533662 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"61b5c371-5637-4913-abd0-5790c95d17e1","Type":"ContainerDied","Data":"5c90cc330eeadd446f1cda94224973f41acc4e8c4a17d4a4d32269ccfc968a26"} May 25 12:17:23.533682 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.533685 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:23.534454 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.533703 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"61b5c371-5637-4913-abd0-5790c95d17e1","Type":"ContainerDied","Data":"265f6844c8bc5c4eea0873fb339e5710cd86e157781c97edeff163f328396670"} May 25 12:17:23.534454 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.533714 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"61b5c371-5637-4913-abd0-5790c95d17e1","Type":"ContainerDied","Data":"d5f48dbc78b6df9735d23644f27891ab48303e0878be8bc8ff8907bff6bd6c10"} May 25 12:17:23.534454 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.533723 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"61b5c371-5637-4913-abd0-5790c95d17e1","Type":"ContainerDied","Data":"b78b135fc0e6202c22272ab5fde81061e9c8a6697c95177dea6558f738b826fa"} May 25 12:17:23.534454 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.533733 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"61b5c371-5637-4913-abd0-5790c95d17e1","Type":"ContainerDied","Data":"a6154b08340b58564a759f2db6be0909783914f47d0ed730757af403d91c1118"} May 25 12:17:23.534454 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.533743 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"61b5c371-5637-4913-abd0-5790c95d17e1","Type":"ContainerDied","Data":"cfa034bdca39ba1edb28a5ba98b471bf8977bf2539816bd7e429666db3eadfbf"} May 25 12:17:23.534454 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.533753 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"61b5c371-5637-4913-abd0-5790c95d17e1","Type":"ContainerDied","Data":"e759d422bc34a252d493c6203afaa991c03b014660b424467c5b56247bf4a2c0"} May 25 12:17:23.534454 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.533767 2558 scope.go:117] "RemoveContainer" containerID="5c90cc330eeadd446f1cda94224973f41acc4e8c4a17d4a4d32269ccfc968a26" May 25 12:17:23.541023 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.540998 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-web-config\") pod \"61b5c371-5637-4913-abd0-5790c95d17e1\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " May 25 12:17:23.541166 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.541051 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-thanos-prometheus-http-client-file\") pod \"61b5c371-5637-4913-abd0-5790c95d17e1\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " May 25 12:17:23.541166 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.541078 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-secret-kube-rbac-proxy\") pod \"61b5c371-5637-4913-abd0-5790c95d17e1\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " May 25 12:17:23.541166 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.541120 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61b5c371-5637-4913-abd0-5790c95d17e1-configmap-metrics-client-ca\") pod \"61b5c371-5637-4913-abd0-5790c95d17e1\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " May 25 12:17:23.541166 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.541142 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-492kt\" (UniqueName: \"kubernetes.io/projected/61b5c371-5637-4913-abd0-5790c95d17e1-kube-api-access-492kt\") pod \"61b5c371-5637-4913-abd0-5790c95d17e1\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " May 25 12:17:23.541383 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.541171 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-secret-prometheus-k8s-tls\") pod \"61b5c371-5637-4913-abd0-5790c95d17e1\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " May 25 12:17:23.541383 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.541212 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-config\") pod \"61b5c371-5637-4913-abd0-5790c95d17e1\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " May 25 12:17:23.541383 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.541236 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/61b5c371-5637-4913-abd0-5790c95d17e1-tls-assets\") pod \"61b5c371-5637-4913-abd0-5790c95d17e1\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " May 25 12:17:23.541383 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.541273 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"61b5c371-5637-4913-abd0-5790c95d17e1\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " May 25 12:17:23.541383 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.541300 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/61b5c371-5637-4913-abd0-5790c95d17e1-prometheus-k8s-db\") pod \"61b5c371-5637-4913-abd0-5790c95d17e1\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " May 25 12:17:23.541383 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.541339 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61b5c371-5637-4913-abd0-5790c95d17e1-prometheus-trusted-ca-bundle\") pod \"61b5c371-5637-4913-abd0-5790c95d17e1\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " May 25 12:17:23.541665 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.541389 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"61b5c371-5637-4913-abd0-5790c95d17e1\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " May 25 12:17:23.541665 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.541415 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61b5c371-5637-4913-abd0-5790c95d17e1-configmap-kubelet-serving-ca-bundle\") pod \"61b5c371-5637-4913-abd0-5790c95d17e1\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " May 25 12:17:23.541665 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.541440 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-secret-metrics-client-certs\") pod \"61b5c371-5637-4913-abd0-5790c95d17e1\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " May 25 12:17:23.541665 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.541487 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61b5c371-5637-4913-abd0-5790c95d17e1-configmap-serving-certs-ca-bundle\") pod \"61b5c371-5637-4913-abd0-5790c95d17e1\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " May 25 12:17:23.541665 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.541524 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61b5c371-5637-4913-abd0-5790c95d17e1-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "61b5c371-5637-4913-abd0-5790c95d17e1" (UID: "61b5c371-5637-4913-abd0-5790c95d17e1"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 12:17:23.541665 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.541540 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/61b5c371-5637-4913-abd0-5790c95d17e1-prometheus-k8s-rulefiles-0\") pod \"61b5c371-5637-4913-abd0-5790c95d17e1\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " May 25 12:17:23.541665 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.541591 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/61b5c371-5637-4913-abd0-5790c95d17e1-config-out\") pod \"61b5c371-5637-4913-abd0-5790c95d17e1\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " May 25 12:17:23.541665 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.541624 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-secret-grpc-tls\") pod \"61b5c371-5637-4913-abd0-5790c95d17e1\" (UID: \"61b5c371-5637-4913-abd0-5790c95d17e1\") " May 25 12:17:23.542040 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.542005 2558 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61b5c371-5637-4913-abd0-5790c95d17e1-configmap-metrics-client-ca\") on node \"ip-10-0-132-116.ec2.internal\" DevicePath \"\"" May 25 12:17:23.542746 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.542578 2558 scope.go:117] "RemoveContainer" containerID="265f6844c8bc5c4eea0873fb339e5710cd86e157781c97edeff163f328396670" May 25 12:17:23.543186 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.543070 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61b5c371-5637-4913-abd0-5790c95d17e1-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "61b5c371-5637-4913-abd0-5790c95d17e1" (UID: "61b5c371-5637-4913-abd0-5790c95d17e1"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 12:17:23.544148 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.543946 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61b5c371-5637-4913-abd0-5790c95d17e1-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "61b5c371-5637-4913-abd0-5790c95d17e1" (UID: "61b5c371-5637-4913-abd0-5790c95d17e1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 12:17:23.544803 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.544378 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61b5c371-5637-4913-abd0-5790c95d17e1-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "61b5c371-5637-4913-abd0-5790c95d17e1" (UID: "61b5c371-5637-4913-abd0-5790c95d17e1"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 12:17:23.544803 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.544628 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61b5c371-5637-4913-abd0-5790c95d17e1-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "61b5c371-5637-4913-abd0-5790c95d17e1" (UID: "61b5c371-5637-4913-abd0-5790c95d17e1"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 12:17:23.544803 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.544727 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61b5c371-5637-4913-abd0-5790c95d17e1-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "61b5c371-5637-4913-abd0-5790c95d17e1" (UID: "61b5c371-5637-4913-abd0-5790c95d17e1"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 25 12:17:23.545063 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.545040 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "61b5c371-5637-4913-abd0-5790c95d17e1" (UID: "61b5c371-5637-4913-abd0-5790c95d17e1"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 12:17:23.545385 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.545281 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-config" (OuterVolumeSpecName: "config") pod "61b5c371-5637-4913-abd0-5790c95d17e1" (UID: "61b5c371-5637-4913-abd0-5790c95d17e1"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 12:17:23.545748 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.545711 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61b5c371-5637-4913-abd0-5790c95d17e1-config-out" (OuterVolumeSpecName: "config-out") pod "61b5c371-5637-4913-abd0-5790c95d17e1" (UID: "61b5c371-5637-4913-abd0-5790c95d17e1"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 25 12:17:23.545843 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.545826 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "61b5c371-5637-4913-abd0-5790c95d17e1" (UID: "61b5c371-5637-4913-abd0-5790c95d17e1"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 12:17:23.546068 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.546020 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "61b5c371-5637-4913-abd0-5790c95d17e1" (UID: "61b5c371-5637-4913-abd0-5790c95d17e1"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 12:17:23.546616 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.546591 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "61b5c371-5637-4913-abd0-5790c95d17e1" (UID: "61b5c371-5637-4913-abd0-5790c95d17e1"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 12:17:23.546702 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.546649 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61b5c371-5637-4913-abd0-5790c95d17e1-kube-api-access-492kt" (OuterVolumeSpecName: "kube-api-access-492kt") pod "61b5c371-5637-4913-abd0-5790c95d17e1" (UID: "61b5c371-5637-4913-abd0-5790c95d17e1"). InnerVolumeSpecName "kube-api-access-492kt". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 12:17:23.546989 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.546969 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "61b5c371-5637-4913-abd0-5790c95d17e1" (UID: "61b5c371-5637-4913-abd0-5790c95d17e1"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 12:17:23.547301 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.547254 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "61b5c371-5637-4913-abd0-5790c95d17e1" (UID: "61b5c371-5637-4913-abd0-5790c95d17e1"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 12:17:23.547431 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.547409 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61b5c371-5637-4913-abd0-5790c95d17e1-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "61b5c371-5637-4913-abd0-5790c95d17e1" (UID: "61b5c371-5637-4913-abd0-5790c95d17e1"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 12:17:23.547796 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.547776 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "61b5c371-5637-4913-abd0-5790c95d17e1" (UID: "61b5c371-5637-4913-abd0-5790c95d17e1"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 12:17:23.553087 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.553067 2558 scope.go:117] "RemoveContainer" containerID="d5f48dbc78b6df9735d23644f27891ab48303e0878be8bc8ff8907bff6bd6c10" May 25 12:17:23.558745 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.558720 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-web-config" (OuterVolumeSpecName: "web-config") pod "61b5c371-5637-4913-abd0-5790c95d17e1" (UID: "61b5c371-5637-4913-abd0-5790c95d17e1"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 12:17:23.562478 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.562084 2558 scope.go:117] "RemoveContainer" containerID="b78b135fc0e6202c22272ab5fde81061e9c8a6697c95177dea6558f738b826fa" May 25 12:17:23.569594 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.569561 2558 scope.go:117] "RemoveContainer" containerID="a6154b08340b58564a759f2db6be0909783914f47d0ed730757af403d91c1118" May 25 12:17:23.576772 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.576749 2558 scope.go:117] "RemoveContainer" containerID="cfa034bdca39ba1edb28a5ba98b471bf8977bf2539816bd7e429666db3eadfbf" May 25 12:17:23.584070 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.584050 2558 scope.go:117] "RemoveContainer" containerID="19f150cae9885e8fad63cdf50e47b4b6fe3dec9397f3c0ddf331cf7b5ecfe55f" May 25 12:17:23.590647 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.590617 2558 scope.go:117] "RemoveContainer" containerID="5c90cc330eeadd446f1cda94224973f41acc4e8c4a17d4a4d32269ccfc968a26" May 25 12:17:23.590886 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:17:23.590867 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c90cc330eeadd446f1cda94224973f41acc4e8c4a17d4a4d32269ccfc968a26\": container with ID starting with 5c90cc330eeadd446f1cda94224973f41acc4e8c4a17d4a4d32269ccfc968a26 not found: ID does not exist" containerID="5c90cc330eeadd446f1cda94224973f41acc4e8c4a17d4a4d32269ccfc968a26" May 25 12:17:23.590931 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.590897 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c90cc330eeadd446f1cda94224973f41acc4e8c4a17d4a4d32269ccfc968a26"} err="failed to get container status \"5c90cc330eeadd446f1cda94224973f41acc4e8c4a17d4a4d32269ccfc968a26\": rpc error: code = NotFound desc = could not find container \"5c90cc330eeadd446f1cda94224973f41acc4e8c4a17d4a4d32269ccfc968a26\": container with ID starting with 5c90cc330eeadd446f1cda94224973f41acc4e8c4a17d4a4d32269ccfc968a26 not found: ID does not exist" May 25 12:17:23.590931 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.590918 2558 scope.go:117] "RemoveContainer" containerID="265f6844c8bc5c4eea0873fb339e5710cd86e157781c97edeff163f328396670" May 25 12:17:23.591143 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:17:23.591123 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"265f6844c8bc5c4eea0873fb339e5710cd86e157781c97edeff163f328396670\": container with ID starting with 265f6844c8bc5c4eea0873fb339e5710cd86e157781c97edeff163f328396670 not found: ID does not exist" containerID="265f6844c8bc5c4eea0873fb339e5710cd86e157781c97edeff163f328396670" May 25 12:17:23.591189 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.591151 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"265f6844c8bc5c4eea0873fb339e5710cd86e157781c97edeff163f328396670"} err="failed to get container status \"265f6844c8bc5c4eea0873fb339e5710cd86e157781c97edeff163f328396670\": rpc error: code = NotFound desc = could not find container \"265f6844c8bc5c4eea0873fb339e5710cd86e157781c97edeff163f328396670\": container with ID starting with 265f6844c8bc5c4eea0873fb339e5710cd86e157781c97edeff163f328396670 not found: ID does not exist" May 25 12:17:23.591189 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.591171 2558 scope.go:117] "RemoveContainer" containerID="d5f48dbc78b6df9735d23644f27891ab48303e0878be8bc8ff8907bff6bd6c10" May 25 12:17:23.591368 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:17:23.591350 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5f48dbc78b6df9735d23644f27891ab48303e0878be8bc8ff8907bff6bd6c10\": container with ID starting with d5f48dbc78b6df9735d23644f27891ab48303e0878be8bc8ff8907bff6bd6c10 not found: ID does not exist" containerID="d5f48dbc78b6df9735d23644f27891ab48303e0878be8bc8ff8907bff6bd6c10" May 25 12:17:23.591406 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.591374 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5f48dbc78b6df9735d23644f27891ab48303e0878be8bc8ff8907bff6bd6c10"} err="failed to get container status \"d5f48dbc78b6df9735d23644f27891ab48303e0878be8bc8ff8907bff6bd6c10\": rpc error: code = NotFound desc = could not find container \"d5f48dbc78b6df9735d23644f27891ab48303e0878be8bc8ff8907bff6bd6c10\": container with ID starting with d5f48dbc78b6df9735d23644f27891ab48303e0878be8bc8ff8907bff6bd6c10 not found: ID does not exist" May 25 12:17:23.591406 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.591386 2558 scope.go:117] "RemoveContainer" containerID="b78b135fc0e6202c22272ab5fde81061e9c8a6697c95177dea6558f738b826fa" May 25 12:17:23.591655 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:17:23.591639 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b78b135fc0e6202c22272ab5fde81061e9c8a6697c95177dea6558f738b826fa\": container with ID starting with b78b135fc0e6202c22272ab5fde81061e9c8a6697c95177dea6558f738b826fa not found: ID does not exist" containerID="b78b135fc0e6202c22272ab5fde81061e9c8a6697c95177dea6558f738b826fa" May 25 12:17:23.591711 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.591658 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b78b135fc0e6202c22272ab5fde81061e9c8a6697c95177dea6558f738b826fa"} err="failed to get container status \"b78b135fc0e6202c22272ab5fde81061e9c8a6697c95177dea6558f738b826fa\": rpc error: code = NotFound desc = could not find container \"b78b135fc0e6202c22272ab5fde81061e9c8a6697c95177dea6558f738b826fa\": container with ID starting with b78b135fc0e6202c22272ab5fde81061e9c8a6697c95177dea6558f738b826fa not found: ID does not exist" May 25 12:17:23.591711 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.591671 2558 scope.go:117] "RemoveContainer" containerID="a6154b08340b58564a759f2db6be0909783914f47d0ed730757af403d91c1118" May 25 12:17:23.591908 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:17:23.591883 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6154b08340b58564a759f2db6be0909783914f47d0ed730757af403d91c1118\": container with ID starting with a6154b08340b58564a759f2db6be0909783914f47d0ed730757af403d91c1118 not found: ID does not exist" containerID="a6154b08340b58564a759f2db6be0909783914f47d0ed730757af403d91c1118" May 25 12:17:23.591947 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.591915 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6154b08340b58564a759f2db6be0909783914f47d0ed730757af403d91c1118"} err="failed to get container status \"a6154b08340b58564a759f2db6be0909783914f47d0ed730757af403d91c1118\": rpc error: code = NotFound desc = could not find container \"a6154b08340b58564a759f2db6be0909783914f47d0ed730757af403d91c1118\": container with ID starting with a6154b08340b58564a759f2db6be0909783914f47d0ed730757af403d91c1118 not found: ID does not exist" May 25 12:17:23.591947 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.591930 2558 scope.go:117] "RemoveContainer" containerID="cfa034bdca39ba1edb28a5ba98b471bf8977bf2539816bd7e429666db3eadfbf" May 25 12:17:23.592145 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:17:23.592127 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfa034bdca39ba1edb28a5ba98b471bf8977bf2539816bd7e429666db3eadfbf\": container with ID starting with cfa034bdca39ba1edb28a5ba98b471bf8977bf2539816bd7e429666db3eadfbf not found: ID does not exist" containerID="cfa034bdca39ba1edb28a5ba98b471bf8977bf2539816bd7e429666db3eadfbf" May 25 12:17:23.592215 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.592148 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfa034bdca39ba1edb28a5ba98b471bf8977bf2539816bd7e429666db3eadfbf"} err="failed to get container status \"cfa034bdca39ba1edb28a5ba98b471bf8977bf2539816bd7e429666db3eadfbf\": rpc error: code = NotFound desc = could not find container \"cfa034bdca39ba1edb28a5ba98b471bf8977bf2539816bd7e429666db3eadfbf\": container with ID starting with cfa034bdca39ba1edb28a5ba98b471bf8977bf2539816bd7e429666db3eadfbf not found: ID does not exist" May 25 12:17:23.592215 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.592161 2558 scope.go:117] "RemoveContainer" containerID="19f150cae9885e8fad63cdf50e47b4b6fe3dec9397f3c0ddf331cf7b5ecfe55f" May 25 12:17:23.592420 ip-10-0-132-116 kubenswrapper[2558]: E0525 12:17:23.592405 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19f150cae9885e8fad63cdf50e47b4b6fe3dec9397f3c0ddf331cf7b5ecfe55f\": container with ID starting with 19f150cae9885e8fad63cdf50e47b4b6fe3dec9397f3c0ddf331cf7b5ecfe55f not found: ID does not exist" containerID="19f150cae9885e8fad63cdf50e47b4b6fe3dec9397f3c0ddf331cf7b5ecfe55f" May 25 12:17:23.592420 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.592422 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19f150cae9885e8fad63cdf50e47b4b6fe3dec9397f3c0ddf331cf7b5ecfe55f"} err="failed to get container status \"19f150cae9885e8fad63cdf50e47b4b6fe3dec9397f3c0ddf331cf7b5ecfe55f\": rpc error: code = NotFound desc = could not find container \"19f150cae9885e8fad63cdf50e47b4b6fe3dec9397f3c0ddf331cf7b5ecfe55f\": container with ID starting with 19f150cae9885e8fad63cdf50e47b4b6fe3dec9397f3c0ddf331cf7b5ecfe55f not found: ID does not exist" May 25 12:17:23.592524 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.592433 2558 scope.go:117] "RemoveContainer" containerID="5c90cc330eeadd446f1cda94224973f41acc4e8c4a17d4a4d32269ccfc968a26" May 25 12:17:23.592652 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.592636 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c90cc330eeadd446f1cda94224973f41acc4e8c4a17d4a4d32269ccfc968a26"} err="failed to get container status \"5c90cc330eeadd446f1cda94224973f41acc4e8c4a17d4a4d32269ccfc968a26\": rpc error: code = NotFound desc = could not find container \"5c90cc330eeadd446f1cda94224973f41acc4e8c4a17d4a4d32269ccfc968a26\": container with ID starting with 5c90cc330eeadd446f1cda94224973f41acc4e8c4a17d4a4d32269ccfc968a26 not found: ID does not exist" May 25 12:17:23.592698 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.592655 2558 scope.go:117] "RemoveContainer" containerID="265f6844c8bc5c4eea0873fb339e5710cd86e157781c97edeff163f328396670" May 25 12:17:23.592861 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.592842 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"265f6844c8bc5c4eea0873fb339e5710cd86e157781c97edeff163f328396670"} err="failed to get container status \"265f6844c8bc5c4eea0873fb339e5710cd86e157781c97edeff163f328396670\": rpc error: code = NotFound desc = could not find container \"265f6844c8bc5c4eea0873fb339e5710cd86e157781c97edeff163f328396670\": container with ID starting with 265f6844c8bc5c4eea0873fb339e5710cd86e157781c97edeff163f328396670 not found: ID does not exist" May 25 12:17:23.592908 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.592862 2558 scope.go:117] "RemoveContainer" containerID="d5f48dbc78b6df9735d23644f27891ab48303e0878be8bc8ff8907bff6bd6c10" May 25 12:17:23.593059 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.593044 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5f48dbc78b6df9735d23644f27891ab48303e0878be8bc8ff8907bff6bd6c10"} err="failed to get container status \"d5f48dbc78b6df9735d23644f27891ab48303e0878be8bc8ff8907bff6bd6c10\": rpc error: code = NotFound desc = could not find container \"d5f48dbc78b6df9735d23644f27891ab48303e0878be8bc8ff8907bff6bd6c10\": container with ID starting with d5f48dbc78b6df9735d23644f27891ab48303e0878be8bc8ff8907bff6bd6c10 not found: ID does not exist" May 25 12:17:23.593222 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.593061 2558 scope.go:117] "RemoveContainer" containerID="b78b135fc0e6202c22272ab5fde81061e9c8a6697c95177dea6558f738b826fa" May 25 12:17:23.593286 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.593266 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b78b135fc0e6202c22272ab5fde81061e9c8a6697c95177dea6558f738b826fa"} err="failed to get container status \"b78b135fc0e6202c22272ab5fde81061e9c8a6697c95177dea6558f738b826fa\": rpc error: code = NotFound desc = could not find container \"b78b135fc0e6202c22272ab5fde81061e9c8a6697c95177dea6558f738b826fa\": container with ID starting with b78b135fc0e6202c22272ab5fde81061e9c8a6697c95177dea6558f738b826fa not found: ID does not exist" May 25 12:17:23.593322 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.593289 2558 scope.go:117] "RemoveContainer" containerID="a6154b08340b58564a759f2db6be0909783914f47d0ed730757af403d91c1118" May 25 12:17:23.593488 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.593472 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6154b08340b58564a759f2db6be0909783914f47d0ed730757af403d91c1118"} err="failed to get container status \"a6154b08340b58564a759f2db6be0909783914f47d0ed730757af403d91c1118\": rpc error: code = NotFound desc = could not find container \"a6154b08340b58564a759f2db6be0909783914f47d0ed730757af403d91c1118\": container with ID starting with a6154b08340b58564a759f2db6be0909783914f47d0ed730757af403d91c1118 not found: ID does not exist" May 25 12:17:23.593529 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.593488 2558 scope.go:117] "RemoveContainer" containerID="cfa034bdca39ba1edb28a5ba98b471bf8977bf2539816bd7e429666db3eadfbf" May 25 12:17:23.593679 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.593663 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfa034bdca39ba1edb28a5ba98b471bf8977bf2539816bd7e429666db3eadfbf"} err="failed to get container status \"cfa034bdca39ba1edb28a5ba98b471bf8977bf2539816bd7e429666db3eadfbf\": rpc error: code = NotFound desc = could not find container \"cfa034bdca39ba1edb28a5ba98b471bf8977bf2539816bd7e429666db3eadfbf\": container with ID starting with cfa034bdca39ba1edb28a5ba98b471bf8977bf2539816bd7e429666db3eadfbf not found: ID does not exist" May 25 12:17:23.593723 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.593680 2558 scope.go:117] "RemoveContainer" containerID="19f150cae9885e8fad63cdf50e47b4b6fe3dec9397f3c0ddf331cf7b5ecfe55f" May 25 12:17:23.593894 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.593878 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19f150cae9885e8fad63cdf50e47b4b6fe3dec9397f3c0ddf331cf7b5ecfe55f"} err="failed to get container status \"19f150cae9885e8fad63cdf50e47b4b6fe3dec9397f3c0ddf331cf7b5ecfe55f\": rpc error: code = NotFound desc = could not find container \"19f150cae9885e8fad63cdf50e47b4b6fe3dec9397f3c0ddf331cf7b5ecfe55f\": container with ID starting with 19f150cae9885e8fad63cdf50e47b4b6fe3dec9397f3c0ddf331cf7b5ecfe55f not found: ID does not exist" May 25 12:17:23.593894 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.593893 2558 scope.go:117] "RemoveContainer" containerID="5c90cc330eeadd446f1cda94224973f41acc4e8c4a17d4a4d32269ccfc968a26" May 25 12:17:23.594113 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.594080 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c90cc330eeadd446f1cda94224973f41acc4e8c4a17d4a4d32269ccfc968a26"} err="failed to get container status \"5c90cc330eeadd446f1cda94224973f41acc4e8c4a17d4a4d32269ccfc968a26\": rpc error: code = NotFound desc = could not find container \"5c90cc330eeadd446f1cda94224973f41acc4e8c4a17d4a4d32269ccfc968a26\": container with ID starting with 5c90cc330eeadd446f1cda94224973f41acc4e8c4a17d4a4d32269ccfc968a26 not found: ID does not exist" May 25 12:17:23.594160 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.594113 2558 scope.go:117] "RemoveContainer" containerID="265f6844c8bc5c4eea0873fb339e5710cd86e157781c97edeff163f328396670" May 25 12:17:23.594346 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.594328 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"265f6844c8bc5c4eea0873fb339e5710cd86e157781c97edeff163f328396670"} err="failed to get container status \"265f6844c8bc5c4eea0873fb339e5710cd86e157781c97edeff163f328396670\": rpc error: code = NotFound desc = could not find container \"265f6844c8bc5c4eea0873fb339e5710cd86e157781c97edeff163f328396670\": container with ID starting with 265f6844c8bc5c4eea0873fb339e5710cd86e157781c97edeff163f328396670 not found: ID does not exist" May 25 12:17:23.594388 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.594347 2558 scope.go:117] "RemoveContainer" containerID="d5f48dbc78b6df9735d23644f27891ab48303e0878be8bc8ff8907bff6bd6c10" May 25 12:17:23.594565 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.594548 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5f48dbc78b6df9735d23644f27891ab48303e0878be8bc8ff8907bff6bd6c10"} err="failed to get container status \"d5f48dbc78b6df9735d23644f27891ab48303e0878be8bc8ff8907bff6bd6c10\": rpc error: code = NotFound desc = could not find container \"d5f48dbc78b6df9735d23644f27891ab48303e0878be8bc8ff8907bff6bd6c10\": container with ID starting with d5f48dbc78b6df9735d23644f27891ab48303e0878be8bc8ff8907bff6bd6c10 not found: ID does not exist" May 25 12:17:23.594613 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.594567 2558 scope.go:117] "RemoveContainer" containerID="b78b135fc0e6202c22272ab5fde81061e9c8a6697c95177dea6558f738b826fa" May 25 12:17:23.594748 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.594732 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b78b135fc0e6202c22272ab5fde81061e9c8a6697c95177dea6558f738b826fa"} err="failed to get container status \"b78b135fc0e6202c22272ab5fde81061e9c8a6697c95177dea6558f738b826fa\": rpc error: code = NotFound desc = could not find container \"b78b135fc0e6202c22272ab5fde81061e9c8a6697c95177dea6558f738b826fa\": container with ID starting with b78b135fc0e6202c22272ab5fde81061e9c8a6697c95177dea6558f738b826fa not found: ID does not exist" May 25 12:17:23.594786 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.594750 2558 scope.go:117] "RemoveContainer" containerID="a6154b08340b58564a759f2db6be0909783914f47d0ed730757af403d91c1118" May 25 12:17:23.594933 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.594913 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6154b08340b58564a759f2db6be0909783914f47d0ed730757af403d91c1118"} err="failed to get container status \"a6154b08340b58564a759f2db6be0909783914f47d0ed730757af403d91c1118\": rpc error: code = NotFound desc = could not find container \"a6154b08340b58564a759f2db6be0909783914f47d0ed730757af403d91c1118\": container with ID starting with a6154b08340b58564a759f2db6be0909783914f47d0ed730757af403d91c1118 not found: ID does not exist" May 25 12:17:23.594995 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.594934 2558 scope.go:117] "RemoveContainer" containerID="cfa034bdca39ba1edb28a5ba98b471bf8977bf2539816bd7e429666db3eadfbf" May 25 12:17:23.595181 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.595164 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfa034bdca39ba1edb28a5ba98b471bf8977bf2539816bd7e429666db3eadfbf"} err="failed to get container status \"cfa034bdca39ba1edb28a5ba98b471bf8977bf2539816bd7e429666db3eadfbf\": rpc error: code = NotFound desc = could not find container \"cfa034bdca39ba1edb28a5ba98b471bf8977bf2539816bd7e429666db3eadfbf\": container with ID starting with cfa034bdca39ba1edb28a5ba98b471bf8977bf2539816bd7e429666db3eadfbf not found: ID does not exist" May 25 12:17:23.595239 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.595181 2558 scope.go:117] "RemoveContainer" containerID="19f150cae9885e8fad63cdf50e47b4b6fe3dec9397f3c0ddf331cf7b5ecfe55f" May 25 12:17:23.595374 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.595358 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19f150cae9885e8fad63cdf50e47b4b6fe3dec9397f3c0ddf331cf7b5ecfe55f"} err="failed to get container status \"19f150cae9885e8fad63cdf50e47b4b6fe3dec9397f3c0ddf331cf7b5ecfe55f\": rpc error: code = NotFound desc = could not find container \"19f150cae9885e8fad63cdf50e47b4b6fe3dec9397f3c0ddf331cf7b5ecfe55f\": container with ID starting with 19f150cae9885e8fad63cdf50e47b4b6fe3dec9397f3c0ddf331cf7b5ecfe55f not found: ID does not exist" May 25 12:17:23.595424 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.595375 2558 scope.go:117] "RemoveContainer" containerID="5c90cc330eeadd446f1cda94224973f41acc4e8c4a17d4a4d32269ccfc968a26" May 25 12:17:23.595593 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.595572 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c90cc330eeadd446f1cda94224973f41acc4e8c4a17d4a4d32269ccfc968a26"} err="failed to get container status \"5c90cc330eeadd446f1cda94224973f41acc4e8c4a17d4a4d32269ccfc968a26\": rpc error: code = NotFound desc = could not find container \"5c90cc330eeadd446f1cda94224973f41acc4e8c4a17d4a4d32269ccfc968a26\": container with ID starting with 5c90cc330eeadd446f1cda94224973f41acc4e8c4a17d4a4d32269ccfc968a26 not found: ID does not exist" May 25 12:17:23.595593 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.595589 2558 scope.go:117] "RemoveContainer" containerID="265f6844c8bc5c4eea0873fb339e5710cd86e157781c97edeff163f328396670" May 25 12:17:23.595790 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.595771 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"265f6844c8bc5c4eea0873fb339e5710cd86e157781c97edeff163f328396670"} err="failed to get container status \"265f6844c8bc5c4eea0873fb339e5710cd86e157781c97edeff163f328396670\": rpc error: code = NotFound desc = could not find container \"265f6844c8bc5c4eea0873fb339e5710cd86e157781c97edeff163f328396670\": container with ID starting with 265f6844c8bc5c4eea0873fb339e5710cd86e157781c97edeff163f328396670 not found: ID does not exist" May 25 12:17:23.595790 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.595794 2558 scope.go:117] "RemoveContainer" containerID="d5f48dbc78b6df9735d23644f27891ab48303e0878be8bc8ff8907bff6bd6c10" May 25 12:17:23.595980 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.595964 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5f48dbc78b6df9735d23644f27891ab48303e0878be8bc8ff8907bff6bd6c10"} err="failed to get container status \"d5f48dbc78b6df9735d23644f27891ab48303e0878be8bc8ff8907bff6bd6c10\": rpc error: code = NotFound desc = could not find container \"d5f48dbc78b6df9735d23644f27891ab48303e0878be8bc8ff8907bff6bd6c10\": container with ID starting with d5f48dbc78b6df9735d23644f27891ab48303e0878be8bc8ff8907bff6bd6c10 not found: ID does not exist" May 25 12:17:23.596017 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.595981 2558 scope.go:117] "RemoveContainer" containerID="b78b135fc0e6202c22272ab5fde81061e9c8a6697c95177dea6558f738b826fa" May 25 12:17:23.596210 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.596190 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b78b135fc0e6202c22272ab5fde81061e9c8a6697c95177dea6558f738b826fa"} err="failed to get container status \"b78b135fc0e6202c22272ab5fde81061e9c8a6697c95177dea6558f738b826fa\": rpc error: code = NotFound desc = could not find container \"b78b135fc0e6202c22272ab5fde81061e9c8a6697c95177dea6558f738b826fa\": container with ID starting with b78b135fc0e6202c22272ab5fde81061e9c8a6697c95177dea6558f738b826fa not found: ID does not exist" May 25 12:17:23.596249 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.596212 2558 scope.go:117] "RemoveContainer" containerID="a6154b08340b58564a759f2db6be0909783914f47d0ed730757af403d91c1118" May 25 12:17:23.596419 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.596403 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6154b08340b58564a759f2db6be0909783914f47d0ed730757af403d91c1118"} err="failed to get container status \"a6154b08340b58564a759f2db6be0909783914f47d0ed730757af403d91c1118\": rpc error: code = NotFound desc = could not find container \"a6154b08340b58564a759f2db6be0909783914f47d0ed730757af403d91c1118\": container with ID starting with a6154b08340b58564a759f2db6be0909783914f47d0ed730757af403d91c1118 not found: ID does not exist" May 25 12:17:23.596457 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.596429 2558 scope.go:117] "RemoveContainer" containerID="cfa034bdca39ba1edb28a5ba98b471bf8977bf2539816bd7e429666db3eadfbf" May 25 12:17:23.596604 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.596589 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfa034bdca39ba1edb28a5ba98b471bf8977bf2539816bd7e429666db3eadfbf"} err="failed to get container status \"cfa034bdca39ba1edb28a5ba98b471bf8977bf2539816bd7e429666db3eadfbf\": rpc error: code = NotFound desc = could not find container \"cfa034bdca39ba1edb28a5ba98b471bf8977bf2539816bd7e429666db3eadfbf\": container with ID starting with cfa034bdca39ba1edb28a5ba98b471bf8977bf2539816bd7e429666db3eadfbf not found: ID does not exist" May 25 12:17:23.596648 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.596605 2558 scope.go:117] "RemoveContainer" containerID="19f150cae9885e8fad63cdf50e47b4b6fe3dec9397f3c0ddf331cf7b5ecfe55f" May 25 12:17:23.596778 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.596763 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19f150cae9885e8fad63cdf50e47b4b6fe3dec9397f3c0ddf331cf7b5ecfe55f"} err="failed to get container status \"19f150cae9885e8fad63cdf50e47b4b6fe3dec9397f3c0ddf331cf7b5ecfe55f\": rpc error: code = NotFound desc = could not find container \"19f150cae9885e8fad63cdf50e47b4b6fe3dec9397f3c0ddf331cf7b5ecfe55f\": container with ID starting with 19f150cae9885e8fad63cdf50e47b4b6fe3dec9397f3c0ddf331cf7b5ecfe55f not found: ID does not exist" May 25 12:17:23.596819 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.596778 2558 scope.go:117] "RemoveContainer" containerID="5c90cc330eeadd446f1cda94224973f41acc4e8c4a17d4a4d32269ccfc968a26" May 25 12:17:23.596956 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.596943 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c90cc330eeadd446f1cda94224973f41acc4e8c4a17d4a4d32269ccfc968a26"} err="failed to get container status \"5c90cc330eeadd446f1cda94224973f41acc4e8c4a17d4a4d32269ccfc968a26\": rpc error: code = NotFound desc = could not find container \"5c90cc330eeadd446f1cda94224973f41acc4e8c4a17d4a4d32269ccfc968a26\": container with ID starting with 5c90cc330eeadd446f1cda94224973f41acc4e8c4a17d4a4d32269ccfc968a26 not found: ID does not exist" May 25 12:17:23.596993 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.596959 2558 scope.go:117] "RemoveContainer" containerID="265f6844c8bc5c4eea0873fb339e5710cd86e157781c97edeff163f328396670" May 25 12:17:23.597145 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.597130 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"265f6844c8bc5c4eea0873fb339e5710cd86e157781c97edeff163f328396670"} err="failed to get container status \"265f6844c8bc5c4eea0873fb339e5710cd86e157781c97edeff163f328396670\": rpc error: code = NotFound desc = could not find container \"265f6844c8bc5c4eea0873fb339e5710cd86e157781c97edeff163f328396670\": container with ID starting with 265f6844c8bc5c4eea0873fb339e5710cd86e157781c97edeff163f328396670 not found: ID does not exist" May 25 12:17:23.597196 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.597147 2558 scope.go:117] "RemoveContainer" containerID="d5f48dbc78b6df9735d23644f27891ab48303e0878be8bc8ff8907bff6bd6c10" May 25 12:17:23.597367 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.597350 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5f48dbc78b6df9735d23644f27891ab48303e0878be8bc8ff8907bff6bd6c10"} err="failed to get container status \"d5f48dbc78b6df9735d23644f27891ab48303e0878be8bc8ff8907bff6bd6c10\": rpc error: code = NotFound desc = could not find container \"d5f48dbc78b6df9735d23644f27891ab48303e0878be8bc8ff8907bff6bd6c10\": container with ID starting with d5f48dbc78b6df9735d23644f27891ab48303e0878be8bc8ff8907bff6bd6c10 not found: ID does not exist" May 25 12:17:23.597367 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.597365 2558 scope.go:117] "RemoveContainer" containerID="b78b135fc0e6202c22272ab5fde81061e9c8a6697c95177dea6558f738b826fa" May 25 12:17:23.597529 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.597511 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b78b135fc0e6202c22272ab5fde81061e9c8a6697c95177dea6558f738b826fa"} err="failed to get container status \"b78b135fc0e6202c22272ab5fde81061e9c8a6697c95177dea6558f738b826fa\": rpc error: code = NotFound desc = could not find container \"b78b135fc0e6202c22272ab5fde81061e9c8a6697c95177dea6558f738b826fa\": container with ID starting with b78b135fc0e6202c22272ab5fde81061e9c8a6697c95177dea6558f738b826fa not found: ID does not exist" May 25 12:17:23.597578 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.597532 2558 scope.go:117] "RemoveContainer" containerID="a6154b08340b58564a759f2db6be0909783914f47d0ed730757af403d91c1118" May 25 12:17:23.597775 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.597758 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6154b08340b58564a759f2db6be0909783914f47d0ed730757af403d91c1118"} err="failed to get container status \"a6154b08340b58564a759f2db6be0909783914f47d0ed730757af403d91c1118\": rpc error: code = NotFound desc = could not find container \"a6154b08340b58564a759f2db6be0909783914f47d0ed730757af403d91c1118\": container with ID starting with a6154b08340b58564a759f2db6be0909783914f47d0ed730757af403d91c1118 not found: ID does not exist" May 25 12:17:23.597824 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.597777 2558 scope.go:117] "RemoveContainer" containerID="cfa034bdca39ba1edb28a5ba98b471bf8977bf2539816bd7e429666db3eadfbf" May 25 12:17:23.598003 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.597986 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfa034bdca39ba1edb28a5ba98b471bf8977bf2539816bd7e429666db3eadfbf"} err="failed to get container status \"cfa034bdca39ba1edb28a5ba98b471bf8977bf2539816bd7e429666db3eadfbf\": rpc error: code = NotFound desc = could not find container \"cfa034bdca39ba1edb28a5ba98b471bf8977bf2539816bd7e429666db3eadfbf\": container with ID starting with cfa034bdca39ba1edb28a5ba98b471bf8977bf2539816bd7e429666db3eadfbf not found: ID does not exist" May 25 12:17:23.598049 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.598004 2558 scope.go:117] "RemoveContainer" containerID="19f150cae9885e8fad63cdf50e47b4b6fe3dec9397f3c0ddf331cf7b5ecfe55f" May 25 12:17:23.598235 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.598216 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19f150cae9885e8fad63cdf50e47b4b6fe3dec9397f3c0ddf331cf7b5ecfe55f"} err="failed to get container status \"19f150cae9885e8fad63cdf50e47b4b6fe3dec9397f3c0ddf331cf7b5ecfe55f\": rpc error: code = NotFound desc = could not find container \"19f150cae9885e8fad63cdf50e47b4b6fe3dec9397f3c0ddf331cf7b5ecfe55f\": container with ID starting with 19f150cae9885e8fad63cdf50e47b4b6fe3dec9397f3c0ddf331cf7b5ecfe55f not found: ID does not exist" May 25 12:17:23.598300 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.598237 2558 scope.go:117] "RemoveContainer" containerID="5c90cc330eeadd446f1cda94224973f41acc4e8c4a17d4a4d32269ccfc968a26" May 25 12:17:23.598474 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.598455 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c90cc330eeadd446f1cda94224973f41acc4e8c4a17d4a4d32269ccfc968a26"} err="failed to get container status \"5c90cc330eeadd446f1cda94224973f41acc4e8c4a17d4a4d32269ccfc968a26\": rpc error: code = NotFound desc = could not find container \"5c90cc330eeadd446f1cda94224973f41acc4e8c4a17d4a4d32269ccfc968a26\": container with ID starting with 5c90cc330eeadd446f1cda94224973f41acc4e8c4a17d4a4d32269ccfc968a26 not found: ID does not exist" May 25 12:17:23.598532 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.598475 2558 scope.go:117] "RemoveContainer" containerID="265f6844c8bc5c4eea0873fb339e5710cd86e157781c97edeff163f328396670" May 25 12:17:23.598699 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.598682 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"265f6844c8bc5c4eea0873fb339e5710cd86e157781c97edeff163f328396670"} err="failed to get container status \"265f6844c8bc5c4eea0873fb339e5710cd86e157781c97edeff163f328396670\": rpc error: code = NotFound desc = could not find container \"265f6844c8bc5c4eea0873fb339e5710cd86e157781c97edeff163f328396670\": container with ID starting with 265f6844c8bc5c4eea0873fb339e5710cd86e157781c97edeff163f328396670 not found: ID does not exist" May 25 12:17:23.598749 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.598699 2558 scope.go:117] "RemoveContainer" containerID="d5f48dbc78b6df9735d23644f27891ab48303e0878be8bc8ff8907bff6bd6c10" May 25 12:17:23.598893 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.598877 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5f48dbc78b6df9735d23644f27891ab48303e0878be8bc8ff8907bff6bd6c10"} err="failed to get container status \"d5f48dbc78b6df9735d23644f27891ab48303e0878be8bc8ff8907bff6bd6c10\": rpc error: code = NotFound desc = could not find container \"d5f48dbc78b6df9735d23644f27891ab48303e0878be8bc8ff8907bff6bd6c10\": container with ID starting with d5f48dbc78b6df9735d23644f27891ab48303e0878be8bc8ff8907bff6bd6c10 not found: ID does not exist" May 25 12:17:23.598951 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.598895 2558 scope.go:117] "RemoveContainer" containerID="b78b135fc0e6202c22272ab5fde81061e9c8a6697c95177dea6558f738b826fa" May 25 12:17:23.599147 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.599127 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b78b135fc0e6202c22272ab5fde81061e9c8a6697c95177dea6558f738b826fa"} err="failed to get container status \"b78b135fc0e6202c22272ab5fde81061e9c8a6697c95177dea6558f738b826fa\": rpc error: code = NotFound desc = could not find container \"b78b135fc0e6202c22272ab5fde81061e9c8a6697c95177dea6558f738b826fa\": container with ID starting with b78b135fc0e6202c22272ab5fde81061e9c8a6697c95177dea6558f738b826fa not found: ID does not exist" May 25 12:17:23.599202 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.599148 2558 scope.go:117] "RemoveContainer" containerID="a6154b08340b58564a759f2db6be0909783914f47d0ed730757af403d91c1118" May 25 12:17:23.599359 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.599340 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6154b08340b58564a759f2db6be0909783914f47d0ed730757af403d91c1118"} err="failed to get container status \"a6154b08340b58564a759f2db6be0909783914f47d0ed730757af403d91c1118\": rpc error: code = NotFound desc = could not find container \"a6154b08340b58564a759f2db6be0909783914f47d0ed730757af403d91c1118\": container with ID starting with a6154b08340b58564a759f2db6be0909783914f47d0ed730757af403d91c1118 not found: ID does not exist" May 25 12:17:23.599419 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.599361 2558 scope.go:117] "RemoveContainer" containerID="cfa034bdca39ba1edb28a5ba98b471bf8977bf2539816bd7e429666db3eadfbf" May 25 12:17:23.599585 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.599567 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfa034bdca39ba1edb28a5ba98b471bf8977bf2539816bd7e429666db3eadfbf"} err="failed to get container status \"cfa034bdca39ba1edb28a5ba98b471bf8977bf2539816bd7e429666db3eadfbf\": rpc error: code = NotFound desc = could not find container \"cfa034bdca39ba1edb28a5ba98b471bf8977bf2539816bd7e429666db3eadfbf\": container with ID starting with cfa034bdca39ba1edb28a5ba98b471bf8977bf2539816bd7e429666db3eadfbf not found: ID does not exist" May 25 12:17:23.599649 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.599586 2558 scope.go:117] "RemoveContainer" containerID="19f150cae9885e8fad63cdf50e47b4b6fe3dec9397f3c0ddf331cf7b5ecfe55f" May 25 12:17:23.599787 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.599771 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19f150cae9885e8fad63cdf50e47b4b6fe3dec9397f3c0ddf331cf7b5ecfe55f"} err="failed to get container status \"19f150cae9885e8fad63cdf50e47b4b6fe3dec9397f3c0ddf331cf7b5ecfe55f\": rpc error: code = NotFound desc = could not find container \"19f150cae9885e8fad63cdf50e47b4b6fe3dec9397f3c0ddf331cf7b5ecfe55f\": container with ID starting with 19f150cae9885e8fad63cdf50e47b4b6fe3dec9397f3c0ddf331cf7b5ecfe55f not found: ID does not exist" May 25 12:17:23.643591 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.643552 2558 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-web-config\") on node \"ip-10-0-132-116.ec2.internal\" DevicePath \"\"" May 25 12:17:23.643591 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.643582 2558 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-116.ec2.internal\" DevicePath \"\"" May 25 12:17:23.643591 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.643596 2558 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-secret-kube-rbac-proxy\") on node \"ip-10-0-132-116.ec2.internal\" DevicePath \"\"" May 25 12:17:23.643841 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.643611 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-492kt\" (UniqueName: \"kubernetes.io/projected/61b5c371-5637-4913-abd0-5790c95d17e1-kube-api-access-492kt\") on node \"ip-10-0-132-116.ec2.internal\" DevicePath \"\"" May 25 12:17:23.643841 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.643624 2558 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-116.ec2.internal\" DevicePath \"\"" May 25 12:17:23.643841 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.643637 2558 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-config\") on node \"ip-10-0-132-116.ec2.internal\" DevicePath \"\"" May 25 12:17:23.643841 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.643650 2558 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/61b5c371-5637-4913-abd0-5790c95d17e1-tls-assets\") on node \"ip-10-0-132-116.ec2.internal\" DevicePath \"\"" May 25 12:17:23.643841 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.643664 2558 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-116.ec2.internal\" DevicePath \"\"" May 25 12:17:23.643841 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.643675 2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/61b5c371-5637-4913-abd0-5790c95d17e1-prometheus-k8s-db\") on node \"ip-10-0-132-116.ec2.internal\" DevicePath \"\"" May 25 12:17:23.643841 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.643687 2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61b5c371-5637-4913-abd0-5790c95d17e1-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-116.ec2.internal\" DevicePath \"\"" May 25 12:17:23.643841 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.643699 2558 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-116.ec2.internal\" DevicePath \"\"" May 25 12:17:23.643841 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.643712 2558 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61b5c371-5637-4913-abd0-5790c95d17e1-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-116.ec2.internal\" DevicePath \"\"" May 25 12:17:23.643841 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.643726 2558 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-secret-metrics-client-certs\") on node \"ip-10-0-132-116.ec2.internal\" DevicePath \"\"" May 25 12:17:23.643841 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.643740 2558 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61b5c371-5637-4913-abd0-5790c95d17e1-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-116.ec2.internal\" DevicePath \"\"" May 25 12:17:23.643841 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.643755 2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/61b5c371-5637-4913-abd0-5790c95d17e1-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-116.ec2.internal\" DevicePath \"\"" May 25 12:17:23.643841 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.643768 2558 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/61b5c371-5637-4913-abd0-5790c95d17e1-config-out\") on node \"ip-10-0-132-116.ec2.internal\" DevicePath \"\"" May 25 12:17:23.643841 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.643782 2558 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/61b5c371-5637-4913-abd0-5790c95d17e1-secret-grpc-tls\") on node \"ip-10-0-132-116.ec2.internal\" DevicePath \"\"" May 25 12:17:23.852422 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.852338 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 12:17:23.856123 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.856082 2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 12:17:23.883675 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.883642 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 12:17:23.884021 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.884004 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61b5c371-5637-4913-abd0-5790c95d17e1" containerName="prometheus" May 25 12:17:23.884082 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.884023 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="61b5c371-5637-4913-abd0-5790c95d17e1" containerName="prometheus" May 25 12:17:23.884082 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.884031 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61b5c371-5637-4913-abd0-5790c95d17e1" containerName="config-reloader" May 25 12:17:23.884082 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.884037 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="61b5c371-5637-4913-abd0-5790c95d17e1" containerName="config-reloader" May 25 12:17:23.884082 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.884052 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61b5c371-5637-4913-abd0-5790c95d17e1" containerName="kube-rbac-proxy" May 25 12:17:23.884082 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.884058 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="61b5c371-5637-4913-abd0-5790c95d17e1" containerName="kube-rbac-proxy" May 25 12:17:23.884082 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.884070 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61b5c371-5637-4913-abd0-5790c95d17e1" containerName="kube-rbac-proxy-web" May 25 12:17:23.884082 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.884075 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="61b5c371-5637-4913-abd0-5790c95d17e1" containerName="kube-rbac-proxy-web" May 25 12:17:23.884082 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.884084 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61b5c371-5637-4913-abd0-5790c95d17e1" containerName="thanos-sidecar" May 25 12:17:23.884082 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.884108 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="61b5c371-5637-4913-abd0-5790c95d17e1" containerName="thanos-sidecar" May 25 12:17:23.884392 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.884120 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61b5c371-5637-4913-abd0-5790c95d17e1" containerName="init-config-reloader" May 25 12:17:23.884392 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.884125 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="61b5c371-5637-4913-abd0-5790c95d17e1" containerName="init-config-reloader" May 25 12:17:23.884392 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.884133 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61b5c371-5637-4913-abd0-5790c95d17e1" containerName="kube-rbac-proxy-thanos" May 25 12:17:23.884392 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.884138 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="61b5c371-5637-4913-abd0-5790c95d17e1" containerName="kube-rbac-proxy-thanos" May 25 12:17:23.884392 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.884192 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="61b5c371-5637-4913-abd0-5790c95d17e1" containerName="prometheus" May 25 12:17:23.884392 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.884201 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="61b5c371-5637-4913-abd0-5790c95d17e1" containerName="thanos-sidecar" May 25 12:17:23.884392 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.884207 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="61b5c371-5637-4913-abd0-5790c95d17e1" containerName="config-reloader" May 25 12:17:23.884392 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.884214 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="61b5c371-5637-4913-abd0-5790c95d17e1" containerName="kube-rbac-proxy-thanos" May 25 12:17:23.884392 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.884220 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="61b5c371-5637-4913-abd0-5790c95d17e1" containerName="kube-rbac-proxy-web" May 25 12:17:23.884392 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.884228 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="61b5c371-5637-4913-abd0-5790c95d17e1" containerName="kube-rbac-proxy" May 25 12:17:23.887990 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.887967 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:23.891075 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.891054 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 25 12:17:23.891270 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.891111 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 25 12:17:23.891270 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.891125 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 25 12:17:23.891270 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.891137 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 25 12:17:23.891270 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.891066 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 25 12:17:23.891270 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.891059 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 25 12:17:23.891533 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.891129 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 25 12:17:23.891533 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.891446 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 25 12:17:23.891533 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.891455 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vndj4\"" May 25 12:17:23.891533 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.891481 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 25 12:17:23.891533 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.891495 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 25 12:17:23.891720 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.891688 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-dc1ccq2rr5csk\"" May 25 12:17:23.903490 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.903457 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 25 12:17:23.905252 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.905228 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 25 12:17:23.905586 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:23.905567 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 12:17:24.046561 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.046512 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.046561 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.046570 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2hlc\" (UniqueName: \"kubernetes.io/projected/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-kube-api-access-k2hlc\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.046790 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.046596 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.046790 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.046613 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.046790 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.046633 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.046790 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.046658 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.046790 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.046707 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.046991 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.046796 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-config-out\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.046991 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.046829 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.046991 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.046851 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.046991 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.046885 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.046991 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.046938 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.047253 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.046993 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-web-config\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.047253 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.047030 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.047253 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.047060 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.047253 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.047087 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.047253 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.047153 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.047253 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.047180 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-config\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.147883 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.147851 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.148044 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.147893 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k2hlc\" (UniqueName: \"kubernetes.io/projected/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-kube-api-access-k2hlc\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.148044 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.147914 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.148044 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.147932 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.148893 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.148069 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.148893 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.148155 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.148893 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.148184 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.148893 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.148227 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-config-out\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.148893 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.148261 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.148893 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.148304 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.148893 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.148355 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.148893 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.148381 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.148893 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.148425 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-web-config\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.148893 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.148463 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.148893 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.148494 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.148893 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.148517 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.148893 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.148548 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.148893 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.148548 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.148893 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.148599 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-config\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.148893 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.148895 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.149946 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.148992 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.151357 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.151319 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.151450 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.151391 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-web-config\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.151450 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.151426 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-config-out\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.151450 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.151428 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.151624 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.151603 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.152138 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.151812 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.152138 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.151989 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.152138 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.152018 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.152347 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.152326 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.153660 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.153640 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-config\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.154157 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.154133 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.154311 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.154261 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.154311 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.154293 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.154775 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.154755 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.155920 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.155902 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2hlc\" (UniqueName: \"kubernetes.io/projected/d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f-kube-api-access-k2hlc\") pod \"prometheus-k8s-0\" (UID: \"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.203007 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.202972 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:24.342226 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.342187 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 12:17:24.345878 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:17:24.345852 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd23a1cc3_c4dc_4c7a_83c3_d96c0cae1a7f.slice/crio-c75a20da9efe22f6bd857780c9a8d7ddff18b4d34d96873e715a3ff265a10907 WatchSource:0}: Error finding container c75a20da9efe22f6bd857780c9a8d7ddff18b4d34d96873e715a3ff265a10907: Status 404 returned error can't find the container with id c75a20da9efe22f6bd857780c9a8d7ddff18b4d34d96873e715a3ff265a10907 May 25 12:17:24.539263 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.539230 2558 generic.go:358] "Generic (PLEG): container finished" podID="d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f" containerID="dd5e9c59aa85bf600ed7acef8661c4c685648d3ccffd3bdbe4aa545bb28a0f79" exitCode=0 May 25 12:17:24.539700 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.539322 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f","Type":"ContainerDied","Data":"dd5e9c59aa85bf600ed7acef8661c4c685648d3ccffd3bdbe4aa545bb28a0f79"} May 25 12:17:24.539700 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:24.539363 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f","Type":"ContainerStarted","Data":"c75a20da9efe22f6bd857780c9a8d7ddff18b4d34d96873e715a3ff265a10907"} May 25 12:17:25.546828 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:25.546797 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f","Type":"ContainerStarted","Data":"748b94c89f55824052b679e2ce5c976960f19c646a9b0b94d56f711fe4ad1132"} May 25 12:17:25.546828 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:25.546836 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f","Type":"ContainerStarted","Data":"5f44eb3d23dbb5465ada790c9a61e956dbba925d9f1b46fb5b1ea324c1045b18"} May 25 12:17:25.547340 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:25.546850 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f","Type":"ContainerStarted","Data":"b08c05754ad63f889a1bd2247b5c2dd5829f09c57f49d4a90de34498f2252e66"} May 25 12:17:25.547340 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:25.546863 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f","Type":"ContainerStarted","Data":"92127039575bb19ea628ac641431f39d775376712538ba3bfad3624df66562a9"} May 25 12:17:25.547340 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:25.546873 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f","Type":"ContainerStarted","Data":"357b081c23dad24816cd7e90e7a7423dd7b40ad10a3a92fe5e1f8a0be8431643"} May 25 12:17:25.547340 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:25.546884 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f","Type":"ContainerStarted","Data":"e87d4403777e0cd86ca56b547b5d96b8073b1ef2488034127cb7eb385f072a03"} May 25 12:17:25.564110 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:25.563368 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61b5c371-5637-4913-abd0-5790c95d17e1" path="/var/lib/kubelet/pods/61b5c371-5637-4913-abd0-5790c95d17e1/volumes" May 25 12:17:25.575269 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:25.575200 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.5751836519999998 podStartE2EDuration="2.575183652s" podCreationTimestamp="2026-05-25 12:17:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 12:17:25.57295346 +0000 UTC m=+278.573741708" watchObservedRunningTime="2026-05-25 12:17:25.575183652 +0000 UTC m=+278.575971902" May 25 12:17:29.203182 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:29.203143 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:38.431685 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:38.431647 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7797964479-f7rc9"] May 25 12:17:47.466042 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:17:47.466020 2558 kubelet.go:1628] "Image garbage collection succeeded" May 25 12:18:03.452224 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:18:03.452166 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7797964479-f7rc9" podUID="35e99c47-a6c6-4ae1-b18b-41e885794adb" containerName="console" containerID="cri-o://c28ad3673bd0d18fbeb95017df25d5bceb38b889df1060a3cf00eeaa7d79e17a" gracePeriod=15 May 25 12:18:03.665684 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:18:03.665659 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7797964479-f7rc9_35e99c47-a6c6-4ae1-b18b-41e885794adb/console/0.log" May 25 12:18:03.665845 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:18:03.665696 2558 generic.go:358] "Generic (PLEG): container finished" podID="35e99c47-a6c6-4ae1-b18b-41e885794adb" containerID="c28ad3673bd0d18fbeb95017df25d5bceb38b889df1060a3cf00eeaa7d79e17a" exitCode=2 May 25 12:18:03.665845 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:18:03.665756 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7797964479-f7rc9" event={"ID":"35e99c47-a6c6-4ae1-b18b-41e885794adb","Type":"ContainerDied","Data":"c28ad3673bd0d18fbeb95017df25d5bceb38b889df1060a3cf00eeaa7d79e17a"} May 25 12:18:03.715398 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:18:03.715378 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7797964479-f7rc9_35e99c47-a6c6-4ae1-b18b-41e885794adb/console/0.log" May 25 12:18:03.715500 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:18:03.715441 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7797964479-f7rc9" May 25 12:18:03.904053 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:18:03.904007 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/35e99c47-a6c6-4ae1-b18b-41e885794adb-service-ca\") pod \"35e99c47-a6c6-4ae1-b18b-41e885794adb\" (UID: \"35e99c47-a6c6-4ae1-b18b-41e885794adb\") " May 25 12:18:03.904053 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:18:03.904065 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/35e99c47-a6c6-4ae1-b18b-41e885794adb-console-config\") pod \"35e99c47-a6c6-4ae1-b18b-41e885794adb\" (UID: \"35e99c47-a6c6-4ae1-b18b-41e885794adb\") " May 25 12:18:03.904309 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:18:03.904128 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-65kdg\" (UniqueName: \"kubernetes.io/projected/35e99c47-a6c6-4ae1-b18b-41e885794adb-kube-api-access-65kdg\") pod \"35e99c47-a6c6-4ae1-b18b-41e885794adb\" (UID: \"35e99c47-a6c6-4ae1-b18b-41e885794adb\") " May 25 12:18:03.904309 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:18:03.904162 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35e99c47-a6c6-4ae1-b18b-41e885794adb-trusted-ca-bundle\") pod \"35e99c47-a6c6-4ae1-b18b-41e885794adb\" (UID: \"35e99c47-a6c6-4ae1-b18b-41e885794adb\") " May 25 12:18:03.904309 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:18:03.904185 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/35e99c47-a6c6-4ae1-b18b-41e885794adb-console-oauth-config\") pod \"35e99c47-a6c6-4ae1-b18b-41e885794adb\" (UID: \"35e99c47-a6c6-4ae1-b18b-41e885794adb\") " May 25 12:18:03.904309 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:18:03.904225 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/35e99c47-a6c6-4ae1-b18b-41e885794adb-oauth-serving-cert\") pod \"35e99c47-a6c6-4ae1-b18b-41e885794adb\" (UID: \"35e99c47-a6c6-4ae1-b18b-41e885794adb\") " May 25 12:18:03.904309 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:18:03.904260 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/35e99c47-a6c6-4ae1-b18b-41e885794adb-console-serving-cert\") pod \"35e99c47-a6c6-4ae1-b18b-41e885794adb\" (UID: \"35e99c47-a6c6-4ae1-b18b-41e885794adb\") " May 25 12:18:03.904604 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:18:03.904577 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35e99c47-a6c6-4ae1-b18b-41e885794adb-service-ca" (OuterVolumeSpecName: "service-ca") pod "35e99c47-a6c6-4ae1-b18b-41e885794adb" (UID: "35e99c47-a6c6-4ae1-b18b-41e885794adb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 12:18:03.904673 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:18:03.904620 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35e99c47-a6c6-4ae1-b18b-41e885794adb-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "35e99c47-a6c6-4ae1-b18b-41e885794adb" (UID: "35e99c47-a6c6-4ae1-b18b-41e885794adb"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 12:18:03.904673 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:18:03.904646 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35e99c47-a6c6-4ae1-b18b-41e885794adb-console-config" (OuterVolumeSpecName: "console-config") pod "35e99c47-a6c6-4ae1-b18b-41e885794adb" (UID: "35e99c47-a6c6-4ae1-b18b-41e885794adb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 12:18:03.904758 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:18:03.904684 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35e99c47-a6c6-4ae1-b18b-41e885794adb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "35e99c47-a6c6-4ae1-b18b-41e885794adb" (UID: "35e99c47-a6c6-4ae1-b18b-41e885794adb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 12:18:03.906576 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:18:03.906548 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35e99c47-a6c6-4ae1-b18b-41e885794adb-kube-api-access-65kdg" (OuterVolumeSpecName: "kube-api-access-65kdg") pod "35e99c47-a6c6-4ae1-b18b-41e885794adb" (UID: "35e99c47-a6c6-4ae1-b18b-41e885794adb"). InnerVolumeSpecName "kube-api-access-65kdg". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 12:18:03.906576 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:18:03.906560 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35e99c47-a6c6-4ae1-b18b-41e885794adb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "35e99c47-a6c6-4ae1-b18b-41e885794adb" (UID: "35e99c47-a6c6-4ae1-b18b-41e885794adb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 12:18:03.906712 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:18:03.906595 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35e99c47-a6c6-4ae1-b18b-41e885794adb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "35e99c47-a6c6-4ae1-b18b-41e885794adb" (UID: "35e99c47-a6c6-4ae1-b18b-41e885794adb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 12:18:04.005464 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:18:04.005364 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/35e99c47-a6c6-4ae1-b18b-41e885794adb-oauth-serving-cert\") on node \"ip-10-0-132-116.ec2.internal\" DevicePath \"\"" May 25 12:18:04.005464 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:18:04.005410 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/35e99c47-a6c6-4ae1-b18b-41e885794adb-console-serving-cert\") on node \"ip-10-0-132-116.ec2.internal\" DevicePath \"\"" May 25 12:18:04.005464 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:18:04.005422 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/35e99c47-a6c6-4ae1-b18b-41e885794adb-service-ca\") on node \"ip-10-0-132-116.ec2.internal\" DevicePath \"\"" May 25 12:18:04.005464 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:18:04.005431 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/35e99c47-a6c6-4ae1-b18b-41e885794adb-console-config\") on node \"ip-10-0-132-116.ec2.internal\" DevicePath \"\"" May 25 12:18:04.005464 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:18:04.005439 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65kdg\" (UniqueName: \"kubernetes.io/projected/35e99c47-a6c6-4ae1-b18b-41e885794adb-kube-api-access-65kdg\") on node \"ip-10-0-132-116.ec2.internal\" DevicePath \"\"" May 25 12:18:04.005464 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:18:04.005449 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35e99c47-a6c6-4ae1-b18b-41e885794adb-trusted-ca-bundle\") on node \"ip-10-0-132-116.ec2.internal\" DevicePath \"\"" May 25 12:18:04.005464 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:18:04.005458 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/35e99c47-a6c6-4ae1-b18b-41e885794adb-console-oauth-config\") on node \"ip-10-0-132-116.ec2.internal\" DevicePath \"\"" May 25 12:18:04.670237 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:18:04.670209 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7797964479-f7rc9_35e99c47-a6c6-4ae1-b18b-41e885794adb/console/0.log" May 25 12:18:04.670702 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:18:04.670271 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7797964479-f7rc9" event={"ID":"35e99c47-a6c6-4ae1-b18b-41e885794adb","Type":"ContainerDied","Data":"bfabcff73c883ed5223dfd962aa37f0aaf0226bda583c75ceebba86fc1d430bc"} May 25 12:18:04.670702 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:18:04.670306 2558 scope.go:117] "RemoveContainer" containerID="c28ad3673bd0d18fbeb95017df25d5bceb38b889df1060a3cf00eeaa7d79e17a" May 25 12:18:04.670702 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:18:04.670335 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7797964479-f7rc9" May 25 12:18:04.691696 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:18:04.691669 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7797964479-f7rc9"] May 25 12:18:04.693824 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:18:04.693802 2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7797964479-f7rc9"] May 25 12:18:05.563829 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:18:05.563793 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35e99c47-a6c6-4ae1-b18b-41e885794adb" path="/var/lib/kubelet/pods/35e99c47-a6c6-4ae1-b18b-41e885794adb/volumes" May 25 12:18:24.203826 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:18:24.203794 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 25 12:18:24.219749 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:18:24.219722 2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 25 12:18:24.744367 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:18:24.744340 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 25 12:23:26.592369 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:26.592333 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/s3-init-ht6tg"] May 25 12:23:26.592897 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:26.592830 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35e99c47-a6c6-4ae1-b18b-41e885794adb" containerName="console" May 25 12:23:26.592897 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:26.592851 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="35e99c47-a6c6-4ae1-b18b-41e885794adb" containerName="console" May 25 12:23:26.593015 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:26.592932 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="35e99c47-a6c6-4ae1-b18b-41e885794adb" containerName="console" May 25 12:23:26.595888 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:26.595869 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-ht6tg" May 25 12:23:26.598799 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:26.598774 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" May 25 12:23:26.598919 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:26.598776 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" May 25 12:23:26.598919 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:26.598777 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-85jzv\"" May 25 12:23:26.598919 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:26.598814 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" May 25 12:23:26.602158 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:26.602137 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-ht6tg"] May 25 12:23:26.674766 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:26.674727 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkt7w\" (UniqueName: \"kubernetes.io/projected/a5985f55-1cf2-4e5a-a205-8e630a4042e9-kube-api-access-dkt7w\") pod \"s3-init-ht6tg\" (UID: \"a5985f55-1cf2-4e5a-a205-8e630a4042e9\") " pod="kserve/s3-init-ht6tg" May 25 12:23:26.776172 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:26.776129 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dkt7w\" (UniqueName: \"kubernetes.io/projected/a5985f55-1cf2-4e5a-a205-8e630a4042e9-kube-api-access-dkt7w\") pod \"s3-init-ht6tg\" (UID: \"a5985f55-1cf2-4e5a-a205-8e630a4042e9\") " pod="kserve/s3-init-ht6tg" May 25 12:23:26.784647 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:26.784617 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkt7w\" (UniqueName: \"kubernetes.io/projected/a5985f55-1cf2-4e5a-a205-8e630a4042e9-kube-api-access-dkt7w\") pod \"s3-init-ht6tg\" (UID: \"a5985f55-1cf2-4e5a-a205-8e630a4042e9\") " pod="kserve/s3-init-ht6tg" May 25 12:23:26.917548 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:26.917514 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-ht6tg" May 25 12:23:27.043341 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:27.043163 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-ht6tg"] May 25 12:23:27.050843 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:27.050804 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 25 12:23:27.605746 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:27.605705 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-ht6tg" event={"ID":"a5985f55-1cf2-4e5a-a205-8e630a4042e9","Type":"ContainerStarted","Data":"06ebacee47667ba93c330868cf981baab884e3c42773c7b79e2bd250b5a1626e"} May 25 12:23:31.621022 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:31.620989 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-ht6tg" event={"ID":"a5985f55-1cf2-4e5a-a205-8e630a4042e9","Type":"ContainerStarted","Data":"32869d8cd26e7c34f5b97a00dd77beaf070b4a8b923e8113c563ef01d7bed220"} May 25 12:23:31.636214 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:31.636114 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/s3-init-ht6tg" podStartSLOduration=1.301237598 podStartE2EDuration="5.636080016s" podCreationTimestamp="2026-05-25 12:23:26 +0000 UTC" firstStartedPulling="2026-05-25 12:23:27.050945162 +0000 UTC m=+640.051733392" lastFinishedPulling="2026-05-25 12:23:31.385787572 +0000 UTC m=+644.386575810" observedRunningTime="2026-05-25 12:23:31.634648505 +0000 UTC m=+644.635436754" watchObservedRunningTime="2026-05-25 12:23:31.636080016 +0000 UTC m=+644.636868265" May 25 12:23:34.630221 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:34.630192 2558 generic.go:358] "Generic (PLEG): container finished" podID="a5985f55-1cf2-4e5a-a205-8e630a4042e9" containerID="32869d8cd26e7c34f5b97a00dd77beaf070b4a8b923e8113c563ef01d7bed220" exitCode=0 May 25 12:23:34.630631 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:34.630255 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-ht6tg" event={"ID":"a5985f55-1cf2-4e5a-a205-8e630a4042e9","Type":"ContainerDied","Data":"32869d8cd26e7c34f5b97a00dd77beaf070b4a8b923e8113c563ef01d7bed220"} May 25 12:23:35.766313 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:35.766291 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-ht6tg" May 25 12:23:35.863110 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:35.863059 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkt7w\" (UniqueName: \"kubernetes.io/projected/a5985f55-1cf2-4e5a-a205-8e630a4042e9-kube-api-access-dkt7w\") pod \"a5985f55-1cf2-4e5a-a205-8e630a4042e9\" (UID: \"a5985f55-1cf2-4e5a-a205-8e630a4042e9\") " May 25 12:23:35.865297 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:35.865273 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5985f55-1cf2-4e5a-a205-8e630a4042e9-kube-api-access-dkt7w" (OuterVolumeSpecName: "kube-api-access-dkt7w") pod "a5985f55-1cf2-4e5a-a205-8e630a4042e9" (UID: "a5985f55-1cf2-4e5a-a205-8e630a4042e9"). InnerVolumeSpecName "kube-api-access-dkt7w". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 12:23:35.964220 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:35.964129 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkt7w\" (UniqueName: \"kubernetes.io/projected/a5985f55-1cf2-4e5a-a205-8e630a4042e9-kube-api-access-dkt7w\") on node \"ip-10-0-132-116.ec2.internal\" DevicePath \"\"" May 25 12:23:36.637027 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:36.636987 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-ht6tg" event={"ID":"a5985f55-1cf2-4e5a-a205-8e630a4042e9","Type":"ContainerDied","Data":"06ebacee47667ba93c330868cf981baab884e3c42773c7b79e2bd250b5a1626e"} May 25 12:23:36.637027 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:36.637019 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="06ebacee47667ba93c330868cf981baab884e3c42773c7b79e2bd250b5a1626e" May 25 12:23:36.637027 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:36.637000 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-ht6tg" May 25 12:23:43.807630 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:43.807597 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/s3-tls-init-custom-dsv68"] May 25 12:23:43.808058 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:43.807952 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5985f55-1cf2-4e5a-a205-8e630a4042e9" containerName="s3-init" May 25 12:23:43.808058 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:43.807964 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5985f55-1cf2-4e5a-a205-8e630a4042e9" containerName="s3-init" May 25 12:23:43.808058 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:43.808014 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="a5985f55-1cf2-4e5a-a205-8e630a4042e9" containerName="s3-init" May 25 12:23:43.811128 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:43.811109 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-dsv68" May 25 12:23:43.813707 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:43.813688 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" May 25 12:23:43.813847 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:43.813775 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" May 25 12:23:43.813847 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:43.813831 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\"" May 25 12:23:43.815290 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:43.815268 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-85jzv\"" May 25 12:23:43.817649 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:43.817629 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-custom-dsv68"] May 25 12:23:43.931434 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:43.931397 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qzz8\" (UniqueName: \"kubernetes.io/projected/25fd19d1-f35f-4e5c-80ea-f520c879a7ab-kube-api-access-8qzz8\") pod \"s3-tls-init-custom-dsv68\" (UID: \"25fd19d1-f35f-4e5c-80ea-f520c879a7ab\") " pod="kserve/s3-tls-init-custom-dsv68" May 25 12:23:44.032582 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:44.032534 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8qzz8\" (UniqueName: \"kubernetes.io/projected/25fd19d1-f35f-4e5c-80ea-f520c879a7ab-kube-api-access-8qzz8\") pod \"s3-tls-init-custom-dsv68\" (UID: \"25fd19d1-f35f-4e5c-80ea-f520c879a7ab\") " pod="kserve/s3-tls-init-custom-dsv68" May 25 12:23:44.042006 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:44.041933 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qzz8\" (UniqueName: \"kubernetes.io/projected/25fd19d1-f35f-4e5c-80ea-f520c879a7ab-kube-api-access-8qzz8\") pod \"s3-tls-init-custom-dsv68\" (UID: \"25fd19d1-f35f-4e5c-80ea-f520c879a7ab\") " pod="kserve/s3-tls-init-custom-dsv68" May 25 12:23:44.137146 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:44.137088 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-dsv68" May 25 12:23:44.262952 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:44.262893 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-custom-dsv68"] May 25 12:23:44.265746 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:23:44.265716 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod25fd19d1_f35f_4e5c_80ea_f520c879a7ab.slice/crio-64ea724228d89a42ca8c07dc936cbcb53d1f39aacbdc41a173e705a095c339a6 WatchSource:0}: Error finding container 64ea724228d89a42ca8c07dc936cbcb53d1f39aacbdc41a173e705a095c339a6: Status 404 returned error can't find the container with id 64ea724228d89a42ca8c07dc936cbcb53d1f39aacbdc41a173e705a095c339a6 May 25 12:23:44.663741 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:44.663706 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-dsv68" event={"ID":"25fd19d1-f35f-4e5c-80ea-f520c879a7ab","Type":"ContainerStarted","Data":"1a181bbeed6f31680e6b5554d9c32fd083b1b610be2b25f8ddf1b9e37b716436"} May 25 12:23:44.663741 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:44.663740 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-dsv68" event={"ID":"25fd19d1-f35f-4e5c-80ea-f520c879a7ab","Type":"ContainerStarted","Data":"64ea724228d89a42ca8c07dc936cbcb53d1f39aacbdc41a173e705a095c339a6"} May 25 12:23:44.679351 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:44.679273 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/s3-tls-init-custom-dsv68" podStartSLOduration=1.679256349 podStartE2EDuration="1.679256349s" podCreationTimestamp="2026-05-25 12:23:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 12:23:44.678755105 +0000 UTC m=+657.679543354" watchObservedRunningTime="2026-05-25 12:23:44.679256349 +0000 UTC m=+657.680044596" May 25 12:23:48.678281 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:48.678236 2558 generic.go:358] "Generic (PLEG): container finished" podID="25fd19d1-f35f-4e5c-80ea-f520c879a7ab" containerID="1a181bbeed6f31680e6b5554d9c32fd083b1b610be2b25f8ddf1b9e37b716436" exitCode=0 May 25 12:23:48.678658 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:48.678313 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-dsv68" event={"ID":"25fd19d1-f35f-4e5c-80ea-f520c879a7ab","Type":"ContainerDied","Data":"1a181bbeed6f31680e6b5554d9c32fd083b1b610be2b25f8ddf1b9e37b716436"} May 25 12:23:49.806059 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:49.806039 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-dsv68" May 25 12:23:49.982217 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:49.982143 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qzz8\" (UniqueName: \"kubernetes.io/projected/25fd19d1-f35f-4e5c-80ea-f520c879a7ab-kube-api-access-8qzz8\") pod \"25fd19d1-f35f-4e5c-80ea-f520c879a7ab\" (UID: \"25fd19d1-f35f-4e5c-80ea-f520c879a7ab\") " May 25 12:23:49.984254 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:49.984228 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25fd19d1-f35f-4e5c-80ea-f520c879a7ab-kube-api-access-8qzz8" (OuterVolumeSpecName: "kube-api-access-8qzz8") pod "25fd19d1-f35f-4e5c-80ea-f520c879a7ab" (UID: "25fd19d1-f35f-4e5c-80ea-f520c879a7ab"). InnerVolumeSpecName "kube-api-access-8qzz8". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 12:23:50.083358 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:50.083333 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qzz8\" (UniqueName: \"kubernetes.io/projected/25fd19d1-f35f-4e5c-80ea-f520c879a7ab-kube-api-access-8qzz8\") on node \"ip-10-0-132-116.ec2.internal\" DevicePath \"\"" May 25 12:23:50.685483 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:50.685451 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-dsv68" event={"ID":"25fd19d1-f35f-4e5c-80ea-f520c879a7ab","Type":"ContainerDied","Data":"64ea724228d89a42ca8c07dc936cbcb53d1f39aacbdc41a173e705a095c339a6"} May 25 12:23:50.685483 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:50.685484 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="64ea724228d89a42ca8c07dc936cbcb53d1f39aacbdc41a173e705a095c339a6" May 25 12:23:50.685483 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:50.685463 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-dsv68" May 25 12:23:54.067360 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:54.067326 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/s3-tls-init-serving-qnxd8"] May 25 12:23:54.067745 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:54.067679 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25fd19d1-f35f-4e5c-80ea-f520c879a7ab" containerName="s3-tls-init-custom" May 25 12:23:54.067745 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:54.067691 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="25fd19d1-f35f-4e5c-80ea-f520c879a7ab" containerName="s3-tls-init-custom" May 25 12:23:54.067814 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:54.067753 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="25fd19d1-f35f-4e5c-80ea-f520c879a7ab" containerName="s3-tls-init-custom" May 25 12:23:54.075160 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:54.075136 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-qnxd8" May 25 12:23:54.076984 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:54.076959 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-serving-qnxd8"] May 25 12:23:54.077909 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:54.077889 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving-artifact\"" May 25 12:23:54.077998 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:54.077898 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" May 25 12:23:54.079265 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:54.079241 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" May 25 12:23:54.079265 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:54.079254 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-85jzv\"" May 25 12:23:54.220449 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:54.220422 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62kgs\" (UniqueName: \"kubernetes.io/projected/3a641592-2411-4190-b63a-c33b738cccf0-kube-api-access-62kgs\") pod \"s3-tls-init-serving-qnxd8\" (UID: \"3a641592-2411-4190-b63a-c33b738cccf0\") " pod="kserve/s3-tls-init-serving-qnxd8" May 25 12:23:54.320914 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:54.320827 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-62kgs\" (UniqueName: \"kubernetes.io/projected/3a641592-2411-4190-b63a-c33b738cccf0-kube-api-access-62kgs\") pod \"s3-tls-init-serving-qnxd8\" (UID: \"3a641592-2411-4190-b63a-c33b738cccf0\") " pod="kserve/s3-tls-init-serving-qnxd8" May 25 12:23:54.329561 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:54.329538 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62kgs\" (UniqueName: \"kubernetes.io/projected/3a641592-2411-4190-b63a-c33b738cccf0-kube-api-access-62kgs\") pod \"s3-tls-init-serving-qnxd8\" (UID: \"3a641592-2411-4190-b63a-c33b738cccf0\") " pod="kserve/s3-tls-init-serving-qnxd8" May 25 12:23:54.391521 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:54.391491 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-qnxd8" May 25 12:23:54.515457 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:54.515364 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-serving-qnxd8"] May 25 12:23:54.518039 ip-10-0-132-116 kubenswrapper[2558]: W0525 12:23:54.517999 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3a641592_2411_4190_b63a_c33b738cccf0.slice/crio-ba3c48182b11eab35034988624d22f9117ebbe057dbe90838edecbd87341d27f WatchSource:0}: Error finding container ba3c48182b11eab35034988624d22f9117ebbe057dbe90838edecbd87341d27f: Status 404 returned error can't find the container with id ba3c48182b11eab35034988624d22f9117ebbe057dbe90838edecbd87341d27f May 25 12:23:54.700487 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:54.700444 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-qnxd8" event={"ID":"3a641592-2411-4190-b63a-c33b738cccf0","Type":"ContainerStarted","Data":"7559099ca8c171befe414a388bc3229108a9a25707ba013a0668bfac23dcefd3"} May 25 12:23:54.700487 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:54.700479 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-qnxd8" event={"ID":"3a641592-2411-4190-b63a-c33b738cccf0","Type":"ContainerStarted","Data":"ba3c48182b11eab35034988624d22f9117ebbe057dbe90838edecbd87341d27f"} May 25 12:23:54.716465 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:54.716251 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/s3-tls-init-serving-qnxd8" podStartSLOduration=0.716233164 podStartE2EDuration="716.233164ms" podCreationTimestamp="2026-05-25 12:23:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 12:23:54.716012298 +0000 UTC m=+667.716800550" watchObservedRunningTime="2026-05-25 12:23:54.716233164 +0000 UTC m=+667.717021405" May 25 12:23:59.715112 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:59.715062 2558 generic.go:358] "Generic (PLEG): container finished" podID="3a641592-2411-4190-b63a-c33b738cccf0" containerID="7559099ca8c171befe414a388bc3229108a9a25707ba013a0668bfac23dcefd3" exitCode=0 May 25 12:23:59.715502 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:23:59.715133 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-qnxd8" event={"ID":"3a641592-2411-4190-b63a-c33b738cccf0","Type":"ContainerDied","Data":"7559099ca8c171befe414a388bc3229108a9a25707ba013a0668bfac23dcefd3"} May 25 12:24:00.845986 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:24:00.845965 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-qnxd8" May 25 12:24:00.879196 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:24:00.879175 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62kgs\" (UniqueName: \"kubernetes.io/projected/3a641592-2411-4190-b63a-c33b738cccf0-kube-api-access-62kgs\") pod \"3a641592-2411-4190-b63a-c33b738cccf0\" (UID: \"3a641592-2411-4190-b63a-c33b738cccf0\") " May 25 12:24:00.881349 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:24:00.881318 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a641592-2411-4190-b63a-c33b738cccf0-kube-api-access-62kgs" (OuterVolumeSpecName: "kube-api-access-62kgs") pod "3a641592-2411-4190-b63a-c33b738cccf0" (UID: "3a641592-2411-4190-b63a-c33b738cccf0"). InnerVolumeSpecName "kube-api-access-62kgs". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 12:24:00.980651 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:24:00.980576 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62kgs\" (UniqueName: \"kubernetes.io/projected/3a641592-2411-4190-b63a-c33b738cccf0-kube-api-access-62kgs\") on node \"ip-10-0-132-116.ec2.internal\" DevicePath \"\"" May 25 12:24:01.721771 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:24:01.721728 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-qnxd8" event={"ID":"3a641592-2411-4190-b63a-c33b738cccf0","Type":"ContainerDied","Data":"ba3c48182b11eab35034988624d22f9117ebbe057dbe90838edecbd87341d27f"} May 25 12:24:01.721771 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:24:01.721760 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ba3c48182b11eab35034988624d22f9117ebbe057dbe90838edecbd87341d27f" May 25 12:24:01.721771 ip-10-0-132-116 kubenswrapper[2558]: I0525 12:24:01.721741 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-qnxd8" May 25 13:21:08.280156 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:08.280122 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rx2md/must-gather-glckv"] May 25 13:21:08.280712 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:08.280639 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a641592-2411-4190-b63a-c33b738cccf0" containerName="s3-tls-init-serving" May 25 13:21:08.280712 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:08.280657 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a641592-2411-4190-b63a-c33b738cccf0" containerName="s3-tls-init-serving" May 25 13:21:08.280813 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:08.280744 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="3a641592-2411-4190-b63a-c33b738cccf0" containerName="s3-tls-init-serving" May 25 13:21:08.284084 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:08.284050 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rx2md/must-gather-glckv" May 25 13:21:08.286783 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:08.286757 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rx2md\"/\"openshift-service-ca.crt\"" May 25 13:21:08.286917 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:08.286767 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rx2md\"/\"kube-root-ca.crt\"" May 25 13:21:08.293137 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:08.293087 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rx2md/must-gather-glckv"] May 25 13:21:08.337516 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:08.337481 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cf47f43c-283e-4df5-ac8d-28159df06319-must-gather-output\") pod \"must-gather-glckv\" (UID: \"cf47f43c-283e-4df5-ac8d-28159df06319\") " pod="openshift-must-gather-rx2md/must-gather-glckv" May 25 13:21:08.337700 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:08.337532 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cgtv\" (UniqueName: \"kubernetes.io/projected/cf47f43c-283e-4df5-ac8d-28159df06319-kube-api-access-6cgtv\") pod \"must-gather-glckv\" (UID: \"cf47f43c-283e-4df5-ac8d-28159df06319\") " pod="openshift-must-gather-rx2md/must-gather-glckv" May 25 13:21:08.438367 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:08.438313 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6cgtv\" (UniqueName: \"kubernetes.io/projected/cf47f43c-283e-4df5-ac8d-28159df06319-kube-api-access-6cgtv\") pod \"must-gather-glckv\" (UID: \"cf47f43c-283e-4df5-ac8d-28159df06319\") " pod="openshift-must-gather-rx2md/must-gather-glckv" May 25 13:21:08.438559 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:08.438449 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cf47f43c-283e-4df5-ac8d-28159df06319-must-gather-output\") pod \"must-gather-glckv\" (UID: \"cf47f43c-283e-4df5-ac8d-28159df06319\") " pod="openshift-must-gather-rx2md/must-gather-glckv" May 25 13:21:08.438823 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:08.438799 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cf47f43c-283e-4df5-ac8d-28159df06319-must-gather-output\") pod \"must-gather-glckv\" (UID: \"cf47f43c-283e-4df5-ac8d-28159df06319\") " pod="openshift-must-gather-rx2md/must-gather-glckv" May 25 13:21:08.447330 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:08.447304 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cgtv\" (UniqueName: \"kubernetes.io/projected/cf47f43c-283e-4df5-ac8d-28159df06319-kube-api-access-6cgtv\") pod \"must-gather-glckv\" (UID: \"cf47f43c-283e-4df5-ac8d-28159df06319\") " pod="openshift-must-gather-rx2md/must-gather-glckv" May 25 13:21:08.612036 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:08.611998 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rx2md/must-gather-glckv" May 25 13:21:08.743567 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:08.743369 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rx2md/must-gather-glckv"] May 25 13:21:08.746445 ip-10-0-132-116 kubenswrapper[2558]: W0525 13:21:08.746407 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcf47f43c_283e_4df5_ac8d_28159df06319.slice/crio-806d220965ebb54b9eea3561e5b2239ceda0ba1f85c0967a74c8208f89f7aa66 WatchSource:0}: Error finding container 806d220965ebb54b9eea3561e5b2239ceda0ba1f85c0967a74c8208f89f7aa66: Status 404 returned error can't find the container with id 806d220965ebb54b9eea3561e5b2239ceda0ba1f85c0967a74c8208f89f7aa66 May 25 13:21:08.748007 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:08.747986 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 25 13:21:09.012580 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:09.012485 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rx2md/must-gather-glckv" event={"ID":"cf47f43c-283e-4df5-ac8d-28159df06319","Type":"ContainerStarted","Data":"806d220965ebb54b9eea3561e5b2239ceda0ba1f85c0967a74c8208f89f7aa66"} May 25 13:21:16.040913 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:16.040873 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rx2md/must-gather-glckv" event={"ID":"cf47f43c-283e-4df5-ac8d-28159df06319","Type":"ContainerStarted","Data":"710fdc49c9ecb9a6e4d52f7f217b9ef5d683fe6811e6cfb9dcecbf5dcf615d0c"} May 25 13:21:16.040913 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:16.040912 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rx2md/must-gather-glckv" event={"ID":"cf47f43c-283e-4df5-ac8d-28159df06319","Type":"ContainerStarted","Data":"76fac909b156aed2d5016aa6bf1815316b2c1db3f215d1d3426e83113574b191"} May 25 13:21:16.058079 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:16.058020 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-rx2md/must-gather-glckv" podStartSLOduration=1.8162814269999998 podStartE2EDuration="8.05800461s" podCreationTimestamp="2026-05-25 13:21:08 +0000 UTC" firstStartedPulling="2026-05-25 13:21:08.748171452 +0000 UTC m=+4101.748959680" lastFinishedPulling="2026-05-25 13:21:14.989894593 +0000 UTC m=+4107.990682863" observedRunningTime="2026-05-25 13:21:16.055584603 +0000 UTC m=+4109.056372866" watchObservedRunningTime="2026-05-25 13:21:16.05800461 +0000 UTC m=+4109.058792898" May 25 13:21:38.113500 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:38.113464 2558 generic.go:358] "Generic (PLEG): container finished" podID="cf47f43c-283e-4df5-ac8d-28159df06319" containerID="76fac909b156aed2d5016aa6bf1815316b2c1db3f215d1d3426e83113574b191" exitCode=0 May 25 13:21:38.113907 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:38.113537 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rx2md/must-gather-glckv" event={"ID":"cf47f43c-283e-4df5-ac8d-28159df06319","Type":"ContainerDied","Data":"76fac909b156aed2d5016aa6bf1815316b2c1db3f215d1d3426e83113574b191"} May 25 13:21:38.113907 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:38.113863 2558 scope.go:117] "RemoveContainer" containerID="76fac909b156aed2d5016aa6bf1815316b2c1db3f215d1d3426e83113574b191" May 25 13:21:38.931541 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:38.931508 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-rx2md_must-gather-glckv_cf47f43c-283e-4df5-ac8d-28159df06319/gather/0.log" May 25 13:21:39.890533 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:39.890492 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wj4hj/must-gather-7g88t"] May 25 13:21:39.893056 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:39.893039 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wj4hj/must-gather-7g88t" May 25 13:21:39.896250 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:39.896226 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wj4hj\"/\"kube-root-ca.crt\"" May 25 13:21:39.896400 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:39.896248 2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wj4hj\"/\"default-dockercfg-lb72r\"" May 25 13:21:39.897553 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:39.897537 2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wj4hj\"/\"openshift-service-ca.crt\"" May 25 13:21:39.900923 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:39.900901 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wj4hj/must-gather-7g88t"] May 25 13:21:39.922857 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:39.922819 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/88071b3a-d770-404b-b0af-88734cf655cb-must-gather-output\") pod \"must-gather-7g88t\" (UID: \"88071b3a-d770-404b-b0af-88734cf655cb\") " pod="openshift-must-gather-wj4hj/must-gather-7g88t" May 25 13:21:39.923034 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:39.922935 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2bdp\" (UniqueName: \"kubernetes.io/projected/88071b3a-d770-404b-b0af-88734cf655cb-kube-api-access-d2bdp\") pod \"must-gather-7g88t\" (UID: \"88071b3a-d770-404b-b0af-88734cf655cb\") " pod="openshift-must-gather-wj4hj/must-gather-7g88t" May 25 13:21:40.023945 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:40.023899 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/88071b3a-d770-404b-b0af-88734cf655cb-must-gather-output\") pod \"must-gather-7g88t\" (UID: \"88071b3a-d770-404b-b0af-88734cf655cb\") " pod="openshift-must-gather-wj4hj/must-gather-7g88t" May 25 13:21:40.024161 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:40.023999 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d2bdp\" (UniqueName: \"kubernetes.io/projected/88071b3a-d770-404b-b0af-88734cf655cb-kube-api-access-d2bdp\") pod \"must-gather-7g88t\" (UID: \"88071b3a-d770-404b-b0af-88734cf655cb\") " pod="openshift-must-gather-wj4hj/must-gather-7g88t" May 25 13:21:40.024298 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:40.024275 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/88071b3a-d770-404b-b0af-88734cf655cb-must-gather-output\") pod \"must-gather-7g88t\" (UID: \"88071b3a-d770-404b-b0af-88734cf655cb\") " pod="openshift-must-gather-wj4hj/must-gather-7g88t" May 25 13:21:40.032368 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:40.032344 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2bdp\" (UniqueName: \"kubernetes.io/projected/88071b3a-d770-404b-b0af-88734cf655cb-kube-api-access-d2bdp\") pod \"must-gather-7g88t\" (UID: \"88071b3a-d770-404b-b0af-88734cf655cb\") " pod="openshift-must-gather-wj4hj/must-gather-7g88t" May 25 13:21:40.203233 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:40.203141 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wj4hj/must-gather-7g88t" May 25 13:21:40.332001 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:40.331967 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wj4hj/must-gather-7g88t"] May 25 13:21:40.334509 ip-10-0-132-116 kubenswrapper[2558]: W0525 13:21:40.334470 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod88071b3a_d770_404b_b0af_88734cf655cb.slice/crio-dd27172bf5a5fcd1543ad5294ab47cdd9addc83c2eb1e42f18126922d913fe08 WatchSource:0}: Error finding container dd27172bf5a5fcd1543ad5294ab47cdd9addc83c2eb1e42f18126922d913fe08: Status 404 returned error can't find the container with id dd27172bf5a5fcd1543ad5294ab47cdd9addc83c2eb1e42f18126922d913fe08 May 25 13:21:41.126517 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:41.126475 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wj4hj/must-gather-7g88t" event={"ID":"88071b3a-d770-404b-b0af-88734cf655cb","Type":"ContainerStarted","Data":"abd8bdba883d4a3b37e369120457ea7ce88cd22a178be72d1f23c95bcf756a76"} May 25 13:21:41.126984 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:41.126525 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wj4hj/must-gather-7g88t" event={"ID":"88071b3a-d770-404b-b0af-88734cf655cb","Type":"ContainerStarted","Data":"dd27172bf5a5fcd1543ad5294ab47cdd9addc83c2eb1e42f18126922d913fe08"} May 25 13:21:42.139444 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:42.139400 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wj4hj/must-gather-7g88t" event={"ID":"88071b3a-d770-404b-b0af-88734cf655cb","Type":"ContainerStarted","Data":"788ff44f5569ef66c4a2f43a009515f83f28beb6ff942c56eac05846d5d798a1"} May 25 13:21:42.154448 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:42.154382 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-wj4hj/must-gather-7g88t" podStartSLOduration=2.511961971 podStartE2EDuration="3.154362556s" podCreationTimestamp="2026-05-25 13:21:39 +0000 UTC" firstStartedPulling="2026-05-25 13:21:40.336220301 +0000 UTC m=+4133.337008529" lastFinishedPulling="2026-05-25 13:21:40.978620887 +0000 UTC m=+4133.979409114" observedRunningTime="2026-05-25 13:21:42.154339057 +0000 UTC m=+4135.155127306" watchObservedRunningTime="2026-05-25 13:21:42.154362556 +0000 UTC m=+4135.155150806" May 25 13:21:42.344251 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:42.344221 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vhv79_79806095-6157-40ab-b31e-353a019ef116/global-pull-secret-syncer/0.log" May 25 13:21:42.518828 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:42.518744 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7mgh4_bdb1015a-2223-4987-a813-6fea589e0dd0/konnectivity-agent/0.log" May 25 13:21:42.651031 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:42.650997 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-116.ec2.internal_41194dcb30c71e287bcaa2f7065bdd2e/haproxy/0.log" May 25 13:21:44.707885 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:44.707845 2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-rx2md/must-gather-glckv"] May 25 13:21:44.708459 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:44.708190 2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-must-gather-rx2md/must-gather-glckv" podUID="cf47f43c-283e-4df5-ac8d-28159df06319" containerName="copy" containerID="cri-o://710fdc49c9ecb9a6e4d52f7f217b9ef5d683fe6811e6cfb9dcecbf5dcf615d0c" gracePeriod=2 May 25 13:21:44.710624 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:44.710589 2558 status_manager.go:895] "Failed to get status for pod" podUID="cf47f43c-283e-4df5-ac8d-28159df06319" pod="openshift-must-gather-rx2md/must-gather-glckv" err="pods \"must-gather-glckv\" is forbidden: User \"system:node:ip-10-0-132-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-rx2md\": no relationship found between node 'ip-10-0-132-116.ec2.internal' and this object" May 25 13:21:44.712079 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:44.712052 2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-rx2md/must-gather-glckv"] May 25 13:21:45.106510 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:45.104298 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-rx2md_must-gather-glckv_cf47f43c-283e-4df5-ac8d-28159df06319/copy/0.log" May 25 13:21:45.106510 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:45.104699 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rx2md/must-gather-glckv" May 25 13:21:45.111119 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:45.107292 2558 status_manager.go:895] "Failed to get status for pod" podUID="cf47f43c-283e-4df5-ac8d-28159df06319" pod="openshift-must-gather-rx2md/must-gather-glckv" err="pods \"must-gather-glckv\" is forbidden: User \"system:node:ip-10-0-132-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-rx2md\": no relationship found between node 'ip-10-0-132-116.ec2.internal' and this object" May 25 13:21:45.154116 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:45.153930 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-rx2md_must-gather-glckv_cf47f43c-283e-4df5-ac8d-28159df06319/copy/0.log" May 25 13:21:45.154810 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:45.154508 2558 generic.go:358] "Generic (PLEG): container finished" podID="cf47f43c-283e-4df5-ac8d-28159df06319" containerID="710fdc49c9ecb9a6e4d52f7f217b9ef5d683fe6811e6cfb9dcecbf5dcf615d0c" exitCode=143 May 25 13:21:45.154810 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:45.154595 2558 scope.go:117] "RemoveContainer" containerID="710fdc49c9ecb9a6e4d52f7f217b9ef5d683fe6811e6cfb9dcecbf5dcf615d0c" May 25 13:21:45.154810 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:45.154729 2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rx2md/must-gather-glckv" May 25 13:21:45.160036 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:45.159997 2558 status_manager.go:895] "Failed to get status for pod" podUID="cf47f43c-283e-4df5-ac8d-28159df06319" pod="openshift-must-gather-rx2md/must-gather-glckv" err="pods \"must-gather-glckv\" is forbidden: User \"system:node:ip-10-0-132-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-rx2md\": no relationship found between node 'ip-10-0-132-116.ec2.internal' and this object" May 25 13:21:45.171432 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:45.170389 2558 scope.go:117] "RemoveContainer" containerID="76fac909b156aed2d5016aa6bf1815316b2c1db3f215d1d3426e83113574b191" May 25 13:21:45.178465 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:45.178432 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6cgtv\" (UniqueName: \"kubernetes.io/projected/cf47f43c-283e-4df5-ac8d-28159df06319-kube-api-access-6cgtv\") pod \"cf47f43c-283e-4df5-ac8d-28159df06319\" (UID: \"cf47f43c-283e-4df5-ac8d-28159df06319\") " May 25 13:21:45.178612 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:45.178525 2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cf47f43c-283e-4df5-ac8d-28159df06319-must-gather-output\") pod \"cf47f43c-283e-4df5-ac8d-28159df06319\" (UID: \"cf47f43c-283e-4df5-ac8d-28159df06319\") " May 25 13:21:45.179961 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:45.179882 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf47f43c-283e-4df5-ac8d-28159df06319-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "cf47f43c-283e-4df5-ac8d-28159df06319" (UID: "cf47f43c-283e-4df5-ac8d-28159df06319"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 25 13:21:45.202382 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:45.200153 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf47f43c-283e-4df5-ac8d-28159df06319-kube-api-access-6cgtv" (OuterVolumeSpecName: "kube-api-access-6cgtv") pod "cf47f43c-283e-4df5-ac8d-28159df06319" (UID: "cf47f43c-283e-4df5-ac8d-28159df06319"). InnerVolumeSpecName "kube-api-access-6cgtv". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 13:21:45.205828 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:45.204262 2558 scope.go:117] "RemoveContainer" containerID="710fdc49c9ecb9a6e4d52f7f217b9ef5d683fe6811e6cfb9dcecbf5dcf615d0c" May 25 13:21:45.205828 ip-10-0-132-116 kubenswrapper[2558]: E0525 13:21:45.204717 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"710fdc49c9ecb9a6e4d52f7f217b9ef5d683fe6811e6cfb9dcecbf5dcf615d0c\": container with ID starting with 710fdc49c9ecb9a6e4d52f7f217b9ef5d683fe6811e6cfb9dcecbf5dcf615d0c not found: ID does not exist" containerID="710fdc49c9ecb9a6e4d52f7f217b9ef5d683fe6811e6cfb9dcecbf5dcf615d0c" May 25 13:21:45.205828 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:45.204756 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"710fdc49c9ecb9a6e4d52f7f217b9ef5d683fe6811e6cfb9dcecbf5dcf615d0c"} err="failed to get container status \"710fdc49c9ecb9a6e4d52f7f217b9ef5d683fe6811e6cfb9dcecbf5dcf615d0c\": rpc error: code = NotFound desc = could not find container \"710fdc49c9ecb9a6e4d52f7f217b9ef5d683fe6811e6cfb9dcecbf5dcf615d0c\": container with ID starting with 710fdc49c9ecb9a6e4d52f7f217b9ef5d683fe6811e6cfb9dcecbf5dcf615d0c not found: ID does not exist" May 25 13:21:45.205828 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:45.204786 2558 scope.go:117] "RemoveContainer" containerID="76fac909b156aed2d5016aa6bf1815316b2c1db3f215d1d3426e83113574b191" May 25 13:21:45.205828 ip-10-0-132-116 kubenswrapper[2558]: E0525 13:21:45.205204 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76fac909b156aed2d5016aa6bf1815316b2c1db3f215d1d3426e83113574b191\": container with ID starting with 76fac909b156aed2d5016aa6bf1815316b2c1db3f215d1d3426e83113574b191 not found: ID does not exist" containerID="76fac909b156aed2d5016aa6bf1815316b2c1db3f215d1d3426e83113574b191" May 25 13:21:45.205828 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:45.205234 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76fac909b156aed2d5016aa6bf1815316b2c1db3f215d1d3426e83113574b191"} err="failed to get container status \"76fac909b156aed2d5016aa6bf1815316b2c1db3f215d1d3426e83113574b191\": rpc error: code = NotFound desc = could not find container \"76fac909b156aed2d5016aa6bf1815316b2c1db3f215d1d3426e83113574b191\": container with ID starting with 76fac909b156aed2d5016aa6bf1815316b2c1db3f215d1d3426e83113574b191 not found: ID does not exist" May 25 13:21:45.280221 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:45.280169 2558 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cf47f43c-283e-4df5-ac8d-28159df06319-must-gather-output\") on node \"ip-10-0-132-116.ec2.internal\" DevicePath \"\"" May 25 13:21:45.280221 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:45.280221 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6cgtv\" (UniqueName: \"kubernetes.io/projected/cf47f43c-283e-4df5-ac8d-28159df06319-kube-api-access-6cgtv\") on node \"ip-10-0-132-116.ec2.internal\" DevicePath \"\"" May 25 13:21:45.469670 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:45.469627 2558 status_manager.go:895] "Failed to get status for pod" podUID="cf47f43c-283e-4df5-ac8d-28159df06319" pod="openshift-must-gather-rx2md/must-gather-glckv" err="pods \"must-gather-glckv\" is forbidden: User \"system:node:ip-10-0-132-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-rx2md\": no relationship found between node 'ip-10-0-132-116.ec2.internal' and this object" May 25 13:21:45.565353 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:45.565263 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf47f43c-283e-4df5-ac8d-28159df06319" path="/var/lib/kubelet/pods/cf47f43c-283e-4df5-ac8d-28159df06319/volumes" May 25 13:21:46.125349 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:46.125248 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f55615a8-9290-4b68-831e-abde9a0d317d/alertmanager/0.log" May 25 13:21:46.150709 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:46.150683 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f55615a8-9290-4b68-831e-abde9a0d317d/config-reloader/0.log" May 25 13:21:46.172709 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:46.172681 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f55615a8-9290-4b68-831e-abde9a0d317d/kube-rbac-proxy-web/0.log" May 25 13:21:46.192890 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:46.192865 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f55615a8-9290-4b68-831e-abde9a0d317d/kube-rbac-proxy/0.log" May 25 13:21:46.214459 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:46.214432 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f55615a8-9290-4b68-831e-abde9a0d317d/kube-rbac-proxy-metric/0.log" May 25 13:21:46.239868 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:46.239789 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f55615a8-9290-4b68-831e-abde9a0d317d/prom-label-proxy/0.log" May 25 13:21:46.275151 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:46.267163 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f55615a8-9290-4b68-831e-abde9a0d317d/init-config-reloader/0.log" May 25 13:21:46.323056 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:46.323020 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-gjgb8_a9b80b14-cbf7-45ac-89af-2f0ca563299d/cluster-monitoring-operator/0.log" May 25 13:21:46.345828 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:46.345799 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-d6h5p_62b68527-00bb-4ed3-9b6c-ffa10beb044e/kube-state-metrics/0.log" May 25 13:21:46.369767 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:46.369719 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-d6h5p_62b68527-00bb-4ed3-9b6c-ffa10beb044e/kube-rbac-proxy-main/0.log" May 25 13:21:46.393863 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:46.393779 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-d6h5p_62b68527-00bb-4ed3-9b6c-ffa10beb044e/kube-rbac-proxy-self/0.log" May 25 13:21:46.423553 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:46.423520 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-76749bc9c-k667z_dd66a003-aa5d-4cc2-92b6-a5f69fee74df/metrics-server/0.log" May 25 13:21:46.450372 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:46.450325 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-mldx5_75db06a3-439a-4d9e-a11e-02232ed870fd/monitoring-plugin/0.log" May 25 13:21:46.484576 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:46.484544 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dgf44_0adb1f7c-393b-4690-b70b-8ffbb670d95e/node-exporter/0.log" May 25 13:21:46.506438 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:46.506411 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dgf44_0adb1f7c-393b-4690-b70b-8ffbb670d95e/kube-rbac-proxy/0.log" May 25 13:21:46.528116 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:46.528064 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dgf44_0adb1f7c-393b-4690-b70b-8ffbb670d95e/init-textfile/0.log" May 25 13:21:46.706193 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:46.706124 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-q6j77_38a38a1a-53f0-498a-8e09-c274b365c58d/kube-rbac-proxy-main/0.log" May 25 13:21:46.726900 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:46.726869 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-q6j77_38a38a1a-53f0-498a-8e09-c274b365c58d/kube-rbac-proxy-self/0.log" May 25 13:21:46.757991 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:46.757964 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-q6j77_38a38a1a-53f0-498a-8e09-c274b365c58d/openshift-state-metrics/0.log" May 25 13:21:46.807689 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:46.807650 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f/prometheus/0.log" May 25 13:21:46.824960 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:46.824923 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f/config-reloader/0.log" May 25 13:21:46.846190 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:46.846151 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f/thanos-sidecar/0.log" May 25 13:21:46.870012 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:46.869987 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f/kube-rbac-proxy-web/0.log" May 25 13:21:46.892782 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:46.892748 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f/kube-rbac-proxy/0.log" May 25 13:21:46.919397 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:46.919363 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f/kube-rbac-proxy-thanos/0.log" May 25 13:21:46.939787 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:46.939761 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d23a1cc3-c4dc-4c7a-83c3-d96c0cae1a7f/init-config-reloader/0.log" May 25 13:21:47.014347 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:47.014320 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-drlhp_8b6f94b0-fafc-4bbd-a971-fe9f978645da/prometheus-operator-admission-webhook/0.log" May 25 13:21:47.150650 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:47.150613 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58bb874567-k497g_e90631d3-7f49-4fa3-b842-28b86aa7e335/thanos-query/0.log" May 25 13:21:47.180988 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:47.180955 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58bb874567-k497g_e90631d3-7f49-4fa3-b842-28b86aa7e335/kube-rbac-proxy-web/0.log" May 25 13:21:47.211938 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:47.210718 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58bb874567-k497g_e90631d3-7f49-4fa3-b842-28b86aa7e335/kube-rbac-proxy/0.log" May 25 13:21:47.235605 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:47.235577 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58bb874567-k497g_e90631d3-7f49-4fa3-b842-28b86aa7e335/prom-label-proxy/0.log" May 25 13:21:47.258839 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:47.258807 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58bb874567-k497g_e90631d3-7f49-4fa3-b842-28b86aa7e335/kube-rbac-proxy-rules/0.log" May 25 13:21:47.283318 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:47.283285 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58bb874567-k497g_e90631d3-7f49-4fa3-b842-28b86aa7e335/kube-rbac-proxy-metrics/0.log" May 25 13:21:49.762543 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:49.762493 2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wj4hj/perf-node-gather-daemonset-57rb2"] May 25 13:21:49.763726 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:49.763697 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf47f43c-283e-4df5-ac8d-28159df06319" containerName="copy" May 25 13:21:49.763893 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:49.763881 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf47f43c-283e-4df5-ac8d-28159df06319" containerName="copy" May 25 13:21:49.764032 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:49.763998 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf47f43c-283e-4df5-ac8d-28159df06319" containerName="gather" May 25 13:21:49.764032 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:49.764017 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf47f43c-283e-4df5-ac8d-28159df06319" containerName="gather" May 25 13:21:49.764264 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:49.764138 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="cf47f43c-283e-4df5-ac8d-28159df06319" containerName="gather" May 25 13:21:49.764264 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:49.764159 2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="cf47f43c-283e-4df5-ac8d-28159df06319" containerName="copy" May 25 13:21:49.768986 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:49.768960 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wj4hj/perf-node-gather-daemonset-57rb2" May 25 13:21:49.774054 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:49.774001 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wj4hj/perf-node-gather-daemonset-57rb2"] May 25 13:21:49.825455 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:49.825370 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c810c058-1c3b-44d8-987b-a9b836b369bc-lib-modules\") pod \"perf-node-gather-daemonset-57rb2\" (UID: \"c810c058-1c3b-44d8-987b-a9b836b369bc\") " pod="openshift-must-gather-wj4hj/perf-node-gather-daemonset-57rb2" May 25 13:21:49.825757 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:49.825732 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c810c058-1c3b-44d8-987b-a9b836b369bc-sys\") pod \"perf-node-gather-daemonset-57rb2\" (UID: \"c810c058-1c3b-44d8-987b-a9b836b369bc\") " pod="openshift-must-gather-wj4hj/perf-node-gather-daemonset-57rb2" May 25 13:21:49.825987 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:49.825969 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c810c058-1c3b-44d8-987b-a9b836b369bc-podres\") pod \"perf-node-gather-daemonset-57rb2\" (UID: \"c810c058-1c3b-44d8-987b-a9b836b369bc\") " pod="openshift-must-gather-wj4hj/perf-node-gather-daemonset-57rb2" May 25 13:21:49.826276 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:49.826257 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q622c\" (UniqueName: \"kubernetes.io/projected/c810c058-1c3b-44d8-987b-a9b836b369bc-kube-api-access-q622c\") pod \"perf-node-gather-daemonset-57rb2\" (UID: \"c810c058-1c3b-44d8-987b-a9b836b369bc\") " pod="openshift-must-gather-wj4hj/perf-node-gather-daemonset-57rb2" May 25 13:21:49.826457 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:49.826442 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c810c058-1c3b-44d8-987b-a9b836b369bc-proc\") pod \"perf-node-gather-daemonset-57rb2\" (UID: \"c810c058-1c3b-44d8-987b-a9b836b369bc\") " pod="openshift-must-gather-wj4hj/perf-node-gather-daemonset-57rb2" May 25 13:21:49.928023 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:49.927987 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c810c058-1c3b-44d8-987b-a9b836b369bc-podres\") pod \"perf-node-gather-daemonset-57rb2\" (UID: \"c810c058-1c3b-44d8-987b-a9b836b369bc\") " pod="openshift-must-gather-wj4hj/perf-node-gather-daemonset-57rb2" May 25 13:21:49.928232 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:49.928044 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q622c\" (UniqueName: \"kubernetes.io/projected/c810c058-1c3b-44d8-987b-a9b836b369bc-kube-api-access-q622c\") pod \"perf-node-gather-daemonset-57rb2\" (UID: \"c810c058-1c3b-44d8-987b-a9b836b369bc\") " pod="openshift-must-gather-wj4hj/perf-node-gather-daemonset-57rb2" May 25 13:21:49.928232 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:49.928071 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c810c058-1c3b-44d8-987b-a9b836b369bc-proc\") pod \"perf-node-gather-daemonset-57rb2\" (UID: \"c810c058-1c3b-44d8-987b-a9b836b369bc\") " pod="openshift-must-gather-wj4hj/perf-node-gather-daemonset-57rb2" May 25 13:21:49.928232 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:49.928130 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c810c058-1c3b-44d8-987b-a9b836b369bc-lib-modules\") pod \"perf-node-gather-daemonset-57rb2\" (UID: \"c810c058-1c3b-44d8-987b-a9b836b369bc\") " pod="openshift-must-gather-wj4hj/perf-node-gather-daemonset-57rb2" May 25 13:21:49.928232 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:49.928154 2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c810c058-1c3b-44d8-987b-a9b836b369bc-sys\") pod \"perf-node-gather-daemonset-57rb2\" (UID: \"c810c058-1c3b-44d8-987b-a9b836b369bc\") " pod="openshift-must-gather-wj4hj/perf-node-gather-daemonset-57rb2" May 25 13:21:49.928232 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:49.928184 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c810c058-1c3b-44d8-987b-a9b836b369bc-podres\") pod \"perf-node-gather-daemonset-57rb2\" (UID: \"c810c058-1c3b-44d8-987b-a9b836b369bc\") " pod="openshift-must-gather-wj4hj/perf-node-gather-daemonset-57rb2" May 25 13:21:49.928232 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:49.928203 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c810c058-1c3b-44d8-987b-a9b836b369bc-proc\") pod \"perf-node-gather-daemonset-57rb2\" (UID: \"c810c058-1c3b-44d8-987b-a9b836b369bc\") " pod="openshift-must-gather-wj4hj/perf-node-gather-daemonset-57rb2" May 25 13:21:49.928441 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:49.928270 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c810c058-1c3b-44d8-987b-a9b836b369bc-sys\") pod \"perf-node-gather-daemonset-57rb2\" (UID: \"c810c058-1c3b-44d8-987b-a9b836b369bc\") " pod="openshift-must-gather-wj4hj/perf-node-gather-daemonset-57rb2" May 25 13:21:49.928441 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:49.928271 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c810c058-1c3b-44d8-987b-a9b836b369bc-lib-modules\") pod \"perf-node-gather-daemonset-57rb2\" (UID: \"c810c058-1c3b-44d8-987b-a9b836b369bc\") " pod="openshift-must-gather-wj4hj/perf-node-gather-daemonset-57rb2" May 25 13:21:49.936539 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:49.936507 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q622c\" (UniqueName: \"kubernetes.io/projected/c810c058-1c3b-44d8-987b-a9b836b369bc-kube-api-access-q622c\") pod \"perf-node-gather-daemonset-57rb2\" (UID: \"c810c058-1c3b-44d8-987b-a9b836b369bc\") " pod="openshift-must-gather-wj4hj/perf-node-gather-daemonset-57rb2" May 25 13:21:50.081981 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:50.081892 2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wj4hj/perf-node-gather-daemonset-57rb2" May 25 13:21:50.239865 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:50.239839 2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wj4hj/perf-node-gather-daemonset-57rb2"] May 25 13:21:50.242358 ip-10-0-132-116 kubenswrapper[2558]: W0525 13:21:50.242327 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc810c058_1c3b_44d8_987b_a9b836b369bc.slice/crio-fcab861e42159d627db8f480d5320bb3a9e449365338463318f7bb04f30b3849 WatchSource:0}: Error finding container fcab861e42159d627db8f480d5320bb3a9e449365338463318f7bb04f30b3849: Status 404 returned error can't find the container with id fcab861e42159d627db8f480d5320bb3a9e449365338463318f7bb04f30b3849 May 25 13:21:50.498934 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:50.498906 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l6n7f_bd3923cb-c163-4844-b189-de774a7e7407/dns/0.log" May 25 13:21:50.518331 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:50.518293 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l6n7f_bd3923cb-c163-4844-b189-de774a7e7407/kube-rbac-proxy/0.log" May 25 13:21:50.585432 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:50.585394 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wtj9s_5c30b440-4b5e-43ca-a622-bb74465cb79b/dns-node-resolver/0.log" May 25 13:21:51.062632 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:51.062594 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wtscn_88e5c705-ce9b-41eb-8d8e-3092d38d11bc/node-ca/0.log" May 25 13:21:51.185443 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:51.185401 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wj4hj/perf-node-gather-daemonset-57rb2" event={"ID":"c810c058-1c3b-44d8-987b-a9b836b369bc","Type":"ContainerStarted","Data":"a98085001689decf537e9b036b33d3193917ee309d9dd5097480a865b6f7ad58"} May 25 13:21:51.185443 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:51.185447 2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wj4hj/perf-node-gather-daemonset-57rb2" event={"ID":"c810c058-1c3b-44d8-987b-a9b836b369bc","Type":"ContainerStarted","Data":"fcab861e42159d627db8f480d5320bb3a9e449365338463318f7bb04f30b3849"} May 25 13:21:51.185652 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:51.185526 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wj4hj/perf-node-gather-daemonset-57rb2" May 25 13:21:51.209237 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:51.209159 2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-wj4hj/perf-node-gather-daemonset-57rb2" podStartSLOduration=2.209136337 podStartE2EDuration="2.209136337s" podCreationTimestamp="2026-05-25 13:21:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 13:21:51.20624468 +0000 UTC m=+4144.207032930" watchObservedRunningTime="2026-05-25 13:21:51.209136337 +0000 UTC m=+4144.209924588" May 25 13:21:51.704519 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:51.704488 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-574b9ddcd4-5kbh6_658c5966-fad8-4301-bed7-474492cdc44f/router/0.log" May 25 13:21:52.059852 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:52.059756 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jd9hk_49c5d043-eb23-43a4-afb0-0f5ebeba2e8d/serve-healthcheck-canary/0.log" May 25 13:21:52.433204 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:52.433171 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6bldh_21bb0d2f-dfe2-4087-82a3-ed81f8782053/kube-rbac-proxy/0.log" May 25 13:21:52.452134 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:52.452083 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6bldh_21bb0d2f-dfe2-4087-82a3-ed81f8782053/exporter/0.log" May 25 13:21:52.474934 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:52.474891 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6bldh_21bb0d2f-dfe2-4087-82a3-ed81f8782053/extractor/0.log" May 25 13:21:55.105045 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:55.105016 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-ht6tg_a5985f55-1cf2-4e5a-a205-8e630a4042e9/s3-init/0.log" May 25 13:21:55.130900 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:55.130877 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-custom-dsv68_25fd19d1-f35f-4e5c-80ea-f520c879a7ab/s3-tls-init-custom/0.log" May 25 13:21:55.154179 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:55.154145 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-serving-qnxd8_3a641592-2411-4190-b63a-c33b738cccf0/s3-tls-init-serving/0.log" May 25 13:21:57.205805 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:57.205772 2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wj4hj/perf-node-gather-daemonset-57rb2" May 25 13:21:59.086708 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:59.086672 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-wgnbb_3f950645-7082-4d5e-aec5-745bb3385c58/migrator/0.log" May 25 13:21:59.107533 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:21:59.107498 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-wgnbb_3f950645-7082-4d5e-aec5-745bb3385c58/graceful-termination/0.log" May 25 13:22:00.414827 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:22:00.414796 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2sxb4_09c05b78-b511-4815-9c0f-18b3aee86125/kube-multus-additional-cni-plugins/0.log" May 25 13:22:00.436085 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:22:00.436052 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2sxb4_09c05b78-b511-4815-9c0f-18b3aee86125/egress-router-binary-copy/0.log" May 25 13:22:00.456503 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:22:00.456476 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2sxb4_09c05b78-b511-4815-9c0f-18b3aee86125/cni-plugins/0.log" May 25 13:22:00.477038 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:22:00.477015 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2sxb4_09c05b78-b511-4815-9c0f-18b3aee86125/bond-cni-plugin/0.log" May 25 13:22:00.498341 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:22:00.498315 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2sxb4_09c05b78-b511-4815-9c0f-18b3aee86125/routeoverride-cni/0.log" May 25 13:22:00.523912 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:22:00.523879 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2sxb4_09c05b78-b511-4815-9c0f-18b3aee86125/whereabouts-cni-bincopy/0.log" May 25 13:22:00.545773 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:22:00.545743 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2sxb4_09c05b78-b511-4815-9c0f-18b3aee86125/whereabouts-cni/0.log" May 25 13:22:00.944405 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:22:00.944374 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-p9w9p_878b49ea-594a-4d14-8cd8-41f51008349d/kube-multus/0.log" May 25 13:22:01.025319 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:22:01.025285 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-g6zkc_0d07b05a-e936-4270-a36e-f25820e43991/network-metrics-daemon/0.log" May 25 13:22:01.083570 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:22:01.083490 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-g6zkc_0d07b05a-e936-4270-a36e-f25820e43991/kube-rbac-proxy/0.log" May 25 13:22:01.926739 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:22:01.926708 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c7fb8_fea7fe46-bebe-4e32-adbe-2d3a6bbae354/ovn-controller/0.log" May 25 13:22:01.991524 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:22:01.991491 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c7fb8_fea7fe46-bebe-4e32-adbe-2d3a6bbae354/ovn-acl-logging/0.log" May 25 13:22:02.033957 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:22:02.033919 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c7fb8_fea7fe46-bebe-4e32-adbe-2d3a6bbae354/kube-rbac-proxy-node/0.log" May 25 13:22:02.062711 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:22:02.062677 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c7fb8_fea7fe46-bebe-4e32-adbe-2d3a6bbae354/kube-rbac-proxy-ovn-metrics/0.log" May 25 13:22:02.096172 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:22:02.096145 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c7fb8_fea7fe46-bebe-4e32-adbe-2d3a6bbae354/northd/0.log" May 25 13:22:02.134957 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:22:02.134935 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c7fb8_fea7fe46-bebe-4e32-adbe-2d3a6bbae354/nbdb/0.log" May 25 13:22:02.160728 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:22:02.160692 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c7fb8_fea7fe46-bebe-4e32-adbe-2d3a6bbae354/sbdb/0.log" May 25 13:22:02.280267 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:22:02.280170 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c7fb8_fea7fe46-bebe-4e32-adbe-2d3a6bbae354/ovnkube-controller/0.log" May 25 13:22:04.523882 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:22:04.523812 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-26hst_a8c1a67f-b7f8-425e-8836-ec0ff5ffca44/network-check-target-container/0.log" May 25 13:22:05.576721 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:22:05.576695 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-86l52_5f2c06a2-06fe-41e4-9f01-6f43ede519cf/iptables-alerter/0.log" May 25 13:22:06.246964 ip-10-0-132-116 kubenswrapper[2558]: I0525 13:22:06.246897 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-9wdlg_51472327-079d-4a4c-9fe8-78b993615360/tuned/0.log"